Anas Mahmoud(@nas_mahmoud_):Congrats to @zkjzou on wrapping up a fantastic internship @scale_AI! This work presents a systematic study of which privileged information (PI) makes on-policy self-distillation effective, along with offline metrics for selecting PI before committing compute to post-training. Proud to have supervised this project. Check out the paper and code below.

Anas Mahmoud

@nas_mahmoud_

Post-training Research @ScaleAILabs | Prev Research @mila_quebec | Research Intern @Meta FAIR | PhD @UofT

参加 June 2022

209 フォロー中 326 ファン

Anas Mahmoud@nas_mahmoud_

2026.10.22 19:02

Congrats to @zkjzou on wrapping up a fantastic internship @scale_AI! This work presents a systematic study of which privileged information (PI) makes on-policy self-distillation effective, along with offline metrics for selecting PI before committing compute to post-training. Proud to have supervised this project. Check out the paper and code below.