註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Anas Mahmoud
@nas_mahmoud_
Post-training Research @ScaleAILabs | Prev Research @mila_quebec | Research Intern @Meta FAIR | PhD @UofT
加入 June 2022
209 正在關注    326 粉絲
Congrats to @zkjzou on wrapping up a fantastic internship @scale_AI! This work presents a systematic study of which privileged information (PI) makes on-policy self-distillation effective, along with offline metrics for selecting PI before committing compute to post-training. Proud to have supervised this project. Check out the paper and code below.
顯示更多