Sergio Paniego
@SergioPaniego
Machine Learning Engineer @huggingface 🤗
AI PhD. Technology enables us to be more human. 🏳️🌈
参加 July 2011
1.7K フォロー中 6.7K ファン
from the vault: on-policy distillation in TRL got 40x faster with three fixes, a generation buffer, batched teacher requests, and binary-encoded logprobs
enough to distill from 100B+ teachers, a 4B student gained 39 AIME25 points learning from a 235B one
もっと見る
