The Teacher Is a Direction, Not a Destination
New on-policy distillation method that extrapolates RL-induced representation residuals, letting students match or exceed the teacher across four model pairs. Code and checkpoints planned for release.
显示更多