Cameron R. Wolfe, Ph.D.
@cwolferesearch
Research @Netflix • Writer @ Deep (Learning) Focus • PhD @optimalab1
가입 August 2021
844 팔로잉 중 42.5K 팬
Really awesome MOPD reading list. Here is also another well-written blog that synthesizes important work in this space (mostly from OSS model reports) for those who are interested:
더 보기
A new post-training paradigm is emerging in 2026: Multi-Teacher On-Policy Distillation (MOPD), which lets a single model absorb capabilities from multiple specialized RL teachers.
It’s already being used in frontier-scale models like MiMo-V2-Flash, Kimi K3, and DeepSeek-V4, making MOPD an increasingly important technique for combining specialized capabilities into one model.
We have compiled a list of popular papers tracing the development of MOPD from its earliest forms to its latest iterations.
Check it out now:
더 보기
