Hoping someone can explain to me what's going on here.
The report says they trained multiple mixRL teachers, then used MOPD to combine those teachers into a student model.
But..the team literally live-streamed their RL run, and then released model + report just one day after it finished.
How does this timeline work out? I would assume the streamed RL run is just a final climb after MOPD, but the paper doesn't mention anything about a final climb.
Maybe the livestreamed run is only for one of their mixRL teachers, and they did MOPD quickly in the 24 hours before launch?
显示更多
