註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Thomas Wolf
@Thom_Wolf
co-founder @HuggingFace - moonshots
加入 February 2011
7.9K 正在關注    133.4K 粉絲
Impressive level of openness on such a large run
Nearly half a year of silence. We spent it studying one problem: how far RL can scale. MiMo-V2.6 is in the middle of its RL run right now. Three things we scaled: compute (~2B tokens per step, 1568 prompts × 16 rollouts, fully async), environments and harnesses (multi-task agentic RL, mixed across multiple harnesses in one run), and grader compute (agentic in-group credit assignment, with test-case and rubric-based rewards). We'll open-source the details piece by piece over the coming weeks. Streaming the run:
顯示更多