Matt White
@matthew_d_white
Open Intelligence | Ex-Global CTO of AI, Linux Foundation | Ex-Exec Dir/CTO, PyTorch Foundation | UC Berkeley | Columbia University | Researcher & Educator
가입 March 2014
1.2K 팔로잉 중 2.3K 팬
We absolutely need more labs to provide this level of transparency into all stages of training.
All American and Chinese labs should follow suit.
Well done @_LuoFuli and the Shaomi team.
Nearly half a year of silence. We spent it studying one problem: how far RL can scale.
MiMo-V2.6 is in the middle of its RL run right now. Three things we scaled: compute (~2B tokens per step, 1568 prompts × 16 rollouts, fully async), environments and harnesses (multi-task agentic RL, mixed across multiple harnesses in one run), and grader compute (agentic in-group credit assignment, with test-case and rubric-based rewards). We'll open-source the details piece by piece over the coming weeks.
Streaming the run:
더 보기
