๐บ Xiaomi Is Livestreaming a Production RL Run โ Burn Rate Included
@XiaomiMiMo is training its MiMo-V2.6 in public โ not a demo, a live post-training dashboard where every step's reward, loss and benchmark movement is watchable in real time. One day in, the meter reads roughly $1.2M spent and 60B tokens consumed. As Zhihu contributor Kittๅจ่ฟๅ puts it: this isn't a training site, it's a money-burning site โ about ยฅ4,000 a minute.
His bigger point: this is rare, valuable data. Almost nobody publishes what frontier-scale RL actually costs.
1๏ธโฃ What the dashboard actually shows
Every training step exposes the internals most labs keep private. His reading guide:
๐น Loss family: training loss, entropy (are answers diversifying or collapsing into one mode), gradient norm, and train/inference KL divergence.
๐น Reward: a mix of test-case scoring and rubric-based reward.
๐น dynsam (dynamic sampling): avg
@n performance over repeated tries, plus pass-rate buckets โ including samples never solved and always solved.
๐น DeepSWE v1.1 as the headline probe (mini-swe-agent, avg
@3): Pro at 63.7, Flash at 60.7 at the time of writing.
2๏ธโฃ The cost ledger, out in the open
From the dashboard he extracts the numbers the industry usually guesses at:
๐น MiMo-V2.6 Pro: roughly $36 per million tokens of training.
๐น MiMo-V2.6 Flash: roughly $8 per million tokens.
๐น His rule of thumb: equivalent inference runs 30-50x cheaper than these training figures.
3๏ธโฃ What's actually being trained
The sample distribution is also public: about 1,500 prompts per step, ~70% of them coding tasks. The remaining third is split across general, visual, cybersecurity and chat tasks โ which makes this, in effect, an agentic-coding-centric RL run with side dishes.
4๏ธโฃ Why it's worth watching
He notes a university lab livestreamed a training run days earlier, but at nowhere near this scale or frontier relevance. For anyone who wants to learn how production RL behaves โ rewards, entropy, dynamic sampling, benchmarks moving step by step โ this is a rare open classroom.
His only complaint, half-joking: a livestream this good deserves a comment section.
๐ Full Reading:
#
Xiaomi# #
MiMo# #
ReinforcementLearning# #
PostTraining# #
LLM# #
OpenScience# #
AI#