Register and share your invite link to earn from video plays and referrals.

Zhihu Frontier
@ZhihuFrontier
๐Ÿš€Bringing China's AI & tech trends, voices and perspectives to the global stage. โšก๏ธPowered by ็ŸฅไนŽ/ China's leading knowledge community.
Joined June 2025
192 Following    12.3K Followers
๐Ÿ“บ Xiaomi Is Livestreaming a Production RL Run โ€” Burn Rate Included @XiaomiMiMo is training its MiMo-V2.6 in public โ€” not a demo, a live post-training dashboard where every step's reward, loss and benchmark movement is watchable in real time. One day in, the meter reads roughly $1.2M spent and 60B tokens consumed. As Zhihu contributor Kittๅœจ่ฟ›ๅŒ– puts it: this isn't a training site, it's a money-burning site โ€” about ยฅ4,000 a minute. His bigger point: this is rare, valuable data. Almost nobody publishes what frontier-scale RL actually costs. 1๏ธโƒฃ What the dashboard actually shows Every training step exposes the internals most labs keep private. His reading guide: ๐Ÿ”น Loss family: training loss, entropy (are answers diversifying or collapsing into one mode), gradient norm, and train/inference KL divergence. ๐Ÿ”น Reward: a mix of test-case scoring and rubric-based reward. ๐Ÿ”น dynsam (dynamic sampling): avg@n performance over repeated tries, plus pass-rate buckets โ€” including samples never solved and always solved. ๐Ÿ”น DeepSWE v1.1 as the headline probe (mini-swe-agent, avg@3): Pro at 63.7, Flash at 60.7 at the time of writing. 2๏ธโƒฃ The cost ledger, out in the open From the dashboard he extracts the numbers the industry usually guesses at: ๐Ÿ”น MiMo-V2.6 Pro: roughly $36 per million tokens of training. ๐Ÿ”น MiMo-V2.6 Flash: roughly $8 per million tokens. ๐Ÿ”น His rule of thumb: equivalent inference runs 30-50x cheaper than these training figures. 3๏ธโƒฃ What's actually being trained The sample distribution is also public: about 1,500 prompts per step, ~70% of them coding tasks. The remaining third is split across general, visual, cybersecurity and chat tasks โ€” which makes this, in effect, an agentic-coding-centric RL run with side dishes. 4๏ธโƒฃ Why it's worth watching He notes a university lab livestreamed a training run days earlier, but at nowhere near this scale or frontier relevance. For anyone who wants to learn how production RL behaves โ€” rewards, entropy, dynamic sampling, benchmarks moving step by step โ€” this is a rare open classroom. His only complaint, half-joking: a livestream this good deserves a comment section. ๐Ÿ”— Full Reading: #Xiaomi# #MiMo# #ReinforcementLearning# #PostTraining# #LLM# #OpenScience# #AI#
Show more