Tianjun Zhang
@tianjun_zhang
@peano_ai | Prev @meta @GoogleDeepMind @berkeley_ai | Project Lead of LiveCodeBench, RAFT and Gorilla LLM
1.2K Following 1.7K Followers
We scale up RL on TPUs for the MiMo families 🚀
It is quite a journey for us to bring RL to scale with Jax + TPU: the most amazing part for me is that scaling it up is mostly a config change, not a code rewrite. This is the dream for any researcher 🫣
Read our blog for more details. Thanks to @XiaomiMiMo, @berkeley_ai, and @googlecloud for making it happen! We'll share more details soon!
Show more
