We scale up RL on TPUs for the MiMo families 🚀
It is quite a journey for us to bring RL to scale with Jax + TPU: the most amazing part for me is that scaling it up is mostly a config change, not a code rewrite. This is the dream for any researcher 🫣
Read our blog for more details. Thanks to
@XiaomiMiMo,
@berkeley_ai, and
@googlecloud for making it happen! We'll share more details soon!