๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Tianjun Zhang
@tianjun_zhang
@peano_ai | Prev @meta @GoogleDeepMind @berkeley_ai | Project Lead of LiveCodeBench, RAFT and Gorilla LLM
๊ฐ€์ž… March 2017
1.2K ํŒ”๋กœ์ž‰ ์ค‘    1.7K ํŒฌ
We scale up RL on TPUs for the MiMo families ๐Ÿš€ It is quite a journey for us to bring RL to scale with Jax + TPU: the most amazing part for me is that scaling it up is mostly a config change, not a code rewrite. This is the dream for any researcher ๐Ÿซฃ Read our blog for more details. Thanks to @XiaomiMiMo, @berkeley_ai, and @googlecloud for making it happen! We'll share more details soon!
๋” ๋ณด๊ธฐ