註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Igor Babuschkin
@ibab
CEO & Co-Founder @river_ai_inc. Previously @xAI, Research & Engineering
加入 February 2020
893 正在關注    111.2K 粉絲
The River API was tested in this blog post and outperformed Tinker on reinforcement learning runs with identical training code. We spent a lot of effort to get details like routing replay right so you get the best possible results with the API.
顯示更多
We can now RL large MoEs with 0 train-infer mismatch! And doing so can improve performance (pictured task: teach Qwen3.6-35B-A3B to play Wordle). Everything is open-source and we did a bunch of ablations. 🧵
顯示更多
0
6
182
14
轉發到社區