Ashwinee Panda
@PandaAshwinee
Joined February 2020
654 Following 3.9K Followers
We can now RL large MoEs with 0 train-infer mismatch! And doing so can improve performance (pictured task: teach Qwen3.6-35B-A3B to play Wordle). Everything is open-source and we did a bunch of ablations. 🧵
Show more
