Running SWE-* evals across a bunch of models, its beyond obvious when models are trained on RL envs where answers are hiding in git. We find most of MiMo's envs have this issue.
Deepseek models, for example, often go to extraordinary lengths to steal solutions versus solving the problem.
もっと見る
