i want someone to do an ablation of reasoning in every language... surely there's a language out there that is objectively the most token-efficient to reason in, and i'm willing to bet it's not english/mandarin
顯示更多
Reasoning models think in English, even on German prompts. We asked what it costs to make one think in German. Answer: a valley. Small doses of German reasoning data hurt, large doses mostly recover.
顯示更多