For their Mistral Large 4 release,
@MistralAI ran a blind Surge human eval, with our expert software engineers evaluating five frontier models on coding quality.
Le Chonk ranked #
1# among open-weight models and #
2# overall, behind only Opus 5.
Unit tests ask: does it work?
Human code review asks: would you merge it?
Our evals measures the difference. Working code is the floor; professional taste and judgment are what make it shippable.
Congrats to the Mistral team on le Chonk and their big release ๐ซ๐ท