The biggest generational jump since June came from a model that costs $0.18 per million output tokens.
DeepSeek-V4-Flash-0731 (
@Deepseek_AI) scored 26.8 points higher on Toolathlon than the release it replaced. GLM-5.3 gained 24.8 on the same board. Claude Opus 5.5 added 20.7 on SWE-bench Pro, and Claude Sonnet 5.5 added 18.1 there six days later.
Scores via week of Sep 28.