Karim Mattar(@MattarARK):I've been turning effort dials like they're free upgrades. They're not. Anthropic gets most of the juice early. OpenAI keeps climbing if you pay for max. So the default seat and the burst seat might not be the same model anymore. That changes how you build agents more than another leaderboard screenshot.

2026.09.23 15:00

I've been turning effort dials like they're free upgrades. They're not. Anthropic gets most of the juice early. OpenAI keeps climbing if you pay for max. So the default seat and the burst seat might not be the same model anymore. That changes how you build agents more than another leaderboard screenshot.

显示更多

Frank Downing@downingARK

2026.09.22 19:31

There is something clearly different in how Anthropic & OpenAI scale effort levels. Doesn't show up on every benchmark, but these results on FrontierCode make it really clear. Anthropic models peak at lower effort levels, where as OpenAI models start low and climb up fairly consistently. The result is a better score at a lower cost for Anthropic models, but an unintuitive experience where increasing effort does not increase scores and might actually degrade performance (on this benchmark at least).

显示更多