Super interesting.
A number of people commented on my GPT-6.1 Terra benchmark this morning and suggested comparing it to Sonnet.
Soooo, thought I'd whip something up.
Here's a comparison of GPT 6.1 Terra to Claude Sonnet 5.5 across all effort levels.
And the data is pretty clear here, Terra is a lot cheaper than Sonnet, but not quite as accurate until you get to Max.
Traces for all 115 Terra runs, with every tool call:
Leaderboard: