I suspect there are multiple instances of benchmarks missing the mark due to some esoteric config issue.
We implemented the harness with the Responses API and turned on:
→ Retained reasoning
→ Context compaction
On the public set, GPT-5.6 Sol’s score rose 188% while using 6x fewer output tokens.
Show more
