Look at these results on
@VulcanBench by
@morganlinton on GPT-6.1 Sol are various effort levels. It's the only consistent benchmark doing the unglamorous work to give us this level of detailed insight that I'm aware of.
6.1 Sol at Low looks incredible, and if you combine it with multi-model code reviews for example (which compound engineering does), you can really get great results while pinching pennies here. I'm gonna try it on fast mode too.