Well it finally happened. A lab gave me credits to use for benchmarking with
@VulcanBench so I don't have to move out of my house and into a paper box in order to afford these benchmarks 😅 📦
Huge thanks to
@cursor_ai, who has now made it possible for me to run a 3 pass benchmark with Grok 4.6, and likely whatever else comes out this week, without breaking the bank 🙏
Proud to bring independent benchmarking to the world, with 100% real engineering tasks, the stuff actual engineering teams would do with a model. No puzzles, no exotic architecture.
And all open source, so every eval, and the benchmarking software itself is all available for you to review, critique, fork, etc.
Live long and benchmark 🖖