Of the 4 new models benchmarked,
@spacexai Grok 4.6 was the better performer, ranking 4th in accuracy at 84% (compared to the current best: Claude Opus 5 at 92%), while costing 60% less than Opus to achieve those results. Grok 4.6 also had 33.3% recall, making it third best on the leaderboard for knowing (and using) Rails APIs.
@AnthropicAI Opus 4.8 ranked second for speed at 3 minutes 36 seconds, just 7 seconds behind the fastest (Luna).
@GoogleDeepMind Gemini Flash 3.7 performed mid to low on all fronts, but is one of the cheaper options.