Ruby on Rails(@rails):Agents on Rails: we added four new models to the benchmark: @SpaceXAI Grok 4.6 (your number 1 request) @ZhipuAI GLM 5.3 (released 3 days ago) @GoogleDeepMind Gemini 3.7 Flash (released 4 days ago) and @AnthropicAI Claude Opus 4.8 …but none of them made it to the top of the leaderboard. As of August 17, 2026: - Most accurate: Still Claude Opus 5. Solved 92% of runs (58 of 63). (With Kimi a close second for a lot less cost.) - Cheapest: GPT-5.6 Luna is still the cheapest from what we can tell. (GLM 5.3 required a subscription, so costs for it are currently unknown.) - Fastest: Luna again, at a median of 3.3 minutes per task. - Best combination of all three: @OpenAI GPT-5.6 Sol. We also updated the insights and shared the full traces of the first two rounds (every command, diff, and verdict) into GitHub for you to explore. Read the latest benchmark report from @evilmartians here:

2026.08.17 20:11

Agents on Rails: we added four new models to the benchmark: @SpaceXAI Grok 4.6 (your number 1 request) @ZhipuAI GLM 5.3 (released 3 days ago) @GoogleDeepMind Gemini 3.7 Flash (released 4 days ago) and @AnthropicAI Claude Opus 4.8 …but none of them made it to the top of the leaderboard. As of August 17, 2026: - Most accurate: Still Claude Opus 5. Solved 92% of runs (58 of 63). (With Kimi a close second for a lot less cost.) - Cheapest: GPT-5.6 Luna is still the cheapest from what we can tell. (GLM 5.3 required a subscription, so costs for it are currently unknown.) - Fastest: Luna again, at a median of 3.3 minutes per task. - Best combination of all three: @OpenAI GPT-5.6 Sol. We also updated the insights and shared the full traces of the first two rounds (every command, diff, and verdict) into GitHub for you to explore. Read the latest benchmark report from @evilmartians here: