We ran Fable 5.2 through 100 unsaturated coding and engineering environments spanning spatial reasoning, planning, games, circuit design, and more. As with all Fable releases, it was an extremely expensive benchmark to run. The biggest winner, however, was OpenAI. Astra, GPT 6.1-Sol, and even GPT 6.1-Terra came up with better solutions to challenging, open-ended technical problems across financial markets, engineering design, and unsaturated coding problems. It's fairly obvious to us why the lion's share of mathematical breakthroughs are coming out of OpenAI. For what it's worth, Anthropic is all-in on training a good coding assistant (which they are succeeding at), not releasing the smartest model. Some things we noticed about Fable 5.2: • It stopped early in our agentic coding runs to ask for human help or clarification "I want you to decide on them before I tune any further" (there is no human to interact with and no reason to expect there would be from the prompt -- we've never seen another model attempt this) • It became confused in our harness (not Claude Code) and spent time trying to understand past tool calls. We have not seen this behavior from other OpenAI or Anthropic models and it hurt its agentic coding scores. • It sometimes used all of its reasoning budget and exceeded its token limit • Several content filter failures (does not affect its score) From our testing, there is no reason to use Fable 5.2 for any purpose, regardless of budget. Use Opus 5.5 for coding, and Astra or Sol for code reviews and challenging, unsaturated problems in engineering, math, and science.

We ran Grok 4.7 through 100 multi-agent coding evaluations. This wasn't the result I expected. When it managed to get a working build, its solutions were often more insightful than comparable frontier models, but it wasted turns and sometimes whole submissions with syntax and runtime errors, and its typical response time was much slower than Grok 4.6. Overall it's a flop.

We evaluated GPT-6-Astra in 100 complex, unsaturated multi-agent coding environments, competing and cooperating with other models in open-ended tasks. It's the new frontier model by a landslide. It's even more dominant than the Fable 5 release, because not only does it wipe the floor with the second best model (Fable 5.1), it was also 80% cheaper and 30% faster in agentic coding. This is a groundbreaking model. The biggest breakthrough since Opus 4.5, maybe even since GPT 4. This is also a testament to how unsaturated our evals are. Some of the open-ended environments we run were introduced almost a year ago and can still compete frontier model submissions against older, deprecated models like Sonnet 4 without signs of saturation. Our newer ones are much more challenging and completely auto-generated. We are clearly living in a post-AGI world. Do something interesting and useful with it.