Håvard Ihle(@htihle):Claude Fable 5.2 (xhigh) scores 43.0% on WeirdML v3, taking the lead ahead of GPT 6 Astra. Astra is ahead on token efficiency, but Fable gets a significantly higher final score. The only task that Fable makes no significant progress on is Mystery Box without any hints.

2026.11.12 13:55

Claude Fable 5.2 (xhigh) scores 43.0% on WeirdML v3, taking the lead ahead of GPT 6 Astra. Astra is ahead on token efficiency, but Fable gets a significantly higher final score. The only task that Fable makes no significant progress on is Mystery Box without any hints.

Håvard Ihle@htihle

2026.09.18 10:20

Introducing WeirdML v3, a fully agentic benchmark featuring 11 complex hand-made tasks. Models must explore and understand unfamiliar data, develop ML and data analysis pipelines and produce results despite limited data, unspecified goals and/or very limited feedback. 1/8