Guanlan Dai(@guanlan):A year ago the question was which model. Now it's which harness. Pi, Exo, Claude Code, Codex, DeepSeek Harness and 4 others. Same model, same tasks, same runtime. 360 runs, 2 billion tokens. Pass rates: 50% to 67%. Cost per pass: $1.05 to $18.34. Introducing FrontierHarness Eval. 🧵

Guanlan Dai

@guanlan

Building @Runta, the execution layer that controls what AI agents can actually do. Prev @Cloudflare and @Kong.

가입 January 2010

478 팔로잉 중 6.2K 팬

Guanlan Dai@guanlan

2026.09.02 15:59

A year ago the question was which model. Now it's which harness. Pi, Exo, Claude Code, Codex, DeepSeek Harness and 4 others. Same model, same tasks, same runtime. 360 runs, 2 billion tokens. Pass rates: 50% to 67%. Cost per pass: $1.05 to $18.34. Introducing FrontierHarness Eval. 🧵