Guanlan Dai(@guanlan):A year ago the question was which model. Now it's which harness. Pi, Exo, Claude Code, Codex, DeepSeek Harness and 4 others. Same model, same tasks, same runtime. 360 runs, 2 billion tokens. Pass rates: 50% to 67%. Cost per pass: $1.05 to $18.34. Introducing FrontierHarness Eval. 🧵

Guanlan Dai

@guanlan

Building @Runta, the execution layer that controls what AI agents can actually do. Prev @Cloudflare and @Kong.

参加 January 2010

478 フォロー中 6.2K ファン

Guanlan Dai@guanlan

2026.09.02 15:59

A year ago the question was which model. Now it's which harness. Pi, Exo, Claude Code, Codex, DeepSeek Harness and 4 others. Same model, same tasks, same runtime. 360 runs, 2 billion tokens. Pass rates: 50% to 67%. Cost per pass: $1.05 to $18.34. Introducing FrontierHarness Eval. 🧵