Yoko
@stuffyokodraws
Cartoonist, Engineer, PM, Partner @a16z investing in infra & AI
Prev Product lead @HashiCorp, Founding Eng/PM @Transposit. Eng @AppDynamics. Opinions = own.
가입 April 2020
2.1K 팔로잉 중 15.4K 팬
This is incredible. So far it looks like Pi + deepseek v4.1 flash is better than deepseek's own harness??
We’re spending up to 100B tokens across 26,040 agent runs to answer one question: when you switch models, should you switch harnesses too?
Our v1.0 FrontierHarness leaderboard ranked harnesses on a single model.
V1.1 expands it to 21 harnesses × 5 models × 62 tasks × 4 attempts, 72x the size of v1.0.
Results are coming in live. Link below🧵
더 보기
