註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Yoko
@stuffyokodraws
Cartoonist, Engineer, PM, Partner @a16z investing in infra & AI Prev Product lead @HashiCorp, Founding Eng/PM @Transposit. Eng @AppDynamics. Opinions = own.
加入 April 2020
2.1K 正在關注    15.4K 粉絲
This is incredible. So far it looks like Pi + deepseek v4.1 flash is better than deepseek's own harness??
We’re spending up to 100B tokens across 26,040 agent runs to answer one question: when you switch models, should you switch harnesses too? Our v1.0 FrontierHarness leaderboard ranked harnesses on a single model. V1.1 expands it to 21 harnesses × 5 models × 62 tasks × 4 attempts, 72x the size of v1.0. Results are coming in live. Link below🧵
顯示更多