註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Morgan
@morganlinton
cto @boldmetrics, evals @vulcanbench / not an expert, endlessly curious
加入 January 2009
1K 正在關注    47K 粉絲
I want to start benchmarking, what I'll call exotic harnesses with @VulcanBench. By this I mean harnesses that people don't often think about, but could be very unique and different. I'm a big fan of Linear, so starting with Linear Agents. As usual, I'll be testing accuracy, token efficiency, and cost with models across all effort levels. The first two models I'll be testing in this harness is Opus 5.5 and GPT 6.1 Sol. More to come, live long and benchmark 🖖
顯示更多