注册并分享邀请链接,可获得视频播放与邀请奖励。

Morgan
@morganlinton
cto @boldmetrics, evals @vulcanbench / not an expert, endlessly curious
加入 January 2009
1K 正在关注    47K 粉丝
I want to start benchmarking, what I'll call exotic harnesses with @VulcanBench. By this I mean harnesses that people don't often think about, but could be very unique and different. I'm a big fan of Linear, so starting with Linear Agents. As usual, I'll be testing accuracy, token efficiency, and cost with models across all effort levels. The first two models I'll be testing in this harness is Opus 5.5 and GPT 6.1 Sol. More to come, live long and benchmark 🖖
显示更多