注册并分享邀请链接,可获得视频播放与邀请奖励。

Morgan
@morganlinton
cto @boldmetrics, evals @vulcanbench / not an expert, endlessly curious
加入 January 2009
1K 正在关注    47K 粉丝
Okay, this is definitely one of the most interesting benchmark comparisons I have ever done. GPT 5.6, 6.0, and 6.1 Sol, across all effort levels on @VulcanBench Frontier v4. And honestly, I don't think I even need to give any analysis or explanations because the results really do speak for themselves. But one thing I will highlight is that GPT-5.6 Sol and GPT-6.0 Sol all struggled at Low effort, GPT-6.1 is a beast at Low effort. I am now convinced, GPT-6.1 Sol is a very good model, and you can comfortable use it, at Low effort, and see strong, insanely cost-effective results. I don't say this often but I can tell you, after seeing this data, I'd be crazy not to make this one of my daily drivers. Full details from the benchmark now live on the site: Live long and benchmark 🖖
显示更多
0
51
502
33
转发到社区