註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Paweł Huryn
@PawelHuryn
AI PM | Deep research. I build, test, then teach. 141K+ subscribe →
加入 November 2021
447 正在關注    135.5K 粉絲
Turns out DeepSeek harness improves the score of DeepSeek V4.1 Flash by 2-3 points on average. It also costs 80% more due to subagents and more output tokens. New results: DeepSeek V4.1 Flash 1017 + Claude Code harness: - max, mean of 7: 39.1 - high, mean of 5: 36.4 - low, mean of 5: 34.4 DeepSeek V4.1 Flash 1017 + DeepSeek harness: - max, mean of 7: 42.7 - high, mean of 5: 39.2 - low, mean of 5: 34.8 For comparison: GPT-6 Astra, max: 45 Opus 5.5, max: 41.7 Muse Wonder Full 1.0, max: 42 It's a crazy model, and the only one catched cheating. All the results are available on the benchmark website.
顯示更多
0
182
1.3K
82
轉發到社區