註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Y11
@seclink
找工作、找面试题、改简历、模拟面试。关注: 创业(冷启动) | 认知心理学|智能体 | 强化学习 | AWS RoboMaker、ROS、Gazebo | 具身智能 | 大模型后训练 (数据标注 | 数据采集 ) | 大模型专家评测 building:
加入 January 2011
779 正在關注    32K 粉絲
这篇文章说了啥观点,用了啥数据集合?
Turns out DeepSeek harness improves the score of DeepSeek V4.1 Flash by 2-3 points on average. It also costs 80% more due to subagents and more output tokens. New results: DeepSeek V4.1 Flash 1017 + Claude Code harness: - max, mean of 7: 39.1 - high, mean of 5: 36.4 - low, mean of 5: 34.4 DeepSeek V4.1 Flash 1017 + DeepSeek harness: - max, mean of 7: 42.7 - high, mean of 5: 39.2 - low, mean of 5: 34.8 For comparison: GPT-6 Astra, max: 45 Opus 5.5, max: 41.7 Muse Wonder Full 1.0, max: 42 It's a crazy model, and the only one catched cheating. All the results are available on the benchmark website.
顯示更多