Y11
@seclink
找工作、找面试题、改简历、模拟面试。关注：
创业（冷启动） ｜ 认知心理学｜智能体 ｜ 强化学习 ｜ AWS RoboMaker、ROS、Gazebo ｜ 具身智能 ｜ 大模型后训练 （数据标注 ｜ 数据采集 ） ｜ 大模型专家评测
building：
加入 January 2011
748 正在關注 32K 粉絲
又一个 benchmark ， 收录一下 样本和标注。
Today, we’re releasing SpeedrunBench: the first benchmark that measures how fast agents can beat video games.
We asked frontier models not to simply complete video games, but to speedrun them - across 10 titles like Mario Kart and Pokemon.
On simpler games, agents get close to the human world record. However, on more complicated games like Pokemon Blue, the best models Kimi-K3 and Opus 5 are ~4x off the world record.
Benchmark, paper, and demo below.
顯示更多
