註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Jennifer Zhou
@chem_safety
rl data @preferencemodel | prev pretraining data @AnthropicAI
加入 December 2023
427 正在關注    2.1K 粉絲
We looked at TerminalBench 4.0 and found a lot of issues. After fixing the issues Sonnet 5.5 scores 89.2%. So, TerminalBench is already mostly saturated. Along the way we found a lot of crazy stuff, including reward hacks in the published transcripts.
顯示更多
0
78
1.6K
119
轉發到社區