註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Ryan Marten
@ryan_marten
加入 June 2022
2.3K 正在關注    3.4K 粉絲
Congrats to for the strong performance on Terminal-Bench 3.0! One of the biggest pieces of feedback we have gotten for TB3 is to increase the timeouts. We calibrated timeouts against frontier models during development, but inference speed can still be a confounder on some of the tasks. Terminal-Bench numbers on the GLM-5.3 model card are reported with increased timeouts (likely for this reason). Look out for Terminal-Bench 4.0 releasing soon with increased timeouts, other task improvements, and a handful of new tasks.
顯示更多