註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Benjamin Marie
@bnjmn_marie
Independent AI researcher (LLM, NLP). My blog, The Kaitchup - AI on a Budget:
加入 June 2019
224 正在關注    7.2K 粉絲
Qwen3.8 Flash Next can nearly solve 50% of Terminal Bench 4.0, with 4 attemps, and probably even more with more attempts. Only 8 points below Astra's pass@1. That's extremely impressive for a model of that size, But it also helps explain why frontier models are already benchmaxxing this benchmark. Terminal Bench 4.0 isn't nearly as hard as it looks, especially when models get multiple attempts. This result requires xhigh reasoning effort. Medium is practically useless here, 4 medium attemps doesn't solve a single task that xhigh can't already solve in one attempt. More results and benchmarks here:
顯示更多