Register and share your invite link to earn from video plays and referrals.

Benjamin Marie
@bnjmn_marie
Independent AI researcher (LLM, NLP). My blog, The Kaitchup - AI on a Budget:
Joined June 2019
224 Following    7.2K Followers
Qwen3.8 Flash Next can nearly solve 50% of Terminal Bench 4.0, with 4 attemps, and probably even more with more attempts. Only 8 points below Astra's pass@1. That's extremely impressive for a model of that size, But it also helps explain why frontier models are already benchmaxxing this benchmark. Terminal Bench 4.0 isn't nearly as hard as it looks, especially when models get multiple attempts. This result requires xhigh reasoning effort. Medium is practically useless here, 4 medium attemps doesn't solve a single task that xhigh can't already solve in one attempt. More results and benchmarks here:
Show more