Register and share your invite link to earn from video plays and referrals.

Arena.ai
@arena
Where AI meets the real world. We measure and advance the frontier of AI through community-driven evaluation. We’re hiring →
Joined March 2023
224 Following    239.9K Followers
Big news: DeepSeek-V4.1-Flash-20261017 (Max) by @deepseek_ai is now the #1# open model in Agent Arena! It just landed at #11# overall with +5.1% net improvement across +7.5K real-world sessions. This performance also reshapes the Agent Arena Pareto frontier! All models above V4.1-Flash 20261017 in performance are proprietary at much higher cost. At $0.20 median cost per task, that’s ~37% of GPT-6.1 Sol’s improvement for about 27% of the cost. By signal, this release achieves: - #8# in Confirmed Success with +11.5% (#1# open) - #11# in Praise vs. Complaint with +5.9% (#1# open) - #12# in Bash Reliability with +5.4% (#1# open) - #13# in Steerability with +2.5% (#1# open) - No issues with Tool Hallucination Find more info on signals at the link in thread on Agent Arena. Congrats to the @deepseek_ai team on this release!
Show more