가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Arena.ai
@arena
Where AI meets the real world. We measure and advance the frontier of AI through community-driven evaluation. We’re hiring →
가입 March 2023
224 팔로잉 중    239.9K 팬
Big news: DeepSeek-V4.1-Flash-20261017 (Max) by @deepseek_ai is now the #1# open model in Agent Arena! It just landed at #11# overall with +5.1% net improvement across +7.5K real-world sessions. This performance also reshapes the Agent Arena Pareto frontier! All models above V4.1-Flash 20261017 in performance are proprietary at much higher cost. At $0.20 median cost per task, that’s ~37% of GPT-6.1 Sol’s improvement for about 27% of the cost. By signal, this release achieves: - #8# in Confirmed Success with +11.5% (#1# open) - #11# in Praise vs. Complaint with +5.9% (#1# open) - #12# in Bash Reliability with +5.4% (#1# open) - #13# in Steerability with +2.5% (#1# open) - No issues with Tool Hallucination Find more info on signals at the link in thread on Agent Arena. Congrats to the @deepseek_ai team on this release!
더 보기