๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Mark Kretschmann
@mark_k
SI (AI) & tech news from a software engineer's perspective. Coding, Omarchy Linux, open source & e/acc. More building, less doom.
๊ฐ€์ž… September 2007
785 ํŒ”๋กœ์ž‰ ์ค‘    59.5K ํŒฌ
Claude Haiku 5.5 just dropped, and the benchmark jump is HUGE. @AnthropicAI's smallest model beats GPT-6 Luna on every benchmark where both have a reported score in the release chart. ๐Ÿ”ฅ Compared with Haiku 4.5: Computer use: 15.7% โ†’ 72.4% on OSWorld 2.1, versus Luna's 48.9%. Reasoning: 10.2% โ†’ 45.9% on Humanity's Last Exam without tools. With tools, it hits 57.4%. Agentic coding: 0% โ†’ 39.2% on Terminal-Bench 4.0, versus Luna's 16.4%. FrontierCode: 46.4%, beating Luna's 42.4% and approaching Sonnet 5.5's 52.1%. Visual reasoning: 6.4% โ†’ 46.4% on Chartography, versus Luna's 29.1%. Knowledge work: 1620 on GDPval-AA and 1578 on AA-Briefcase, ahead of Luna's 1437 and 1336. Sonnet 5.5 still leads across the chart, especially on Terminal-Bench. But the leap from the previous Haiku is enormous, particularly for computer use and reasoning.
๋” ๋ณด๊ธฐ