๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Zbigniew Majewski
@majewskizby
๊ฐ€์ž… May 2014
53 ํŒ”๋กœ์ž‰ ์ค‘    508 ํŒฌ
Time-limited agentic benchmark on DGX Spark (44 tasks, 4 agents in parallel, auto-graded): ๐Ÿฅ‡ DeepSeek-V4.1-Flash (low effort, 4 Sparks): 40/44 ๐Ÿฅˆ GLM-5.3 (low effort, 4 Sparks): 37/44 GLM-5.3-Flash (2 Sparks): 33/44 MiniMax-M3.1-Flash (4 Sparks): 26/44 (but best vision) Low effort edged out max for both DS and GLM. Agent tasks are time-bound, so thinking less finishes more - though max wasn't far behind. Caveat: these are practical, moderately hard tasks (TB 2.1 subset: 14 medium, 6 hard). On harder problems without a clock, higher effort may still win.
๋” ๋ณด๊ธฐ