๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture ๆŠ•็จฟใฏๅ€‹ไบบใฎๆ„่ฆ‹ใงใ™ใ€‚
๊ฐ€์ž… May 2026
286 ํŒ”๋กœ์ž‰ ์ค‘    470 ํŒฌ
TL;DR: Agents fail not from a lack of model smarts but from a weak execution harness. "Harness scaling" โ€” hardening the runtime without touching weights โ€” reaches 95.3% on Terminal-Bench 2.1 for ~$15. Title: StateM: Reaching 95.3% Raw Accuracy, or a $15 Frontier Run, on Terminal-Bench 2.1 via Harness Scaling URL: Key points ๐Ÿง  Scale the harness, not the model โ€” learn from failures with no retraining ๐Ÿ“Œ Durable states retain discoveries across episodes ๐ŸŽฏ Phase-local context surfaces only relevant info at decision points โœ… Checked transitions verify preconditions to stop cascading failures ๐Ÿ“– Recoverable runbooks turn failures into queryable knowledge ๐Ÿ•’ Versioned practices let agents update and roll back strategies ๐Ÿ’ฐ GPT-5.6 hits 95.3% (445 trials, all 89 tasks), compressing a $574.68 run to ~$15 It turns every failure into an executable precondition, lifting reliability from the operational layer. #AIAgents# #TerminalBench#
๋” ๋ณด๊ธฐ