๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture ๆŠ•็จฟใฏๅ€‹ไบบใฎๆ„่ฆ‹ใงใ™ใ€‚
๊ฐ€์ž… May 2026
286 ํŒ”๋กœ์ž‰ ์ค‘    468 ํŒฌ
Still defaulting to your top-tier model for every simple task? LangChain just published how they cut costs on their own coding agent without losing quality. Title: How to Build a Model Router in the Harness URL: Facing ballooning monthly costs on its Open SWE coding agent, LangChain built a model router directly into the harness to balance cost and quality. Three highlights stand out. ๐Ÿ“Š Starting from task analysis Analyzing historical traces showed 22% of requests were new features and 17% bug fixes, with wide variation in token consumption. That diversity in task complexity is exactly what makes selective routing worthwhile. ๐ŸŽฏ Three models on the Pareto frontier They picked a fast tier (GLM-5.3-Flash), a balanced tier (GPT-5.6 Sol), and a performance tier (GPT-6 Astra) based on cost-intelligence tradeoffs. Routing happens once at the start of each thread, and that model is used throughout. ๐Ÿ’ฐ 64% cost reduction with no quality loss In an A/B test across 973 threads, merged-PR rate was essentially the same โ€” 29.2% with the router versus 27.3% always-premium (p=0.49) โ€” while median cost per thread dropped from $2.61 to $0.94. A parallel test using only the cheapest model was pulled after just one day, underscoring the value of finding that sweet spot instead of going all-cheap or all-premium. #AIAgents# #CostOptimization#
๋” ๋ณด๊ธฐ