๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Yuhang Yao
@yuhang_yao
Senior Research Scientist @ZOOM | PhD @CarnegieMellon | Graph Agent Research
๊ฐ€์ž… December 2021
112 ํŒ”๋กœ์ž‰ ์ค‘    1K ํŒฌ
Excited to share that TwinRouterBench has been accepted to the #RLEval# Workshop at #CAIS2026# ๐ŸŽ‰ As LLM apps become long-horizon agents, one request can trigger many model calls across planning, tool use, retrieval, coding, and verification. That makes per-step LLM routing a core infrastructure problem: sending each call to the cheapest sufficient model without breaking downstream success. TwinRouterBench introduces: โšก Static track: 970 router-visible prefixes from 520 instances across SWE-bench, BFCL, mtRAG, QMSum, and PinchBench ๐Ÿš€ Dynamic track: live SWE-bench Verified evaluation with official task resolution + realized API spend Key result: a router trained on static labels achieves comparable SWE-bench resolve rate while cutting API cost by ~53% vs. an unrouted Opus 4.6 baseline. Paper: Code: Dataset: Website: #LLM# #AgenticAI# #LLMRouting# #Benchmark# #SWEBench#
๋” ๋ณด๊ธฐ