注册并分享邀请链接,可获得视频播放与邀请奖励。

Commonstack
@commonstack_ai
One API to access the best AI models in the world. Faster agents, lower costs.
加入 January 2026
23 正在关注    441 粉丝
Great to see TwinRouterBench accepted to the #RLEval# Workshop at #CAIS2026#! Per-step routing is quickly becoming essential infrastructure for agentic systems: each planning, coding, retrieval, and verification call should use the cheapest sufficient model without hurting final task success. Proud to open-source TwinRouterBench and contribute a practical benchmark for this problem.
显示更多
Excited to share that TwinRouterBench has been accepted to the #RLEval# Workshop at #CAIS2026# 🎉 As LLM apps become long-horizon agents, one request can trigger many model calls across planning, tool use, retrieval, coding, and verification. That makes per-step LLM routing a core infrastructure problem: sending each call to the cheapest sufficient model without breaking downstream success. TwinRouterBench introduces: ⚡ Static track: 970 router-visible prefixes from 520 instances across SWE-bench, BFCL, mtRAG, QMSum, and PinchBench 🚀 Dynamic track: live SWE-bench Verified evaluation with official task resolution + realized API spend Key result: a router trained on static labels achieves comparable SWE-bench resolve rate while cutting API cost by ~53% vs. an unrouted Opus 4.6 baseline. Paper: Code: Dataset: Website: #LLM# #AgenticAI# #LLMRouting# #Benchmark# #SWEBench#
显示更多
0
10
33
13
转发到社区