TL;DR: No single LLM is optimal for every query and budget. This work unifies the scattered field of LLM routing into "five building blocks" and ships an open-source infrastructure bundling 16+ routers with a dedicated benchmark.
Title: LLMRouter: Unified Infrastructure for Developing, Evaluating, and Deploying LLM Routers
URL:
Key points
๐งฉ Decomposes any router into 5 components: Context Encoder / Model Encoder / Scoring / Decision Rule / Learning Signal
๐ xRouteBench spans 5 tracks (Generic, Memory, Vision, TimeSeries, Personalized), 4,767 queries total
๐ ๏ธ A dense query-model matrix, built by dispatching every query to all 18 candidate models, serves as both training supervision and test bed
๐ Learned routers beat the strongest fixed-model baseline (always pick the largest) by 14.6% relative
โ๏ธ No router dominates: RouterDC leads on accuracy but drops to 10th under tight cost constraints
๐ Multi-turn routing adds cost without consistent gains (Router-R1 at just 22.3%)
๐ค User conditioning helps, but the best design flips between simulated personas and real feedback
A solid step that proves "the best router depends on task and budget" and lays a foundation for fair comparison.
#
LLM# #
ModelRouting#