Abhay Singhal
@_AbhaySinghal
Joined January 2021
226 Following 4.3K Followers
Model routing can happen across layers, each with a different set of information. The final choice belongs in the harness because it can:
- Reduce cost while maintaining performance, accounting for the prompt cache
- Shape jobs and choose their models together
- Learn continuously from task outcomes
More on why, plus data and learnings from building @Factory Router
Show more
