Abhay Singhal
@_AbhaySinghal
加入 January 2021
226 正在關注 4.3K 粉絲
Model routing can happen across layers, each with a different set of information. The final choice belongs in the harness because it can:
- Reduce cost while maintaining performance, accounting for the prompt cache
- Shape jobs and choose their models together
- Learn continuously from task outcomes
More on why, plus data and learnings from building @Factory Router
顯示更多
