Haseeb Qureshi ＞|＜
@hosseeb
Managing partner @DragonflyVC.
Let's think step by step.
加入 December 2010
1.2K 正在关注 149.1K 粉丝
Excellent primer on the economics of token caching, and why fancy token model routers aren't as economical as you'd think.
As workloads lean more agentic (way more tokens in than out vs chat), caching dominates as the most important input into token costs.
显示更多
Wrote about the incredibly important KV cache:
- Why are people spending so much on agents
- How is inference so profitable all of a sudden (+ why it won't last)
- Why routing doesn't work
P.S. they also constrain the design space for coding agents A LOT
显示更多
