Haseeb Qureshi ＞|＜
@hosseeb
Managing partner @DragonflyVC.
Let's think step by step.
가입 December 2010
1.2K 팔로잉 중 149.1K 팬
Excellent primer on the economics of token caching, and why fancy token model routers aren't as economical as you'd think.
As workloads lean more agentic (way more tokens in than out vs chat), caching dominates as the most important input into token costs.
더 보기
Wrote about the incredibly important KV cache:
- Why are people spending so much on agents
- How is inference so profitable all of a sudden (+ why it won't last)
- Why routing doesn't work
P.S. they also constrain the design space for coding agents A LOT
더 보기
