Haseeb Qureshi ＞|＜
@hosseeb
Managing partner @DragonflyVC.
Let's think step by step.
参加 December 2010
1.2K フォロー中 149.1K ファン
Excellent primer on the economics of token caching, and why fancy token model routers aren't as economical as you'd think.
As workloads lean more agentic (way more tokens in than out vs chat), caching dominates as the most important input into token costs.
もっと見る
Wrote about the incredibly important KV cache:
- Why are people spending so much on agents
- How is inference so profitable all of a sudden (+ why it won't last)
- Why routing doesn't work
P.S. they also constrain the design space for coding agents A LOT
もっと見る
