Sane + 🌶️ takes in an insane AI world... AI capabilities researcher: co-created RLHF/ChatGPT @ @openai now trying to right the wrong 🤭 (ceo @typesafeai)
Wrote about the incredibly important KV cache:
- Why are people spending so much on agents
- How is inference so profitable all of a sudden (+ why it won't last)
- Why routing doesn't work
P.S. they also constrain the design space for coding agents A LOT