Gavin Baker: "I profoundly believe the future is composable models"
This is him laying out the stack every enterprise ends up running and putting 85% of the queries on a model you trained yourself.
His words:
"You're going to have what Andrej Karpathy called the Council of LLMs. You're going to have Grok, you're going to have Anthropic, you're going to have OpenAI, Google. You're going to have at least two of those."
"But you're also going to have your own open weights model that you RL'd on your data. And you're going to put those two together, the frontier models and your own model, and you are going to get real Pareto dominant outcomes."
"Only the hardest ones are then checked by the frontier models."
"A misconception that a lot of people have is that open source models are somehow bad for AI. They're awesome for the AI infrastructure providers. They just shift economic value from the margins of the frontier labs to the infrastructure."
"Frontier tokens are capturing 90% of the economic value and open source tokens are probably 80% plus of tokens processed, and those ratios may be here to stay."
"So I think this is the future. It's coming."
Bookmark & watch today ↓