Baseten’s CEO on why every company will want to own its AI /
@tuhinone on the rise of AI agents, the demand for inference, and building a new kind of hyperscaler.
Lately, I’ve been spending a lot of time thinking about the AI inference market and how big it could get. Agents like Muse, Instinct, Town, and Grok Bot aggressively use browsers, run their own computers, and burn through far more tokens than a traditional chatbot.
As more people put them to work (Muse is number two in the App Store), the demand for inference, or the computing needed to run these models, should grow enormously.
Tuhin and I discuss the rise of agents using browsers and virtual machines to get things done, and
@baseten's recent acquisition to help power that shift.
We also talk about the data center backlash, why companies are embracing Chinese open models, his plans for Baseten’s new research lab, and why he thinks inference becomes the only market left after AGI.
Timestamps:
00:00 What Is AI Inference?
06:05 Competing With the Cloud Giants
09:24 Why Companies Want to Own Their AI
15:30 Building Baseten Before the AI Boom
23:45 DeepSeek and the Race for Open AI Models
29:32 Baseten’s Growth and Expansion
33:05 AI Agents and the Blaxel Acquisition
38:32 Data Centers and the AI Backlash
43:25 What Happens to Inference After AGI?
45:12 When AI Agents Become Customers
Thanks to the show's premier sponsors:
@Atlassian,
@meetgranola, and
@mercury.