Register and share your invite link to earn from video plays and referrals.

Mark
@MRRydon
Cofounder @AethirCloud | Building global GPU infrastructure for AI | Here for AI, GPUs, inference economics, power and the money behind the compute
Joined December 2016
2.3K Following    335.6K Followers
The neocloud boom is the most exciting thing happening in AI infrastructure right now, and it's also where the gap between talking and building is widest Every week I see another team announce they're "becoming a cloud". Some raised for a different idea and found that GPU capacity is the thing customers are actually paying for. Rental rates keep moving up, demand keeps outrunning supply and the capital is there, so it makes sense that people are jumping in What a lot of new entrants learn the hard way is that the business barely lives in the GPUs. You can wire money for hardware in an afternoon. Then you need power that's actually contracted, a site with the right cooling, networking that holds up under real training loads, and a crew that can get all of it live on the exact date you promised your customer That ready for service date is everything. A customer who signed for capacity in March has a model to train, a product to ship and their own investors to answer to. If you slip by two months, you've pushed their whole roadmap back So the providers who win this cycle look a bit boring from the outside. They've brought clusters online before. They know the local electrician by name. They plan for the transformer arriving late and the permit taking longer than it should. They treat a delivery date like a promise to someone else's business That's also what lenders and customers will pay up for. Plenty of buyers want to work with smaller and more flexible providers because the big clouds can't always give them the capacity, the timing or the price they need. That demand is real and it keeps growing. What they need is confidence that the capacity will actually show up The long tail of compute providers is here to stay and it's healthy for the whole market. Over the next couple of years the ones who execute will pull way ahead, and the teams who can bring a cluster online on time, every time, are going to be worth their weight in gold At Aethir we spend a lot of time on exactly this, because getting the compute to show up is the whole job If you're building in this space, go hire the people who've done it before. They're the scarcest resource in AI right now
Show more