Register and share your invite link to earn from video plays and referrals.

Dwarkesh Patel
@dwarkesh_sp
1.1K Following    249.6K Followers
Cmon, this is unfair. Dylan's had a job before #sexworkiswork#
Neither Dylan Patel nor Dwarkesh has ever held a job. And yet they confidently predict the entire economy over an entire tech cycle.
0
89
4.2K
49
Forward to community
If the leading AI lab can't train models that are smarter for a given level of compute, then it gets commoditized the way Ziplock bag producers are commoditized. My point is that if there are such intelligence-efficiency differences, compute getting more expensive allows the leading model company to charge higher margins. If one person could make a Ziploc bag that was 2x better than the next guy's Ziplog bag at preserving leftovers, they could, in fact, capture a large part of that surplus.
Show more
"A Ziploc bag saves $4 of leftovers that I would have thrown out. Ziplog bags will sell for $4."
I agree that if you think "capabilities growth will be slower, spikier, and more data-limited than people currently assume", then you should be bearish on LLM companies. But the crux is just you think timelines are long, not necessarily something structural about the business. Progress currently is so fast that many people are willing to pay many times more for models that are 3 months ahead (because 3 months of AI progress counts for a lot). Obviously, capabilities have to plateau at some point, for example when we hit the physical limits of intelligence. But we are so far from even human level intelligence, much less superhuman intelligence, that I don't expect the plateau anytime soon. (There's this misconception where people say that we have already achieved AGI. This makes no sense. The definition of AGI is an AI that can do anything any human can do. Even if you circumscribed this to anything a human can do on a computer, notice that there are billions of people employed in knowledge work jobs who have not yet been automated.) --- I disagree with the implication of the seperate diffusion argument: "even if we froze current capability levels at today's levels, it would take well over two decades to fully integrate in LLMs into our lives." Sure, but that's because we don't have human level intelligence. It will be far easier to integrate AGI labor into companies than human labor. And companies hire human workers all the time! And if they don't, humans start new businesses. That's one of the main ways in which AGI is different from other technologies - AGI diffuses itself, the way, say, a highly skilled immigrant diffuses himself. @steve47285 put it well: "how do highly-skilled, experienced, and entrepreneurial immigrant humans manage to integrate into the economy immediately? Once you’ve answered that question, note that AGI will be able to do those things too." I wrote more about this diffusion question a previous essay that I'm going to copy paste below: "If these models were actually like humans on a server, they’d diffuse incredibly quickly. In fact, they’d be so much easier to integrate and onboard than a normal human employee (they could read your entire Slack and Drive in minutes and immediately distill all the skills your other AI employees have). Plus, hiring is very much like a lemons market, where it’s hard to tell who the good people are, and hiring someone bad is quite costly. This is a dynamic you wouldn’t have to worry about when you just wanna spin up another instance of a vetted AGI model. For these reasons, I expect it’s going to be much much easier to diffuse AI labor into firms than it is to hire a person. And companies hire lots of people all the time."
Show more
I'm actually fairly bearish on frontier lab valuations. I've never seen the reasons articulated to my satisfaction, so before I go to sleep, I wanted to quickly jot down my thinking here. The basic issue is that the labs are highly unprofitable. This may seem like a simple point, but private market valuations can be relatively irrational; however, like with $SPCX, post-IPO pricing will likely be much more punishing, especially as the standard 6-month lockup period expires and selling pressure intensifies. Many people claim that the labs have high margins. Yet even with high margins, a valuation of $1T would be justified only if the labs were doing nothing aside from serving inference (thus reducing costs only to those relevant to inference) and posting annual revenue numbers in the $100-200 billion range assuming ~80% gross margin and a 20x earnings multiple. This assumption is obviously not true, because the frontier labs have to continually spend money training the next generation of models. This is because of market competition from runner-up firms. For example, if OpenAI had paused model development last year, there would no longer be any point in paying GPT-5 API prices when you can just use Qwen or Kimi instead for much cheaper. Thus, the labs are forced to invest ever-increasing amounts of money in model training, in a way such that at any given point of time, the amount you're forced to invest in the next model is dramatically higher than the amount of money you're actually making, because even if your revenue goes up with higher model capabilities, so do your future training costs. This is a profoundly punishing dynamic which severely penalizes frontrunners. (There is also a related subpoint where frontier labs claim they can distill their leading models to win out at lower intelligence levels as well. This makes no sense because the revenue numbers involved are far too low when taking into consideration the rather low margin of such inference.) Frontier lab valuations appear largely to be based on the assumption that as you scale up, the capabilities which emerge will be sufficiently general and profound that we'll see explosive growth ( from things akin to AI agents starting and autonomously managing entire companies of subagents. But it's not clear to me that this is the case; indeed, as I mentioned in my previous post ( I believe that capabilities growth will be slower, spikier, and more data-limited than people currently assume. It may be the case that eventually we will see explosive growth of this nature with full automation of the economy, but at the very least my viewpoint implies much longer (multi-decade) timelines until we reach this point. It is not clear to me that the frontier labs will be able to operate unprofitably for so long, although I suppose maybe this foreshadows some sort of inevitable nationalization. I also want to make a broader point about technological diffusion. The reason why technological diffusion is slow isn't just because, e.g., old people take a long time to learn how to use technology (although this is of course a contributing factor to some degree). In my view, it's because when a new, revolutionary technology comes along, the ways to incorporate that technology into subsequent developments are not always obvious, and in fact they cannot necessarily be arrived at through the application of pure reason. If they could be, then perhaps frontier models, at a certain point, would have a perfect understanding of how the LLM application layer should be developed, and they would then autonomously code, deploy, and sell such a layer. But it seems more plausible to me that this diffusion is limited moreso by the hard problem of economic calculation--that is to say, the Hayekian notion through which the price system gradually promotes efficient allocation of resources and which cannot be simulated through central planning--and that even if we froze current capability levels at today's levels, it would take well over two decades to fully integrate in LLMs into our lives. Such a view is consequently rather bearish for the continued profitability of labs as it reduces their prospects for finding, say, something else comparable in profitability to coding agents, which seems to have been a somewhat lucky discovery by Anthropic to begin with. That is to say, even if you spam FDEs you aren't necessarily going to be able to just figure out the "correct" product shapes fast enough. Overall, I don't think that people have clearly reasoned through their mental models for why lab equity should be worth as much as it currently is, and that if you actually bother to write down such a model, you may not arrive at the conclusion that you want to arrive at. This isn't to say that I don't expect AI to experience a huge (industry-wide) boom in the coming decades, but just that I'm not entirely sure I would buy OpenAI or Anthropic stock at latest valuations if I were given the opportunity to do so. Of course, as an ex-lab employee, arguably this is talking against my own book; I should really be giving people more reasons to be bullish. But in the end, my influence is so small that it doesn't make a difference, so why not have some fun?
Show more
0
94
1.2K
90
Forward to community
“The really interesting implication is that the frontier labs end up competing on who can afford the most compute. The labs making the most revenue can bid up GPU prices, making it even harder for everyone else to catch up. Basically it’s a super steep power law with only top labs surviving and the rest fighting to create small cheap models with no pricing power. “
Show more
I agree with Dwarkesh even if it’s a contrarian take. The standard way of thinking is that AI gets cheaper every year. Better chips, better algorithms, more competition. Intelligence becomes abundant, so the price of compute should keep falling (aka intelligence too cheap to meter) His argument is almost the opposite, at least for the next few years. If frontier models become dramatically more economically useful faster than we can manufacture GPUs, then the value of each GPU rises faster than supply. Compute stops being priced by its cost to produce and starts being priced by what it can earn. How much would you pay to to hire geniuses in a data center? Or if one GPU can generate the output of a great software engineer, why would anyone rent it for today’s prices? The really interesting implication is that the frontier labs end up competing on who can afford the most compute. The labs making the most revenue can bid up GPU prices, making it even harder for everyone else to catch up. Basically it’s a super steep power law with only top labs surviving and the rest fighting to create small cheap models with no pricing power. Long term I still expect compute to get cheap. But during this transition, intelligence could become cheaper while the hardware that produces it becomes dramatically more expensive. That’s a pretty counterintuitive idea but a good idea imo.
Show more
.@steve47285 has a great section on how to think about 'lump of labor fallacy' with AGIs in his post, "Four ways learning Econ makes people dumber re: future AI"
In all seriousness, can someone explain to me why "lump of labor fallacy" is different from "supply and demand"?
By the way, the fact that Ant revenue has been 10x-ing year over year, while compute has only been 3x-ing, suggests that there are very strong economies of scale in the model business. Logically this makes sense - when you train a model, you pay this one time cost of learning all these different skills that you can then amortize across all your users. (Unlike with human labor, where each instance has to be retrained from scratch). I wish we didn't live in a world with such strong economies of scale of intelligence (because I'm worried about power concentration). But it seems we do.
Show more
"Lab compute 3x-es year over year. For a lab to 10x revenue while continuing to only 3x compute, some combination of the following 3 things has to happen: 1. Lab margins have to increase, 2. The price of compute has to increase, 3. Labs have to spend a greater fraction of their compute on inference. My understanding is that basically all 3 of these things have been happening..." "Consider the price at which Google and Anthropic are renting compute from SpaceX. Google is reportedly paying $900 million a month for 110K GPUs [at] ... roughly 2x the spot price per hour for those GPUs. And the current spot price is itself 40% higher than it was in February."
Show more
0
56
1.3K
58
Forward to community
I think this is the most interesting prediction about what will happen in this world of 10x compute prices: If you can train the best, most efficient model, then you’ll be able to charge MUCH higher margins than you can today.
Show more
New blog post on what would be true about the world if trendline continues and leading lab hits $1T in revenue by the end of next year. In other words, why compute might get 10x+ more expensive in coming years
Show more
A series of fairly wild thoughts from Dwarkesh. I thought I was bullish but even I am not assuming that the price to rent compute continues to go up! I will say that I am in SV this week and Dwarkesh is capturing the zeitgeist. Net, net public markets would probably be trading differently if they saw the OpenAI, Anthropic, Grok/Cursor and Open Source numbers over the last 6 weeks. And really good for anyone who has installed compute coming off contract and/or is bringing on compute that is not already contracted. And credit slowing down capacity adds - if it happens - only exacerbates all of this.
Show more
0
109
2.8K
238
Forward to community
"Lab compute 3x-es year over year. For a lab to 10x revenue while continuing to only 3x compute, some combination of the following 3 things has to happen: 1. Lab margins have to increase, 2. The price of compute has to increase, 3. Labs have to spend a greater fraction of their compute on inference. My understanding is that basically all 3 of these things have been happening..." "Consider the price at which Google and Anthropic are renting compute from SpaceX. Google is reportedly paying $900 million a month for 110K GPUs [at] ... roughly 2x the spot price per hour for those GPUs. And the current spot price is itself 40% higher than it was in February."
Show more
New blog post on what would be true about the world if trendline continues and leading lab hits $1T in revenue by the end of next year. In other words, why compute might get 10x+ more expensive in coming years
Show more
0
84
1.6K
130
Forward to community
I discuss this in the next paragraph. If you applied this argument to people instead of AIs, it would be the classic lump of labor fallacy.
@dwarkesh_sp "at current market rates" current software engineer tasks/rates wont be worth $250k a year in a couple of years
New blog post on what would be true about the world if trendline continues and leading lab hits $1T in revenue by the end of next year. In other words, why compute might get 10x+ more expensive in coming years
Show more
0
152
2.1K
187
Forward to community
I highly recommend this video if you never formally studied general relativity. All of the informal explanations I've heard growing up (e.g. balls bending space) ended up being misleading in ways that gave me a wrong impression of how general relativity works. The first 30 minutes completely changed my understanding.
Show more
Einstein's general relativity is the closest thing we have to a perfect theory. You start by asking why your flight path seems to bend toward the north pole — and before long you've reconceptualized nature's most familiar force, with consequences not just for falling apples and orbiting planets but for the origin and fate of the universe. And it's all true! Had a great time discussing one of humanity's crowning achievements with @dwarkesh_sp
Show more
Adam Brown (@A_G_I_Joe) is back! General relativity is said to be the most beautiful idea the human mind has ever produced. Most of us will never get to fully appreciate its elegance by taking the 20-lecture graduate course Adam taught on it at Stanford. But in the video below, Adam distills the key idea at its heart so clearly and compellingly that even I could keep up lol. At the core of general relativity, Einstein is trying to figure out the principle behind a particular coincidence: that the mass that resists acceleration and the mass that gravity pulls on just happen to be exactly the same. Adam then leads us through the path of insight which Einstein called his “happiest thought.” Then Adam lectures on black holes. First, by showing how even under special relativity you could create a perpetual motion machine if black holes weren't truly black. And then, by explaining why the observations of an infalling observer and a distant bystander to the black hole would be so radically different Adam leads Blueshift, the team at Google DeepMind cracking science and reasoning. Which gave us the opportunity to discuss at the very end how close we are to AIs that could rediscover general relativity from scratch. Stay till the close for some philosophy of science. 0:00:00 – The coincidence that led Einstein to general relativity 0:16:42 – Gravity is a consequence of curved spacetime, not a force 0:31:46 – Why black holes prevent unlimited energy extraction 0:47:12 – Black holes are the ultimate power plants 1:13:50 – What falling into a black hole would actually feel like 1:18:51 – The three ways we know black holes are real 1:24:21 – The first time we saw gravity bend light 1:29:33 – How far can AI get without experimental evidence? Look up Dwarkesh Podcast on YouTube/Spotify to watch. Enjoy!
Show more
0
76
3.6K
397
Forward to community
Seems to suggest that if it stops being the case that there's 3 labs which are all roughly equally good, competing each others margins away, the provider of the best model could probably get away with charging *a lot* more than they currently are.
Show more
Always learn a lot from chatting with Will and other Prime Intellect researchers. Great team. Congrats!
we raised $130M @ $1B for our series A >$100M run rate we’re just getting started
Really looking forward to asking @drfeifei some questions in person. Only a couple spots left!
What does the next training paradigm look like? 0:00:00 – The big research bet the labs are making 0:02:12 – Grindability is just as important as verifiability 0:06:10 – Will RLVR alone generalize? 0:08:41 – Getting the learning back to the weights 0:15:22 – Dreaming 0:17:23 – What 2027 looks like Also on YouTube, pod feed, and Substack.
Show more
0
72
1.7K
141
Forward to community