I remember when I went to Advancing AI a couple months ago and Lisa predicted the Server CPU market to go from ~$25B today (as of July) to $220B by 2030. Citi just came out and is expecting $300B by 2030. I think $300B should be seen as a floor.
Here are my thoughts from Advancing AI yesterday:
Lisa opened by stating 35 quadrillion tokens are being consumed every month, up roughly 160x in two years. She mentioned that the curve is steepening, NOT FLATTENING.
She mentioned that training is not dying. Compute being used to train frontier models is still growing 5x per year. However, 2026 is the first year inference is the larger consumer at around 60% of global compute (AI).
Both can be true at once. What was interesting to me, and which I liked, were the TAM revisions.
> AI accelerator market to be $1.4T by 2030, up from $AMD's own $500B from a year ago
> Total high performance and adaptive compute TAM: approaching $2T by 2030
> Server CPU market: from ~$25B today to $220B by 2030
So it was confirmed, once more that you do not just run billions of agents on GPUs alone. CPUs run the loop.
On hardware (Helios is in full production):
> 72 instinct MI455X GPUs + 18 6th Gen EPYC Venice CPUs in one double-wide rack, tied together with Pensando networking
> 31TB of pooled HBM4 per rack, 1.4PB/s aggregate memory BW
> 2.9 exaflops FP4, 1.4 exaflops FP8
> 260TB/s scale-up, 43TB/s scale-out
> vs. the competing next-gen rack: 10-15% more FP4 compute, 50% more HBM4 capacity and BW, 50% more scale-out BW
Each MI455X is 320B transistors, 432GB of HBM4 at 19.6TB/s, TSMC's 2nm compute tiles over 3nm base dies. MI300 and MI350 have shipped as OAM modules on a universal baseboard. MI455X ships as an EAM, direct liquid cooled. That is the packaging level reason a 72 GPU rack-scale domain is possible. Shipments start at the end of Q3, ramping thru Q4 and into H1 2027.
Also, the 18x lower $/tok is MI455X vs. MI355X, NOT against NVDA's. Against the leading competitive rack, the claim is up to 30% more tokens per dollar.
OpenAI and Meta each at 6GW. Anthropic up to 2GW starting H1 2027, with up to a $5B investment into Anthropic. CBRS splitting prefill onto Helios and decode onto wafer-scale, which is oddly familiar to NVDA x Groq.
Now, on software:
> pushes AMD skills directly into Claude, Codex, Cursor, and Gemini so the agent understands AMD hardware natively. $AMD claimed 3.3x average inference and 2.4x training uplift
> Hyperloom, an open-source agent that profiles and rewrites kernels E2E, lifted tok rate on the demo code by 38%
> FlyDSL, a Python DSL for authoring GPU kernels that match hand-tuned HIP C++
So it looks to me, and sounded like, the CUDA moat is fading.
AMD is using its own enterprise deployment as a case study: 43% cut to the tok cost and 2.9x faster responses.
It was also neat to hear so much about local AI. Gorgon Halo goes to 192GB unified memory and runs 300B+ param models on an x86, shipping Q3.
So, if you're in on $AMD I'd be watching 8/4 earnings and see if Helios units are recognized and EPYC commentary.
Show more