Nvidia has despecced Rubin Ultra's HBM: from HBM4E 12-Hi (384GB) down to HBM4 8-Hi (192GB).
Why strip memory out of your flagship rack-scale system? Because after the latest HBM and DRAM price hikes, memory had quietly become ~40% of total capital cost of ownership.
We ran the TCO math in a recent conference keynote (1/3)🧵