At Hot Chips, d-Matrix stole the show with Raptor, the first 3D-stacked DRAM accelerator.
They didn't waste any time building on the momentum by announcing that Raptor has been designed into NVIDIA's MGX rack as an NVLink Fusion partner. The rack features 144 XPUs, 2.3 TB of 3D-DRAM at 7.2 PB/s per rack, targeting ~1,000 tok/s/user on 3T models at 1M context.
NVIDIA already has Groq 3 LPX with its 128 GB of rack-level SRAM. Raptor brings 18x the capacity for the frontier models SRAM can't fit. NVIDIA's decode portfolio now spans the model size spectrum with Vera CPUs, NVLink, and Spectrum-X attaching either way.
NVIDIA just validated the 3D-DRAM bet two years before first revenue. d-Matrix proved it's going to scale.