注册并分享邀请链接,可获得视频播放与邀请奖励。

Brendan Burke
@BrendanBurkeX
Semiconductor Research Director @TheFuturumGroup | Decoding the Silicon Brain of the Intelligence Age
加入 May 2010
1.6K 正在关注    1.2K 粉丝
At Hot Chips, d-Matrix stole the show with Raptor, the first 3D-stacked DRAM accelerator. They didn't waste any time building on the momentum by announcing that Raptor has been designed into NVIDIA's MGX rack as an NVLink Fusion partner. The rack features 144 XPUs, 2.3 TB of 3D-DRAM at 7.2 PB/s per rack, targeting ~1,000 tok/s/user on 3T models at 1M context. NVIDIA already has Groq 3 LPX with its 128 GB of rack-level SRAM. Raptor brings 18x the capacity for the frontier models SRAM can't fit. NVIDIA's decode portfolio now spans the model size spectrum with Vera CPUs, NVLink, and Spectrum-X attaching either way. NVIDIA just validated the 3D-DRAM bet two years before first revenue. d-Matrix proved it's going to scale.
显示更多