註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Patrick Moorhead
@PatrickMoorhead
Founder, CEO, Chief Analyst @MoorInsStrat. Co-founder of @TheSixFiveMedia and @Signal_65. Ex-AMD CVP & Fellow, Compaq and AltaVista dot-com bomb participant.
加入 May 2008
4.8K 正在關注    70K 粉絲
$QCOM HBC is now validated silicon, not an Investor Day slide. @Qualcomm has first-gen High Bandwidth Compute running in its San Diego lab, with the full memory read-write path and near-memory compute at production-representative sizes. -18x effective memory bandwidth vs. LPDDR5X, the same 18x it promised in June -More than 5x the bandwidth per watt of HBM4 Coming out of Investor Day, I said the open question was execution timing, not credibility. This is the first hard proof point on execution. It is still lab silicon. The next test is stacked-DRAM yields at volume and tokens per dollar when AI250 samples in 1H 2027.
顯示更多
Memory bandwidth has been the limiting factor for LLM inference for a while now, and anyone building out inference capacity is paying for it in power and in cost per token. @Qualcomm has been talking about High Bandwidth Compute as its answer to that problem, and today it showed first-generation HBC silicon working in its San Diego lab, running the full memory read-write path and near-memory compute at production-representative sizes. The numbers Qualcomm is sharing are big, with 18x the effective bandwidth of LPDDR5X and more than 5x the bandwidth per watt of HBM4. Those are Qualcomm estimates, normalized from ATE testing and compared against published competitor specs, so I'll want to see how they translate once HBC is sitting inside a full accelerator. That first accelerator will likely be Dragonfly AI250, which Qualcomm expects to sample in the first half of 2027 as part of its Dragonfly Rack platform. A data center product has already taped out and early bring-up of the bonded DRAM stack is apparently yielding well, which tells me this has moved past the research phase. Qualcomm has more than a decade of experience bonding DRAM onto logic from its mobile business, but HBC is the first time I've seen that work pointed directly at data center inference economics. If HBC delivers anything close to those efficiency numbers in a shipping system, the market impact could be significant. HBM supply has been one of the tightest constraints on AI infrastructure buildouts, and it is a big part of what makes today's accelerators (and basically everything else!) so expensive. An inference platform that gets its bandwidth from a different memory approach would give hyperscalers and cloud providers another lever on cost and supply, and it would put real pressure on NVIDIA and AMD in the inference tier, where tokens per dollar per watt matter more than peak training performance. Silicon is only part of what these customers are buying, though. Hyperscalers commit to a platform for years, and they need confidence in a multi-generation roadmap, a mature software stack, supply they can count on and support when things break at scale. Qualcomm walked away from its Centriq server CPU effort in 2018, and data center buyers have long memories. The HBC results are a strong technical step, and the next couple of years will determine whether Qualcomm can prove it is the kind of reliable, long-term partner these companies need.
顯示更多