註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

SemiAnalysis
@SemiAnalysis_
加入 January 2024
35 正在關注    167.9K 粉絲
ALERT🚨 GB300 NVL72 NVLINK BACKPLANE ENABLES 13x BETTER PERF PER DOLLAR THAN HOPPER ON AGENTIC INFERENCE Through extreme co-design, GB300 NVL72 uses an innovative copper backplane to expand the scale-up domain to 72 versus 8 on Hopper. This allows optimizations like @vllm_project wide expert parallelism, which allows each GPU to have only a subset of experts.
顯示更多
0
15
266
15
轉發到社區