SemiAnalysis
@SemiAnalysis_
参加 January 2024
35 フォロー中 167.7K ファン
ALERT🚨 GB300 NVL72 NVLINK BACKPLANE ENABLES 13x BETTER PERF PER DOLLAR THAN HOPPER ON AGENTIC INFERENCE
Through extreme co-design, GB300 NVL72 uses an innovative copper backplane to expand the scale-up domain to 72 versus 8 on Hopper. This allows optimizations like @vllm_project wide expert parallelism, which allows each GPU to have only a subset of experts.
もっと見る
