๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

SemiAnalysis
@SemiAnalysis_
๊ฐ€์ž… January 2024
38 ํŒ”๋กœ์ž‰ ์ค‘    183.9K ํŒฌ
ALERT๐Ÿšจ๐Ÿšจ: @vllm_project, @Inferact & NVIDIA TOOK CO-DESIGN TO THE EXTREME WITH A GB300 NVL72 INFERENCE OPTIMIZATION TO GET ๐Ÿš€ 7.2x ๐Ÿš€ BETTER PERF PER TCO THAN LITERALLY EVERY OTHER AI CHIP, using an inference co-design optimization called wideEP take full advantage of the NVL72 BACKPLANE. We explain below๐Ÿ‘‡๏ธ (1/3)๐Ÿงต
๋” ๋ณด๊ธฐ