ALERT๐จ๐จ:
@vllm_project,
@Inferact & NVIDIA TOOK CO-DESIGN TO THE EXTREME WITH A GB300 NVL72 INFERENCE OPTIMIZATION TO GET ๐ 7.2x ๐ BETTER PERF PER TCO THAN LITERALLY EVERY OTHER AI CHIP, using an inference co-design optimization called wideEP take full advantage of the NVL72 BACKPLANE. We explain below๐๏ธ (1/3)๐งต