註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Inferact
@inferact
Building the future of inference through @vllm_project
加入 December 2025
5 正在關注    8.3K 粉絲
Thanks for the shoutout @SemiAnalysis_! Our team at @inferact has been optimizing @vllm_project on GB300, and those gains translate directly into better TCO. More optimizations are coming soon. Current results on InferenceX:
顯示更多
ALERT🚨🚨: @vllm_project, @Inferact & NVIDIA TOOK CO-DESIGN TO THE EXTREME WITH A GB300 NVL72 INFERENCE OPTIMIZATION TO GET 🚀 7.2x 🚀 BETTER PERF PER TCO THAN LITERALLY EVERY OTHER AI CHIP, using an inference co-design optimization called wideEP take full advantage of the NVL72 BACKPLANE. We explain below👇️ (1/3)🧵
顯示更多