NVIDIA's Vera Rubin NVL72 could train large mixture-of-experts AI models using 75% fewer GPUs than Grace Blackwell.
Training a 10T-parameter model on 100T tokens in one month would just require roughly 16,000 Rubin GPUs, compared with 64,000 GB200 GPUs.