Nvidia dropped an official DeepSeek-V4.1-Flash NVFP4 build.
And this thing is BIG.
DeepSeek V4.1 Flash stats
đ§ 552B backbone
đ +196B Engram conditional memory
⥠only 8B active during prefill
đ 16B active during decode
đī¸ native vision
đ 1 MILLION token context
đ§Š 384 routed experts across 40 layers
đ MIT license
Nvidia has converted its routed MoE experts to NVFP4 W4A4 specifically for Blackwell GPUs.
This is not a compressed giant model down to 4-bit.
DeepSeek's experts were already stored in MXFP4, Nvidia instead converts them to its Blackwell-friendly NVFP4 format.
And because NVFP4 uses finer scaling, the checkpoint actually gets slightly larger.
đž Source: ~476 GiB
đž NVIDIA NVFP4: ~492 GiB
48 safetensor shards. đŗ
So why bother? Because NVIDIA is optimizing how those 4-bit experts execute on Blackwell.
And impressively, NVIDIA's evaluations show basically no obvious quality collapse from the conversion.
For example:
đ§ GPQA Diamond
91.04 â 91.29
đģ SciCode
54.40 â 55.84
đ ī¸ Terminal-Bench 2.1
81.60 â 82.16
đī¸ MMMU-Pro
74.05 â 73.70
Some slightly up.
Some slightly down.
Essentially benchmark parity.
And it already has:
â vLLM support
â SGLang support
â reasoning parser
â tool calling
â image input
â 1M context
â ī¸ Nvidia validated it on 4à GB300 GPUs so not a local model (yet). The checkpoint is still ~492 GiB.
đ HF: /nvidia/DeepSeek-V4.1-Flash-NVFP4