Nvidia dropped an official DeepSeek-V4.1-Flash NVFP4 build.
And this thing is BIG.
DeepSeek V4.1 Flash stats
๐ง 552B backbone
๐ +196B Engram conditional memory
โก only 8B active during prefill
๐ 16B active during decode
๐๏ธ native vision
๐ 1 MILLION token context
๐งฉ 384 routed experts across 40 layers
๐ MIT license
Nvidia has converted its routed MoE experts to NVFP4 W4A4 specifically for Blackwell GPUs.
This is not a compressed giant model down to 4-bit.
DeepSeek's experts were already stored in MXFP4, Nvidia instead converts them to its Blackwell-friendly NVFP4 format.
And because NVFP4 uses finer scaling, the checkpoint actually gets slightly larger.
๐พ Source: ~476 GiB
๐พ NVIDIA NVFP4: ~492 GiB
48 safetensor shards. ๐ณ
So why bother? Because NVIDIA is optimizing how those 4-bit experts execute on Blackwell.
And impressively, NVIDIA's evaluations show basically no obvious quality collapse from the conversion.
For example:
๐ง GPQA Diamond
91.04 โ 91.29
๐ป SciCode
54.40 โ 55.84
๐ ๏ธ Terminal-Bench 2.1
81.60 โ 82.16
๐๏ธ MMMU-Pro
74.05 โ 73.70
Some slightly up.
Some slightly down.
Essentially benchmark parity.
And it already has:
โ vLLM support
โ SGLang support
โ reasoning parser
โ tool calling
โ image input
โ 1M context
โ ๏ธ Nvidia validated it on 4ร GB300 GPUs so not a local model (yet). The checkpoint is still ~492 GiB.
๐ HF: /nvidia/DeepSeek-V4.1-Flash-NVFP4