๐ง GLM-5.3 743B (Int4-Int8Mix) on 4ร DGX Spark just got TWO new lanes ๐
๐ฆ Lane 2: DCP4 + NVFP4 KV + DFlash2
๐ฆ 689,772-token KV pool @ 262K ctx: 2.35ร our old best
๐ 512K window boots: 594K pool, needle 3/3 at 490K tokens โ
๐ง Lane 1: DCP4 + fp8 KV + DFlash2
๐ฆ 462,308-token pool @ 262K
โก Same decode on both: 54 tok/s counting ยท 40 code ยท 36 json ยท 17 prose (single stream)
๐ peak 63 tok/s aggregate (C5, mixed real prompts)
๐ฏ 254K needle 3/3 on both lanes
๐งช NVFP4 + DCP merge checked token-by-token vs DCP1: inside run-to-run noise
โ ๏ธ Trade-off: prefill ~400 tok/s
๐ DCP4 + DFlash2 is
@ajclark's work, now in the repo with full credit. Thanks
@omanuke,
@wuwenthink,
@knapcio,
@brah_ddah & incoai
๐