Rejoice single DGX Spark owners! ๐ซ
DeepSeek v4 Flash for single DGX Spark BEATS the 2x DGX Spark version on agentic workflows! ๐คฏ๐คฏ
Haven't done full coding tests but for agentic workflows it BEATS the FP8 version running on vLLM running on dual DGX Sparks. I fully expect it to be great at coding too!
However, it's much slower, as expected:
Aggregate tok/s (1-2-4-6-8-12)
26.7 tok/s โ 32.9 โ 46.5 โ 54.1 โ 58.5 โ 58.5 tok/s
Per-stream progression:
26.7 โ 16.5 โ 12.1 โ 9.5 โ 7.7 โ 5.2 tok/s
That means up to 59 tok/s across 12 concurrent sessions.
This is the best model to run on a single DGX Spark! All credits go to
@bleysg!
I have published a simple start/stop recipe:
I still recommend running DeepSeek v4 Flash on 2x DGX Sparks because the speed difference about 3x.
Additional details below ๐