Rejoice single DGX Spark owners! đĢ
DeepSeek v4 Flash for single DGX Spark BEATS the 2x DGX Spark version on agentic workflows! đ¤¯đ¤¯
Haven't done full coding tests but for agentic workflows it BEATS the FP8 version running on vLLM running on dual DGX Sparks. I fully expect it to be great at coding too!
However, it's much slower, as expected:
Aggregate tok/s (1-2-4-6-8-12)
26.7 tok/s â 32.9 â 46.5 â 54.1 â 58.5 â 58.5 tok/s
Per-stream progression:
26.7 â 16.5 â 12.1 â 9.5 â 7.7 â 5.2 tok/s
That means up to 59 tok/s across 12 concurrent sessions.
This is the best model to run on a single DGX Spark! All credits go to
@bleysg!
I have published a simple start/stop recipe:
I still recommend running DeepSeek v4 Flash on 2x DGX Sparks because the speed difference about 3x.
Additional details below đ