가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

sat0xshi
@sat0xshi
旅とgadgets,変態Infrastructure Engineer , ローカルLLM × AI, Ingress ENL j0c 🇯🇵 , techno and ambient DJ, biohacker.
가입 January 2015
1.3K 팔로잉 중    1.9K
設定ありがとう
Rejoice single DGX Spark owners! 💫 DeepSeek v4 Flash for single DGX Spark BEATS the 2x DGX Spark version on agentic workflows! 🤯🤯 Haven't done full coding tests but for agentic workflows it BEATS the FP8 version running on vLLM running on dual DGX Sparks. I fully expect it to be great at coding too! However, it's much slower, as expected: Aggregate tok/s (1-2-4-6-8-12) 26.7 tok/s → 32.9 → 46.5 → 54.1 → 58.5 → 58.5 tok/s Per-stream progression: 26.7 → 16.5 → 12.1 → 9.5 → 7.7 → 5.2 tok/s That means up to 59 tok/s across 12 concurrent sessions. This is the best model to run on a single DGX Spark! All credits go to @bleysg! I have published a simple start/stop recipe: I still recommend running DeepSeek v4 Flash on 2x DGX Sparks because the speed difference about 3x. Additional details below 👇
더 보기