登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Mia
@MiaAI_lab
Building with AI & LLMs | Insights, recipes, tools & honest experiments
参加 July 2022
385 フォロー中    9.6K ファン
Rejoice single DGX Spark owners! 💫 DeepSeek v4 Flash for single DGX Spark BEATS the 2x DGX Spark version on agentic workflows! 🤯🤯 Haven't done full coding tests but for agentic workflows it BEATS the FP8 version running on vLLM running on dual DGX Sparks. I fully expect it to be great at coding too! However, it's much slower, as expected: Aggregate tok/s (1-2-4-6-8-12) 26.7 tok/s → 32.9 → 46.5 → 54.1 → 58.5 → 58.5 tok/s Per-stream progression: 26.7 → 16.5 → 12.1 → 9.5 → 7.7 → 5.2 tok/s That means up to 59 tok/s across 12 concurrent sessions. This is the best model to run on a single DGX Spark! All credits go to @bleysg! I have published a simple start/stop recipe: I still recommend running DeepSeek v4 Flash on 2x DGX Sparks because the speed difference about 3x. Additional details below 👇
もっと見る