登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Niklas
@niklaslenz_ai
I run local AI at home on 4 DGX Sparks, 1 M5U 256GB, 1 RTX 5090, 2 RTX 5060 Ti 16GB, and rank what runs best on the machine you own. LLMs, image/video gen. etc
参加 June 2026
187 フォロー中    1.7K ファン
GLM-5.3-Flash on one DGX Spark at 33 tok/s. Plus CYBER-FROST at 55 tok/s on code. Two impressive community one-box recipes from this week. I re-ran both with the authors' own benchmark method. Both hold up. RED-SNOW 5.3 Flash, 2.49 bpw: • long outputs (1000+ tokens): 32.95 tok/s median. README says 34.4. • prose: 25.4 tok/s. README says ~24. • MTP acceptance 89.5%. CYBER-FROST 3.8, 3.87 bpw, with the repo's own bench script: • code: 54.7 tok/s. DEPLOY.md says 53.2. • devops: 49.0 tok/s. DEPLOY.md says 45.8. • prose: 46.9 tok/s. DEPLOY.md says 46.5. So both land within 7% of what the repos say. Honest limits: • My box runs with a 2200 MHz clock cap. That can cost a few percent against an uncapped box. • Engine pins differ too: I ran exllamav3 fork 24f0dec + TabbyAPI main; the repo and yume ran 047ce72 + TabbyAPI 7a524a9. Part of the gap below may come from that. • @yume_arasaki got 60.7 tok/s on the code suite. I got 54.7, best single sample 60.6. • 2.49 bpw is a tight squeeze: the card reports 90% top-1 agreement with BF16. • 3 runs each. Both are de-refused security finetunes (RED-SNOW is an abliterated GLM-5.3-Flash). Recipes @WescheNex1q + @ViC305, finetunes @Blackfrost_AI.
もっと見る