GLM-5.3-Flash on one DGX Spark at 33 tok/s. Plus CYBER-FROST at 55 tok/s on code.
Two impressive community one-box recipes from this week. I re-ran both with the authors' own benchmark method. Both hold up.
RED-SNOW 5.3 Flash, 2.49 bpw:
• long outputs (1000+ tokens): 32.95 tok/s median. README says 34.4.
• prose: 25.4 tok/s. README says ~24.
• MTP acceptance 89.5%.
CYBER-FROST 3.8, 3.87 bpw, with the repo's own bench script:
• code: 54.7 tok/s. DEPLOY.md says 53.2.
• devops: 49.0 tok/s. DEPLOY.md says 45.8.
• prose: 46.9 tok/s. DEPLOY.md says 46.5.
So both land within 7% of what the repos say.
Honest limits:
• My box runs with a 2200 MHz clock cap. That can cost a few percent against an uncapped box.
• Engine pins differ too: I ran exllamav3 fork 24f0dec + TabbyAPI main; the repo and yume ran 047ce72 + TabbyAPI 7a524a9. Part of the gap below may come from that.
•
@yume_arasaki got 60.7 tok/s on the code suite. I got 54.7, best single sample 60.6.
• 2.49 bpw is a tight squeeze: the card reports 90% top-1 agreement with BF16.
• 3 runs each. Both are de-refused security finetunes (RED-SNOW is an abliterated GLM-5.3-Flash).
Recipes
@WescheNex1q +
@ViC305, finetunes
@Blackfrost_AI.