Register and share your invite link to earn from video plays and referrals.

Mia
@MiaAI_lab
Building with AI & LLMs // Running frontier open models locally
Joined July 2022
413 Following    48.3K Followers
Run the NEW GLM 5.3 Flash recipe (1104) on your 2x NVIDIA DGX Sparks with ease ✨ Based on my RTX PRO 6000 recipe and ported to GB10. 93 of its patches are unchanged, and 12 are unique GB10 patches. Your sessions will run smoother, feel snappier, and in general be a more pleasant experience from top to bottom. Focused on uncompromising quality. Everything has been tested & verified, and the default settings are the best quality you can run. Native 1M context, 8 streams, TensorFold. Decode performance (non-greedy prose): ~ 48 tok/s single stream. ~ 87 tok/s at 4 concurrent streams. - You will feel a noticeable difference vs the older recipe. Prefill: ~1,700-1,800 tok/s, 4k-256k. I ran all benchmarks with the GPU clock cap set to 2200. Support for 4x DGX Sparks is coming soon! The link to the new recipe is below.
Show more