登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Mia
@MiaAI_lab
Building with AI & LLMs // Running frontier open models locally
参加 July 2022
413 フォロー中    48.3K ファン
Run the NEW GLM 5.3 Flash recipe (1104) on your 2x NVIDIA DGX Sparks with ease ✨ Based on my RTX PRO 6000 recipe and ported to GB10. 93 of its patches are unchanged, and 12 are unique GB10 patches. Your sessions will run smoother, feel snappier, and in general be a more pleasant experience from top to bottom. Focused on uncompromising quality. Everything has been tested & verified, and the default settings are the best quality you can run. Native 1M context, 8 streams, TensorFold. Decode performance (non-greedy prose): ~ 48 tok/s single stream. ~ 87 tok/s at 4 concurrent streams. - You will feel a noticeable difference vs the older recipe. Prefill: ~1,700-1,800 tok/s, 4k-256k. I ran all benchmarks with the GPU clock cap set to 2200. Support for 4x DGX Sparks is coming soon! The link to the new recipe is below.
もっと見る