登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Niklas
@niklaslenz_ai
I run local AI at home on 4 DGX Sparks, 1 M5U 256GB, 1 RTX 5090, 2 RTX 5060 Ti 16GB, and rank what runs best on the machine you own. LLMs, image/video gen. etc
参加 June 2026
187 フォロー中    1.7K ファン
Nemotron 3.5 Lightning (30B-A3B) fits on a single 16 GB card. I ran it on my RTX 5060 Ti, every layer on the GPU. ggml-org's model GGUFs start at 17.6 GiB, unsloth's at 18.1 GiB. Myric's APEX-mini is 13.66 GiB and keeps the MTP head in the same file. Stock llama.cpp (b11151), no patch. Speed = 400 tokens ÷ full request time, temp 0, median of 3. Thinking was on (default), so the tokens are reasoning, not final prose or code. MTP drafts help one request, not 4 at once (same prompt): Solo prose: 129.6 → 152.9 tok/s Solo code: 127.2 → 190.9 tok/s 4x prose: 277.6 → 235.9 tok/s total 4x code: 307.9 → 277.5 tok/s total Peak VRAM: 13.0 GiB, 14.4 GiB with MTP. GSM8K, 100 problems, thinking off: 92/100, none cut off. Thinking on: 91/100, 2 still thinking at 129k tokens. Limits: GSM8K is my only quality check, no full-precision run (Myric: +11.7% perplexity vs BF16). Speed and VRAM at 2k context per request. MTP and 4 at once change the exact output.
もっと見る