Jonathan Spangler(@Spangler3000):@jundotkim , I published a bunch of PR's for OMLX for m5U optimization for Mimo 2.6 flash , GLM 5.3 flash and qwen 3.8 Next . As always Lossless by design no tricks or benchmax BLUF : M5 ultra is insanely fast . 🔥 The numbers are pretty wild after a day and a half of lossless optimizing. Qwen3.8-Flash-Next Prefill: 5.6k tok/s @ 8k–16k · 5.5k @ 64k · 4.5–4.8k @ 4k Decode: 109–124 tok/s (MTP) Peak mem: ~109 GB GLM-5.3-Flash Prefill: 2.35k tok/s @ 16k & 64k · 2.32k @ 4k Decode: 63 @ 1k · 59 @ 4k–16k · 56 @ 64k (no spec dec) Peak mem: ~187–191 GB MiMo-V2.6-Flash Prefill: 3.3k tok/s @ 8k Decode: 99–118 @ 8k

2026.09.27 19:15

@jundotkim , I published a bunch of PR's for OMLX for m5U optimization for Mimo 2.6 flash , GLM 5.3 flash and qwen 3.8 Next . As always Lossless by design no tricks or benchmax BLUF : M5 ultra is insanely fast . 🔥 The numbers are pretty wild after a day and a half of lossless optimizing. Qwen3.8-Flash-Next Prefill: 5.6k tok/s @ 8k–16k · 5.5k @ 64k · 4.5–4.8k @ 4k Decode: 109–124 tok/s (MTP) Peak mem: ~109 GB GLM-5.3-Flash Prefill: 2.35k tok/s @ 16k & 64k · 2.32k @ 4k Decode: 63 @ 1k · 59 @ 4k–16k · 56 @ 64k (no spec dec) Peak mem: ~187–191 GB MiMo-V2.6-Flash Prefill: 3.3k tok/s @ 8k Decode: 99–118 @ 8k · 89–99 @ 1k (MTP) Peak mem: ~170–173 GB

126

コミュニティへ転送

人気のあるユーザー