Jonathan Spangler
@Spangler3000
Pursue the unknown | Eigen Labs / Darkbloom , USMC Vet
298 Following 531 Followers
Today is my official first day @eigenlabs building @darkbloomai
It’s been almost a month working with the teams here and I cannot speak highly enough of everyone here .
To all involved so far I cannot thank you enough for this opportunity.
Let’s build 🫶
Show more
@jundotkim , I published a bunch of PR's for OMLX for m5U optimization for Mimo 2.6 flash , GLM 5.3 flash and qwen 3.8 Next .
As always Lossless by design no tricks or benchmax
BLUF : M5 ultra is insanely fast . 🔥
The numbers are pretty wild after a day and a half of lossless optimizing.
Qwen3.8-Flash-Next Prefill: 5.6k tok/s @ 8k–16k · 5.5k @ 64k · 4.5–4.8k @ 4k Decode: 109–124 tok/s (MTP) Peak mem: ~109 GB
GLM-5.3-Flash Prefill: 2.35k tok/s @ 16k & 64k · 2.32k @ 4k Decode: 63 @ 1k · 59 @ 4k–16k · 56 @ 64k (no spec dec) Peak mem: ~187–191 GB
MiMo-V2.6-Flash Prefill: 3.3k tok/s @ 8k Decode: 99–118 @ 8k · 89–99 @ 1k (MTP) Peak mem: ~170–173 GB
Show more
