Register and share your invite link to earn from video plays and referrals.

Jun Kim
@jundotkim
Open-Source ML Engineer at 🤗 Hugging Face | Creator of oMLX | I build the tools I wish existed for my Mac, then open-source them. junkim.dot@gmail.com
Joined February 2026
198 Following    4.7K Followers
After a long wait, oMLX 0.7.0 is out! This release brings faster Qwen3.8, GLM-5.3-Flash and MiMo V2, faster Lightning MTP and DFlash2 at long contexts, and a completely rebuilt memory guard. * Special thanks to @Spangler3000 and @jerry543, who helped a lot with the speed improvements. Performance vs 0.7.0rc1 (oQ4e, Lightning MTP on) - Qwen3.8-Flash-Next prefill on M5 Max: 1,953 -> 2,844 tok/s (+46%) at 16K context. - Qwen3.8-27B decode on M3 Ultra: 46.9 -> 70.3 tok/s (+50%) at 64K context. - GLM-5.3-Flash prefill on M3 Ultra: 413 -> 516 tok/s (+25%) at 16K context. What's new - A completely rebuilt memory guard. It lets oMLX use as much of your memory as it safely can. - DFlash2 support for GLM-5.3-Flash. - Faster image follow-ups for Qwen3.8-Flash-Next with a vision feature cache. - Fixes for the regressions reported against the RC, including ANE prefill, M5 A8 prefill and clustering. Most of the speedups in this release came from contributors. Thanks to everyone who sent PRs and tested dev&RC versions!
Show more