注册并分享邀请链接,可获得视频播放与邀请奖励。

Jun Kim
@jundotkim
Open-Source ML Engineer at 🤗 Hugging Face | Creator of oMLX | I build the tools I wish existed for my Mac, then open-source them. junkim.dot@gmail.com
加入 February 2026
190 正在关注    3.7K 粉丝
oMLX 0.5.2 is out. (Sorry for the long silence!) oMLX is the most convenient way to run MLX models on your Mac, and the fastest way to run them, with custom Metal kernels for GLM, MiniMax, DeepSeek V4, and Qwen. New in 0.5.2: - Live activity in the macOS menu bar: opt-in readouts for live, session, and all-time throughput (PP and TG), plus CPU/GPU/MEM usage bars, each with a popover and rolling graphs - A reorganized Models menu: load models directly from the menu bar, sectioned into Loaded, Favorites, and Library with load state and sizes - Bonsai 1-bit / 2-bit decode kernels for extreme low-bit models - Faster Hugging Face downloads, more TTS output formats, and chat history import/export And if you are coming from 0.4.x, here is what the 0.5 line added: - oMLX custom kernels: prefill improved by up to +45% for DeepSeek-V4-Flash, +33% for Qwen3.6-27B, +99% for GLM-5.2, and +94% for MiniMax M3 on my M3 Ultra - Lightning MTP: native speculative decoding that accelerates TG on top of the custom-kernel PP path. Qwen3.6-35B-A3B went from 89.6 to 140.4 tok/s and Qwen3.6-27B from 35.0 to 55.1 tok/s - oQe imatrix enhanced quantization: The highest-accuracy quantization on MLX, driven by an activation-importance calibration pass - Plus a lot of stability and memory hardening across 0.5.1 and 0.5.2 for long-running servers Huge thanks to everyone who contributed, tested, reported bugs, and shared feedback. I hope this makes running local models on your Mac even nicer!
显示更多
0
19
209
23
转发到社区