Register and share your invite link to earn from video plays and referrals.

Jun Kim
@jundotkim
Open-Source ML Engineer at 🤗 Hugging Face | Creator of oMLX | I build the tools I wish existed for my Mac, then open-source them. junkim.dot@gmail.com
Joined February 2026
198 Following    4.7K Followers
oMLX 0.7.3 is out! Ask AI, the question bar for your local models in any app, now talks back. Press Option-Shift-Space, speak, and your model answers out loud with captions. It can also search the web, read links and look at your screen. Ask AI voice and tools - Voice runs on LFM3-Omni, LFM3-Audio and Qwen3-Omni. With LFM3-Omni 2B on an M3 Ultra, the first audio comes about 100 ms after you stop talking. - Cut in while it's speaking, or share your screen in the middle of a conversation. - Web search, link reading and screen capture work in both text and voice. - Prompt placeholders like {date}, {app} and {clipboard}. Faster DeepSeek V4.1 - INT8 Activation Prefill on M5 Ultra: 64K prefill 2,882 -> 3,507 tok/s (+22%), 195K 2,476 -> 3,200 tok/s (+29%). - 12 concurrent requests decode 56.3 -> 125.7 tok/s (+123%). - Engram prefetch adds another +15% to prefill at 128K. Many requests at once, much less memory - 8 Lightning MTP streams at 81K on Qwen3.8-Flash-Next: peak memory 248 -> 161 GiB (-35%), decode 180.7 -> 241.1 tok/s (+33%). - Batched decode on oQ models: 16 requests 146.9 -> 221.9 tok/s (+51%) on M3 Ultra, 8 requests +74% on M2 Max. - Hybrid Qwen models reuse a shared system prompt across conversations, TTFT 0.89 -> 0.25 s. Also in 0.7.3 - Update downloaded models by fetching only the files that changed. - Better oQ quants, KL drops 9-49% for under 5% more size. - LFM3 text, audio and d1 models, and Unlimited-OCR-2. - Temporary chats in the web UI. Thanks to everyone who sent PRs and tested the rc!
Show more