Unlimited-OCR is now on ModelScope! A 3.3B multilingual OCR model for one-shot parsing across single images, multi-page documents, and PDFs. License: MIT🚀
🤖
📄 Full-document parsing instead of cropped-region OCR
📏 32K output length for long OCR sequences
🧩 Base and gundam image modes for different document layouts
⚙️ Transformers inference + SGLang serving with OpenAI-compatible streaming requests
Built to push DeepSeek-OCR-style document parsing further.
Show more
oMLX 0.7.3 is out!
Ask AI, the question bar for your local models in any app, now talks back. Press Option-Shift-Space, speak, and your model answers out loud with captions. It can also search the web, read links and look at your screen.
Ask AI voice and tools
- Voice runs on LFM3-Omni, LFM3-Audio and Qwen3-Omni. With LFM3-Omni 2B on an M3 Ultra, the first audio comes about 100 ms after you stop talking.
- Cut in while it's speaking, or share your screen in the middle of a conversation.
- Web search, link reading and screen capture work in both text and voice.
- Prompt placeholders like {date}, {app} and {clipboard}.
Faster DeepSeek V4.1
- INT8 Activation Prefill on M5 Ultra: 64K prefill 2,882 -> 3,507 tok/s (+22%), 195K 2,476 -> 3,200 tok/s (+29%).
- 12 concurrent requests decode 56.3 -> 125.7 tok/s (+123%).
- Engram prefetch adds another +15% to prefill at 128K.
Many requests at once, much less memory
- 8 Lightning MTP streams at 81K on Qwen3.8-Flash-Next: peak memory 248 -> 161 GiB (-35%), decode 180.7 -> 241.1 tok/s (+33%).
- Batched decode on oQ models: 16 requests 146.9 -> 221.9 tok/s (+51%) on M3 Ultra, 8 requests +74% on M2 Max.
- Hybrid Qwen models reuse a shared system prompt across conversations, TTFT 0.89 -> 0.25 s.
Also in 0.7.3
- Update downloaded models by fetching only the files that changed.
- Better oQ quants, KL drops 9-49% for under 5% more size.
- LFM3 text, audio and d1 models, and Unlimited-OCR-2.
- Temporary chats in the web UI.
Thanks to everyone who sent PRs and tested the rc!
Show more