Qwen3.8-27B at up to 144 tok/s on an M5 Max MacBook Pro?! You have to try this Splash Engine!
It's a new open-source inference engine called Splash.
Instead of being a universal runtime like llama.cpp or Ollama, Splash optimizes the whole stack around the exact model đ
âī¸ model-specific kernels
đ§ hardware-aware memory planning
đ DFlash2 speculative decoding
đž prompt-cache reuse
đĨ continuous batching
On the same 48GB M5 Pro running Qwen3.8-27B:
đ Splash: 74 tok/s
⥠oMLX: 38 tok/s
đ Ollama: 24 tok/s
At 32K context:
đ Splash: 54 tok/s
And with 4 concurrent requests:
đĨ 170 aggregate tok/s
vs 43 tok/s for oMLX
Now Inco + LM Studio are showing up to ~144 tok/s on M5 Max.
And LM Studio Bionic 1.1.5 already added Splash as an experimental runtime.
Requirements
đ M3 or newer
đž 36GB minimum
đ 48GB+ recommended
Completely different performance because the software stack is optimized around what it is running.
â ī¸ 144 tok/s is an Inco/LM Studio result. The detailed numbers above are from Inco's 48GB M5 Pro test.
đ