K2 Horizon got another llama.cpp-family path, this time through TurboQuant.
Spark-X2.5 already landed in upstream llama.cpp. I’ve actually got it running myself.
A brand-new K2 Horizon TurboQuant PR adds …
🧠 K2 Horizon model support
📦 Hugging Face → GGUF conversion
💬 tokenizer + chat templates
⚙️ llama.cpp-style inference
And they’ve already tested
🧠 K2-Horizon-3.7B Q4_K_M
🍎 M3 Pro / 18GB
⚡ ~35 tok/s
📚 64K configured context
The PR also adds Spark-X2.5 to the TurboQuant fork:
⚡ ~36 tps
📚 256K configured context
Caveats
⚠️ This is still an OPEN PR
⚠️ Only Metal has been tested
⚠️ Other K2 sizes + MoVA/MoE variants remain untested
K2 Horizon already has an IFM llama.cpp fork, but it still isn’t supported in normal upstream llama.cpp.
So what I’m watching here is whether TurboQuant becomes another path for K2.
K2-Horizon-7B scores 21 on Artificial Analysis Intelligence Index, punching above its weights.
It scores 50% above the next best model under 10B, beating Qwen3.6-35B-A3B and closely matching Qwen3.6-27B.
• Try it:
• 8-bit quantization:
• Uno, the speed-up diffusion-augmented version:
K2 Horizon is coming to CMU.
Following the release, we're hosting a workshop on building with K2 Horizon, followed by an event at HackCMU 2026.
We look forward to seeing what CMU's hackers create.
Learn more:
K2497 is a limb bone from a plesiosaur, a group of marine reptiles that lived during the Jurassic Period. The bone preserves damage across both sides of the distal section, including a distinctive set of bite marks. This specimen was collected from Dorset in the 1990s.
K2: ROOKIE OF THE YEAR FINALIST.
💫 1st rookie to ever lead the NBA in 3PM
💫 3rd rookie to average 15+ PTS, 5+ REB & shoot 40% from 3P (Bird, Pierce)
💫 5th most 50-40-90 games by any NBA player in a season in history
💫 League-leading 4 ROTM awards this season
Meet K2 Horizon model fleet.
The smallest model is designed for devices where memory, power consumption and local processing matter. The largest model is intended for demanding reasoning and enterprise AI workloads.
Developers can prototype on smaller models and scale to larger models without leaving the K2 Horizon fleet.
Start building: