This might be my new favorite all-purpose local AI model. Fits nicely into 16GB of VRAM for an RTX
5060/5070TI.
The new SparkX2.6-4B beats Qwen3.5-9B in 80% of shared benchmarks and 97% of Gemma4-12Bs.
Stats
đž official Q4_K_M â 3.54GB
đ§ only 4B parameters
đ native 1M context
đ none / low / high thinking budgets
đ¤ trained for local agents
đ Apache 2.0
It already runs with:
âī¸ llama.cpp
đĻ Ollama
đĨī¸ LM Studio
đ MLX
đ vLLM / SGLang
In the team's reported benchmark suite Averages:
Spark-X2.6-4B â 63.3
Spark-X2.5-4B â 52.1
Qwen3.5-9B â 49.1
So they're claiming a 4B model beats their tested 9B comparison overall.
For normal local-agent contexts, though, a ~3.5GB reasoning/agent model with this runtime support is very interesting.
Link in ALT