This might be my new favorite all-purpose local AI model. Fits nicely into 16GB of VRAM for an RTX
5060/5070TI.
The new SparkX2.6-4B beats Qwen3.5-9B in 80% of shared benchmarks and 97% of Gemma4-12Bs.
Stats
๐พ official Q4_K_M โ 3.54GB
๐ง only 4B parameters
๐ native 1M context
๐ญ none / low / high thinking budgets
๐ค trained for local agents
๐ Apache 2.0
It already runs with:
โ๏ธ llama.cpp
๐ฆ Ollama
๐ฅ๏ธ LM Studio
๐ MLX
๐ vLLM / SGLang
In the team's reported benchmark suite Averages:
Spark-X2.6-4B โ 63.3
Spark-X2.5-4B โ 52.1
Qwen3.5-9B โ 49.1
So they're claiming a 4B model beats their tested 9B comparison overall.
For normal local-agent contexts, though, a ~3.5GB reasoning/agent model with this runtime support is very interesting.
Link in ALT