Register and share your invite link to earn from video plays and referrals.

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | 🔔 Follow for AI & Vibe Coding Tips 👇
Joined July 2023
552 Following    12.5K Followers
This might be my new favorite all-purpose local AI model. Fits nicely into 16GB of VRAM for an RTX 5060/5070TI. The new SparkX2.6-4B beats Qwen3.5-9B in 80% of shared benchmarks and 97% of Gemma4-12Bs. Stats 💾 official Q4_K_M → 3.54GB 🧠 only 4B parameters 📚 native 1M context 💭 none / low / high thinking budgets 🤖 trained for local agents 🔓 Apache 2.0 It already runs with: âš™ī¸ llama.cpp đŸĻ™ Ollama đŸ–Ĩī¸ LM Studio 🍎 MLX 🚀 vLLM / SGLang In the team's reported benchmark suite Averages: Spark-X2.6-4B → 63.3 Spark-X2.5-4B → 52.1 Qwen3.5-9B → 49.1 So they're claiming a 4B model beats their tested 9B comparison overall. For normal local-agent contexts, though, a ~3.5GB reasoning/agent model with this runtime support is very interesting. Link in ALT
Show more