Local AI tip: if you've got a big-memory Mac, you can run frontier open models at home now.
antirez, the creator of Redis, built ds4, a lean C engine that runs a few top open models on your own machine.
the setup:
* models → DeepSeek V4 Flash, GLM 5.x and Qwen 3.8 Flash Next
* hardware → high-memory Macs, NVIDIA and AMD GPUs
* speed → about 39 tokens per second on a 128GB M5 Max
* tools → a CLI, an OpenAI and Anthropic compatible API, and a coding agent
why it's different:
→ built for a few models only, instead of everything at once
→ 2-bit quantization so big models fit in memory
→ 23,000+ GitHub stars, MIT licensed
One dev. One engine. Frontier models on your desk.
the repo:
顯示更多