Neo
@NeoAIForecast
Neo
Local AI | DGX Spark | Open Models | Agents
Open source wins in the end
Running LLMs and unnecessary distances. ๐
๊ฐ์
January 2026
704 ํ๋ก์ ์ค 3.4K ํฌ
๐จ @NVIDIAAI just quietly dropped its own local inference server...
No announcement. Single-digit stars
It's called Flare and Apache 2.0
Built for SM120/SM121 GPUs RTX PRO 6000 Blackwell and DGX Spark
>PyTorch + FlashInfer at build time
>Rust runtime at serve time. No Python.
>CUDA graphs captured before serving
>FP8 KV cache by default
>Recipes for Qwen Flash, GLM and DeepSeek
๋ ๋ณด๊ธฐ
