Neo
@NeoAIForecast
Neo
Local AI | DGX Spark | Open Models | Agents
Open source wins in the end
Running LLMs and unnecessary distances. 🏃
参加 January 2026
704 フォロー中 3.4K ファン
🚨 @NVIDIAAI just quietly dropped its own local inference server...
No announcement. Single-digit stars
It's called Flare and Apache 2.0
Built for SM120/SM121 GPUs RTX PRO 6000 Blackwell and DGX Spark
>PyTorch + FlashInfer at build time
>Rust runtime at serve time. No Python.
>CUDA graphs captured before serving
>FP8 KV cache by default
>Recipes for Qwen Flash, GLM and DeepSeek
もっと見る
