SGLang(@sgl_project):🎉 Day 0 support for @nvidia Nemotron 3.5 Lightning is live in SGLang! A 30B hybrid Mamba-Transformer MoE with 3B active params, distilled from Nemotron 3 Ultra for always-on agents: ✅ Three built-in speculators: MTP, DFlash, DSpark ✅ Trained for agent harnesses: coding, tool use, multi-turn ✅ Up to 1M-token context, BF16 + NVFP4 available ✅ Runs on Jetson, DGX Spark, Hopper and Blackwell architectures Run it now with SGLang!

SGLang

@sgl_project

Run LLMs fast at any scale 🔗 Join our community For AI tech blogs & deep-dives 👉 @lmsysorg

加入 May 2025

53 正在关注 9.5K 粉丝

SGLang@sgl_project

2026.08.11 13:36

🎉 Day 0 support for @nvidia Nemotron 3.5 Lightning is live in SGLang! A 30B hybrid Mamba-Transformer MoE with 3B active params, distilled from Nemotron 3 Ultra for always-on agents: ✅ Three built-in speculators: MTP, DFlash, DSpark ✅ Trained for agent harnesses: coding, tool use, multi-turn ✅ Up to 1M-token context, BF16 + NVFP4 available ✅ Runs on Jetson, DGX Spark, Hopper and Blackwell architectures Run it now with SGLang!

显示更多