Register and share your invite link to earn from video plays and referrals.

SGLang
@sgl_project
Run LLMs fast at any scale 🔗 Join our community For AI tech blogs & deep-dives 👉 @lmsysorg
Joined May 2025
53 Following    9.5K Followers
🎉 Day 0 support for @nvidia Nemotron 3.5 Lightning is live in SGLang! A 30B hybrid Mamba-Transformer MoE with 3B active params, distilled from Nemotron 3 Ultra for always-on agents: ✅ Three built-in speculators: MTP, DFlash, DSpark ✅ Trained for agent harnesses: coding, tool use, multi-turn ✅ Up to 1M-token context, BF16 + NVFP4 available ✅ Runs on Jetson, DGX Spark, Hopper and Blackwell architectures Run it now with SGLang!
Show more