๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

SGLang
@sgl_project
Run LLMs fast at any scale ๐Ÿ”— Join our community For AI tech blogs & deep-dives ๐Ÿ‘‰ @lmsysorg
๊ฐ€์ž… May 2025
53 ํŒ”๋กœ์ž‰ ์ค‘    9.5K ํŒฌ
๐ŸŽ‰ Day 0 support for @nvidia Nemotron 3.5 Lightning is live in SGLang! A 30B hybrid Mamba-Transformer MoE with 3B active params, distilled from Nemotron 3 Ultra for always-on agents: โœ… Three built-in speculators: MTP, DFlash, DSpark โœ… Trained for agent harnesses: coding, tool use, multi-turn โœ… Up to 1M-token context, BF16 + NVFP4 available โœ… Runs on Jetson, DGX Spark, Hopper and Blackwell architectures Run it now with SGLang!
๋” ๋ณด๊ธฐ