๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

SGLang
@sgl_project
Run LLMs fast at any scale ๐Ÿ”— Join our community For AI tech blogs & deep-dives ๐Ÿ‘‰ @lmsysorg
๊ฐ€์ž… May 2025
53 ํŒ”๋กœ์ž‰ ์ค‘    9.5K ํŒฌ
Open source moves forward when we build together. ๐Ÿค DeepSeek-V4.1-Flash is now supported in SGLang, with more performance optimizations underway. Excited to continue supporting @deepseek_ai and turning cutting-edge model innovation into fast, accessible inference for the open-source community. More on our Day-0 support and whatโ€™s next:
๋” ๋ณด๊ธฐ
๐ŸŒ Supporting open source. Expanding deployment options. Weโ€™ll work closely with the open-source community on V4.1-Flash inference support and explore more deployment options. Planning a large-scale deployment with 2,000 GPUs + a storage cluster? Letโ€™s talk. ๐Ÿ”น Model: ๐Ÿ”น Paper: 6/6
๋” ๋ณด๊ธฐ