๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

SGLang
@sgl_project
Run LLMs fast at any scale ๐Ÿ”— Join our community For AI tech blogs & deep-dives ๐Ÿ‘‰ @lmsysorg
๊ฐ€์ž… May 2025
53 ํŒ”๋กœ์ž‰ ์ค‘    9.5K ํŒฌ
SGLang-Diffusion with VDN-H3 now generates 14.4s of 768p video in just 9.0s ๐Ÿš€ On 8ร— B200, 8 step denoising takes just 6.9s, reaching over 2ร— real time. The 9.0s figure covers the full generation request after warmup. No measured quality regression versus dense 50-step H3 across 103 test prompts. ๐Ÿงต
๋” ๋ณด๊ธฐ