注册并分享邀请链接,可获得视频播放与邀请奖励。

SGLang
@sgl_project
Run LLMs fast at any scale 🔗 Join our community For AI tech blogs & deep-dives 👉 @lmsysorg
加入 May 2025
53 正在关注    9.5K 粉丝
SGLang v0.5.20 landed! Welcome @intel XPU to join standard SGLang releases 🎉 Some of our favorite updates: - RL sampling masks make rollouts more reliable, with up to 52% faster decode - Unified Radix Tree adds SWA branching-point caching: ~20pt higher cache hit rate, ~1/3 lower TTFT - DSpark now supports PD + DCP for long-context serving - SGLang Simulator brings scheduler & cache experiments to CPU - ROCm model loading is up to 12.5× faster - SGLang-Diffusion gets up to ~38% lower E2E latency New models include GLM-5.3-Flash, Qwen3.8-Flash-Next, K2 Horizon, Hy4-Preview, FastH3, VDN-H3, and more. Full release notes👇
显示更多
0
7
107
21
转发到社区