Byron Hsu
@hsu_byron
가입 November 2017
2K 팔로잉 중 6.3K 팬
Happy to contribute a fast and correct RL sampling mask from @periodiclabs, developed jointly with @nanjiangwill @agarwl_ and now running in our production RL pipeline!
SGLang v0.5.20 landed! Welcome @intel XPU to join standard SGLang releases 🎉
Some of our favorite updates:
- RL sampling masks make rollouts more reliable, with up to 52% faster decode
- Unified Radix Tree adds SWA branching-point caching: ~20pt higher cache hit rate, ~1/3 lower TTFT
- DSpark now supports PD + DCP for long-context serving
- SGLang Simulator brings scheduler & cache experiments to CPU
- ROCm model loading is up to 12.5× faster
- SGLang-Diffusion gets up to ~38% lower E2E latency
New models include GLM-5.3-Flash, Qwen3.8-Flash-Next, K2 Horizon, Hy4-Preview, FastH3, VDN-H3, and more.
Full release notes👇
더 보기
