SGLang-Diffusion is a high-performance serving framework for diffusion models, designed for both large-scale offline generation and latency-sensitive real-time inference.
At PyTorch Conference North America 2026, Yihao Wang and Kevin Mi of
@RadixArk will present the design of
@sgl_project-Diffusion and the PyTorch-based inference optimizations behind it, including efficient request scheduling, memory management, batching strategies, and execution-path optimizations for diffusion pipelines.
Join us in San Jose, October 20-21: #
PyTorchCon#