Register and share your invite link to earn from video plays and referrals.

SGLang
@sgl_project
Run LLMs fast at any scale 🔗 Join our community For AI tech blogs & deep-dives 👉 @lmsysorg
Joined May 2025
53 Following    9.5K Followers
Congrats to the Halo team (@whitecircle) on the launch! 🎉 SGLang powers Halo rollouts as the primary engine. It runs in an isolated serving environment, returning token IDs, logprobs, and MoE routing to the trainer, with weights synced over NCCL and generation overlapped across servers. Excited to partner with the Halo team!
Show more
Halo is not limited to supervised fine-tuning. It supports async RL and training with external environments. We are excited to partner with the @sgl_project team to make it the primary engine for rollouts.
Show more