注册并分享邀请链接,可获得视频播放与邀请奖励。

SGLang
@sgl_project
Run LLMs fast at any scale 🔗 Join our community For AI tech blogs & deep-dives 👉 @lmsysorg
加入 May 2025
53 正在关注    9.5K 粉丝
Congrats to the Halo team (@whitecircle) on the launch! 🎉 SGLang powers Halo rollouts as the primary engine. It runs in an isolated serving environment, returning token IDs, logprobs, and MoE routing to the trainer, with weights synced over NCCL and generation overlapped across servers. Excited to partner with the Halo team!
显示更多
Halo is not limited to supervised fine-tuning. It supports async RL and training with external environments. We are excited to partner with the @sgl_project team to make it the primary engine for rollouts.
显示更多