註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

SGLang
@sgl_project
Run LLMs fast at any scale 🔗 Join our community For AI tech blogs & deep-dives 👉 @lmsysorg
加入 May 2025
53 正在關注    9.5K 粉絲
Congrats to the Halo team (@whitecircle) on the launch! 🎉 SGLang powers Halo rollouts as the primary engine. It runs in an isolated serving environment, returning token IDs, logprobs, and MoE routing to the trainer, with weights synced over NCCL and generation overlapped across servers. Excited to partner with the Halo team!
顯示更多
Halo is not limited to supervised fine-tuning. It supports async RL and training with external environments. We are excited to partner with the @sgl_project team to make it the primary engine for rollouts.
顯示更多