注册并分享邀请链接,可获得视频播放与邀请奖励。

Prime Intellect
@PrimeIntellect
Open Superintelligence Stack
加入 June 2020
44 正在关注    84.7K 粉丝
Our RL stack now supports NIXL weight transfer, reducing trainer-to-inference transfer time 9x compared with NCCL: from 86 seconds down to single-digit seconds for an 800B-parameter model, and even <4 seconds in our experiments. For prime-rl users, this means over 25% more throughput end-to-end compared with our previous speed. It also clears the way for fault-tolerant, elastic inference scaling that NCCL's rigid process groups made difficult.
显示更多
0
7
187
27
转发到社区