註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Prime Intellect
@PrimeIntellect
Open Superintelligence Stack
加入 June 2020
44 正在關注    84.7K 粉絲
Our RL stack now supports NIXL weight transfer, reducing trainer-to-inference transfer time 9x compared with NCCL: from 86 seconds down to single-digit seconds for an 800B-parameter model, and even <4 seconds in our experiments. For prime-rl users, this means over 25% more throughput end-to-end compared with our previous speed. It also clears the way for fault-tolerant, elastic inference scaling that NCCL's rigid process groups made difficult.
顯示更多
0
7
187
27
轉發到社區