注册并分享邀请链接,可获得视频播放与邀请奖励。

NVIDIA AI
@NVIDIAAI
Teaching your AI new tricks.
加入 June 2016
906 正在关注    362.7K 粉丝
Congrats @CoreWeave on RL Rollouts! RL post-training involves a lot of back and forth: train the model, generate responses, then train again. Inference workers need to load the updated model weights each time. As models get bigger, that can leave GPUs waiting. CoreWeave’s new service uses ModelExpress and Router in NVIDIA Dynamo to speed up those reloads with minimal downtime. Working with us and @youdotcom, CoreWeave achieved 15× faster model reloads compared with its baseline while post-training Nemotron 3.5 Lightning. Check out their blog below for details
显示更多
0
20
321
35
转发到社区