注册并分享邀请链接,可获得视频播放与邀请奖励。

Xinyu Zhang
@xinyzng
Scaling RL/Inference infra with @raydistributed backed by @anyscalecompute | Prev @LTIatCMU @Meta
加入 November 2023
1.1K 正在关注    903 粉丝
We stress tested Ray-2.58.0 for improvements on fault tolerance and reliability by scaling video data processing pipeline to caption 0.6 Petabytes of video data on 1600 Nvidia Blackwell GPUs in collaboration with @CoreWeave With the new release Ray Data shows: • 𝟲𝟬% higher throughput for streaming data processing • 𝟮𝟯% faster for batch inference • 𝟮𝟰% faster for Ray Data shuffle This will significantly improve how world model and physical AI companies handle pre-training data. Blog:
显示更多