注册并分享邀请链接,可获得视频播放与邀请奖励。

AI at Meta
@AIatMeta
We're building the future of personal superintelligence to help people create, connect, and achieve more in life.
加入 August 2018
371 正在关注    876.9K 粉丝
We trained our Muse foundational models, including Muse Wonder, at Prometheus, our gigawatt-scale supercluster in New Albany, Ohio. Across a supercluster with hundreds of thousands of GPUs, even one underperforming host can slow an entire training run. We engineered Prometheus for resilience at scale, achieving 85%+ goodput on pretraining, 90%+ on reinforcement learning and ~47K GPU hours mean time between interruptions during Muse Wonder training. Take a look at the tech powering Prometheus:
显示更多
0
173
4K
320
转发到社区