註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

AI at Meta
@AIatMeta
We're building the future of personal superintelligence to help people create, connect, and achieve more in life.
加入 August 2018
371 正在關注    876.9K 粉絲
We trained our Muse foundational models, including Muse Wonder, at Prometheus, our gigawatt-scale supercluster in New Albany, Ohio. Across a supercluster with hundreds of thousands of GPUs, even one underperforming host can slow an entire training run. We engineered Prometheus for resilience at scale, achieving 85%+ goodput on pretraining, 90%+ on reinforcement learning and ~47K GPU hours mean time between interruptions during Muse Wonder training. Take a look at the tech powering Prometheus:
顯示更多
0
173
4K
320
轉發到社區