Register and share your invite link to earn from video plays and referrals.

AI at Meta
@AIatMeta
We're building the future of personal superintelligence to help people create, connect, and achieve more in life.
Joined August 2018
371 Following    876.9K Followers
We trained our Muse foundational models, including Muse Wonder, at Prometheus, our gigawatt-scale supercluster in New Albany, Ohio. Across a supercluster with hundreds of thousands of GPUs, even one underperforming host can slow an entire training run. We engineered Prometheus for resilience at scale, achieving 85%+ goodput on pretraining, 90%+ on reinforcement learning and ~47K GPU hours mean time between interruptions during Muse Wonder training. Take a look at the tech powering Prometheus:
Show more
0
173
4K
320
Forward to community