Elon Musk on how xAI built Colossus in 122 days after data center providers quoted 18 to 24 months:
"How were we able to get the world's most powerful training cluster operational within 122 days?"
"We went to the data center providers and said, how long would it take to have 100,000 GPUs operating coherently in a single location? And we got time frames from 18 to 24 months. ... So the only option was to do it ourselves."
"Nobody had ever done a liquid cooling data center at scale."
"So to buffer the power, we then used Tesla Megapacks to smooth out the power."
@elonmusk at the Grok 3 launch livestream, February 17, 2025
Now Colossus 2 is headed for around 1.2 million Blackwells by the end of this year.
Video:
@xai @Tesla @elonmusk