Elon Musk just gave a massive update on Colossus 2 in Memphis, and the scale of what's being built is absolutely insane
Two buildings already packed with GB300s, two more are coming online within weeks, and it is heading toward roughly 860,000 NVIDIA GB300s
Here's the breakdown:
• Macroharder: 220,000 GB300s, 800-gig NICs, configured for training
• Minihard: 220,000 GB300s, same training configuration
• Gun Range: 220,000 GB300s, tracking to be operational by the END OF NOVEMBER
• Spam: ~200,000 GB300s, configured for inference, targeting DECEMBER
That's roughly 860,000 GB300s across these four buildings
Spam is designed for inference, which needs much simpler networking and less than HALF the fiber of the training buildings. And yes, the building once housed Hormel products
Elon personally walked the entire Colossus 2 site around midnight and again the next morning to check progress
Building by building, SpaceXSI is assembling SI compute at a speed no one else on Earth can match
顯示更多