There will be a total of around 1.2M Blackwells at Colossus 2 by end of year
Reply to @XFreeze: Elon Musk just gave a m | Hanami
There will be a total of around 1.2M Blackwells at Colossus 2 by end of year
Reply to @XFreeze: Elon Musk just gave a massive update on Colossus 2 in Memphis, and the scale of what's being built is absolutely insane
Two buildings already packed with GB300s, two more are coming online within weeks, and it is heading toward roughly 860,000 NVIDIA GB300s
Here's the breakdown:
• Macroharder: 220,000 GB300s, 800-gig NICs, configured for training
• Minihard: 220,000 GB300s, same training configuration
• Gun Range: 220,000 GB300s, tracking to be operational by the END OF NOVEMBER
• Spam: ~200,000 GB300s, configured for inference, targeting DECEMBER
That's roughly 860,000 GB300s across these four buildings
Spam is designed for inference, which needs much simpler networking and less than HALF the fiber of the training buildings. And yes, the building once housed Hormel products
Elon personally walked the entire Colossus 2 site around midnight and again the next morning to check progress
Building by building, SpaceXSI is assembling SI compute at a speed no one else on Earth can match
Quoted @elonmusk: Macroharder and Minihard both have 220k GB300s with 800 gig nics configured for training. Gun Range will have the same. Spam (used to house Hormel products) will have ~200k GB300s, but configured for inference, so much simpler networking and less than half the fiber.
I walked the whole Colossus 2 site around midnight and again this morning.
Good progress by the SpaceX team and contractors. Gun Range is tracking to be operational by end of November and Spam in December.