2 gigawatts of compute power might seem small when considering OpenAI’s potential 36 GW footprint, but xAI trained the very capable Grok 4 on just a little over one GW’s worth of Nvidia chips.
The plan is to expand Colossus to house at least 1 million GPUs, Reuters reports, and adds that the new data center is close to a natural gas plant that xAI is building in the area.
The name of the building will be MACROHARDRR, according to Elon Musk.
Read more: Bloomberg (paywalled), and Reuters. Musk’s tweet.