Part 2/4:
Colossus boasts over 100,000 Nvidia HGX H100 GPUs, connected with exabytes of data storage and a super-fast network. Nvidia CEO Jensen Huang has described Colossus as "easily the fastest supercomputer on the planet." This massive computing power is dedicated to training Gro, an AI model that Elon Musk and xai hope to evolve into something far more capable than a simple chatbot.
The Innovative Design
The Colossus facility is designed with a unique "raised floor data hall" configuration, which splits the system into three levels: power above, cooling below, and the GPU cluster in the middle. This modular design allows for easy maintenance and servicing, with each GPU rack being individually serviceable without shutting down the entire system.