Supermicro Maxing Out AI
Vik Mayala of Supermicro taked about maxing out the AI infrastructure at the Ignite AI Infra event.
Vik Mayala of Supermicro taked about maxing out the AI infrastructure at the Ignite AI Infra event.
5th gen CPUs are going to 500 watts per chip and next gen GPUs are going to 1000 watts and beyond.
The AI training centers are going to 100k, 200k and 400k GPUs.
Supermicro was a primary vendor for the XAI Colossus 100K Nvidia H100 AI training center. This will add another 50,000 Nvidia H200s in the next few months.