Nvidia describes Spectrum-X as the world’s first ethernet networking platform for generative AI.
Theoretically, with Nvidia’s help, the combined Colossus array could eventually achieve about 497.9 exaflops (497,900,000 teraflops). This would set a new benchmark in supercomputing power and make Grok the most impressive AI chatbot on the planet.