AI models are trained only a few times to create and fine-tune them. But AI models can be called millions of times per month, so using more compute at inference will require more Nvidia chips deployed to customers.
"The market responded to R1 as in, 'oh my gosh, AI is finished,' that AI doesn't need to do any more computing anymore," Huang said in a pretaped interview last week. "It's exactly the opposite."
Jensen Huang, co-founder and chief executive officer of Nvidia Corp., during the opening ceremony of the Siliconware Precision Industries Co. (SPIL) Tan Ke Plant in Taichung, Taiwan, on Thursday, Jan. 16, 2025.