Moving forward, Noah Giansiracusa, an associate professor of mathematics at Bentley University in Waltham, Massachusetts, said AI models will continue to improve, but the hypergrowth in recent years is unsustainable:
"We got very excited for a brief period of very fast progress. That just wasn't sustainable."
If tech firms are struggling to advance LLM performance, this raises serious doubts about whether large investments can continue to be made in AI infrastructure.