Part 3/5:
The discussion then shifts to the debate surrounding the pace of improvement in large language models. Sung acknowledges the reports suggesting a slowdown in the rate of progress, but he sees this as a positive in some ways. He argues that the tech giants, such as Google and Amazon, are investing in AI infrastructure for their long-term relevance, even if the immediate return on investment (ROI) is not immediately apparent.
Sung suggests that the focus on ROI is a valid concern, but there are other factors at play, such as the cloud companies' desire to maintain their position as industry leaders. He believes that the continued investment in AI infrastructure is driven by the need for these companies to remain at the forefront of technological advancements.