Part 4/7:
Reflecting on recent advancements in AI, Robert highlights the significant improvements in generative AI since the introduction of Transformer models in 2019. These models represent a major leap forward in the capabilities of AI, allowing for impressive applications in language processing and beyond. However, a plateau in breakthrough innovations has been observed, with the next few years expected to be characterized by incremental, rather than revolutionary changes.
The excitement surrounding generative AI peaked around the time ChatGPT was made widely accessible, drawing public attention. Despite this, many within the scientific community focused heavily on methodologies rather than practical applications, which has since shifted as the commercial viability of AI has become apparent.