Part 2/6:
The interview highlights how OpenAI's access to significant computing power, combined with its conviction, has been a crucial factor in its success. This approach, while seen as reckless by some, has paid off, as OpenAI has transformed from a "tiny startup almost a joke" to a driving force in the AI landscape.
The Discovery of the Unsupervised Sentiment Neuron
One of the key moments discussed in the interview is the discovery of the "unsupervised sentiment neuron" by Alec Ratford, a researcher at OpenAI. This seemingly small detail sparked the development of the GPT series, which has had a profound impact on the field of AI.