To put this in perspective, suppose GPT-4 training took 3 months. In 2027, a leading AI lab will be able to train a GPT-4-level model in a minute. The OOM effective compute scaleup will be dramatic.
You are viewing a single comment's thread from:
To put this in perspective, suppose GPT-4 training took 3 months. In 2027, a leading AI lab will be able to train a GPT-4-level model in a minute. The OOM effective compute scaleup will be dramatic.