Chinese company 01.ai built an AI rival to GPT-4 using 2,000 GPUs and $3M
This shows that smart engineering beats big budgets almost always.
Lots of AI companies startup up, they'll have to be smart to compete otherwise big budget will win
You are viewing a single comment's thread from:
This is how things are going. We are seeing less compute required to build models that were "state of the art" just 6 months ago.
and what would you think the solution should be?
You talked about spatial intelligence do you think this will be the next direction I'll they'll find a way to directly fix the compute problem
Spatial is a different concept. It is real world, 3D learning. That will require robots and such. LLMs reside and learn from text, video, and images, all 2D media.
I imagine spatial will require more compute in the early days. There is a lot of data that will be flowing through, mostly video.
i agree that the data will be mostly videos. Infact the only reason AI videos have dominated AI images is because AI video generators are not as common and advanced yet but they will be