Decentralized AI tackles privacy issues
To train such a large model, the project would need “tens of thousands of GPUs in one place,” which wouldn’t be ideal. But to use a decentralized network of compute “you’d need a new technology that doesn’t exist today because all the distributed training techniques we have require very fast interconnect.” However, he added that emerging research from Deep Mind suggests it is possible.
You are viewing a single comment's thread from: