"The dataset, even highly compressed and still 30 TB, took a few months to be transferred from Brazil to Australia!"
Wow thats pretty... bad. We have 2017 where you can get residential internet with 1gb/s upload so real transfer at 100mb/s so you can transfer 30TB in around 83 hours. Few months is pretty bad result. :/
You are viewing a single comment's thread from:
Truly, but that's what they said it took. Not sure how horrible internet access these universities and research centers has though :)
It's possible they were doing excessive redundancy checks to verify the integrity of each packet, which hypothetically could double or triple transfer time. Then they may have had to keep it throttled back to save bandwidth for all other needs. This is probably the big one here.