Google helps terabyte data swaps

Not open for further replies.


Google is developing a program to help academics around the world exchange huge amounts of data.

The firm's open source team is working on ways to physically transfer huge data sets up to 120 terabytes in size.

"We have started collecting these data sets and shipping them out to other scientists who want them," said Google's Chris DiBona.

Google sends scientists a hard drive system and then copies it before passing it on to other researchers.

Data delays

It hopes that one day the data it helps to swap will be available to the public.

Mr DiBona, open source program manager at Google, said the team was inspired by work done by Microsoft researcher Jim Grey, who delivered copies of the Terraserver mapping data to people around the world.

The one terabyte of image data in the set was too large to send over a computer network.

"I wished people were doing that for biology, genetic research and antiquities research," said Mr DiBona.



Yellow Belt
That is interesting. I used to be a business analyst for the NHS. Our backup system used to backup close to a terrabyte of data a night but had to stage it first as the tape gobbler couldnt keep up with the speed. Even with a massive SAN used for staging it still took almost 24 hours to complete a backup.
Not open for further replies.