Archiving the Web?

[ANADRILL]

How many terrabytes do you think it would take to archive 75-80% of the web's content?

[Jeff350]

Well you got me wondering how big the internet really is:

http://www.wisegeek.com/how-big-is-the-internet.htm

According to this article, the CEO of Google estimated the size of the internet at 5 million Terrabytes.

[J]

5 exabytes

[Zundfolge]

According to this article, the CEO of Google estimated the size of the internet at 5 million Terrabytes.

Does that include duplicated files?

[Ranger]

Of 5 exabytes, 4.9 is porn

[scratchy]

No matter how big it is, tomorrow it will be bigger. 5 exabytes will seem exceedingly small in 2 years.

[vim]

You talking one snapshot or something like www.archive.org's Wayback Machine?

[Ronin13]

Of 5 exabytes, 4.9 is porn

From some figures I saw, actually the internet is not as much porn as we once imagined... something in the area of (really shocking here it comes) 6-10%. Now the source I cite for that (Here) states that it's a nearly impossible task to try and figure out exactly how much of the billions of web addresses in the interwebz is adult content, but think about how many websites out there are recently added due to the blogging epidemic (?) and you have to imagine that about 1% of the internet is social media, so despite being in the area of >10%, that's really a huge amount of stuff!