2007-02-15: How many websites exist? How big is the World Wide Web? Since no one is in charge of the World Wide Web, the question is difficult to answer precisely. After all, there is no one central "server" that runs all the websites in the world. The DNS registrars have lists of the domain names that exist, but not every domain contains a website, many domains contain more than one, and the registrars are not under any obligation to tell the rest of us exactly how many domains their databases contain.
So what can be done to measure the size of the World Wide Web? Has anyone tried? Yes! The Netcraft Web Server Survey is a widely respected survey that attempts to contact each and every website that is accessible on the Internet.
Netcraft's primary goal is to determine web server market share: what percentage of websites run Microsoft's Internet Information Server, versus the Apache web server? But fortunately for us, they also count the websites visited by their automatic web-exploring "spider" software. And in February 2007, the Netcraft Web Server Survey found 108,810,358 distinct websites.
Of course, Netcraft's survey isn't perfect - there may be websites in the world that were not discovered by Netcraft's software. So, as of this writing, "there are more than 108 million websites" is the most accurate statement that can be made.
"But how many web pages are there?"
Large websites can have many thousands of pages. Dynamically generated sites can have a seemingly infinite number - and we must somehow agree not to count all of these. Yet most sites just have a few pages introducing a business or a person, or simply a placeholder home page.
Who could possibly tell us how many web pages there are? There are two obvious candidates: Google and Yahoo, the major search engine companies. Visiting, analyzing and indexing the billions of web pages in the world is their business. Unfortunately, neither company currently publicizes the exact size of its index and they have not done so since August 2005.
Is there anything we can do to arrive at a realistic estimate at the number of pages on the web? Yes: we can look at those August 2005 web page numbers, divide them by Netcraft's count of web sites in August 2005, and arrive at an estimated number of web pages per site. Assuming that the number of web pages per site has not changed drastically in a year and a half, we can then multiply Netcraft's February 2007 count of websites to arrive at a reasonable projection of the number of web pages in in the world as of February 2007.
So let's run the numbers!
Web pages in the world, August 2005: 19.2 billion pages were indexed by Yahoo as of August 2005.
Websites in the world, August 2005: 70,392,567 websites were indexed by Netcraft as of August 2005.
Web pages per website: 273 (rounding to the nearest whole number).
Web pages in the world, February 2007: multiplying our estimate of the number of web pages per website by Netcraft's February 2007 count of websites, we arrive at 29.7 billion pages on the World Wide Web as of February 2007.
Source
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment