T.Sharon-A.Frank 1 Internet Resources Discovery (IRD) Internet/WWW Technical Background Thanks to Miki Even-Haim and Yoram Dahan

2 T.Sharon-A.Frank Measuring the Web "When you can measure what you are speaking about, and express it in numbers, you know something about it; but when you cannot express it in numbers, your knowledge is of a meager and unsatisfactory kind; it may be the beginning of knowledge, but you have scarcely in your thoughts advanced to the state of science." - Lord Kelvin

3 T.Sharon-A.Frank Internet/WWW Statistics Internet Size & Growth Population Sizes Various Activities Web Size & Growth Web Pages and Formats

4 T.Sharon-A.Frank The Domain Survey The Domain Survey attempts to discover every host (i.e., uniquely reachable connected computers) on the Internet by doing a complete search of the Domain Name System. The latest results gathered during late Jan 2001 are listed, together with Mark Lottor’s work in this area over many years. For more information see RFC 1296; for more data see the archive site at the Internet Software Consortium, Beginning with the January 1998 survey, Lottor began using a new method of doing the survey to avoid the increasing blocking of DNS zone transfers. This method of querying the DNS for known IP address is explained at It is not backward compatible with the old results. The old and the new data is juxtaposed in these trends graphs with dotted lines.

5 T.Sharon-A.Frank Internet Domain Survey Host Count

6 Internet Hosts New survey data Adjusted old survey data

7 Internet Hosts - Overall Trend Projected Historical

8 T.Sharon-A.Frank Trends in Internet Hosts The figure of 109 million hosts represents a significant new benchmark for the number of Internet hosts. The current annual growth rate now stands at 51%, within the % rates seen over the past 2 years. It shows continued strong exponential growth, with the 100 million host barrier being crossed in late If the same growth rate is sustained, the Internet would cross the 1 billion host mark in mid The Internet is now expanding at the rate of 63 new hosts and 11 new domains per minute worldwide.

9 T.Sharon-A.Frank Total domains registered Total domains registered worldwide: 33,293,791 International (COM):23,121,005 International (EDU): 6,708 International (GOV):1,269 International (NET):4,343,150 International(ORG):2,671,279 United Kingdom (CO.UK):3,150,380

10 T.Sharon-A.Frank Where the Internet hosts are by domain (Jan 2000)

11 T.Sharon-A.Frank Where the Internet hosts are by domain (Jan 2001)

12 Hosts: Large Three-Letter Domains

13 T.Sharon-A.Frank Trends in Domains Growth The largest domain is COM, jumping 7.8 million hosts since January 2000 to a new high of 36.3 million hosts. That represents a current annualized growth rate of 32%. As a percentage of the entire Internet, the COM host count stayed about the same at 33.2% of all Internet hosts. The number of hosts in the NET domain - which is heavily used by ISPs for dialup customers - remained the fastest growing of all the large domains, expanding at an annual growth rate of 45% to 30.8 million hosts.

14 T.Sharon-A.Frank Internet/WWW Statistics Internet Size & Growth Population Sizes Various Activities Web Size & Growth Web Pages and Formats

15 T.Sharon-A.Frank Netizens

16 T.Sharon-A.Frank Internet Users around the Globe Source:

17 T.Sharon-A.Frank Internet Users Statistics Source:

18 T.Sharon-A.Frank Top 20 Countries in Internet Usage

19 T.Sharon-A.Frank US Internet Users by Age

20 T.Sharon-A.Frank European Internet Users by Age

21 T.Sharon-A.Frank US Internet Users by Gender

22 T.Sharon-A.Frank European Internet Users by Gender

23 T.Sharon-A.Frank Internet/WWW Statistics Internet Size & Growth Population Sizes Various Activities Web Size & Growth Web Pages and Formats

24 T.Sharon-A.Frank Language populations Source: Global reach

25 T.Sharon-A.Frank US Internet Users by Income 1998

26 T.Sharon-A.Frank Number of surfers vs. computer holders

27 T.Sharon-A.Frank Operations done by Americans on the Internet

28 T.Sharon-A.Frank Leading Search Engines (by entries)

29 T.Sharon-A.Frank Internet/WWW Statistics Internet Size & Growth Population Sizes Various Activities Web Size & Growth Web Pages and Formats

30 T.Sharon-A.Frank Number of Web Sites

31 T.Sharon-A.Frank Number of Web Sites 1997: 1,570, : 2,851, : 4,882, : 7,399, : 8,745,000

32 T.Sharon-A.Frank Number of Unique Web Sites* 1998: 2,636, : 4,662, : 7,128, : 8,443,000 * If a site is located at multiple IP addresses, the site is retained in the sample only if the numerically lowest IP address is in the sample.

33 T.Sharon-A.Frank Types of Unique Web Sites PublicPrivateProvisional 1998:1,457,000315,000864, :2,229,000790,0001,643, :2,942,0001,494,0002,692, :3,119,0002,078,0003,246,000 Public: Offers content that is freely accessible to the general public. Private: Offers restricted access to content: for example, via fee payment or prior authorization. Provisional: Is in a transitory or unfinished state (e.g., “under construction”).

34 T.Sharon-A.Frank Growth of Unique Web Sites Sites: 457%82%71%52%18% Unique Sites: N/a 77%53%18% Public Sites: 290%82%53%32%6%

35 T.Sharon-A.Frank Web Pages Statistics (1) Note: all numbers below (source data: "Accessibility of Information on the Web“) refer to publicly indexable web pages; publicly indexable web pages exclude pages that are not normally considered for indexing by web search engines, such as pages with authorization requirements (including firewalls), pages excluded from indexing using the robots exclusion standard, dynamic pages, etc; 12/97 : At least 320 million pages; 02/98 : 2.8 million servers on the publicly indexable web; 289 average pages per server; 800 million publicly indexable web pages; 18.7 kilobytes is the mean size of a page; 3.9 kilobytes is the median size of a page;

36 T.Sharon-A.Frank Web Pages Statistics (2) 02/99: –7.3 kilobytes average size of textual content per page (after removing HTML tags, comments and extra white space); –0.98 kilobytes median size of the textual content; –15 terabytes of pages is the amount of data on the web; –6 terabytes is the amount of text data; –62.8 images per web server; –15.2 Kbytes - average image size; –5.5 Kbytes - median image size; –180 million images on the publicly indexable web; –3 terabytes - total amount of image data;

37 T.Sharon-A.Frank Web Pages Statistics (3) As of 7/5/2000, the web has roughly: –2,170,000,000 pages; –40,800,000,000,000 bytes of text; –489,000,000 images; –8,160,000,000,000 bytes of image data; In the last 24 hours, the web added: –4,420,000 new pages; –82,800,000,000 new bytes of text; –994,000 new images; –16,600,000,000 new bytes of image data; –49,400,000 pages changed; –11,100,000 images changed; Average life span of the web page: 44 days;

38 T.Sharon-A.Frank Internet/WWW Statistics Internet Size & Growth Population Sizes Various Activities Web Size & Growth Web Pages and Formats

39 T.Sharon-A.Frank Number of Web Pages

40 T.Sharon-A.Frank Growth of the Internet in Pages

41 T.Sharon-A.Frank What is the "average page" like?

42 T.Sharon-A.Frank Embedded Image Count

43 T.Sharon-A.Frank What data formats are being used?

44 T.Sharon-A.Frank More data formats being used

45 T.Sharon-A.Frank References Internet Domain Survey – Online Computer Library Center – UCLA Center for Communication Policy – Network Facts – Internet Statistics – Domain Statistics –