CSU - DCE Webmaster I Scaling Issues - Fort Collins, CO Copyright © XTR Systems, LLC Web Site Scaling Issues (or Size Really Does Matter) Instructor: Joseph DiVerdi, Ph.D., M.B.A.

CSU - DCE Webmaster I Scaling Issues - Fort Collins, CO Copyright © XTR Systems, LLC Web Site Size Issues This is a short presentation with one theme: –Provide some concrete examples of web sites of widely differing size Helps to understand how various components vary with traffic rate It's unlikely that this year's web site will be be the same as next year's web site

CSU - DCE Webmaster I Scaling Issues - Fort Collins, CO Copyright © XTR Systems, LLC Sample Site Configurations Low Volume –0.01 Hits per Second –<1,000 Hits per Day –Can Be Run Out of the Home –Old Intel (386, 486) Hardware ($<200) –Linux ($0) –Apache ($0) –DSL or Cable Modem (0.5 Mbps) (<$100/month) –Flat-file or Perl hash as Database (<1,000 items) –mySQL Relational Database (>1,000 items)

CSU - DCE Webmaster I Scaling Issues - Fort Collins, CO Copyright © XTR Systems, LLC Sample Site Configurations Low Volume – Hits per Second –1,000-10,000 Hits per Day –Can Be Run Out of the Home –Old Intel (586) Hardware ($200) –Linux 2.0 ($0) –Apache ($0) –DSL or Cable Modem (0.5 Mbps) (<$100/month) –Flat-file or Perl hash as Database (<1,000 items) –mySQL Relational Database (>1,000 items)

CSU - DCE Webmaster I Scaling Issues - Fort Collins, CO Copyright © XTR Systems, LLC Sample Site Configurations Medium Volume – Hits per Second –10,000-1,000,000 Hits per Day –Sun Ultra Workstation ($6,000) –Separate Disks for Content, Logs, & Swap space –RAID Disks Speed Optimized and/or Auto Backup –Linux 2.4 and Apache ($0) –T1 Line (1.544 Mbps) ($1,000/month) –Oracle Relational Database ($10,000)

CSU - DCE Webmaster I Scaling Issues - Fort Collins, CO Copyright © XTR Systems, LLC Sample Site Configurations High Volume - Sun Microsystems, Inc. –24 Hits per Second –2,000,000 Hits per Day –Two UltraServer 1/170 systems 167 MHz UltraSPARC processor 256 MB RAM SPARCstorage disk array –Solaris 2.6 OS –Netscape Enterprise/2.01 server –T3 Connection (45 Mbps) to BBN –Internally connected by 100 Mbps Ethernet

CSU - DCE Webmaster I Scaling Issues - Fort Collins, CO Copyright © XTR Systems, LLC Sample Site Configurations Very High Volume - AltaVista –200 Searches (Not Hits) per Second –20,000,000 Searches per Day –Query Interface: 3 Digital AlphaStation 500/500 –1GB RAM, 6 GB Disk, Running DEC Unix –Search Engine: 16 Digital AlphaServer /440 –12 64-bit CPUs, 8GB RAM, 300 GB RAID Disk –Several T3 Connections (≈250 Mbps, total) –5 Worldwide Mirror Sites

CSU - DCE Webmaster I Scaling Issues - Fort Collins, CO Copyright © XTR Systems, LLC Sample Site Configurations Really High Volume Netscape Communications Inc. –1,600 Hits per Second –135,000,000 Hits per Day –More Than 100 servers Representing Every Major Hardware Manufacturer –Four T3 lines in Palo Alto Internally connected by 100 Mbps FDDI –Substantial Mirrors in Europe and Australia

CSU - DCE Webmaster I Scaling Issues - Fort Collins, CO Copyright © XTR Systems, LLC Sample Site Configurations Modest Volume XTR Systems, LLC –0.01 Hits per Second –1,000 Hits per Day –Run Out of the Home Office –Old (486) Hardware ($0) –Linux ($0) –Apache ($0) –DSL (0.5 Mbps) (<$100/month) –Flat-file or Perl hash as Database ($0) –mySQL Relational Database ($0)