Scaling the Internet Core William B. Norton Co-founder and Chief Technical Liaison Equinix, Inc. William B. Norton Co-founder and Chief Technical Liaison Equinix, Inc.

Perspective Practical: Application of technology Neutral Internet Exchanges Environment for Exploitation of Optical Efficiencies ISP Peering and Transit Massive Scaling of Content Environment for launching Next Generation Services Practical: Application of technology Neutral Internet Exchanges Environment for Exploitation of Optical Efficiencies ISP Peering and Transit Massive Scaling of Content Environment for launching Next Generation Services

Service Provider Scalability Position: The current service provider interconnection model does not scale well Service providers need solutions that provide: Control over bandwidth provisioning Choice of providers Efficient scaling Position: The current service provider interconnection model does not scale well Service providers need solutions that provide: Control over bandwidth provisioning Choice of providers Efficient scaling

NSFNET to Post-NSFNET Era Internet No Internet presentation complete without… BARRNet NWNet Sesqui NEARNet NyserNet Merit NCAR OarNet Regional NSFNET SDSC AT&T MCI Sprint UUNet ANS NWNet NyserNet Merit OarNet Regional NSFNET ( ) Regional Tech Meetings Performance & Operations Reporting & Coordination Routing & Network Planning Privatization (1994-Now) North American Network Operators Group (NANOG) Meetings NSFNET ( ) Regional Tech Meetings Performance & Operations Reporting & Coordination Routing & Network Planning Privatization (1994-Now) North American Network Operators Group (NANOG) Meetings

Internet Statistics 87.5% of all Internet statistics are made up Made Up Real Source: I made it up

Evolution of Interconnection Strategies Carrier Internet Exchanges Technologies: ATM, distributed (and colo) Network Access Points (NAPs) Technologies: FDDI (with colo) Congestion issues Direct (point-to-point) interconnections Technologies: N x OC-3, N x OC-12 Carrier Internet Exchanges Technologies: ATM, distributed (and colo) Network Access Points (NAPs) Technologies: FDDI (with colo) Congestion issues Direct (point-to-point) interconnections Technologies: N x OC-3, N x OC-12 OC-3=155Mbps, OC-12=622Mbps OC-48=2.5Gbps, OC-192=10Gbps OC-768=40Gbps OC-3=155Mbps, OC-12=622Mbps OC-48=2.5Gbps, OC-192=10Gbps OC-768=40Gbps

Direct Circuit ISP Interconnection Strategy Point-to-Point Circuits Regional interconnects Now: N x OC-12 Insufficient carrier bandwidth Carriers can’t provision fast enough No traffic aggregation efficiency Doesn’t scale well Point-to-Point Circuits Regional interconnects Now: N x OC-12 Insufficient carrier bandwidth Carriers can’t provision fast enough No traffic aggregation efficiency Doesn’t scale well UUUU GGGGAAAACCCCSSSS

Current Problems at the “Core” Time to provision services (9-18 months) Carrier ISPs Content (ASP, E*Com, hosting, etc.) Scaling at the Core Interconnection bandwidth (OC-12->OC-48->OC- 192) Transport (try and order an OC-12!) ISP Peering (exponential growth in users/traffic) ISP Transit (demand exceeds supply, choice) Content Peering (unicast streaming, content generation) Edge (DSL – AOL+) Time to provision services (9-18 months) Carrier ISPs Content (ASP, E*Com, hosting, etc.) Scaling at the Core Interconnection bandwidth (OC-12->OC-48->OC- 192) Transport (try and order an OC-12!) ISP Peering (exponential growth in users/traffic) ISP Transit (demand exceeds supply, choice) Content Peering (unicast streaming, content generation) Edge (DSL – AOL+)

Tools for Service Provider Scalability Application of Technology Dark Fiber Providers Control over provisioning of capacity WDM/DWDM Huge capacity into exchange Enabled Bandwidth Aggregation Efficiency Half filled pipes Collocated Content Providers Environment to exploit optical efficiencies Application of Technology Dark Fiber Providers Control over provisioning of capacity WDM/DWDM Huge capacity into exchange Enabled Bandwidth Aggregation Efficiency Half filled pipes Collocated Content Providers Environment to exploit optical efficiencies WDM=Wave Division Multiplexing, DWDM=Dense Wave Division Multiplexing S UUUU GGGG AAAA CCCC SSS Neutral Internet Business Exchange CP

Scaling of Interconnection Methods Traffic (Content, Peering, Transit) Exchange at OC-3 Cost Comparison of Interconnection Strategies $- $50,000 $100,000 $150,000 $200,000 $250,000 $300,000 $350,000 $400, # of participants Monthly Cost of Interconnection Direct Circuit Interconnection: Linear Exchange : Stepped Efficient Fiber Exchange:Linear Efficient

Future of the Internet Exchange Environment MarketPlace: Stratification of component operations, fast creation & provisioning of next generation packaged operations services MarketPlace: Stratification of component operations, fast creation & provisioning of next generation packaged operations services DSL Access Providers Dial-in Modem Operators Svcs USENET Svcs WebHost Svcs Search Engines Cache/Content Distribution Carrier Internet Service Provider Carriers Carrier Internet Service Provider Carrier Internet Service Provider Service Providers Internet Service Provider Wireless Access Svc Virtual ISP Sparing

Scaling Benefits of Neutral Co-location of Content and ISP Backbones Control Time to provision interconnect : 24 hours Scalability Bandwidth scalability into the exchange Bandwidth scalability within the exchange Choice Ease of multi-homing Open marketplace to buy/sell evolving services Stratification of the Internet service space Robust Interconnection Environment Control Time to provision interconnect : 24 hours Scalability Bandwidth scalability into the exchange Bandwidth scalability within the exchange Choice Ease of multi-homing Open marketplace to buy/sell evolving services Stratification of the Internet service space Robust Interconnection Environment

Summary Application of existing technology can scale the core Service provider tools include: Dark fiber service providers; WDM into Robust neutral exchange environment Fiber cross-connects within exchange Co-located content and multiple ISPs Leads to: Control, choice, scalability at the core Application of existing technology can scale the core Service provider tools include: Dark fiber service providers; WDM into Robust neutral exchange environment Fiber cross-connects within exchange Co-located content and multiple ISPs Leads to: Control, choice, scalability at the core