Internet2 Network of the Future By Steve Corbató Director, Backbone Network Infrastructure Presented by Ana Preston Program Manager, International Relations CUDI Reunión de Otoño Guadalajara 13 November 2001 This is a general overview presentation about Internet2. Internet2 is a consortium, led by US universities, which is recreating the partnership among academia, industry and government that fostered today’s Internet in its infancy.

Internet2 Network of the Future Current state of Abilene Evolution of optical networking Next phase of Abilene Outline of talk today; recap of where Abilene is today, some background on the evolution of opt. Networking and the next phase for Abilene 1/16/2019

Abilene background & milestones Abilene is a UCAID project in partnership with Qwest Communications Nortel Networks Cisco Systems Indiana University ITECs in North Carolina and Ohio Timeline Apr 1998: Project announced at White House Jan 1999: Production status for network Oct 1999: IP version of HDTV (215 Mbps) over Abilene Apr 2001: First state education network added Jun 2001: Participation reaches all 50 states & D.C. Nov 2001: Raw HDTV/IP (1.5 Gbps) over Abilene Partnerships are the foundation of how the Internet developed and they are also a part of the foundation of Internet2. 1/16/2019

Abilene focus Enabling innovative applications and services not possible over the commercial Internet Advanced service efforts Multicast IPv6 QoS Measurement Security DDoS detection efforts (Arbor Networks & Asta Networks) 1/16/2019

Abilene status – November, 2001 IP-over-SONET (OC-48c) backbone 54 direct connections 3 OC-48c (2.5 Gbps) connections 22 will connect via at least OC-12c (622 Mbps) by year end 200+ primary participants All 50 states, District of Columbia, & now Puerto Rico 15 regional GigaPoPs support ~70% of participants 37 sponsored participants 15 state education networks (SEGPs) Collaboration of sponsoring member universities and Abilene connectors 1/16/2019

- also note that recently added POP in Chicago. RED DOTS indicate GigaPOPS where international peering is taking place. Currently 8 out of 12 are. - also note that recently added POP in Chicago. 1/16/2019

Over 200 participants. Covering pretty much all US universities and research centers. Landprint also involves all 50 states, including Hawaii and Alaska. Plus Puerto Rico 1/16/2019

International peering Transoceanic R&E bandwidths growing! Key international exchange points facilitated by Internet2 membership and the U.S. scientific community STARTAP  STAR LIGHT – Chicago Pacific Wave – Seattle AMPATH – Miami New York City – EP under development CUDI - CENIC and Univ. of Texas at El Paso International transit service -- Pacific WAVE : new name for Pacific Northwest GigaPOP international services: providing Gigabit transport services for those entering into the US. EP: Exchange Point 1/16/2019

StarLight (UIC/Northwestern/Argonne) StarLight is an advanced optical infrastructure and proving ground for network services optimized for high-performance applications -- Point out: Major investment (major facility) made by UIC, Northwestern University and Argonne National Laboratory. -- Important international peering: NORDUnet, SURFnet, and many more. CAnet4 coming up very shortly 710 N. Lake Shore Drive, Chicago Abbott Hall, Northwestern University Chicago view from 710 Source: Tom DeFanti, UIC 1/16/2019

Measurement and DDoS Traffic characterization (Ohio ITEC) Network utilization by SEGPs and Abilene ITN Abilene Scavenger Service policing GigaPoP pair hotspot identification Passive measurement Planned for Indy router backbone links Collaboration with SDSC Distributed Denial of Service detection Strong IU Global NOC interest Asta Networks (UCSD/U of Washington roots) Arbor Networks (U of Michigan/Merit roots) Data privacy and anonymity policy Important concerns to us/Abilene: -- Scavenger: less-than-best effort “labeling” qos Re. Data Privacy and anonymity: sensitive to this. 1/16/2019

Network of the Future: Context for the next backbone Computational science as an emerging interdisciplinary field Bandwidth and distributed sensing capability as the next critical parameters Complement CPU, memory & storage Increasingly distributed data collection and storage NSF Distributed Terascale Facility solicitation Emergence of optical technologies Dense Wave Division Multiplexing (DWDM) Important distinction: optical transport vs. switching Much new transcontinental conduit and fiber in place; a lot of business plans abandoned… Glut of fiber & conduit – but not bandwidth Drivers: - Science and science becoming more “digitized” and distributed. Eg. Distributing sensors, instruments. The network taking more relevant . DTF: see next slide Amplifying challenges over long gistances. Glut of fiber and conduit – lots of fiber on the ground but lighting it more costly, particularly at national – long distance – scale. 1/16/2019

TeraGrid Wide Area Network - NCSA, ANL, SDSC, Caltech StarLight International Optical Peering Point (see www.startap.net) Abilene Chicago DTF Backplane (4x: 40 Gbps) Indianapolis Urbana Los Angeles DTF: project funded by US NSF. To connect four key research centers/sites: SDSC, CalTech, Argonne Nat. Lab, and NCSA via 4 lambas adding to a total capacity of 40 Gbps (provisioning for this) Dedicated bandwidth for specific high performance applications. Explanation of dashed lines: St. Louis: State of Illinois fiber between St. Louis and Chicago will be connected to I-WIRE by November 2001. This fiber will terminate at 900 Walnut Street-- the Switch Data Services carrier collocation facility in St. Louis (location of St. Louis Gigapop). In Chicago the State of Illinois fiber will connect both directly to Argonne (which will serve as one of the State’s repeater/opto-electronic equipment hubs) and to the James R. Thompson Center downtown. I-WIRE fiber connects the James R. Thompson Center to the Starlight hub via the Qwest POP. Indianapolis: We are working with Indiana University to obtain fiber either to Urbana or Chicago. We have preliminary pricing and expect at least a pair of fiber to be available by Summer 2002 if not before. Starlight / NW Univ San Diego UIC I-WIRE Multiple Carrier Hubs Ill Inst of Tech OC-48 (2.5 Gb/s, Abilene) ANL Multiple 10 GbE (Qwest) Univ of Chicago Indianapolis (Abilene NOC) Multiple 10 GbE (I-WIRE Dark Fiber) NCSA/UIUC Solid lines in place and/or available by October 2001 Dashed I-WIRE lines planned for summer 2002 Source: Charlie Catlett, Argonne 1/16/2019

DWDM system components Multiplexing terminals 80-160 ’s per fiber pair Amplifiers All optical (OO) Needed every ~100 km Regenerators OEO – electronic signal processing Long haul (LH): needed every ~500 km Ultra long haul (ULH): needed only every ~2500+ km Organizational scale correspondence (LH) Metro (campus): no amplifiers Regional (GigaPoP): no regenerators National (backbone): regenerators or ULH needed Ren explain DWDM 3 important components: 1) multiplexing terminals (at the ends/edges). 2) amplifiers: needed every 100 km or so. More tightly spaced. 3) regenerators: needed every 500 km. ULH: every 2500 km (new systems – from transoceanic links) cost still coming down Organizational correspondence: campus (can do dark fiber) metro area, no amplifiers needed. Region: could be a state, need amplifiers but may not need regenerators. Larger/national: need regenerators. Bigger ultrahaul needed. 1/16/2019

Current state of optical networking Dense Wave Division Multiplexing (DWDM) Current systems can support >160 10-Gbps ’s (1.6 Tbps!) Optical growth can overwhelm Moore’s Law (routers) Costs scale dramatically with distance Three possible scenarios for the future Enhanced IP transport (higher BW and circuit multiplicity) Fine-grained traffic engineering p2p links between campuses, HPC centers, & Gigapops Physical manifestation of switched circuits (a la ATM SVCs) Evolution of optical switching will be critical Leading international efforts in R&E exploration The Netherlands, Canada, STAR LIGHT (Chicago) Optical gain over electronics gain. Longer you go, more it costs Where is it going: 3 possible scenarios: 1) just upgrading/enhancing IP transport 2) combination of ip and dedicated capacity (lamba provisioning) for specific purposes. Requires traffic engineering 3) a la ATM (a few years ago) with switched virtual circuits. Still can’t happen until cost goes down on optical switches. 1/16/2019

National optical networking options 1 - Incremental wavelengths Provision 10-Gbps ’s from provider(s) in the same way that SONET circuits are done for Abilene now Exploit smaller incremental cost of additional ’s 2 - Dim Fiber Acquisition of fiber IRU and subsequent O&M agreement for inter-PoP services (amps, regens, DWDMs?) National footprint of 1-2 fiber pairs IRU would cost $10-20M Most likely awaits the development of lower-cost optical transmission equipment 1/16/2019

Future of Abilene Original UCAID/Qwest MoU amended on October 1, 2001 Extension of Qwest’s original commitment to Abilene for another 5 years – 10/01/2006 Originally expired March, 2003 Upgrade of Abilene backbone to optical transport capability - ’s x4 increase in the core backbone bandwidth OC-48c SONET (2.5 Gbps) to 10-Gbps DWDM Capability for flexible provisioning of ’s to support future point-to-point experimentation & other projects 1/16/2019

Key aspects of the next backbone IPv6 Running natively concurrently with IPv4 Replicate multicast deployment strategy Motivations Resolving IPv4 address exhaustion issues Preservation of the original End-to-End Architecture International collaboration Router and host capabilities Close collaboration with Internet2 IPv6 Working Group Network resiliency MPLS/TE fast reroute or IP-based IGP fast convergence Opportunity for new measurement capabilities Support of End-to-End Performance Initiative 1/16/2019

Next generation network deployment October, 2001: Detailed technical design starts February, 2002: PoP upgrades start deployment in three phases April, 2002 – Phase 1 October, 2002 – Phase 2 April, 2003 – Phase 3 October 2003 - Completion of 10-Gbps upgrade 1/16/2019

Detailed technical design process Qwest  service characterization Interface selection: OC-192c POS likely 10GE WAN/LAN PHY interesting alternatives Next generation router selection 10-Gbps interface selection Native v6 routing and high-performance forwarding Existing features: high-performance v4, ASM/SSM multicast & flow characterization IPv6 coordination & planning 1/16/2019

Network design overview Overall next generation topology is expected to be very similar to current design Previous iterations to router locations Washington DC, Chicago, Sunnyvale, Houston Some differences expected due to Qwest DWDM deployment Expect same number of backbone routers 1/16/2019

Optical fanout Next generation architecture: Regional & state based optical networking projects are critical Three-level hierarchy: backbone, GigaPoPs, campuses CENIC ONI, I-WIRE, SURA Crossroads, Indiana, Ohio Collaboration with the Quilt Regional Optical Networking project Carrier DWDM access is now not nearly as widespread as with SONET circa 1998 1/16/2019

The Quilt A UCAID project support regional advanced networking initiatives 15 charter GigaPoPs EDUCAUSE and SURA Quilt GigaPoPs support over 70% of Abilene participants Initial projects Commodity Internet Services Regional Optical Networking Measurement Led by Wendy Huntoon (Pittsburgh SC) 1/16/2019

Conclusions Abilene partnership with Qwest extended through 2006 Backbone to be upgraded to 10-Gbps in three phases by late 2003 Capability for flexible  provisioning in support of future experimentation in optical networking Overall approach to the new technical design and business plan is for an incremental, non-disruptive transition 1/16/2019

For more information Web: www.internet2.edu/abilene E-mail: abilene@internet2.edu 1/16/2019

www.internet2.edu