Super Computing 2016 Salt Lake City, Utah Nov 15, 2016 Creating new opportunities for U.S.-Latin America research and education collaborations through the development of an intercontinental 100G optical network infrastructure Julio Ibarra, PI Heidi Morgan, Co-PI Donald Cox, Co-PI Jeronimo Bezerra, Chief Network Engineer Florida International University

Outline AmLight Express and Protect Project Anticipated Challenges Science Challenges motivating 100G

U.S.-Latin America 100G network link

AmLight Express and Protect (AmLight-ExP) AmLight-ExP is a project (2015-2020) of the National Science Foundation Award# ACI-1451018 AmLight-ExP builds upon the achievements of the AmLight project (2010-2015) Award# ACI-0963053 Introduces spectrum capacity between the U.S. and Brazil Continues evolving a rational network infrastructure, using both spectrum and leased capacity

AmLight-ExP Today 100G Miami-São Paulo, Atlantic 100G Miami-São Paulo, Pacific 4x10G links, landings in São Paulo, Fortaleza, Santiago 240G of aggregate bandwidth capacity 100G ring to include Santiago and Fortaleza in November 2016

AmLight-ExP Future AmLight Express: AmLight Protect: 300GHz of spectrum: Miami-São Paulo, São Paulo-Santiago Spectrum to be configurable by RENs to meet user/application requirements AmLight Protect: 100G leased capacity ring Miami, São Paulo, Santiago, Panama City, Miami AMPATH, Southern Light, REUNA, and RedCLARA operated Fortaleza as a South Atlantic Crossroads EulaLink submarine cable from Fortaleza to Portugal SACS submarine cable to Angola (Q3 2018) CBCS submarine cable to Cameroon (Q4 2017) 680G+ bandwidth capacity

Anticipated Challenges Integration of spectrum with existing 100G network services Multi-domain optical provisioning and network management Network virtualization and SDN applications

Integration of Spectrum with existing 100G network services What multi-link protection approach to implement to mutual redundancy involving both spectrum and leased capacity? How to extend the current SDN environment to manage the optical layer? Evaluating SDN and packet optical integration What other questions can be added to this slide? How the SDN environment can manage both the packet layer and optical layer, while simultaneously managing and operating AmLight-ExP resources in an integrated fashion. Reducing the manual interventions.

Multi-domain Optical Provisioning Challenges How to establish the end-to-end path across multiple optical domains? Is “domain-based” regeneration necessary? How to coordinate spectral width and frequency requirements across optical domains? How can channels be modeled and supported across domains with varying optical power and signal to noise requirements? Can super-channel capabilities be leveraged? There are other challenges as well Super channels combine two or more channels. It results in an increase in amplitude. It’s done to support technologies that cannot work in a single channel, such as 400GHz. Can the interconnected optical networks be protected from one another?

Network Virtualization and SDN Applications How to evolve to newer control plane protocols, for example, from OF 1.3 to OF 1.4, and so on? How to evolve the current SDN infrastructure to manage the underlying optical network? How to support multiple testbeds alongside a production network (security and operational perspective) in a scalable fashion? What are the challenges involving Network Virtualization and SDN Applications?

Science Challenges motivating 100G What are the science challenges for 100G? Ultra-High Definition Video Streaming Astronomy Large Synoptic Survey Telescope (LSST) Atacama Large Millimeter Array (ALMA) Dark Energy Camara (DECam) Distributed High-Throughput Computing Pierre Auger Observatory GridUNESP LHC Open Network Environment (LHCONE) Large-scale Testbed Networks SDN and Future Internet

Ultra-High Definition (UHD) Video Streaming UHD video includes 4K UHD (8.3 Mpixels) and 8K UHD (33.2 Mpixels) 4K uncompressed, 60 frame/s, 12Gbps 8K uncompressed, 60 frame/s, 48Gbps For the World Cup, 8K compressed was transmitted over 10Gbps connections NTT, NHK, RNP, CLARA, Florida LambdaRail, Internet2, AmLight collaboration

Astronomy: Large Synoptic Survey Telescope (LSST) 8.4 meter large aperture, ground based telescope Located in the Andes mountains of northern Chile Continuously will scan the southern hemisphere 6.4GB images will be created every 17 seconds Each image will be transferred to NCSA within 4 seconds Requires 80-100Gbps

Distributed High-Throughput Computing refers to a distributed computing environment that delivers large amounts of computational power over a long period of time Distributing and Sharing computational resources Pierre Auger observatory detection of ultra-high energy cosmic rays Malargue, Argentina GridUNESP, Super Computing Center in Sao Paulo, and Open Science Grid (OSG), USA

Conclusion AmLight Express and Protect is Implementing a scalable network infrastructure that interconnects North America to key aggregation points in South and Central America (Brazil, Chile, Panama) Evolving into a reliable, flexible and efficient research and education network infrastructure underpinned by the integration of spectrum and leased capacity Facilitating effective peering between RENs and communities of interest through a distributed exchange model Meeting the requirements of science applications Facilitate outreach to researchers and network operators

Thank You! NSF OpenWave, AmLight, OSDC-PIRE, CC-NIE, CC*IIE, AMPATH, AtlanticWave infrastructure, science application support, education, outreach and community building efforts are made possible by funding and support from: National Science Foundation (NSF) awards ACI-1451018, ACI-1451024, ACI-1440728, ACI-0963053, ACI-1140833, ACI-1246185, ACI-1341895 FAPESP, ANSP – grant no. 2008/52885-8 Rede Nacional de Ensino e Pesquisa (RNP) CLARA Association of Universities for Research in Astronomy (AURA) Florida International University Latin American Research and Education community The many national and international collaborators who support our efforts