Internet2 Spring Member Meeting Tutorial: Internet2 101 Advanced Services and End-to-End Performance Russ Hobby This is a general overview presentation about Internet2. Internet2 is a consortium, led by US universities, which is recreating the partnership among academia, industry and government that fostered today’s Internet in its infancy. 11 April 2019

Outline Original Internet2 Intents and Reasons What we have done What we have discovered Changes in direction based on what we have learned 4/11/2019

Original Reasons for Advanced Services in Internet2 Commercial Internet could not deliver what researchers wanted Eliminate the network as a limitation for applications Re-create the sharing environment to test and develop new capabilities Transfer new technologies to the larger Internet 4/11/2019

Provide Reliable Performance Across the Network Implement Quality of Service (QoS) capabilities from Source to Destination Create a coordinated bandwidth reservation system Let applications determine the level they need Allow resource control and accounting Provide “Bandwidth Overkill” until QoS is available 4/11/2019

Support efficient “one-to-many” and “few-to-few” applications Internet2 video broadcast Support effective video conferencing Allow shared use of common data The solution: Multicast 4/11/2019

Create an National Network for Technology Development 4/11/2019

Test New Protocols and Capabilities New Network Equipment New Link Technologies Complex Routing Measurement Techniques IPv6 4/11/2019

What We Have Tried Creating a National Network for Development Implementing wide-spread Multicast Trials of QoS across the Network Tests and Training of IPv6 4/11/2019

We learned from all the experiences! What We Have Learned Some ideas have worked Some ideas are more complex than expected Some had to go back to the drawing board Some had a change in direction We learned from all the experiences! 4/11/2019

High Capacity Development Networks They Enable New Applications 4/11/2019

High Capacity Development Networks Enable New Applications Many good Demonstrations Real Time Application can now work Transfers of Large Datasets Provide the Test Bed for New Technologies Packet over Sonet New Measurement Techniques Allows sharing of Ideas and Results 4/11/2019

Multicast Robust Multicast Deployment Can Be Done 4/11/2019

Any problem can be made harder by Multicast It is hard for Operations to understand how well Multicast is running. Beacons are up now to help. It is more difficult for Applications to use. New methods for joining Multicast Groups have been developed (SSM). Any problem can be made harder by Multicast 4/11/2019

QoS Abilene Premium Service failed to get off the ground It is a complex system that needs many parts before it can work. Some key part were not implemented for high speed links. Premium Service requires all parts of the end-to-end path to participate and coordinate. This is against the current Internet operating model. Allocation models for who gets Premium Service need a lot more work. Trials are going on with Scavenger Service Low Priority Best Effort Service 4/11/2019

IPv6 Set up a National Backbone Established Hands-on Training Workshops 4/11/2019

What Did Not Work QoS was too hard to implement at this time Even with High Bandwidth available, researchers often did not see the expected performance. WHY? The End-to-End Performance Initiative (E2Epi) was create to figure this out. 4/11/2019

The Wizard Gap 4/11/2019

Hey, this is not working right! A Problem Hey, this is not working right! Others are getting in ok Not our problem Applications Developer Applications Developer LAN Administrator LAN Administrator Talk to the other guys System Administrator Everything is AOK System Administrator Campus Networking Campus Networking The computer Is working OK No other complaints Looks fine Gigapop Gigapop All the lights are green How do you solve a problem along a path? Backbone We don’t see anything wrong The network is lightly loaded 4/11/2019

True End-to-End Experience User perception Application Operating system Host IP stack Host network card Local Area Network Campus backbone network Campus link to regional network/GigaPoP GigaPoP link to Internet2 national backbones International connections EYEBALL APPLICATION STACK JACK NETWORK . . . 4/11/2019

Good Work Already Going On Many projects and research is underway by others investigating performance on portions of the end-to-end path. E2Epi seeks to bring these efforts together to look at the end-to-end path as a complete system. 4/11/2019

Areas of E2Epi Applications Host/OS Tuning Measurement Infrastructure Performance Improvement Environment (PIE) Operations and Human Communications Performance Evaluation and Review Framework (PERF) 4/11/2019

Applications Work with specific application communities to help solve their performance problems. High Energy Physics Medical Sciences – Visible Human Project Use a few key, general purpose applications for performance testing. FTP Video Conferencing 4/11/2019

Host/OS Tuning Web100 has a leading role Provide Best Practices for getting the most from your computer. Locate or build tools for Host/OS performance diagnostics. Work with computer vendors on Internet2 Performance Packages. 4/11/2019

Measurement Infrastructure Bring together current measurement efforts and projects in the community. Establish an End-to-End Measurement Infrastructure from the intersection of these works. Create diagnostic tools to determine the health of the network and locate performance problems. 4/11/2019

Standard Operational Info Applications Developer Applications Developer Ops Info Ops Info LAN Administrator LAN Administrator System Administrator System Administrator Campus Networking Ops Info Ops Info Campus Networking Ops Info Ops Info Ops Info Ops Info Gigapop Gigapop Information from All Parts of the Network Ops Info Backbone 4/11/2019

Standard Operational Info End-to-End Analyzer Applications Developer Applications Developer Ops Info Ops Info LAN Administrator LAN Administrator System Administrator System Administrator Campus Networking Ops Info Ops Info Campus Networking Ops Info Ops Info Ops Info Ops Info Gigapop Gigapop Know the Health of the Network Ops Info Backbone 4/11/2019

Standard Operational Info Apps Tuning End-to-End Analyzer Applications Developer Applications Developer Ops Info Ops Info LAN Administrator LAN Administrator System Administrator System Administrator Campus Networking Ops Info Ops Info Campus Networking Ops Info Ops Info Ops Info Ops Info Gigapop Gigapop Applications Adapt to the Network Ops Info Backbone 4/11/2019

Performance Improvement Environment (PIE) Develop a dynamic environment where collaboration and information sharing will happen. Identify, collect and disseminate appropriate information for end-to-end related information. Include success stories,measurement statistics, reference materials, measurement tool documentation. Include pointers to materials already developed by other communities. 4/11/2019

E2Epie – Activities Collecting stories. Using interviews and other channels we will begin collecting stories about performance improvement issues. We will work with EDUCAUSE Effective Practices and Solutions database for publishing the E2Epi stories. Identify and collect information about projects, resources, and tools. With help of Technical Advisory Group and other E2Epi participants we will make sure to have up-to-date and correct information. Explore resources and tools for collaboration efforts. Discussion forum: http://e2edev.internet2.edu/discus/ 4/11/2019

Operations and Human Communications Establish communications among common interest groups System administrators LAN administrators Campus NOCs GigaPoP Application support staff Establish communications between groups for operations and problem resolution. 4/11/2019

Groups of Common Interest I don’t know how to solve this problem! I do! I do! Applications Developer Applications Developer LAN Administrator LAN Administrator System Administrator System Administrator Campus Networking Campus Networking Gigapop Gigapop Backbone Provide a means of communications Let them share experiences. 4/11/2019

Can You Go Direct to the Problem? How can you tell where is the problem? Need a tool to tell you: Where the problem is. The type of problem Who to contact to get it fixed Terry Gray, University of Washington “We Need a Finger Pointing Tool” 4/11/2019

Gray Finger Pointing Tool Finger Pointing Tool Time! Applications Developer Applications Developer LAN Administrator LAN Administrator System Administrator System Administrator Campus Networking Campus Networking Gigapop Gigapop Locate the Problem Gray Finger Pointing Tool Terry Gray University of Washington Backbone 4/11/2019

Gray Finger Pointing Tool Finger Pointing Tool Time OK, I’ll fix it Applications Developer Applications Developer LAN Administrator LAN Administrator You ARE the Weakest Link! System Administrator System Administrator Campus Networking Campus Networking Gigapop Gigapop Backbone 4/11/2019

E2E piPES E2E piPES will establish a measurement system and provide contact information when there appears to be a problem Campus X Abilene PMP Gigapop S Regional Network M PMP PMP PMP Host A PMP Host B PMP E2Epi need input on how to make this work. There are operational and policy issues here. piPES Test Analysis Looks like a problem In Gigapop T. Pass these test result to: Joe@gigapopT.net Campus Y PMP PMP PMP Regional Network J Gigapop T The test results obtained by the End-User will be passed on to the contact person 4/11/2019

Performance Evaluation and Review Framework (PERF) Establish a framework for resolving performance problems Provide known solutions by using the PIE Tap community knowledge by facilitating group communications Coordinate a team of experts to solve hard problems 4/11/2019

The Hard Problems Hey, Its is not working again! What if no Others are getting in ok I don’t know Applications Developer Applications Developer LAN Administrator LAN Administrator No clue here System Administrator I’m stumped System Administrator Campus Networking Campus Networking I don’t know what is wrong This is strange I am Cluefully Challenged Gigapop Gigapop Doh! What if no one has the answer? Backbone We can’t figure it out Need a Tiger Team of Experts to Research the Problem It looks normal here 4/11/2019

Partners Campuses Faculty and discipline communities GigaPoPs International partners NSF-sponsored engineering efforts NLANR, www.nlanr.net Web100 Project, www.web100.org Internet2 corporate members Federal labs and agencies 4/11/2019

Peer-to-Peer and Grid Systems Peer-to-Peer (P2P) and Grid Systems are global computers that use the network as the computer backplane End-to-End Performance can greatly affect their usability. P2P is a developing area that will affect and be affected by E2Epi 4/11/2019

Network Security Initial Internet Premise: Security belongs on the end-system Development of security capabilities has been slow. Devices have been put into the network to try to help Firewalls, NAT boxes, Filters These often impede Applications. Network devices themselves need to be protected 4/11/2019

4/11/2019