Interoperable Measurement Frameworks: Internet2 E2E piPEs and NLANR Advisor Eric L. Boyd Internet2 17 April 2019

Overview What is piPEs? Goals E2E piPEs Measurement Infrastructure Abilene Measurement Domain Federation of Measurement Infrastructures Hawaii Demo Overview MAGGIE Proposal Conclusions 4/17/2019

Internet2 E2E piPEs Project: End-to-End Performance Initiative Performance Environment System (E2E piPEs) Approach: Collaborative project combining the best work of many organizations, including DANTE/GEANT, EGEE, GGF NMWG, NLANR/DAST, UCL, Georgia Tech, etc. 4/17/2019

Goals Enable end-users & network operators to: determine E2E performance capabilities locate E2E problems contact the right person to get an E2E problem resolved. Enable remote initiation of partial path performance tests Make partial path performance data publicly available Interoperable with other performance measurement frameworks 4/17/2019

Measurement Infrastructure Components 4/17/2019

Deployed Measurement Infrastructure Deployment is an inside-out approach. Start with regularly scheduled tests inside, make sure it plays well with regularly scheduled tests outside. Hope that projects working on the end nodes will meet us in the middle. 4/17/2019

Measurement Software Components 4/17/2019

Abilene Measurement Domain Part of the Abilene Observatory: http://abilene.internet2.edu/observatory Regularly scheduled OWAMP and BWCTL Tests Web pages displaying: Latest results http://abilene.internet2.edu/ami/bwctl_status.cgi/now “Weathermap” http://abilene.internet2.edu/ami/bwctl_status_map.cgi/now Worst 10 Performing Links http://abilene.internet2.edu/ami/bwctl_worst_case.cgi/now Data available via web service: http://abilene.internet2.edu/ami/webservices.html 4/17/2019

Abilene Measurement Domain Insights Work in Progress, but for now, numbers are generally “Good Enough” If the “Ten Worst” is “Good Enough” then “It’s not the network.” If the “Ten Worst” is NOT “Good Enough” then “We have a problem Houston …” 4/17/2019

Establishing a Performance Measurement Mesh Issues include: Scheduling in the presence of scarce resources Making the tool bidirectional Adding security Ensuring correct source/target pairs BWCTL for Iperf 4/17/2019

Measurement Infrastructure Federation Why a Federation? Multiple measurement frameworks in existence and under development (piPEs, NLANR Advisor, NLANR AMP, etc.). No static “best practice” measurement framework is likely to emerge, given academics being academics. Future measurement frameworks can build on shoulders of current efforts, not feet. Performance Measurement Architecture Workshop (NSF Grant # ANI-0314723) 4/17/2019

Measurement Infrastructure Federation Interfaces 4/17/2019

Measurement Infrastructure Federation Requirements Agreement on Characteristic Names Access and Authentication Discovery (Measurement Nodes, Databases) Test/Data Request Schema Result Response Schema Inter-Framework Tests Resource Allocation Broker for Tools 4/17/2019

GGF Network Measurement Working Group Hierarchy of Network Performance Characteristics Request Schema Requirements and Sample Implementation Sample Response Schema Implementation 4/17/2019

Open Research Issues Access and Authentication Discovery of Measurement Nodes (“Super-Traceroute”) Discovery of Measurement Databases Inter-framework Testing 4/17/2019

E2E TAG: Hawaii Demo Challenge: Demonstrate end-to-end partial path analysis Demonstrate (partially) interoperable measurement domains and frameworks Create kernel for federation of measurement infrastructures 4/17/2019

Hawaii Demo Measurement Infrastructure 4/17/2019

NLANR Advisor GUI (during run) 4/17/2019

NLANR Advisor GUI (after run) 4/17/2019

MAGGIE Proposal Proposal to DOE. Involves Internet2, LBNL, SLAC, PSC, and UDel. Goals: Build a federation of measurement infrastructures. Deploy across network backbones (e.g. Abilene, ESnet, Ultralight) and research communities (Universities, labs, etc.). Share best practices among several measurement infrastructures (focus on filling missing pieces). 4/17/2019

Conclusions We can do partial path analysis, although making sense of the results is still a big issue. We can speak the same measurement language, although it’s still evolving. We are working together in growing numbers, but we need critical mass (become de facto standard) We need to be able to find each other. We need to be able to verify each other’s identity. 4/17/2019

4/17/2019