1. Interoperable Measurement Frameworks: Internet2 E2E piPEs and NLANR Advisor
Eric L. Boyd
Internet2
17 April 2019

2. Overview What is piPEs? Goals E2E piPEs Measurement Infrastructure
Abilene Measurement Domain
Federation of Measurement Infrastructures
Hawaii Demo Overview
MAGGIE Proposal
Conclusions
4/17/2019

3. Internet2 E2E piPEs
Project: End-to-End Performance Initiative Performance Environment System (E2E piPEs)
Approach: Collaborative project combining the best work of many organizations, including DANTE/GEANT, EGEE, GGF NMWG, NLANR/DAST, UCL, Georgia Tech, etc.
4/17/2019

4. Goals Enable end-users & network operators to:
determine E2E performance capabilities
locate E2E problems
contact the right person to get an E2E problem resolved.
Enable remote initiation of partial path performance tests
Make partial path performance data publicly available
Interoperable with other performance measurement frameworks
4/17/2019

5. Measurement Infrastructure Components
4/17/2019

6. Deployed Measurement Infrastructure
Deployment is an inside-out approach. Start with regularly scheduled tests inside, make sure it plays well with regularly scheduled tests outside. Hope that projects working on the end nodes will meet us in the middle.
4/17/2019

7. Measurement Software Components
4/17/2019

8. Abilene Measurement Domain
Part of the Abilene Observatory:
Regularly scheduled OWAMP and BWCTL Tests
Web pages displaying:
Latest results
“Weathermap”
Worst 10 Performing Links
Data available via web service:
4/17/2019

9. Abilene Measurement Domain Insights
Work in Progress, but for now, numbers are generally “Good Enough”
If the “Ten Worst” is “Good Enough” then “It’s not the network.”
If the “Ten Worst” is NOT “Good Enough” then “We have a problem Houston …”
4/17/2019

10. Establishing a Performance Measurement Mesh
Issues include:
Scheduling in the presence of scarce resources
Making the tool bidirectional
Adding security
Ensuring correct source/target pairs
BWCTL for Iperf
4/17/2019

11. Measurement Infrastructure Federation
Why a Federation?
Multiple measurement frameworks in existence and under development (piPEs, NLANR Advisor, NLANR AMP, etc.).
No static “best practice” measurement framework is likely to emerge, given academics being academics.
Future measurement frameworks can build on shoulders of current efforts, not feet.
Performance Measurement Architecture Workshop (NSF Grant # ANI )
4/17/2019

12. Measurement Infrastructure Federation Interfaces
4/17/2019

13. Measurement Infrastructure Federation Requirements
Agreement on Characteristic Names
Access and Authentication
Discovery (Measurement Nodes, Databases)
Test/Data Request Schema
Result Response Schema
Inter-Framework Tests
Resource Allocation Broker for Tools
4/17/2019

14. GGF Network Measurement Working Group
Hierarchy of Network Performance Characteristics
Request Schema Requirements and Sample Implementation
Sample Response Schema Implementation
4/17/2019

15. Open Research Issues Access and Authentication
Discovery of Measurement Nodes (“Super-Traceroute”)
Discovery of Measurement Databases
Inter-framework Testing
4/17/2019

16. E2E TAG: Hawaii Demo Challenge:
Demonstrate end-to-end partial path analysis
Demonstrate (partially) interoperable measurement domains and frameworks
Create kernel for federation of measurement infrastructures
4/17/2019

17. Hawaii Demo Measurement Infrastructure
4/17/2019

18. NLANR Advisor GUI (during run)
4/17/2019

19. NLANR Advisor GUI (after run)
4/17/2019

20. MAGGIE Proposal Proposal to DOE.
Involves Internet2, LBNL, SLAC, PSC, and UDel.
Goals:
Build a federation of measurement infrastructures.
Deploy across network backbones (e.g. Abilene, ESnet, Ultralight) and research communities (Universities, labs, etc.).
Share best practices among several measurement infrastructures (focus on filling missing pieces).
4/17/2019

21. Conclusions
We can do partial path analysis, although making sense of the results is still a big issue.
We can speak the same measurement language, although it’s still evolving.
We are working together in growing numbers, but we need critical mass (become de facto standard)
We need to be able to find each other.
We need to be able to verify each other’s identity.
4/17/2019

22. 4/17/2019