1. Jeff Boote, Eric L. Boyd, Rich Carlson, Hyungseok Chung
Pipefitters BOF
Jeff Boote, Eric L. Boyd, Rich Carlson, Hyungseok Chung
4 December 2018

2. Pipefitters BOF BWCTL: Bandwidth Control (Jeff Boote)
Building a Measurement Framework: Request and Response Schemas (Eric Boyd)
“Detective”: Integrating NDT and E2E piPEs (Rich Carlson)
Wise* Trafview: Flow-based Measurement and Analysis System (Hyungseok Chung)
12/4/2018

3. Building a Measurement Framework: Request and Response Schemas
Eric L. Boyd, Internet2
Reporting on GGF NMWG Activities
4 December 2018

4. GGF Network Measurement Working Group
Hierarchy of Network Performance Characteristics
Request Schema Requirements and Sample Implementation
12/4/2018

5. Network Performance Characteristics Sub-WG
Les Cottrell, SLAC
Richard Hughes-Jones, University of Manchester
Thilo Kielmann, Vrije Universiteit
Bruce Lowenkamp, College of William and Mary
Martin Swany, University of Delaware
Brian Tierney, LBNL
12/4/2018

6. Hierarchy of Network Performance Characteristics
Standard set of network characteristics
Network classification hierarchy
Useful for Grid applications and services
Facilitates portability of all measurements actually taken
Submitted to GGF
12/4/2018

7. Terminology
Network characteristics are the intrinsic properties of a portion of the network that are related to the performance and reliability of the network.
Measurement methodologies are the means and methods of applying those characteristics
An observation is an instance of the information obtained by applying the measurement methodology.
12/4/2018

8. Relationship between Terms
12/4/2018

9. Describing a Network Measurement
Two Elements:
Characteristic being Measured
Network Entity that the Measurement Describes
Nodes
Paths
12/4/2018

10. Relationship between Node and Path Network Entities
12/4/2018

11. Characteristics
GGF Discovery and Monitoring Event Descriptions (DAMED) WG
<entity type>.<characteristic>.<sub-characteristic>
Examples
path.delay.oneway
path.loss.oneway
path.bandwidth.achievable
12/4/2018

12. Subset of Characteristics
12/4/2018

13. Network Topology Representation
End-to-end are the common case of host-to-host measurements
Links between between routers and switches are frequently measured for capacity, availability, latency, and loss
Nodes may report useful information such as router queue discipline or host interface speed
Physical vs. Functional Topologies
Nodes: Hosts, Internal Nodes, Virtual Nodes
12/4/2018

14. GGF Network Measurement Working Group
Hierarchy of Network Performance Characteristics
Request Schema Requirements and Sample Implementation
12/4/2018

15. Request Schema Sub-Working Group
Mark Leese, Daresbury Laboratory
Nicolas Simar, DANTE
Loukik Kudarimoti, DANTE
Jeff Boote, Internet2
Eric Boyd, Internet2
Matt Zekauskas, Internet2
Dan Gunter, LBNL
Tanya Brethour, NLANR/DAST
Paul Mealor, University College London
Warren Matthews, Georgia Tech
12/4/2018

16. Test / Data Request and Response Protocol
12/4/2018

17. Request Schema
Requirements Document:
Schema and Examples:
XML Spy Documentation
12/4/2018

18. What: Measurement/Metric Info
Use DAMED-style name
One characteristic / message
Possible to request multiple statistical data
Extensible to unsupported statistical data
Number of Results (Positive real number or “all”)
12/4/2018

19. Where: Source and Destination Information
Flexible, allow
Hostnames
IP Addreses (IPv4 and IPv6)
Aliases (e.g. “edge router”), if alias file known to source and destination
Source Address info required
12/4/2018

20. When: Time Information (1)
Target Time
Target Time (Absolute Time or “now”)
Relative negative and positive time tolerances
Negative time tolerance can be (“infinity”)
Time Interval
Give Start & End Time
Target Time = Start Time
Negative Time Tolerance = 0
Positive Time Tolerance = End Time – Start Time
Max # Results = “all”
Absolute Time
Seconds since 1970, XML type, or NTP timestamp)
12/4/2018

21. When: Time Information (2)
Evaluate “now” as late as possible
Testing Interval to Control Timing of Tests
Specified in Seconds, accurate to microsecond granularity
12/4/2018

22. How: Test Parameters (1)
Allow either:
NMWG-style Predefined Tags
<packetTypeParam>TCP</packetTypeParam>
Or:
Allow Command-Line Tool Parameters
<sourceParameterString>-c –p 501</sourceParameterString>
<destParameterString>-s –w 1024k</destParameterString>
12/4/2018

23. How: Test Parameters (2)
Maintain Parameter Order
Employ Receiving System Parameter Defaults
Reject Requests if Required Parameter Cannot be Supported
Ability to Request Measurement Parameters
Ability to Set Ranges and Preferential Order for Tool Parameters
12/4/2018

24. Other (Non-)Requirements
Desirable: Ability to add Custon Tags
Non-Requirements: Ability to query monitoring and data publishing capabilities
What network monitoring data available?
What tools are available?
What are tool versions?
What parameters can be used with tools?
12/4/2018

25. Request Schema Example
12/4/2018

26. Conclusions
Consensus emerging on network measurement characteristic definitions
Test/Data Request and Response Schemas in “Alpha” Form
Future work includes:
Abstracting commonalities between request and response schemas into an inherited schema
Intermediate schemas
Full-blow “Grid Service” (including Discovery, AA)
12/4/2018

27. 12/4/2018