Jeff Boote, Eric L. Boyd, Rich Carlson, Hyungseok Chung Pipefitters BOF Jeff Boote, Eric L. Boyd, Rich Carlson, Hyungseok Chung 4 December 2018

Pipefitters BOF BWCTL: Bandwidth Control (Jeff Boote) Building a Measurement Framework: Request and Response Schemas (Eric Boyd) “Detective”: Integrating NDT and E2E piPEs (Rich Carlson) Wise* Trafview: Flow-based Measurement and Analysis System (Hyungseok Chung) 12/4/2018

Building a Measurement Framework: Request and Response Schemas Eric L. Boyd, Internet2 Reporting on GGF NMWG Activities 4 December 2018

GGF Network Measurement Working Group Hierarchy of Network Performance Characteristics Request Schema Requirements and Sample Implementation 12/4/2018

Network Performance Characteristics Sub-WG Les Cottrell, SLAC Richard Hughes-Jones, University of Manchester Thilo Kielmann, Vrije Universiteit Bruce Lowenkamp, College of William and Mary Martin Swany, University of Delaware Brian Tierney, LBNL 12/4/2018

Hierarchy of Network Performance Characteristics Standard set of network characteristics Network classification hierarchy Useful for Grid applications and services Facilitates portability of all measurements actually taken Submitted to GGF http://www-didc.lbl.gov/NMWG/docs/draft-ggf-nmwg-hierarchy-02.pdf 12/4/2018

Terminology Network characteristics are the intrinsic properties of a portion of the network that are related to the performance and reliability of the network. Measurement methodologies are the means and methods of applying those characteristics An observation is an instance of the information obtained by applying the measurement methodology. 12/4/2018

Relationship between Terms 12/4/2018

Describing a Network Measurement Two Elements: Characteristic being Measured Network Entity that the Measurement Describes Nodes Paths 12/4/2018

Relationship between Node and Path Network Entities 12/4/2018

Characteristics GGF Discovery and Monitoring Event Descriptions (DAMED) WG <entity type>.<characteristic>.<sub-characteristic> Examples path.delay.oneway path.loss.oneway path.bandwidth.achievable 12/4/2018

Subset of Characteristics 12/4/2018

Network Topology Representation End-to-end are the common case of host-to-host measurements Links between between routers and switches are frequently measured for capacity, availability, latency, and loss Nodes may report useful information such as router queue discipline or host interface speed Physical vs. Functional Topologies Nodes: Hosts, Internal Nodes, Virtual Nodes 12/4/2018

GGF Network Measurement Working Group Hierarchy of Network Performance Characteristics Request Schema Requirements and Sample Implementation 12/4/2018

Request Schema Sub-Working Group Mark Leese, Daresbury Laboratory Nicolas Simar, DANTE Loukik Kudarimoti, DANTE Jeff Boote, Internet2 Eric Boyd, Internet2 Matt Zekauskas, Internet2 Dan Gunter, LBNL Tanya Brethour, NLANR/DAST Paul Mealor, University College London Warren Matthews, Georgia Tech 12/4/2018

Test / Data Request and Response Protocol 12/4/2018

Request Schema Requirements Document: http://www.gridmon.dl.ac.uk/nmwg/request_schema_requirements-01b.rtf Schema and Examples: http://www.hep.ucl.ac.uk/~pdm/nmwg/ XML Spy Documentation http://www.hep.ucl.ac.uk/~pdm/nmwg/Dante-NM-WG-RequestSchema2-docs/#element_NetworkMeasurementRequest_Link028220C0 12/4/2018

What: Measurement/Metric Info Use DAMED-style name One characteristic / message Possible to request multiple statistical data Extensible to unsupported statistical data Number of Results (Positive real number or “all”) 12/4/2018

Where: Source and Destination Information Flexible, allow Hostnames IP Addreses (IPv4 and IPv6) Aliases (e.g. “edge router”), if alias file known to source and destination Source Address info required 12/4/2018

When: Time Information (1) Target Time Target Time (Absolute Time or “now”) Relative negative and positive time tolerances Negative time tolerance can be (“infinity”) Time Interval Give Start & End Time Target Time = Start Time Negative Time Tolerance = 0 Positive Time Tolerance = End Time – Start Time Max # Results = “all” Absolute Time Seconds since 1970, XML type, or NTP timestamp) 12/4/2018

When: Time Information (2) Evaluate “now” as late as possible Testing Interval to Control Timing of Tests Specified in Seconds, accurate to microsecond granularity 12/4/2018

How: Test Parameters (1) Allow either: NMWG-style Predefined Tags <packetTypeParam>TCP</packetTypeParam> Or: Allow Command-Line Tool Parameters <sourceParameterString>-c –p 501</sourceParameterString> <destParameterString>-s –w 1024k</destParameterString> 12/4/2018

How: Test Parameters (2) Maintain Parameter Order Employ Receiving System Parameter Defaults Reject Requests if Required Parameter Cannot be Supported Ability to Request Measurement Parameters Ability to Set Ranges and Preferential Order for Tool Parameters 12/4/2018

Other (Non-)Requirements Desirable: Ability to add Custon Tags Non-Requirements: Ability to query monitoring and data publishing capabilities What network monitoring data available? What tools are available? What are tool versions? What parameters can be used with tools? 12/4/2018

Request Schema Example http://www.hep.ucl.ac.uk/~pdm/nmwg/2004-01-08-Dante-NM-WG-RequestSchema2-examples/Dante-NM-WG-RequestSchema2-demo-Iperf.xml 12/4/2018

Conclusions Consensus emerging on network measurement characteristic definitions Test/Data Request and Response Schemas in “Alpha” Form Future work includes: Abstracting commonalities between request and response schemas into an inherited schema Intermediate schemas Full-blow “Grid Service” (including Discovery, AA) 12/4/2018

12/4/2018