Testing Standards Track Metrics Draft-geib-ippm-metrictest-02 Testing Standards Track Metrics Draft-geib-ippm-metrictest-02 Geib, Morton, Fardid IETF-77 March 2010 Geib/Morton/ Hasslinger/Fardid / draft-geib-metrictest-02 Mar 2010
Autor / Thema der Präsentation Draft-geib-ippm-metrictest-02. Improved comprehensibility and straightened concepts. 13.08.2007 Autor / Thema der Präsentation Carol Davids provided an external review, Al Morton added an internal one. Improved editorial quality and English. Added example statistics, a reference on the Anderson Darling K-sample algorithm and a glossary. Completed suggested principles to compare a single metric implementation against the metric specification. Completed suggested principles to improve metric specification before promotion to standard. Removed discussion on statistics unless applied as part of Anderson Darling K-sample test. Added a figure on the tunnel scenario to clarify how to compare metric implementations under identical network conditions. Geib/Morton/ Hasslinger/Fardid / draft-geib-metrictest-02 Mar 2010
Autor / Thema der Präsentation Draft-geib-ippm-metrictest-02. Identical networking conditions for repeated measurements (logical). 13.08.2007 Autor / Thema der Präsentation Metric implementations will be operated in real networks. Metric compliance should be tested under live network conditions too. Identical networking conditions for multiple flows can be reached by: Setting up one or two tunnels to use an identical path for all measurement flows. Simultaneously measure with 5 or more flows per implementation. Ensure that the test set up doesn’t interfere with the metric measurement. Example: „repeating“ measurements under identical network conditions with a single implementation by measuring with two parallel flows. Metric Implement. A Instance 1 Metric Implement. A Instance 2 Tunnel termination 1 Tunnel termination 2 Internet Geib/Morton/ Hasslinger/Fardid / draft-geib-metrictest-02 Mar 2010
Autor / Thema der Präsentation Draft-geib-ippm-metrictest-02 Tunnels: Criteria and Possible Candidates 13.08.2007 Autor / Thema der Präsentation - must map packets of different interfaces onto the same tunnel, carrying an identical outer IP address/port for all packets. - easily accessible/commodity implementation - low operational overhead - reliable - low cost Candidates after an initial survey seem to be (ordered by best match to the above criteria): - IP in IP (RFC2003) - GRE - Ethernet PW Geib/Morton/ Hasslinger/Fardid / draft-geib-metrictest-02 Mar 2010
Autor / Thema der Präsentation Draft-geib-ippm-metrictest-02. Identical networking conditions for repeated measurements (physical). 13.08.2007 Autor / Thema der Präsentation Started to negotiate with a student to verify a metric test setup Realise an IP “Generic Route Encapsulation” tunnel. Utilise Ethertype 802.1Q (0x8100) transport to avoid local routing. Execute Anderson Darling K-sample test for two instances of one implementation. Geib/Morton/ Hasslinger/Fardid / draft-geib-metrictest-02 Mar 2010
Draft-geib-ippm-metrictest-02. Next steps. 13.08.2007 Autor / Thema der Präsentation Judging by the absent comments on the list, there’s no community interest in this draft (or it is felt to be perfect). If this isn’t an obstacle, the authors ask to promote this draft to WG status. Geib/Morton/ Hasslinger/Fardid / draft-geib-metrictest-02 Mar 2010