Nov. 2010Geib/Morton/Fardid/Steinmitz / draft-ietf-metrictest-011 Testing Standards Track Metrics Draft-ietf-ippm-metrictest-01 Geib, Morton, Fardid, Steinmitz IETF-79 November 2010

Nov. 2010Geib/Morton/Fardid/Steinmitz / draft-ietf-metrictest-012 Draft-ietf-ippm-metrictest-01 Proposed definition of easy and difficult metrics to be tested  Frequency of events and temporal properties of impairment processes are to be respected by a metric test.  A frequent event produces one outcome helpful to capture a distribution of results (almost) per singleton. This is true for Delay, Delay Variation or capacity metrics. The proposed test allows comparisons of implementations.  A rare event produces infrequent outcomes helpful to capture a distribution of rates (these events are at least often charaterised by rates). Packet Loss and Duplication fit here. The proposed test allows comparisons of implementations.  Some rare events probably can’t be tested with implementations sending streams of different packet frequency (and may be sizes), like Loss Pattern or Reordering. The temporal properties of the impairment process impact the test. A suitable test set up requires further study.

Nov. 2010Geib/Morton/Fardid/Steinmitz / draft-ietf-metrictest-013 Draft-ietf-ippm-metrictest-01. Test set up comparison. Test Set UpEvaluation Single test lab, emulate the Internet or measure across the Internet. Causes travel cost, time consuming for one party. Remote test labs, emulate the Internet with identically configured impairment generators. Requires test specification and may introduce the impairment generator as additional source of error. Remote test labs, measure across the Internet. The same tunnel segments are passed by the separate measurements flows in different order. Only metrics capturing frequent events can be tested. Remote test labs, measure across the Internet and include a single impairment generator to be passed by the tunnel. The same tunnel segments are passed by the separate measurements flows in different order. Metrics capturing frequent and rare events can be tested.

Nov. 2010Geib/Morton/Fardid/Steinmitz / draft-ietf-metrictest-014 Draft-ietf-ippm-metrictest-01. New experimental set up avoiding Compare two implementations by a two site measurement configuration  That is an experiment, to be carried out as a diploma thesis.  Aim:prove IPPM standard compliance of the RIPE Test box and of Telekom’s Perfas (which is a self development only used internally).  Pro: Simple, an no equipment is moved. Con:The same L2TPv3 tunnel segments are passed in different order by the different implementations. VLAN 100 VLAN 101 VLAN 200 VLAN 201

Nov. 2010Geib/Morton/Fardid/Steinmitz / draft-ietf-metrictest-015 Draft-ietf-ippm-metrictest-01. Next steps.  Carry out the experiment of a complete metric test (not just ADK) and include reports in -02.  If the experiments validates the idea of metric test, finalise draft and go for last call.  We don’t want to worry about what do, if not.