1 Benchmarking Methodology WG (bmwg) 67th IETF – San Diego CA, USA Tuesday, November 7, 2006, 13:00-15:00 (Spinnaker) Chairs: –Al Morton – If you are not subscribed to the BMWG mailing list and would like to be, put a BIG asterisk (*) by your legibly- printed address when you sign the blue attendance sheet, or go to

2 BMWG Agenda (Any Bashing needed?) Note-Taker(s), Jabber, IPR (Yellow Sheet), Blue Sheets WG Status (Chairs, 10 min) – Standard Paragraph for Intro/Security Section Core Router Accelerated Stress Test I-Ds (Chair, 10 min) IPv6 Bechmarking (Hamza, 15 min) Sub-IP Protection Benchmarking (Le Roux, 15 min) Milestones Status (Chairs, 5 min) New Work (Chairs, 45 min, nominally 15 min each) –SIP Performance Benchmarking (Gurbani,Davids) –Multicast VPN Scalability (Dry) –Wireless LAN Switches and LAN Meshes (Perser, Alexander) –(not appearing this time): LDP Convergence (Papneja) MPLS Benchmarking Methodology (Akhter)

3 BMWG Activity AD/IESG Review, DISCUSS Rev I-Ds needed WG Last Call Comments ++ LAST-Last Call? Expired I-Ds draft-ietf-bmwg-ipsec-meth-01.txt need READERS Expired draft-popoviciu-bmwg-ipv6benchmarking-02.txt, good reviews draft-ietf-bmwg-protection-term-00.txt Need Readers draft-ietf-bmwg-protection-meth-00.txt Need Readers draft-ietf-bmwg-dsmmeth-02.txt No update for this meeting?

4 BMWG Activity New Work proposals. –draft-poretsky-sip-bench-term-01.txt <=Revised –draft-poretsky-bmwg-sip-bench-meth-00.txt <=New –draft-sdry-bmwg-mvpnscale-00.txt <=New –draft-akhter-bmwg-mpls-meth-01.txt <=Revised –draft-eriksson-ldp-convergence-03.txt –draft-not-written-yet-WLAN-Switches-00.xml Expected I-Ds – ?

5 BMWG Activity Expired BMWG I-Ds –, – Pending term RFC Editor – none. Charter Update –Meet the OLD Milestones, start new work. Supplementary BMWG Page –See New RFC: –4689 Terminology for Benchmarking Network-layer Traffic Control Mechanisms, Poretsky, Perser, Erramilli, Khurana

6 Standard “Paragraph” (intro/security) Benchmarking activities as described in this memo are limited to technology characterization using controlled stimuli in a laboratory environment, with dedicated address space and the constraints specified in the sections above. The benchmarking network topology will be an independent test setup and MUST NOT be connected to devices that may forward the test traffic into a production network, or misroute traffic to the test management network. Further, benchmarking is performed on a "black-box" basis, relying solely on measurements observable external to the DUT/SUT. Special capabilities SHOULD NOT exist in the DUT/SUT specifically for benchmarking purposes. Any implications for network security arising from the DUT/SUT SHOULD be identical in the lab and in production networks.

7 Current Milestones July 06 Hash and Stuffing I-D to AD Review Dec 2006 IPsec Device Benchmarking Terminology to AD Review Dec 2006IPsec Device Benchmarking Methodology to AD Review Dec 2006 Router Accelerated Test Terminology I-D to AD Review Dec 2006Router Accelerated Test Method. and Considerations I-Ds to AD Review Feb 2007 Terminology For Protection Benchmarking to AD Review Mar 2007 IPv6 Benchmarking Methodology to AD Review Jul 2007 Basic BGP Convergence Benchmarking Methodology to AD Review. Jul 2007 Methodology For Protection Benchmarking to AD Review Dec 2007 Net Traffic Control Benchmarking Methodology to AD Review. Dec 2007 Router Accelerated Test Method for EBGP to AD Review Dec 2007 Router Accelerated Test Method for Operational Security to AD Review

8 New Work Evaluation Matrix Work Area > Criteria \/ SIP WLAN switch Mcast VPN Scalability LDP Converg MPLS Proposal YYYY minimal In Scope of Charter? (acm) Y No Overlap w/802.11T YYY Draft(s) Sig. Support at meeting Sig. Support on List Interest when first proposed