1 Content-Aware Device Benchmarking Methodology (draft-hamilton-bmwg-ca-bench-meth-05) BMWG Meeting IETF-79 Beijing November 2010 Mike Hamilton

Slides:



Advertisements
Similar presentations
Basic BGP Data Plane Convergence Benchmarking -Rajiv Papneja - Mohan Nanduri -Bhavani Parise - Eric Brendel -Susan Hares - Jay Karthik.
Advertisements

1 ISMS WG 79th IETF Beijing November 10, 2010 Goal:Creating a security model for SNMPv3 that will meet the security and operational needs of network administrators.
Basic BGP Data Plane Convergence Benchmarking draft-papneja-bgp-basic-dp-convergence-01 Rajiv Papneja, Susan Hares, Bhavani Parise, Mohan Nanduri, Jay.
1 Content-Aware Device Benchmarking Methodology/Terminology (draft-hamilton-bmwg-ca-bench-meth-06) (draft-hamilton-bmwg-ca-bench-term-00) BMWG Meeting.
69th IETF Chicago IETF BMWG WLAN Switch Benchmarking Tarunesh Ahuja, Tom Alexander, Scott Bradner, Sanjay Hooda, Jerry Perser, Muninder Sambi.
Status of L3 PPVPN Working Group Documents Ross Callon Ron Bonica Rick Wilder.
Benchmarking Methodology WG (bmwg) 60th IETF – San Diego, CA Thursday, August 5, 2004, Chairs: –Kevin Dubray –Al Morton.
1 Benchmarking Methodology WG (bmwg) 84th IETF Thursday, August 2, 2012 (1730 Vancouver Local Time, GMT-7:00) Chairs: –Al Morton If.
1 Benchmarking Methodology WG (bmwg) Virtual Interim Meeting prior to 76th IETF Friday, October 30, 2009, GMT Chairs: –Al Morton
Draft-novak-bmwg-ipflow-meth-05.txt IP Flow Information Accounting and Export Benchmarking Methodology
66th IETF Meeting Montreal IETF BMWG WLAN Switch & Mesh Benchmarking Jerry Perser
L2VPN WG “NVO3” Meeting IETF 82 Taipei, Taiwan. Agenda Administrivia Framing Today’s Discussions (5 minutes) Cloud Networking: Framework and VPN Applicability.
IETF 90: VNF PERFORMANCE BENCHMARKING METHODOLOGY Contributors: Sarah Muhammad Durrani: Mike Chen:
Detecting Network Attachment IETF61 Chairs: Pekka Nikander, Greg Daley.
1 Benchmarking Methodology WG (bmwg) 70th IETF – Vancouver, Canada Thursday, December 6, 2007, 9:00-11:30 (Oak) Chairs: –Al Morton If.
SIP working group status Keith Drage, Dean Willis.
MANET Where are we? Where are we going? Adrian Farrel Routing AD Honolulu – November 2015 – IETF-91.
1 Benchmarking Methodology WG (bmwg) 80th IETF Tuesday, March 29, 2011, CDT (Central Europe Daylight Time, GMT+2:00) Chairs: –Al Morton
1 Proposal for BENCHMARKING SIP NETWORKING DEVICES draft-poretsky-sip-bench-term-01.txt draft-poretsky-sip-bench-meth-00.txt Co-authors are Scott Poretsky.
1 Benchmarking Methodology WG (bmwg) 82nd IETF Monday, November 14, 2011, (Taipei Local Time, GMT+8:00) Chairs: –Al Morton
DIME WG IETF 82 Dime WG Agenda & Status THURSDAY, November 17, 2011 Jouni Korhonen & Lionel Morand.
Proposal for new Working Group Item: Core Router Software Accelerated Life Testing (draft-poretsky-routersalt-term-00.txt) Authors: Scott Poretsky, Avici.
Yang Shi (Richard), Yong Zhang IETF 74 th 26 March 2009, San Francisco CAPWAP WG MIB Drafts Report.
1 Benchmarking Methodology WG (bmwg) 85th IETF Tuesday, November 6, 2012 (1520 Atlanta Local Time, GMT-5:00) Chairs: –Al Morton – PLEASE.
1 Content-Aware Device Benchmarking Methodology/Terminology (draft-ietf-bmwg-ca-bench-meth-00) BMWG Meeting IETF-82 Taipei November 2011 Mike Hamilton.
AAA and Mobile IPv6 Franck Le AAA WG - IETF55. Why Diameter support for Mobile IPv6? Mobile IPv6 is a routing protocol and does not deal with issues related.
1 Miscellaneous Capabilities for IP Network Infrastructure IETF 64 Vancouver, BC, Canada November 2005.
Multi6 interim meeting agenda Chairs: Brian Carpenter, Kurt Lindqvist 1.IPR reminder, logistics, agenda bashing 2.Charter review 3.draft-lear-multi6-things-to-think-about-03.txt.
Device Reset Characterization draft-ietf-bmwg-reset-02 Rajiv Asati Carlos Pignataro Fernando Calabria Cesar Olvera Presented by Andrew.
Benchmarking Methodology WG (bmwg) 61st IETF – Washington, D.C. Thursday, November 11, 2004, Chairs: –Kevin Dubray –Al.
1 Traffic Management Benchmarking Framework IETF 85 Atlanta Barry Constantine Tim Copley Ram Krishnan.
IPR WG Agenda, Vancouver December Agenda 0900: Administrativia 0910: Status of WG documents 0915: Issues raised so far at Last Call 0945: Instructions.
Multiple Interfaces (MIF) WG IETF 79, Beijing, China Margaret Wasserman Hui Deng
NEMO Re-chartering IETF 67 – November 9, 2006 T.J. Kniveton.
1 SIP Performance Benchmarking draft-poretsky-sip-bench-term-04.txt draft-poretsky-bmwg-sip-bench-meth-02.txt BMWG, IETF-70 Vancouver Dec 2007 Davids IIT.
1 Benchmarking Methodology WG (bmwg) 77th IETF Monday, March 22, 2010, PDT (GMT – 7:00, due to DST in US) Chairs: –Al Morton
1 Benchmarking Methodology WG (bmwg) 86th IETF Tuesday, July 30, 2013 ( Berlin Local Time, GMT+2:00) Chairs: –Al Morton (acmorton(at)att.com)
1 Content-Aware Device Benchmarking Methodology (draft-hamilton-bmwg-ca-bench-meth-04) BMWG Meeting Maastricht July 2010 Mike Hamilton
IETF-90 (Toronto) DHC WG Meeting Wednesday, July 23, GMT IETF-90 DHC WG1 Last Updated: 07/21/ :10 EDT.
26Jul BGP Data-Plane Benchmarking Applicable to Modern Routers Rajiv Papneja Ilya Varlashkin Bhavani Parise Dean Lee Sue Hares.
Dissuasion, Working Group Scope and Deliverables Lou Berger Pat Thaler
1 SIP Performance Benchmarking draft-poretsky-sip-bench-term-03.txt draft-poretsky-bmwg-sip-bench-meth-01.txt BMWG, IETF-69 Chicago July 2007 Poretsky,
1 Benchmarking Methodology WG (bmwg) 79th IETF Thursday, November 11, 2010, CST (China Standard Time GMT +8:00) Chairs: –Al Morton
July 28, 2010IETF 78 – Maastricht, Netherlands1 IP Multicast Performance Monitoring: update on IPPM experience Vero Zheng Alberto Tempia Bonda.
1 Benchmarking Methodology WG (bmwg) 64th IETF – Vancouver, Canada Monday, November 7, 2005, 15:10-17:10 (Oak) Chairs: –Kevin Dubray
1 Content-Aware Device Benchmarking Methodology/Terminology (draft-ietf-bmwg-ca-bench-meth-01) BMWG Meeting IETF-83 Paris March 2012 Mike Hamilton
1 Benchmarking Methodology WG (bmwg) 67th IETF – San Diego CA, USA Tuesday, November 7, 2006, 13:00-15:00 (Spinnaker) Chairs: –Al Morton
IGP Data Plane Convergence draft-ietf-bmwg-dataplane-conv-meth-15.txt draft-ietf-bmwg-dataplane-conv-term-15.txt draft-ietf-bmwg-dataplane-conv-app-15.txt.
1 Benchmarking Methodology WG (bmwg) 66th IETF – Montreal, Canada Thursday, June 13, 2006, 13:00-15:00 (519A) Chairs: –Al Morton – If.
HIP research group 1 HIP-RG meeting IETF 78 July 27, 2010 Andrei Gurtov and Tom Henderson
1 Benchmarking Methodology WG (bmwg) 71st IETF – Philadelphia, PA USA Monday, March 10, 2008, 13:00-15:00 (Salon J) Chairs: –Al Morton
28 July BGP Data-Plane Benchmarking Applicable to Modern Routers Ilya Varlashkin Rajiv Papneja Bhavani Parise presented by Grégory CAUCHIE.
Interface to the Routing System (IRS) BOF IETF 85, Atlanta November 2012.
Benchmarking Methodology WG (bmwg) 57th IETF – Vienna, Austria Tuesday, July 15, 2003, and Chairs: –Kevin Dubray
1 IETF-70 draft-akhter-bmwg-mpls-meth MPLS Benchmarking Methodology draft-akhter-bmwg-mpls-meth-03 IETF 70 Aamer Akhter / Rajiv Asati /
82nd IETF Taipei, Nov 2011 IETF BMWG Security Effectiveness Benchmarking Kenneth Green.
Data Center Benchmarking Drafts Lucien Avramov, Cisco Jacob Rapp, Cisco July 2013 IETF 87 - Berlin draft-dcbench-def-00 draft-bmwg-dcbench-methodology-01.
1 Benchmarking Methodology WG (bmwg) 78th IETF Thursday, July 29, 2010, CET (GMT – 0:00, due to DST in Europe) Chairs: –Al Morton
1 Benchmarking Methodology WG (bmwg) 95th IETF Thursday, April 7, 2016 ( Local Time, UTC-3:00) Chairs: –Al Morton (acmorton(at)att.com) –Sarah.
1 Benchmarking Methodology WG (bmwg) 73rd IETF – Minneapolis, MN USA Monday, November 17, 2008, Afternoon Session I (Rochester) Chairs: –Al Morton.
Data Center Benchmarking Drafts
Benchmarking Methodology WG (bmwg) 90th IETF
Authors: Scott Poretsky, Quarry Technologies Brent Imhoff, LightCore
IPv6 Benchmarking Methodology
Benchmarking Framework
Benchmarking Methodology WG (bmwg) 96th IETF
Terminology for IPv6 Benchmarking <draft-ietf-martin-term-ipv6-00
Working Group Re-charter Draft Charter Reference Materials
$DN Software Defined Networking Benchmarking SDN
IETF 87 DHC WG Berlin, Germany Thursday, 1 August, 2013
Presentation transcript:

1 Content-Aware Device Benchmarking Methodology (draft-hamilton-bmwg-ca-bench-meth-05) BMWG Meeting IETF-79 Beijing November 2010 Mike Hamilton BreakingPoint Systems

2 Agenda Charter Update Now What? Proposed Schedule Goals Reset Goals/Non-Goals Proposed Schedule Outstanding Questions Draft-05 highlights

3 Charter Update New classes of network devices that operate above the IP layer of the network stack require a new methodology to perform adequate benchmarking. Existing BMWG RFCs (RFC2647 and RFC3511) provides useful measurement and performance statistics, though they may not reflect the actual performance of the device when deployed in production networks. Operating within the limitations of the charter, namely blackbox characterization in laboratory environments, the BMWG will develop a methodology that more closely relates the performance of these devices to performance in an operational setting. In order to confirm or identify key performance characteristics, BMWG will solicit input from operations groups such as NANOG, RIP and APRICOT.

4 Now What? Define strategy for getting the work done Terminology Draft Methodology Draft Call for volunteers Would like to setup weekly meetings

5 Proposed Schedule December 2011 Terminology Draft for IESG Review Methodology Draft for IESG Review December terminology draft January methodology draft March – June 2011 Solicit WG feedback June 2011 Start WGLC

6 Goals Reset Create a series of benchmark tests to MOST accurately predict device performance under realistic conditions FOR A SPECIFIC SIMULATED NETWORK RFC 2544 Quotes Page 11, Section 18, “Multiple Frame Sizes” “The distribution MAY approximate the conditions on the network in which the DUT would be used.” “The authors do not have any idea how the results of such a test would be interpreted other than to directly compare multiple DUTs in some very specific simulated network”

7 Goals/Non-Goals Goals Repeatable Results Random/Repeatable Testbed to testbed Compare Multiple DUTs Non-Goals Replace RFC 2544/3511

8 Outstanding Questions Traffic Composition Basket? Methodology for selecting? Updatable? One network is different from another every day Security? Is it worth the trouble? Malformed Traffic What information is necessary to create repeatable ‘application layer’ flows? Type of flow, size of flow, etc Others?

9 Draft-05 Highlights and Reasons “Shell” Methodology More reproducible Added back ‘security’ Why shy away when application layer already difficult Maintain ‘fuzzing’ aspect Random but repeatable