Benchmarking Methodology WG (bmwg) 96th IETF

Slides:



Advertisements
Similar presentations
IETF Calsify.
Advertisements

1 Benchmarking Methodology WG (bmwg) 84th IETF Thursday, August 2, 2012 (1730 Vancouver Local Time, GMT-7:00) Chairs: –Al Morton If.
1 Benchmarking Methodology WG (bmwg) Virtual Interim Meeting prior to 76th IETF Friday, October 30, 2009, GMT Chairs: –Al Morton
Note Well Any submission to the IETF intended by the Contributor for publication as all or part of an IETF Internet-Draft or RFC and any statement made.
PPSP Working Group IETF-89 London, UK 16:10-18:40, Tuesday, Webex: participation.html.
1 Benchmarking Methodology WG (bmwg) 70th IETF – Vancouver, Canada Thursday, December 6, 2007, 9:00-11:30 (Oak) Chairs: –Al Morton If.
CCAMP Working Group Online Agenda and Slides at: Tools start page:
IETF 90: NetExt WG Meeting. Note Well Any submission to the IETF intended by the Contributor for publication as all or part of an IETF Internet- Draft.
1 Benchmarking Methodology WG (bmwg) 80th IETF Tuesday, March 29, 2011, CDT (Central Europe Daylight Time, GMT+2:00) Chairs: –Al Morton
1 Benchmarking Methodology WG (bmwg) 82nd IETF Monday, November 14, 2011, (Taipei Local Time, GMT+8:00) Chairs: –Al Morton
1 Benchmarking Methodology WG (bmwg) 85th IETF Tuesday, November 6, 2012 (1520 Atlanta Local Time, GMT-5:00) Chairs: –Al Morton – PLEASE.
IPPM WG IETF 79. Note Well Any submission to the IETF intended by the Contributor for publication as all or part of an IETF Internet-Draft or RFC and.
1 Benchmarking Methodology WG (bmwg) 77th IETF Monday, March 22, 2010, PDT (GMT – 7:00, due to DST in US) Chairs: –Al Morton
1 Benchmarking Methodology WG (bmwg) 86th IETF Tuesday, July 30, 2013 ( Berlin Local Time, GMT+2:00) Chairs: –Al Morton (acmorton(at)att.com)
1 Benchmarking Methodology WG (bmwg) 79th IETF Thursday, November 11, 2010, CST (China Standard Time GMT +8:00) Chairs: –Al Morton
1 Benchmarking Methodology WG (bmwg) 67th IETF – San Diego CA, USA Tuesday, November 7, 2006, 13:00-15:00 (Spinnaker) Chairs: –Al Morton
IETF 89, LONDON, UK LISP Working Group. 2 Agenda and slides:  lisp.html Audio Stream 
DMM WG IETF 84 DMM WG Agenda & Status Tuesday, July 31 st, 2012 Jouni Korhonen, Julien Laganier.
1 Benchmarking Methodology WG (bmwg) 71st IETF – Philadelphia, PA USA Monday, March 10, 2008, 13:00-15:00 (Salon J) Chairs: –Al Morton
Interface to the Routing System (IRS) BOF IETF 85, Atlanta November 2012.
1 Benchmarking Methodology WG (bmwg) 78th IETF Thursday, July 29, 2010, CET (GMT – 0:00, due to DST in Europe) Chairs: –Al Morton
1 Benchmarking Methodology WG (bmwg) 95th IETF Thursday, April 7, 2016 ( Local Time, UTC-3:00) Chairs: –Al Morton (acmorton(at)att.com) –Sarah.
OPSAWG chairs: Scott Bradner Christopher Liljenstolpe.
1 Chairs: Pascal Thubert Thomas Watteyne Mailing list: Jabber: Etherpad for minutes:
Agenda Wednesday, July 29, :00 – 15:00 Congresshall B Please join the Jabber room: LEDBAT WG IETF 75.
Emergency Context Resolution with Internet Technologies (ECRIT) Chairs: Marc Linsner & Roger Marshall Standing In for the Chairs: Brian Rosen IETF 94.
STIR Secure Telephone Identity Revisited
Benchmarking Methodology WG (bmwg) 90th IETF
Agenda Alexey, Yoav, Tobias July 2012
LMAP WG IETF 97 – Seoul, SK November 17, 2016 Dan Romascanu Jason Weil
Layer Independent OAM Management in the Multi-Layer Environment LIME
NETCONF WG IETF 93 - Prague, Czech Republic THURSDAY, July 23, 2015
Benchmarking Methodology WG (bmwg) 93rd IETF
Gunter Van de Velde Kiran Kumar Chitimaneni Warren Kumari
SIPREC WG, Interim virtual meeting , GMT-4
Benchmarking Methodology WG (bmwg) 65th IETF – Dallas, Texas, USA
Extensible Messaging and Presence Protocol (XMPP) WG
Note Well Any submission to the IETF intended by the Contributor for publication as all or part of an IETF Internet-Draft or RFC and any statement made.
Agenda OAuth WG IETF 87 July, 2013.
Joint TICTOC and NTP Meeting
Wednesday, 9:30-11:00, Grand Ballroom 3, Morning session I
MODERN Working Group IETF 97 November 14, 2016.
CAPWAP Working Group IETF 73 Minneapolis 18 Nov 2008, 17:10-18:10
Network Virtualization Overlays (NVO3) Working Group IETF 97, November 2016, Seoul Chairs: Secretary: Sam Aldrin Matthew Bocci.
Tuesday , 9:30-12:00 Morning session I, Buckingham
Joint OPS Area and OPSAWG Meeting
P2PSIP WG IETF 84 P2PSIP WG Agenda & Status Tuesday, July 31st, 2012
Kathleen Moriarty, Trusted Execution Environment Provisioning (TEEP) BoF IETF-100 November 2017 Chairs: Nancy Cam-Winget,
SPRING IETF-98 Tuesday, March 28.
Note Well Any submission to the IETF intended by the Contributor for publication as all or part of an IETF Internet-Draft or RFC and any statement made.
Singapore – IETF 100 – November 2017
Thursday, 20th of July 2017.
16th November 2016 Gorry Fairhurst (via webrtc) David Black WG chairs
SIPREC WG, Interim Meeting , GMT/UTC
Flexible Ethernet (Side meeting)
IETF DTN Working Group July 17th, 2017 Chairs:
Web Authorization Protocol (OAuth) WG Chairs: Hannes Tschofenig, Rifaat Shekh-Yusef, Security AD: Roman.
Web Authorization Protocol (OAuth) WG Chairs: Hannes Tschofenig, Rifaat Shekh-Yusef, Security AD: Roman.
20th July 2017 Gorry Fairhurst Wes Eddy David Black WG chairs
DetNet WG Chairs: Lou Berger
Web Authorization Protocol (OAuth) WG Chairs: Hannes Tschofenig, Rifaat Shekh-Yusef, Security AD: Roman.
SIPREC WG, Interim virtual meeting , GMT
Agenda Wednesday, March 30, :00 – 11:30 AM
Interface to Network Security Functions (I2NSF)
TEAS CCAMP MPLS PCE Working Groups
SIPBRANDY Chair Slides
Scott Bradner & Martin Thomson
NETCONF WG IETF 80, Prague, Czech Republic March 31,
IETF 100 Singapore MBONED.
Web Authorization Protocol (OAuth)
Presentation transcript:

Benchmarking Methodology WG (bmwg) 96th IETF Tuesday, Nov 15, 2016 (0930-1200 Local Time, UTC+9:00) Chairs: Al Morton (acmorton(at)att.com) Sarah Banks (sbanks(at)encrypted.net) PLEASE MOVE CLOSE TO THE FRONT If you are not subscribed to the BMWG mailing list and would like to be, please go to https://www.ietf.org/mailman/listinfo/bmwg  When you start, request that folks sign the blue attendance sheet; monitor it’s progress. (You’ll probably have a light turnout given the Monday evening session, but who knows.) Try to conscript a minute taker. (It’s challenging taking good notes and leading the session.) Please record the email addresses from the blue sheet of those folks w/asterisks by their name, send them to me, and I’ll add them to the list. Please note for me then number of people that attended the session. Have the minute taker send the minutes to minutes@ietf.org. This needs to be done before August 15th. Turn the blue list into the secretariat’s/registration desk. (If they are closed down when you get there, you can give the sheets to them on Tuesday.) AD summary: send to randy@psg.com, bwijnen@lucent.com, (and me!) a short, 1 paragraph summary of the results of the WG session. This should be done ASAP, but before the closing Friday.

Note Well Any submission to the IETF intended by the Contributor for publication as all or part of an IETF Internet-Draft or RFC and any statement made within the context of an IETF activity is considered an "IETF Contribution". Such statements include oral statements in IETF sessions, as well as written and electronic communications made at any time or place, which are addressed to: The IETF plenary session The IESG, or any member thereof on behalf of the IESG Any IETF mailing list, including the IETF list itself, any working group or design team list, or any other list functioning under IETF auspices Any IETF working group or portion thereof Any Birds of a Feather (BOF) session The IAB or any member thereof on behalf of the IAB The RFC Editor or the Internet-Drafts function All IETF Contributions are subject to the rules of RFC 5378 and RFC 3979 (updated by RFC 4879). Statements made outside of an IETF session, mailing list or other function, that are clearly not intended to be input to an IETF activity, group or function, are not IETF Contributions in the context of this notice.  Please consult RFC 5378 and RFC 3979 for details. A participant in any IETF activity is deemed to accept all IETF rules of process, as documented in Best Current Practices RFCs and IESG Statements. A participant in any IETF activity acknowledges that written, audio and video records of meetings may be made and may be available to the public.

BMWG Agenda (Any Bashing needed?) Note-Taker(s), Jabber, IPR, Blue Sheets 1a. WG Status Presenter: Chairs WG Drafts VNF and Infrastructure Benchmarking Considerations 1b. Charter and Milestones 2. IPv6 Neighbor Discovery Presenter: Ron 3. DataCenter Benchmarking Presenter: Jacob 4. IPv6 Transition Benchmarking Presenter: Marius (remote) 5. Benchmarking for SDN Controller Performance Presenter: Sarah 6. vSwitch Benchmarking in OPNFV Presenter: Al 7. Benchmarking Performance Monitoring on a DUT Presenter: Sudhin Jacob 8. Benchmarking Methodology for EVPN & PBB-EVPN Presenter: Sudhin Jacob -=-=-=-=- 9. Considerations for Benchmarking High Availability of NFV Presenter: Taekhee Kim LAST. AOB ?. Considerations for Benchmarking Network Virtualization Platforms Presenter: Samuel Kommu Administrivia: Have the agenda approved. Go over the BMWG activity since the last meeting. (Slide 3) After Kimura presents, please get a sense from the group assembled whether they would support this as a new WG deliverable. If so, say that well have to propose the new work item on the mailing list. When you get to the resource reservation topic, poll the group and see who has read the draft. If none, stop. If some have read the draft, glean from them whether they believe the draft should be forwarded to the Ads…

Quick WG Status Consensus on VNF and NFVI Consid. Publication Request to follow… WGLC: drafts on Data Center WGLC: IPv6 trans drafts WGLC: SDN Controller WGLC: VSPERF vSwitch Revived and Revised Draft on IPv6 ND New work proposals keep coming

BMWG Activity New RFCs: none Charter Update none Supplementary BMWG Page Watch this space! New home needed for: http://home.comcast.net/~acmacm/BMWG/ Last Call: you’ll know the results by mtg time; please announce. I-Ds: DSM: Editors believe this might be the last call version, Jerry Perser is there to update folks. The OSPF convergence drafts are the new WG work items from the last meeting. Other: The author of the FIB draft has solicited input on various topics of the draft, with no response. So, we’ll probably move to last call soon. The last call of the Resource Reservation benchmarking terminology draft produced NO input, even though the last call was posted to numerous WGs. Hopefully you can get input at the meeting. The multicast methodology draft expired. The editor has shown signs of life; hopefully, outstanding comments to this draft will be addressed soon and a last call reissued.

Current Milestones DONE Basic BGP Convergence Benchmarking Methodology to IESG Review DONE Terminology for SIP Device Benchmarking to IESG Review DONE Methodology for SIP Device Benchmarking to IESG Review DONE Draft on Traffic Management Benchmarking to IESG Review Dec 2017 Draft on IPv6 Neighbor Discovery to IESG Review DONE Draft on In-Service Software Upgrade Benchmarking to IESG Review Aug 2017 Draft on VNF Benchmarking Considerations to IESG Review Dec 2016 Drafts on Data Center Benchmarking to IESG Review Jul 2017 Draft on v6 Transition Jul 2017 Drafts on SDN Controller Benchmarking

Standard “Paragraph” (intro/security) Benchmarking activities as described in this memo are limited to technology characterization using controlled stimuli in a laboratory environment, with dedicated address space and the constraints specified in the sections above. The benchmarking network topology will be an independent test setup and MUST NOT be connected to devices that may forward the test traffic into a production network, or misroute traffic to the test management network. Further, benchmarking is performed on a "black-box" basis, relying solely on measurements observable external to the DUT/SUT. Special capabilities SHOULD NOT exist in the DUT/SUT specifically for benchmarking purposes. Any implications for network security arising from the DUT/SUT SHOULD be identical in the lab and in production networks.

Work Proposal Summary Matrix Work Area > Criteria \/ Perf Mon Benchmk EVPN & PBB EVPN VNF (was VBaaS) Virtualized Platforms SFC (new!) Proposal Y In Scope of Charter? (acm) Draft(s) Sig. Support at meetings Sig. Support on List some Dependencies/Notes