SIP Performance Metrics

Slides:



Advertisements
Similar presentations
Basic BGP Data Plane Convergence Benchmarking -Rajiv Papneja - Mohan Nanduri -Bhavani Parise - Eric Brendel -Susan Hares - Jay Karthik.
Advertisements

1 © 2001, Cisco Systems, Inc. All rights reserved. © 2004, Cisco Systems, Inc. All rights reserved. Location Conveyance in SIP draft-ietf-sipping-location-requirements-02.
Advanced IM Capabilities Hisham Khartabil. draft-rosenberg-simple- messaging-requirements- 01.txt Found on jdrosen.net or softarmor.com (in the morge)
Indication of support for keep- alive draft-holmberg-sip-keep-03 Christer Holmberg
SIP Interconnect Guidelines draft-hancock-sip-interconnect-guidelines-02 David Hancock, Daryl Malas.
1 SIP End-to-End Performance Metrics (draft-ietf-pmol-sip-perf-metrics-00.txt)draft-ietf-pmol-sip-perf-metrics-00.txt 71 st IETF Conference PMOL Daryl.
69th IETF Chicago IETF BMWG WLAN Switch Benchmarking Tarunesh Ahuja, Tom Alexander, Scott Bradner, Sanjay Hooda, Jerry Perser, Muninder Sambi.
SIP issues with S/MIME and CMS Rohan Mahy SIP, SIPPING co-chair.
Benchmarking Methodology WG (bmwg) 60th IETF – San Diego, CA Thursday, August 5, 2004, Chairs: –Kevin Dubray –Al Morton.
SIP Performance Benchmarking draft-ietf-bmwg-sip-bench-term-04 draft-ietf-bmwg-sip-bench-meth-04 August 2, 2012 Prof. Carol Davids, Illinois Inst. of Tech.
SIP Performance Benchmarking draft-ietf-bmwg-sip-bench-term-03 draft-ietf-bmwg-sip-bench-meth-03 March 28, 2011 Prof. Carol Davids, Illinois Inst. of Tech.
SIP Performance Metrics 66 th IETF – Montreal Daryl Malas.
66th IETF Meeting Montreal IETF BMWG WLAN Switch & Mesh Benchmarking Jerry Perser
Session Policy Framework using EAP draft-mccann-session-policy-framework-using-eap-00.doc IETF 76 – Hiroshima Stephen McCann, Mike Montemurro.
Session-ID Requirements for IETF84 draft-ietf-insipid-session-id-reqts-00 1 August 2012 Paul Jones, Gonzalo Salgueiro, James Polk, Laura Liess, Hadriel.
SIP End-to-End Performance Metrics draft-malas-performance-metrics-06.txt.
1 Proposal for BENCHMARKING SIP NETWORKING DEVICES draft-poretsky-sip-bench-term-01.txt draft-poretsky-sip-bench-meth-00.txt Co-authors are Scott Poretsky.
Proposal for new Working Group Item: Core Router Software Accelerated Life Testing (draft-poretsky-routersalt-term-00.txt) Authors: Scott Poretsky, Avici.
SPEERMINT Terminology Draft th IETF - Chicago Editors: Daryl Malas David Meyer.
XCON WG IETF-73 Meeting Instant Messaging Sessions with a Centralized Conferencing (XCON) System draft-boulton-xcon-session-chat-02 Authors: Chris Boulton.
Application Performance Metrics APM BOF July 25, 2007 Alan Clark Al Morton IETF 69 – Chicago – July 2007.
IGP Data Plane Convergence draft-ietf-bmwg-dataplane-conv-meth-14.txt draft-ietf-bmwg-dataplane-conv-term-14.txt draft-ietf-bmwg-dataplane-conv-app-14.txt.
SIP Performance Benchmarking draft-ietf-bmwg-sip-bench-term-02 draft-ietf-bmwg-sip-bench-meth-02 July 24, 2010 Prof. Carol Davids, Illinois Inst. of Tech.
1 SIPREC draft-ietf-siprec-architecture-00 An Architecture for Media Recording using SIP IETF SIPREC INTERIM – Sept 28 th 2010 Andrew Hutton.
SIPREC draft-ietf-siprec-req-00 Requirements for Media Recording using SIP Draft authors: K. Rehor, A. Hutton, L. Portman, R. Jain, H. Lum IETF 78 Ken.
SIP Interconnect Guidelines draft-hancock-sip-interconnect-guidelines-01 David Hancock, Daryl Malas.
IETF 69 SIPPING WG Meeting Mohammad Vakil Microsoft An Extension to Session Initiation Protocol (SIP) Events for Pausing and Resuming.
1 SIP Performance Benchmarking draft-poretsky-sip-bench-term-04.txt draft-poretsky-bmwg-sip-bench-meth-02.txt BMWG, IETF-70 Vancouver Dec 2007 Davids IIT.
Draft-ietf-fecframe-config-signaling-02 1 FEC framework Configuration Signaling draft-ietf-fecframe-config-signaling-02.txt IETF 76 Rajiv Asati.
SIP Performance Benchmarking draft-ietf-bmwg-sip-bench-term-01 draft-ietf-bmwg-sip-bench-meth-01 March 22, 2010 Prof. Carol Davids, Illinois Inst. of Tech.
1 SIP Performance Benchmarking draft-poretsky-sip-bench-term-03.txt draft-poretsky-bmwg-sip-bench-meth-01.txt BMWG, IETF-69 Chicago July 2007 Poretsky,
July 28, 2010IETF 78 – Maastricht, Netherlands1 IP Multicast Performance Monitoring: update on IPPM experience Vero Zheng Alberto Tempia Bonda.
Real-Time Streaming Protocol draft-ietf-mmusic-rfc2326bis-01.txt Magnus Westerlund.
IGP Data Plane Convergence draft-ietf-bmwg-dataplane-conv-meth-15.txt draft-ietf-bmwg-dataplane-conv-term-15.txt draft-ietf-bmwg-dataplane-conv-app-15.txt.
1 Benchmarking Methodology WG (bmwg) 66th IETF – Montreal, Canada Thursday, June 13, 2006, 13:00-15:00 (519A) Chairs: –Al Morton – If.
75 th IETF, Stockholm, Sweden July 26-31, 2009 BMWG SIP Benchmarking BMWG, Monday July 27, 2009 Scott Poretsky Carol Davids Vijay K. Gurbani.
Indication of Terminated Dialog draft-holmberg-sipping txt Christer Holmberg NomadicLab Ericsson.
1 Authors: Scott Poretsky, Reef Point Systems Shankar Rao, Qwest Communications 64th IETF Meeting – Vancouver Accelerated Stress Benchmarking draft-ietf-bmwg-acc-bench-term-07.txt.
28 July BGP Data-Plane Benchmarking Applicable to Modern Routers Ilya Varlashkin Rajiv Papneja Bhavani Parise presented by Grégory CAUCHIE.
23Mar BGP Data-Plane Benchmarking Applicable to Modern Routers Rajiv Papneja Ilya Varlashkin Bhavani Parise Dean Lee Sue Hares.
82nd IETF Taipei, Nov 2011 IETF BMWG Security Effectiveness Benchmarking Kenneth Green.
1 IGP Data Plane Convergence Benchmarking draft-ietf-bmwg-igp-dataplane-conv-app-00.txt draft-ietf-bmwg-igp-dataplane-conv-term-00.txt draft -ietf-bmwg-igp-dataplane-conv-meth-00.txt.
SIPPING Working Group IETF 67 Mary Barnes Gonzalo Camarillo.
1 Benchmarking Methodology WG (bmwg) 73rd IETF – Minneapolis, MN USA Monday, November 17, 2008, Afternoon Session I (Rochester) Chairs: –Al Morton.
1 SIP End-to-End Performance Metrics 70 th IETF Conference PMOL Daryl Malas.
SIP wg Items Jonathan Rosenberg dynamicsoft Caller Preferences: Changes Discussion of Redirects –Previous draft only proxy –Nothing different for redirect.
Authors: Scott Poretsky, Quarry Technologies Brent Imhoff, LightCore
IPv6 Benchmarking Methodology
IETF 80 MMUSIC WG draft-elwell-mmusic-ice-updated-offer
and answer command CCF Friday, April 5th 2016
Jonathan Rosenberg Volker Hilt Daryl Malas
SIP Performance Benchmarking
Kumiko Ono End-to-middle Security in SIP draft-ietf-sipping-e2m-sec-reqs-04 draft-ono-sipping-end2middle-security-03 Kumiko Ono.
Authors: Scott Poretsky, Quarry Technologies Brent Imhoff, LightCore
Packet Switching Datagram Approach Virtual Circuit Approach
Distributed voting application for handheld devices
draft-ietf-simple-message-session-09
IETF 78 Ken Rehor on behalf of the team
Accelerated Stress Benchmarking
IETF BMWG FRR Related Benchmarking Drafts Status and Update
IETF BMWG FRR Related Benchmarking Drafts Status and Update
draft-ietf-pce-pcep-mib-03 Jon Hardwick (presenting)
ECE 544 Protocol Design Project: Description and Timeline
Kevin Lee & Adam Piechowicz 10/10/2009
INSIPID Session Initiation Protocol (SIP) Extension for logging and debugging (draft-kaithal-dispatch-sip-log-information-00 ) March 26th 2012 IETF -83.
Technical Issues with draft-ietf-mpls-bfd-directed
<month year> <doc.: IEEE doc> January 2013
<month year> <doc.: IEEE doc> January 2013
Strategic Coordination Group 2007 Reporting Guidance on Monitoring
ECN in QUIC - Questions Surfaced
Presentation transcript:

SIP Performance Metrics 66th IETF – Montreal Daryl Malas

Motivation With widespread implementation of SIP the following problems have surfaced: No standard performance terms No standard performance metrics No standard methods No standards between vendors and operators Current reliance on PSTN metrics Operator and vendor problem!!!

Industry Acknowledgment & Relevance SIPPING WG develops standard to benchmark end-to-end SIP application performance BMWG develops standard to benchmark SIP networking device performance SPEC to develop industry-available test code for SIP benchmarking in accordance with IETF’s BMWG and SIPPING standards. ITU-T (Study Group 12) focused on detailed failure/success scenarios and end-to-end benchmark guidance.

SIPPING vs. BMWG -----Original Message----- From: Poretsky, Scott Sent: Thursday, June 22, 2006 8:00 PM To: 'Malas, Daryl'; acmorton@att.com; gonzalo.camarillo@ericsson.com; mary.barnes@nortel.com Cc: vkg@lucent.com; Poretsky, Scott Subject: RE: (BMWG/SippingWG) SIP performance metrics Yes Daryl.  I absolutely agree.  The item posted to BMWG focuses on single DUT benchmarking of SIP performance.  Your work in SIPPING is focused on end-to-end application benchmarking.  It would be great (and I would even say a requirement) that the Terminologies for these two work items remain consistent with each other.   

Proposed Metrics (Solution) Create standard metrics with consistent terms and methods of calculations The metrics: Session Request Delay Measures time from the initiation request to an acknowledgment Session Completion Delay Measures time from a completion request to an acknowledgment Average Hops per INVITE Measures the average hops an INVITE takes to traverse the network Average Hops per Session Measures the average hops of origination messages, associated with a session, taken to traverse the network Session Duration Time Measures time from the initiation message to the completion message Session Establishment Rate Ratio of number of initiation requests to established sessions

Metrics Cont’d Session Defects Ineffective Session Attempts Identifies the number of persistent failures “defects” in dialog processing Ineffective Session Attempts Identify attempts described as ineffective due to failure or congestion Session Disconnect Failures Identify issues causing sessions to fail after they were established Session Completion Rate Measures the number of sessions completed without failure due to timeouts Session Success Rate Identifies the number of successful calls by removing the percentage of Ineffective Session Attempts and Session Disconnect Failures

Feedback and Next Steps Interest in making a working group item? Should end-to-end media performance metrics be included? Should terminology be extracted and included only in BMWG terminology draft? Additional metrics? Reduce number of metrics? SIP MIB incorporation?