1. 1 SIP Performance Benchmarking draft-poretsky-sip-bench-term-03.txt draft-poretsky-bmwg-sip-bench-meth-01.txt BMWG, IETF-69 Chicago July 2007 Poretsky, Gurbani, Davids

2. 2 Motivation Problem Statement: –Service Providers are now deploying VoIP and Multimedia using the IETF developed Session Initiation Protocol (SIP). –Industry lacks common terminology for SIP performance benchmarks –SIP allows a wide range of configuration and operational conditions that can influence performance benchmark measurements. Goals: –Service Providers use the benchmarks to compare performance of RFC 3261 network devices –Vendors and others can use benchmarks to ensure performance claims are based on common terminology and methodology. –Benchmark metrics can be applied to make device deployment decisions for IETF SIP and 3GPP IMS networks

3. 3 Scope SUT SIP Server (DUT) SIP ALG /NAT Tester (Emulated Agents) Benchmark SIP Signaling Performance (not Associated Media). Terminology defines Performance benchmark metrics for black-box measurements of SIP networking devices Methodology describes how to measure the metrics for a DUT or SUT SIP Signaling

4. 4 Benchmarks Maximum Session Establishment Rate Maximum Registration Rate Maximum IM Rate Session Capacity Session attempt performance Session setup delay Session disconnect delay Standing sessions

5. 5 Revision Changes draft-poretsky-sip-bench-term-03.txt Describe a session as a 3-dimensional vector –Sess.sig –Sess.med –Sess.medc Identifies session states - in words and diagram draft-poretsky-bmwg-sip-bench-meth-01.txt Incorporates terminology changes

6. 6 Complements Proposed SIPPING or OPS - apm Work draft-malas-performance-metrics-05 –This draft relates to end-to-end performance metrics –To be discussed in OPS BoF on application performance metrics The BMWG drafts define metrics whose values contribute to end-to-end delay budgets and total capacity The metrics in the current draft are consistent with a subset of the metrics defined in the malas draft.

7. 7 Next Steps Incorporate comments from meeting and mailing list Consider for BMWG work item?