1. SIP Testing Methodology Elie Cohen ProLab PM 17/01/2003

2. Agenda  SIP Testing Overview  SIP Test Topology  SIP Server and SIP User Agent Testing  Building a Practical SIP Testing Environment  ProLab Test Management Suite

3. SIP Testing Overview Requirement

4. The Importance of E arly B ug D etection  Early detection of software and hardware defects is crucial for mainlining development costs low Cost of bug fixes% Software Cycle Test early & Test often

5. SIP Testing System Challenges  Minimize testing time & improve time-to-market  Testing throughout the development cycle  Perform comprehensive testing:  Load and stress  Protocol compliance  Error conditions  Network simulation  Test both signaling and media

6. SIP Testing System Challenges  Flexibility to change tests as needed  Change test parameters quickly  Change test topology  Ease-of-use for developers and QA engineers  Full network simulation  One or more endpoints SIP User agent  Simulate Full SIP Server application  RTP Network Simulation  Varying network topology (cont.)

7. SIP Testing System Challenges  High performance and scalability  Generate very high rates of calls/transactions per second  Standards compliant  Based on SIP RFC3261 for User agent (cont.)

8. SIP Test Topology

9. IP SIP Test Environment  Simulates an endpoint capable of handling thousands of calls System Under Test Scenario Test results SIP protocol UAC UAS SIP protocol Scenario Test results

10. SIP Functional Test Topology DUT UAC/UAS IP

11. SIP Stress Test Topology  Verify that the system performs under extreme conditions and test to see that system can handle intended load DUT UAC UAS IP

12. SIP Server and User Agent Testing

13. SIP Server Functional Test Topics  Proxy testing  Request and response forwarding  State full and Stateless  Reject responses (Forwarding, registration)  Server functionality routing with address resolution (forking) & loose routing  Redirect Server Functionality: Returns “Contact this address” response  Message Validation and Invalid response handling  Record route  Outbound proxy

14. SIP Server Performance Metrics  SIP servers typically need to handle high transaction rates  Transactions statistics:  Total Transactions per second  Total Transactions Capacity  Transactions failed per second  Percentage Transactions rejected  Calls statistics:  Calls requested per second  Calls Connected per second  Call establishment time (call setup delay)

15. SIP Server Performance Metrics  Registration statistics:  Total Registrations per second  Percentage Registrations rejected  Registrations requested per second  Registrations confirm per second (cont.)

16. SIP Server Registrar Test  Registrar & location database  Different types of expiration  Different type of TO header  Registration with other contact  Unregistration (expires=0)  Update existing registration  Registration with multiple contact  Multiple registration

17. SIP Server Registrar Test  Security  Authentication header  Different type of nonce and Realm  Existing and non existing user  User expired (cont.)

18. High Volume of Concurrent Calls  Capability to send and receive thousands of concurrent calls from single or multiple endpoints  Capability to simulate thousands of media calls simultaneously  Capability to send thousands of concurrent registrations to an SIP Server  Capability to simulate different scenarios simultaneously

19. SIP Stress Method Testing  Burst Testing (multiple invite simultaneous)  Poisson Call distribution  Poisson Call duration  Constant Call distribution (X Calls per second)  Constant call duration  Load testing  Stress Test using only signaling  Stress Test using signaling and media

20. SIP User Agent Testing  Methods (invite,re-invite, cancel, bye, info, notify, subscribe, options, re-invite, refer, …)  Retransmission mechanism  Provisional response  Register and authentication  Add contact to register  Timer configuration  Atypical testing  SIP Parsing coding and decoding headers  Non standard message  Call Flow - State Machine  Reject response handling  Multipart mime  Body message  SIP headers test  TCP & UDP Interface

21. SDP Packet  Session information  Session name and purpose.  Time(s) the session is active.  Media information  Type of media, such as video and audio. Transport protocol, such as RTP/UDP/IP and H.320. Media format, such as H.261 video and MPEG video.  SDP With different type of Media information  SDP with Telephone-event  Different Type of SDP

22. Response Message  RESPONSE TYPES  Provisional (1xx class)— provisional responses are used by the server to indicate progress, but they do not terminate SIP transactions  Final (2xx, 3xx, 4xx, 5xx, 6xx classes)—final responses terminate SIP transactions.  CLASSES  1xx = provisional, searching, ringing, queuing etc.  2xx = success  3xx = redirection, forwarding  4xx = request failure (client mistakes)  5xx = server failures  6xx = global failure (busy, refusal,not available anywhere)

23. Advanced RTP Testing  RTP Simulation  Packet loss, Duplicate Packets, Packets ordering  Corrupted packet & SSRC Corrupted  Delay, Jitter  Stop Sending RTP and resume.  DTMF in band and RFC 2833, DTMF in band

24. Advanced RTP Testing  RTP Monitoring and statistics  Packet loss and Packet distribution (sender & receiver)  RTP General information (Payload, low seq #,High Seq #, SSRC, UDP, …)  Different Codecs G711, g728, G729, G722, G723.1, H261, H263,.  RTCP  Jitter, Cumulative lost, fractional lost, … (cont.)

25. Building a Practical SIP Testing Environment

26. SIP Testing Environment User Agent Client 1..X User Agent Server 1..X Test ManagementSIP Server Media Testing Device Under Test SIP Server Run Test IP

27. Testing Lab Components  Test Management  Script and configuration Management (typical and Atypical)  Control Test Execution (Saving result, Notification )  Test Scheduling ( Test Scheduler, Compare test result)  SIP Server  Full SIP Server Simulation (Proxy, Registrar, Location DB, Authentication)  Positive and negative response  Multi SIP Server

28. Testing Lab Components  SIP User Agent Client/Server P Server  Simulation UAC and UAS  Media Testing  Full Media Network simulation and media monitoring (cont.)

29. ProLab Test Management Suite SIP Testing Solutions

30. ProLab™ Test Management Suite ProLab Gatekeeper Agent ProLab Test Manager ProLab SIP Test Agent ProLab H.323 Test Agent ProLab RTP Analyzer ProLab Test Scheduler ProLab SIP Server Agent Voice and Video Over IP Complete Test Solution Controlling ProLab Test Agents and scripts management Scheduling test scenarios RTP monitoring and simulation H.323 advanced endpoint simulation Full H.323 gatekeeper simulation SIP advanced User Agent simulation Full SIP Proxy, Registrar and Redirect Server simulation

31. ProLab Advantage  Full Network simulation (SIP UAC/UAS, SIP Server, Advanced RTP and full automation)  Closely synchronized with protocol updates  Distributed Solution  SIP & H.323 Advanced Testing  Script Driven  Script & Result management  High performance and volume of calls

32. ProLab Application Message Statistics Incoming and Outgoing Messages Multiple Agents Call Performance RTP- Packets Distribution RTP – Packets Loss

33. Summary  Testing Media & Signaling over IP is typically complicated and costly if not done thoroughly  Cost effective for Media over IP  Script-driven is highly flexible and good solution for full automation  Numerous powerful testing capabilities for both SIP UAC/UAS, SIP Server, SDP and RTP.  Full SIP Network Simulation

34. Thank You Booth #1 RADVISION www.radvision.com elic@radvision.com