1. October 4-7, 2004 Los Angeles, CA www.itexpo.com The importance of Testing Tools and Quality Assurance Pathangi Janardhanan HCL Technologies Janar@npd.hcltech.com

2. October 4-7, 2004 Los Angeles, CA www.itexpo.com Agenda Test Tools - The Benefits Test Tool Characteristics SIP Test Tool - Features Case Study

3. October 4-7, 2004 Los Angeles, CA www.itexpo.com Test Tool – The Benefits Testing Framework Simulate multiple entities Reuse Shorter test development time Avoid configuration delays and problems Faster debugging and test cycles

4. October 4-7, 2004 Los Angeles, CA www.itexpo.com Test Tool – The Benefits Graphical outputs Plug gable tools Controlled test environment Easier debugging Reduces bug analysis and fix timing Enables testing of corner and race conditions Test conditions are reproducible

5. October 4-7, 2004 Los Angeles, CA www.itexpo.com Test Tool – The Benefits Automation Framework Easy to automate the test cases Faster and reliable regression testing Quicker identification of broken code

6. October 4-7, 2004 Los Angeles, CA www.itexpo.com Test Tool Characteristics Unit Testing Generic Component (Black Box) Testing Language Dependent Static and Dynamic analysis Stub code Scripting environment Test case organization and execution Load/Stress/Performance environment

7. October 4-7, 2004 Los Angeles, CA www.itexpo.com Test Tool Characteristics Domain specific black box testing System Test Tools Framework and high level APIs Pre-defined test suites Full automation support Scripting environment Automation support Domain independent

8. October 4-7, 2004 Los Angeles, CA www.itexpo.com SIP Test Tool Component (Black box) test tool Object oriented scripting language CORE Framework – Domain independent Domain specific extensions Event based framework Easy simulation of multiple entities Automation Framework

9. October 4-7, 2004 Los Angeles, CA www.itexpo.com SIP Test Tool Component Under Test (SIP Phone / Proxy / SIP Application Test Tool

10. October 4-7, 2004 Los Angeles, CA www.itexpo.com Testing Scenario SIP Phone Registrar Proxy SIP Soft Phone Emulated by Test Tool

11. October 4-7, 2004 Los Angeles, CA www.itexpo.com Testing Scenario Proxy SIP Soft Phone

12. October 4-7, 2004 Los Angeles, CA www.itexpo.com Component Testing - Framework Test Controller and Plotter (Test Analysis) Test Case Test Case Test Case Test Case Test Group Test Group Test Suite Entity Log/Message files

13. October 4-7, 2004 Los Angeles, CA www.itexpo.com Viewing Results - Plotter

14. October 4-7, 2004 Los Angeles, CA www.itexpo.com Viewing Results - Message

15. October 4-7, 2004 Los Angeles, CA www.itexpo.com SIP UA release 1.0 – Case Study QA Efforts* - No ToolQA Efforts* - With Tool ROI on Tool – 180 % * All efforts are in Person Weeks Test Plan - 12 Test Development - 20 Test Execution - 9 Total Effort - 41 Test Tool Ramp Up - 6 Automation effort - 10 Test Execution - 4 Total Effort - 20

16. October 4-7, 2004 Los Angeles, CA www.itexpo.com SIP UA release 1.1 – Case Study QA Efforts* - No ToolQA Efforts* - With Tool * All efforts are in Person Weeks ROI on Tool – 47 % Test Plan - 6 Test Development - 14 Test Execution - 6 Total Effort - 26 Test Plan - 6 Test Development - 5 Test Execution - 4 Total Effort - 15

17. October 4-7, 2004 Los Angeles, CA www.itexpo.com Thank You www.hcltech.com/voip www.hcltech.com/voip Booth Number: 508