1. Testing Tools Presentation for Senior Mgmt Team August 4, 2003

2. Agenda Types of Testing Tools Demo of Robot Recording and CTA (web-based) Demo of WA Regressions (virtual terminal-based) Demo of CA Import Tests Demo of Execute Action Business Case for Automation Other Uses of Automation Additional Tool Needs Summary and Questions

3. Types of Test Tools

4. Misc. Testing Tools - Worth Mentioning Stress/Performance – Empirix (Web Based Application Performance) Defect Tracking – TeamTrack by TeamShare Coverage Tools – C-Cover by Bullseye – TrueCoverage by NuMega – TCAT C/C++ for Windows by TestWorks – AQTime’s Coverage Profiler by Codework – CoverMeter by Synopsys – LiveCoverage by Paterson Technology – G-Cover by Green Hills Software – VectorCAST by Vector Software – Test Coverage by Semantic Designs – CTC++ by Testwell – Object Coverage by ObjectSoftware –...

5. Demo Robot/CTA – Record/Playback Notepad demo – CTA Regressions Item and Container Pages Three levels of a UI regression script – Level 1 - Record/Playback Scripts – Level 2 - Portable Scripts Use internal functions to make scripts portable – OS independent – database independent – directory location – Platform version – Timing independent (speed of machine) Error handling (script continues even when the unexpected happens) Log condition of environment Database dump/compare – Level 3 - Data driven Scripts Single script that is adaptable by configuring a database

6. Demo WA – Receiving – Demonstrate how an actual defect was found using this script – Using Virtual Terminal screen verification points – Also using internally developed Robot functions to verify database state

7. Demo CA Import Testing

8. Demo Platform Testing – Copy the latest version of the test application and scripts to the test environment – Open Advantage Architect and the test application then compile and activate – Start the Advantage Workflow Engine – Open the Application Status Console and System Status Console – Execute the test – Current test exercises the runtime functionality of “Execute Action” parameter types

9. Business Case for Automation Benefits of automation – Increase speed and accuracy – Reusability – Repeatability – Broader test coverage – Discover defects early

10. Cost of Defect Resolution

11. When to invest in Automation Multiple Hardware and Software configurations Multiple Builds Product Longevity Product Sales Vision Repetitious or tedious testing

12. Case Study

13. Case Study Continued...

14. Yearly Savings Summary

15. Current Use of Automation at HighJump Tools we own/use – Two licenses of Robot Current Projects – CTA, WA – Advantage Platform – CA – WebWise regressions for Microsoft Gold Certification Planned Projects – “Reference” application for testing platform services – Automated nightly builds with smoke test Subset of product regressions used as build verification – Continue automating all WA processes – EA Testing all possible filters for correct runtime behavior Regression test of UI for defining all filter types – Installation regression (across all products?)

16. Additional Tool Needs UI Regression – Additional Robot license just purchased – Purchase first WinRunner license Performance/Stress Test – Research and recommendation Coverage – Research and recommendation

17. Summary & Questions Product Development committed to realizing the benefits of test tools at HighJump Research will continue to identify and select tools for performance testing and coverage Some tools may have practical application in professional services team as well