1. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Accelerated Testing in a continuous delivery process Steven Brown

2. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 2 Agenda The Evolution of TestingVision for Test Automation AccelerationTest Center of ExcellenceSTCA

3. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 3 The Evolution of Testing

4. © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 4 Paradigm Shift 4 Focus changing from Technology to Business Driven 20% 80% 20% 80% Process optimization driven with the focus on:  EFFECTIVENESS  EFFICIENCY Business Oriented Technology Oriented Do More with the same or LESS  Agile  SCRUM  RAD

5. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. In the beginning, functional testing was all manual… Test Design Test Repository Test Execution Reporting Requirement Definition Test Data Requirements Test Data for Execution in Test Environments DesignBuildTest & Accept Manual 0% Test Cycle Time = 6 weeks* * On average for an SAP, Oracle eBusiness suite, or Siebel etc. grade system

6. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Then ALM provided a repository for test assets… Test Design Test Repository in ALM Test Execution Reporting in ALM Requirement Definition Test Data Requirements Test Data for Execution in Test Environments DesignBuildTest & Accept ManualAutomated 20% Test Cycle Time = 4 weeks*

7. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. After that, test execution was automated… Test Design w/ BPT/UFT Test Repository in ALM Test Execution with Sprinter and UFT Reporting in ALM Requirement Definition Test Data Requirements Test Data for Execution in Test Environments DesignBuildTest & Accept ManualAutomated 40% Test Cycle Time = 2 weeks*

8. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. And then test preparation was fully automated… Test Design in Agile Designer + ITAS Test Repository in ALM Test Execution with Sprinter and UFT Reporting in ALM Requirement Definition with Agile Designer® Prepare Test Data with DataMaker® Test Data for Execution in Test Environments generated from scripts in Test Data Warehouse DesignBuildTest & Accept ManualAutomated 90% Test Cycle Time = < 2 days*

9. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Save time & money, whilst increasing quality… Manual Automation 90% Test Design in Agile Designer + ITAS Test Repository in ALM Test Execution with Sprinter and UFT Reporting in ALM Requirement Definition with Agile Designer® Prepare Test Data with DataMaker® Test Data for Execution in Test Environments generated from scripts in Test Data Warehouse DesignBuildTest & Accept Test Cycle Time = < 2 days * Down to minutes for smaller/web applications! Full SAP/Oracle system in less then 2 days!

10. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Vision for Test Automation

11. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Test Automation ** CONFIDENTIAL // INTERNAL **11 ALM with traditional Test Automation DesignBuildTest & Accept HP UFT / BPT Record & ReplayKeyword Driven Testing Execution Engine HP Application Lifecycle Management Release Management Requirements Management Test Planning Test Execution Defect Management Analysis & Reporting Automated testing happens too late in the software development life cycle, especially when Working in Agile environments

12. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Support for continuous integration. Shift testing left in delivery process. Test Automation Accelerated testing that fits in a continuous delivery process DesignBuildTest & Accept HP Application Lifecycle Management Release Management Requirements Management Test Planning Test Execution Defect Management Analysis & Reporting Agile Designer Requirement & App Flow Design Test Case Paths generation Test Data Generation (Datamaker) ITAS and UFT Accelerated Test Automation Out of the box support for major applications Unified Applications Inspector Business Execution Reporting Technical Change Analysis Native Integration with ALM products

13. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.  ITAS is a test automation accelerator that reduces test authoring and maintenance efforts traditionally associated with test automation tools. This allows ITAS customers to deploy test automation quicker in order to spend more time testing their applications and less time creating or maintaining test scripts.  ITAS can ensure customers:  Ability to test their end to end business process in an efficient and effective manner;  Leverage on test automation much earlier in the software development lifecycle;  Greatly reduce maintenance costs ensuring lower Total Cost of Ownership and quicker ROI. 13 ** CONFIDENTIAL ** Test Automation Accelerating Test Automation with ITAS

14. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Test Automation 14 ITAS Solution Overview Multi-platform support Build on top of HP ALM Unified Applications Inspector AUT Out of the box BPT components

15. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Test Scenario Create PO Test Automation ** CONFIDENTIAL **15 ITAS in action… Script InitializerLaunch App & LoginNavigate App App Logout  1) Application Inspection 2) Test Composition 3) Run Inspected screen Set value to field A Set value to field B Set value to field C

16. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Return on Investment 16 Number of Test Cycles Effort in Hours ROI with ITAS in 2-3 Test Cycles ROI with traditional automation in 5-6 Test Cycles Total Effort Comparison Based on Average 40 Business Processes

17. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Support for continuous integration. Shift testing left in delivery process. Recorded Demo Accelerated testing that fits in a continuous delivery process DesignBuildTest & Accept HP Application Lifecycle Management Release Management Requirements Management Test Planning Test Execution Defect Management Analysis & Reporting Agile Designer Requirement & App Flow Design Test Case Paths generation Test Data Generation (Datamaker) ITAS and UFT Accelerated Test Automation Out of the box support for major applications Unified Applications Inspector Business Execution Reporting Technical Change Analysis Native Integration with ALM products

18. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Test Center of Excellence

19. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Definition Test Center of Excellence The TCOE is a unit within an organization that is responsible for: Establishing Testing Policies Defining Testing Processes and training staff in their use Establishing what Testing Tools will be used by the organization, procuring them centrally from suppliers and training staff in their use Testing Delivery Management using a centralized testing team either in-house or outsourced to a supplier. HP recommends that enterprises establish a TCOE and implement the vision for test automation and test data management

20. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. TCOE Goals Test data is sufficiently complete to enable all requirements to be tested Test data does not contain sensitive or personally identifiable information All stages of testing are automated from point at which requirements are defined, through test case preparation and test execution, to the production of test results Test cases are prepared and executed so that all requirements are tested The duration of a test cycle is reduce to less than 2 days for large systems, and minutes for smaller/web applications.

21. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Why engage HP to put Test Automation ‘on Steroids’ (TAoS) to grow towards a Test Center of Excellence (TCoE)? Why TCoE? Increased stability in production Fast delivery (must have for Agile!) Lowered costReduced risk & rework 1423 More apps demanded  more, faster & better testing is needed! Realize value quickly and remain doing so, whilst enabling DevOps and Enterprise Agile!

22. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Strategic Test Coverage Assessment

23. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Strategic Test Coverage Assessment “To deliver a step by step blueprint on how to create a test practice which can operate at full test coverage on both test data and test scripts, and is completely automated: TCoE (Test Center of Excellence). This tailor made blueprint, based upon the findings of the current situation, provides clear steps on how to arrive at the desired situation, saving you significant time and money whilst dramatically improving quality of software delivery.” ROI within just a few months!

24. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Strategic Test Coverage Assessment Goal Delivers the blueprint on how to establish a Test Center of Excellence that delivers full test coverage of functional requirements, using advanced, highly automated, testing and test data management tools. Next to the ‘toolchain’ develop capability, by enablement & training. Value The blueprint, based upon the findings of the current situation, provides clear steps on how to arrive at the desired situation, saving organizations significant time and money whilst dramatically improving quality of software delivered. Enabling the growth towards a mature organization, and DevOps. Goals and Value

25. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. More information Aernoudt Bottemanne Practice Lead, DevOps & Enterprise Agile HP SW Professional Services bottemanne@hp.com +31 6 46800079 Jon Fairclough Lead Solution Consultant, Devops HP SW Professional Services jon.fairclough@hp.com +44 7790 492087 Steven Brown Director IOVIO steven.brown@iovio.com +31611206999