1. © 2013 IBM Corporation Accelerating Product and Service Innovation Service Virtualization Testing in Managed Environments Michael Elder, IBM Senior Technical Staff Member mdelder@us.ibm.commdelder@us.ibm.com | http://linkedin.com/in/mdelderhttp://linkedin.com/in/mdelder

2. © 2013 IBM Corporation Accelerating Product and Service Innovation Agenda  What does DevOps mean for Testing? continuous feedback  Understanding multi-tier applications and inter-app dependencies  Integration Scenarios supported by UrbanCode Deploy and Rational Test Workbench

3. © 2013 IBM Corporation Accelerating Product and Service Innovation Plan / MeasureDevelopment / TestRelease / DeployMonitor / Optimize Scaled Reliable Repeatable Practiced DevOps maturity model Define release with business objectives Measure to customer value Define release with business objectives Measure to customer value Plan and source strategically Dashboard portfolio measures Plan and source strategically Dashboard portfolio measures Link objectives to releases Measure to project metrics Link objectives to releases Measure to project metrics Automate problem isolation and issue resolution Optimize continuously Automate problem isolation and issue resolution Optimize continuously Improve continuously with development intelligence Test Continuously Improve continuously with development intelligence Test Continuously Manage environments through automation Provide self-service build, provision and deploy Manage environments through automation Provide self-service build, provision and deploy Monitor using business and end user context Centralize event notification and incident resolution Monitor using business and end user context Centralize event notification and incident resolution Deliver and build with test Centralize test management Link lifecycle information Deliver and build with test Centralize test management Link lifecycle information Plan departmental releases and automate status Automated deployment with standard topologies Plan departmental releases and automate status Automated deployment with standard topologies Optimize applications Use enterprise issue resolution procedures Optimize applications Use enterprise issue resolution procedures Deliver and integrate continuously Manage data and virtualize services for test Deliver and integrate continuously Manage data and virtualize services for test Standardize and automate cross-enterprise Automate patterns-based provision and deploy Standardize and automate cross-enterprise Automate patterns-based provision and deploy Document objectives locally Manage department resources Document objectives locally Manage department resources Monitor resources consistently Collaborate Dev/Ops informally Monitor resources consistently Collaborate Dev/Ops informally Manage Lifecycle artifacts Schedule SCM integrations and automated builds Test following construction Manage Lifecycle artifacts Schedule SCM integrations and automated builds Test following construction Plan and manage releases Standardize deployments Plan and manage releases Standardize deployments Industry norm

4. © 2013 IBM Corporation Accelerating Product and Service Innovation Multi-tier apps present specific challenges to DevOps Middle Tier Server Client Tier Devices Back-end Data & Services Mobile-specific challenges: Lots of device targets Provisioning rules and artifacts Curated App Stores Dependent upon backend service versions The Mobile-specific challenge in DevOps is mainly: 1.Dealing with the specific issues in the Mobile Client tier 2.And subsequently coordinating separate pipelines for each tier:  Mobile Client  Middleware  Back-end data and services

5. © 2013 IBM Corporation Accelerating Product and Service Innovation Mobile Tier (SOE) Back-end Tier (SOR) Web Services Tier (SOE) Mainframe transactional services Production Environment AppStore Integration Test Integration Test Dev Mobile Build Mobile Build Device deployment & testing Dev Build App Deploy & testing Distributed DevOps Pattern Mobile apps need to be updated and released rapidly, delays due to wait for operations teams to setup test labs, longer cycles required to integrate with existing apps/services, processes Rapid deployments Frequent deployments Few deployments

6. © 2013 IBM Corporation Accelerating Product and Service Innovation Accelerate continuous testing with Service Virtualization Deploy what is ready, virtualize the rest - Enable continuous integration testing and progressive deployments throughout the software delivery lifecycle for complex applications Automate the creation of virtual test environments as part of the end-to-end DevOps process Establish a virtual system pattern with automated deployment to standardize and share test environments quickly and easily across projects and teams Enable an end-to-end Agile software delivery process Increase the frequency of releases by testing earlier in the development cycle and deploying reliably to pre-production and production environments.. Databases Mainframe applications Third-party Services Rational Test Virtualization Server Virtualized services Dev QA Rational Test Workbench Test IBM UrbanCode Deploy RTW pluginRTVS plugin 1 2 3 IBM UrbanCode Deploy v6.0 Deploy Configure

7. © 2013 IBM Corporation Accelerating Product and Service Innovation Preparing Virtualized Service Tests 1.Configure the initial environment (physical or virtual) 2.Record Test Stubs using Rational Test Workbench (RTW) 1.Augment results as needed to test “good” and “bad” use cases 3.Define automated tests and share with Source Control Management (SCM) 4.Update your CI process to publish test artifacts into UrbanCode Deploy 1.Or use Rational Quality Manager tasks to invoke tests against the running system 5.Define the component processes for the “test” component to run RTW tests

8. © 2013 IBM Corporation Accelerating Product and Service Innovation Preparing Test Stubs and Automated Tests  Test Stubs define the “virtualized” service; which is a mock up of how the service responds under known conditions  Test Stubs facilitate automated test creation

9. © 2013 IBM Corporation Accelerating Product and Service Innovation Understanding Environments  Both UrbanCode and Rational Test Workbench have some understanding of “Environment”  UCD understand the hosts, components, and deployment processes; RTW understands the hosts and data required to execute the test stubs or run tests

10. © 2013 IBM Corporation Accelerating Product and Service Innovation Understanding Transient Environments  In RTW 8.5, a new concept of “Transient” environment was introduced  Transient Environments are short-lived environments within RTW  These are created as part of an automated process, generally provisioning against the cloud  Transient Environments specify properties that can be overridden each time that it is instantiated …

11. © 2013 IBM Corporation Accelerating Product and Service Innovation Defining Test Components  Test components in UCD are just like other components, but with test artifacts  Rational Integration Tester provides the functional test capability, but any test harness could be used including Selenium, Cucumber, JUnit, etc  Tests will execute against a live deployed system  Test component defines one or more validation processes, which are used by the Application process

12. © 2013 IBM Corporation Accelerating Product and Service Innovation Externalizing Properties  UCD enables components to specify “Component Environment” properties  We leverage these to define values required by the test process  Each environment can override these properties for its specific needs  Some of these properties may be used for substituting values in Transient Environments

13. © 2013 IBM Corporation Accelerating Product and Service Innovation Bringing It Together – Continuous Feedback  Existing Continuous Integration (CI) processes produce packaged artifacts and run unit tests and other scans against the build  Now we’re extending CI to be Continuous Deployment (CI/CD) and using tests against live environments »-------  Built artifacts are published to UCD (including test artifacts)  Our application is then deployed (via REST call to UCD), where validation is run against the live system

14. © 2013 IBM Corporation Accelerating Product and Service Innovation Thanks!