1. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational IBM DevOps: Continuous Testing with Virtualized Services Steve Weaver, IBM Rational Marketing Manager, Cloud & Devops May 20 th, 2013

2. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Organizations that effectively leverage software innovation outperform their competitors... yet few are able to deliver it effectively 2 86 % of companies believe software delivery is important or critical 25 % leverage software delivery effectively today But only… Source: “The Software Edge: How effective software development drives competitive advantage,” IBM Institute of Business Value, March 2013 69 % outperform those who don’t of those who leverage software delivery today

3. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational And a lack of continuous delivery impacts the entire business 3 Costly, error prone manual processes and efforts to deliver software across an enterprise CHALLENGES Upgrade risk due to managing multiple application configurations and versions across servers Slow deployment to development and test environments leave teams waiting and unproductive CHALLENGES Operations/ Production Development/ Test Customers Business Owners Software glitch costs trading firm Knight Capital $440 million in 45 minutes A bad software upgrade at RBS Bank left millions unable to access money for four days New Zealand’s biggest phone company, Telecom paid out $2.7 million to some 47,000 customers who were overcharged after a software glitch

4. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Accelerate Software Delivery Expanding collaboration to include customers, LOB and others to eliminate organization silos Balance speed, cost, quality and risk Automating manual processes across delivery lifecycle to eliminate waste/delays and compliance tracking Reduce time to customer feedback Enabling a customer feedback loop for continuous improvement DevOps Enterprise capability for continuous software delivery that enables clients to seize market opportunities and reduce time to customer feedback 44

5. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Accelerate Software Delivery Balance speed, cost, quality and risk Reduce time to customer feedback New capabilities to enable a DevOps approach Enterprise capability for continuous software delivery that enables clients to seize market opportunities and reduce time to customer feedback 55DRAFT: IBM Confidential until June 2, 2013 OSLC

6. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational 6 Deployment Enhancing Continuous Release and Deployment:  Drive down cost by automating manual tasks, eliminating wait-time and rework  Speed time to market by increasing the frequency of software delivery  Reduce risk through increased compliance of application deployments. Complements our DevOps solution:  Deliver a differentiated and engaging customer experience by reducing time to customer feedback  Quicker time-to-value of software-based innovation with improved predictability and success  Increased capacity to innovate by reducing waste and rework in order to shift resources to high-value activities IBM announces the acquisition of UrbanCode Inc. Complementing our DevOps solution, combining IBM and UrbanCode, will enable clients to more rapidly deliver mobile, cloud, big data analytics and traditional applications.

7. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational UrbanCode fills gaps Expand DevOps capabilities and accelerate plans

8. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Dev Providing Integrated Test Environments is hard Challenges Lack of Availability and access of dependent components & systems Managing complexity multitude of environments and configurations Mismatch in speed of dev changes and ability to provide environments Cost, Skills and Complexity to setup Impact: Fewer environments available limiting integrated testing to late in the lifecycle Week 8 Week 4 1 hour / day Build 10 times / day PVT Dev FVT UAT

9. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational FVT Goals to improve Quality – Continuous Testing Dev Integration test sand-box Continuous Testing - The practice of testing across the lifecycle with progressively increasing test environments. Performance Test User Acceptance Test FVT QA Performance Test Env QA FVT Env Need: Providing integrated test environment @ scale

10. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational DevOps Tool Chain Application Release Management Cloud Provisioning Application Deployment Automation

11. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Application Release Management Cloud Provisioning Application Deployment Automation Rational Collaborative Lifecycle Management Solution Rational Test Workbench Rational Functional Tester Rational Performance Tester Cucumber DevOps Tool Chain Current Implementations Jenkins Rational Build Forge IBM SmartCloud Orchestrator IBM Pure Application System

12. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Demo Scenario: JK Enterprises 12  We’re developing a stock quote feature on our banking website – pulling the info from an internet service.  The demo will build, deploy, and test the new version of our application.

13. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Building the JK Enterprises Project 13  We begin in Rational Team Concert, where our project is defined.  We’re going to build our app with Jenkins, so we have a build definition for each component, in this case, the web app. IBM Rational solution for Collaborative Lifecycle Management

14. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Build artifacts can be managed by uDeploy 14  Once the artifacts are built, we can take advantage of uDeploy’s Jenkins plugin to automatically publish the components into the artifact repository, which tracks each version for us. Jenkins uDeploy

15. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Continuous Delivery with RTC 15  So, that’s Continuous Integration, but what about Continuous Delivery?  For that, we’re going back to RTC, and defining an Ant script that will enable us to deploy and test the application automatically after building.  We can easily build a script that will deploy and validate the application for us – both functional tests, and tests that validate virtual services, like the stock quote service, that we need to stub out.. IBM Rational solution for Collaborative Lifecycle Management

16. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Using Ant to orchestrate Continuous Delivery 16  We go back to Jenkins, where, instead of publishing directly to uDeploy, we can invoke our Ant script instead.  The script will in turn call uDeploy, Cucumber for functional tests, and Rational Integration Tester for testing of virtualized services. Jenkins Ant

17. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Deploying the application build  In uDeploy, we’ve defined an environment for our application, the components that need to be deployed, the tasks required to deploy them, and the process for the deployment onto our target infrastructure. uDeploy

18. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Defining the Deployment Process 18  In uDeploy, we graphically create our deployment process, defining each task in a flow chart that ends with application deployment.  We can install and configure middleware and applications across multiple nodes.  The resulting deployment process can be called from our build.xml ant script via the uDeploy CLI. uDeploy

19. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Functional Testing with Cucumber 19  Here’s a cucumber script that we’re going to use for some basic functional testing. It can be called directly from our build.xml ant script after Jenkins has built the app, and uDeploy has deployed it into our target environment.

20. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational IBM Rational Test Workbench Continuous testing with virtualized services Avoid testing bottlenecks due to dependencies on external services Automate setup and management of test virtualization server Automates configuration of virtualized services for an application under test Automate setup of production-like test environments with low cost Databases Mainframe applications Third-party Services App deploy Application changes being tested virtualized services IBM SmartCloud Orchestrator IBM PureApplication System SIT FVT uDeploy IBM Rational Test Virtualization Server

21. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational 21 What is Test Virtualization? Test Virtualization enables to create “virtual services”: –Virtual Services simulate the behavior of an entire application or system during testing –Virtual Services can run on commodity hardware, private cloud, public cloud –Each developer, tester can easily have their own test environment –Developer and testers continue to use their testing tools (Manual, Web performance, UI test automation) Capture & Model System dependencies are a key challenge in setting up test environments:  Unavailable/inaccessible: Testing is constrained due to production schedules, security restrictions, contention between teams, or because they are still under development  Costly 3rd party access fees: Developing or testing against Cloud-based or other shared services can result in costly usage fees  Impractical hardware-based virtualization: Systems are either too difficult (mainframes) or remote (third-party services) to replicate via traditional hardware-based virtualization approaches Heterogeneous Environments Public Cloud Private Cloud Data Warehouse Mainframe Enterprise Service Bus Directory Identity File systems Collaboration App Under Test Routing Service Third-party Services Portals Content Providers EJB Shared Services Archives Business Partners Messaging Services Databases Mainframe applications App Under Test Third-party Services Packaged apps, messaging services, etc. Virtual Services

22. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational IBM Rational Test Virtualization Solution A smarter solution to better quality  Rational Test Workbench is a desktop solution that enables testers/developers to: –Capture and model virtual services –Test services and applications long before their user interfaces becomes available and do integration testing (SOA, BPM)  Rational Test Virtualization Server is a server solution that: –Provides a central environment to virtualize heterogeneous hardware, software and services to provide 24x7 testing capabilities –Reduces infrastructure costs of traditional testing environments –Virtual Services can be built from the interface definition of the system for a wide variety of protocols, including HTTP, web services, SOA, JMS, TIBCO, IBM WebSphere MQ, Oracle, etc.  Rational Performance Test Server enables Rational Test Workbench users to reuse test scripts to drive performance testing –Can be used in combination with Virtual Services –Probe for identification of system bottlenecks Databases Mainframe applications App Under Test Third-party Services Packaged apps, messaging services, etc. Rational Test Virtualization Server Rational Test Workbench Developers & Testers Rational Performance Test Server

23. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Define constrained systems and services for virtualization Integration Operability User AcceptanceSystem IntegrationSystemUnitIntegration Operability User AcceptanceSystem IntegrationSystemUnit Performance Developer uses virtual services to unit test code on their workstation – no elaborate environment required Development and Test teams uses virtual services for early stage advanced testing The full system or components of the system can be performance tested early in the cycle. Virtual services can be used when components are not available Later in the cycle, final pre- production versions of services are swapped in as they become available. Final testing is done against real services IBM Rational Test Virtualization Solution provides benefits across the software delivery life cycle

24. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Incremental Integration Testing Actual Service/App Virtual Service/App Test Virtualization is an enabler for continuous Integration Testing Services, applications, systems are introduced into the continuous integration cycle in a prioritized, controlled fashion. IBM Rational Test Virtualization Solution is a key enabler for Continuous Integration Testing

25. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Validating Virtual Services  Here’s our deployed app, with the stock quote service. In our scenario, the service is not accessible to our tester, so it must be virtualized.  IBM Rational Test Virtualization Server can duplicate (“stub”)the service so that we can test it. 25  Then, using IBM Rational Test Workbench, we can build a test that can ensure our new capability is working. IBM Rational Test Workbench

26. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Building Validation Tests 26  It’s simple to define the test steps, and we can run the test directly from Integration Tester to make sure it works. IBM Rational Test Workbench

27. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Viewing the results 27  Once the script is run, we can access the results through an integrated dashboard in Rational Team Concert, which includes multiple links to dive into the data for a complete view of each process. IBM Rational solution for Collaborative Lifecycle Management

28. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Viewing our results  Each step of the process is captured.  In our case, we did a complete application build, deployment, functional test suite and virtualized service test suite inside 6 minutes.  Without the continuous delivery automation, these steps could have taken days or weeks. 28 IBM Rational solution for Collaborative Lifecycle Management

29. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational The Continuous Delivery Pipeline  But that’s only one step along the pipeline.  We can use the results of our validation tests in uDeploy to define approval gates. 29  By setting statuses, we can build gates in uDeploy that the application needs to pass in order to move on to the next step along the pipeline. uDeploy

30. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Ensuring Quality deployed applications 30  For each environment we define - dev, QA, UAT, staging or production, we can set these approval gates to ensure that our application is meetin quality criteria at each step of the way. uDeploy

31. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Develop and Test solutions Measureable results and business value 31 Communications Service Provider Revamp manual approach to decrease testing time and increase quality  Solution: Rational Test Workbench with IBM Green Hat  Results: Increased team efficiency by 300%, and decreased test time 25-40% A leading global financial services firm with assets of over $2 trillion Many disparate legacy format to be migrated to next gen payments system  Solution: Virtualized third-party systems otherwise unavailable for testing  Results: Reduced manual testing from 10 days to 10 minutes, saving over $7 million to date Major U.S. insurer Recognized manual test efforts insufficient for complex SOA and web services  Solution: Agile middleware solution created to match the legacy systems’ functionality  Results: Reduced testing by 95% to 2 hours; reduced ‘rate filing’ validation by 94% to 320 hours Global manufacturer acquires competitor Migrate off rented infrastructure onto company’s standardized middleware platform  Solution: Virtualized critical, unavailable systems during migration  Results: Fully integrated in 6 months – 2 months ahead of schedule; saved significant rental costs and dependencies on third-party systems

32. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational Release and Deployment solutions Deliver measureable business results 32 International Investment Firm Driving Down Costs Release process required considerable effort and delayed by manually-introduced errors  Solution: Automated release process  Results: Cost avoidance of over $2.3M/year, reduced release time from 2-3 days to 1-2 hours and virtually eliminated test team “down-time” Higher Education Speeding Time-to-Market Agile development teams constrained by slow deployment to dev. and test environments  Solution: Accelerate deployment by enabling development teams to self deploy with automation  Results: Deployments cut from hours to minutes and a greater number of servers with fewer resources SaaS Software Provider Reducing Risk Difficulty managing multiple customer configurations and versions of software deployed across servers  Solution: Automate managing configuration and version deployment  Results: Execute customer specific releases, reduced deployment outages by over 90% Online Retailer Speeding Time-to-Market Significant delays getting application changes to production  Solution: Scaled up continuous deployment  Results: Deployment time reduced by over 95% with easy scale and deploying to over 250 servers within 2 months of implementation

33. © 2013 IBM Corporation Accelerating Product and Service Innovation | Rational 33 © Copyright IBM Corporation 2013. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others. www.ibm.com/software/rational