1. Application Lifecycle Optimization with Agile Collaboration and Cloud DevTest Labs Date Name when title IS NOT a question there is NO ‘WE CAN’ in the box

2. Changing nature of applications – where is the application? Users and and the applications have moved to the cloud. —Applications are no longer in the hands of call centers. Losing simplified consumption and training of application use. —Applications are no longer on our enterprise computers and green screens. Losing control over delivery of business applications. —Applications are in the hands of the end users. Losing knowledge of how the application is being used. Who is SME? 2

3. Increasing complexity and heterogeneity of environments —Internal cloud initiatives are pervasive, data visualization is in the cloud —Production is the only true end to end implementation people have for combined business workflows —These environments are getting more complex – monitoring of a application is spanning data centers and cloud providers —Production visibility is the only accurate record of how composite and SOA applications actually run in cloud providers 3

4. Cloud based lab Constraints “Wires hanging out” of the cloud for DevTest Labs Virtual Machines Websphere Order Mgr Virtual Lab Manager Cloud Environment CRM Mainframe SaaS DB System of Record System Dependencies Remain Unanswered VM Catalog Dev Test Provision Requests

5. Dev & Test Cloud – Addressing Bottlenecks preproduction Throughput is always set by the lowest capacity system Any off-Cloud system nullifies the promise of on-demand capacity Portal Service/XML Gateway ERP System (CAN’T REPLICATE) Order MgmtFulfillment Actual throughput Post-Cloud throughput 20 10 8 8 =2 2 2

6. Portfolio Management RequirementsDesignDev System Test Integration Test UAT Performance Test DeployMonitor Planning & Governance LISA Production & Support DevTest Cloud Manager Service Virtualization Test Automation Defect Collaboration Continuous Validation ALM (Requirements, Code, Test Mgmt) Introducing CA LISA suite Optimizing Agile Composite Application Development Platforms for agile composite app dev Application Lifecycle

7. W W W. I T K O. C O M Dysfunctional Development Cycles Meeting business demand has consequences in IT  Most new applications are composite and highly integrated  Agile has replaced waterfall development methodologies  Much of the new application development is self-service and customer- facing making complexity exponential

8. W W W. I T K O. C O M Dysfunctional Development Cycles Meeting business demand has consequences in IT  Much of the information developers need is outside of their control when they need it  Limited predictability on performance and where it’s going to break  Traditional products and methodologies fail in this new cloud architecture Result: Inability to release new functionality on time – over budget and poor quality

9. W W W. I T K O. C O M 4 Huge Opportunities for Improvement

10. Problem: Constraints “I can’t do anything unless I have everything”

11. Virtual Services HTTP JMS JDBC SOAP Create Maintain Live Traffic Transaction logs, WSDL definitions, flat files, other Agents LISA Workstation “Self-Heal” from Live Systems Virtual Services are typically 95- 100% “complete” upon creation Source Application Flexible options to create and maintain Virtual Services

12. Constraint: Limited capacity for production level load tests Large North American consumer bank web presence BeforeAfter Business Problem  Limited capacity on test instances of Back-end Services  Unable to sufficiently test ESB for performance Business Impact  More complete SLA testing in less time  Test lab costs reduced 30% in Year 1, 65% in year 2  Avoided over $30M in test lab hardware upgrades VSE ~5000 tps ESB Back-end Services ESB Load Generators Public facing applications ~20 tps Eliminate Capacity Constraints

13. Constraint: Could not deliver on parallel development Regional telco and global internet backbone BeforeAfter Business Problem  Integrate enterprise systems for 7 acquired telecom companies  Increase speed and agility to deliver new product offerings Business Impact  70% testing time reduction for end-to-end  New release functional points increased by 60% with better quality  38% reduction in testing time due to virtualizing unavailable systems11 DELAY Billing Savvion Siebel Time VSE

14. Problem: Manual Labor “My team of 50 is now a team of 250 in just 5 years due to more components and releases.”

15. Solution: Automation Achieve and maintain 85%-95% coverage after 1 st test cycle.

16. Baseline generation Replay previous application transactions to verify behavior

17. Problem: Complexity “We spend far more time figuring out where the bug is than we do fixing the bug”

18. Solution: Collaboration Reduced “non-reproducible” defect closure by > 66% DEVELOPER TESTER “Alt-Click!”

19. POS Systems CMS Database Vendors Integration Broker CMS Apps CSR APP OMS Pricing & Offers VMI Customer Info Inventory Management Functional & Regression Testers Result: Inability to release customer functionality to stores on time! App upgrade incomplete Errors lost at integration Data setup 4+ hours/test Changes invalidate regressions System access denied Complexity: highly integrated systems inside enterprise Leading Electronic Retailer – Mobile Sales app

20. Solution: Visibility to DevTest Labs exposing application behavior

21. POS Systems CMS Database Vendors Integration Broker CMS Apps CSR APP OMS Pricing & Offers VMI Customer Info Inventory Management Functional & Regression Testers Reduce infrastructure cost, setup time and execute 60x faster Model virtual app from definition Baseline and Directly invoke & verify ESB responses CA LISA agents capture data, test cases, environment Virtualize Customer app ready 24/7 CA LISA Users Middle-tier test suites Deliver end-to- end testing using CA LISA Baseline Automate end-to-end regression and performance test scenarios for better productivity

22. Complexity: Cloud based consumer applications How is the user actually using the system? 22 End Users Quality Teams How do the users do that? I just use the back Button… I book marked this page and start here…

23. OMS v2.0 Mainframe System of Record ERPCost OMS v2.1 Performance Profile Load Pattern Production Data Mining to Close the Loop understanding Production enables a new best practice…

24. Remove the problem of “wires hanging out” For Cloud DevTest Labs Virtual Machines Websphere Order Mgr LISA Dev Cloud Manager CRM CA LISA Virtualize (Virtual Services) MFvsDBvsSaaSvs Virtual Service Catalog VM Catalog Model dependent systems in dev test cloud to create production like environments Dev Test Provision Requests

25. W W W. I T K O. C O M Better modeling in Cloud DevTest Labs optimizes the application lifecycle