1. 2012/13 Presentation to NOSQAA November 15, 2012 World Quality Report 2012-13 Testing for the Future

2. 2 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Company Overview

3. 3 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Sogeti Testing Practice Overview

4. 4 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Introductions Dan Hannigan Senior Vice President QA/Testing Services Sogeti USA Dan Hannigan is a Senior Vice President with Sogeti USA LLC. Sogeti is a wholly owned subsidiary of Capgemini SA. Dan has been with Sogeti for 24 years, during this time he has held several positions including: Director of Consulting Services specializing in package implementations, Manager of Systems Professionals, Project Manager, National Practice Manager for Seibel Implementations, Account Executive (sales), Geographic Vice President for the Akron/Cleveland offices and is currently the North American Practice Manager for the Sogeti Quality Assurance and Testing Practice (Managed Testing Practice). His current responsibilities include supporting Sogeti Geographic units in the sales and delivery of QA/Testing solutions, development of solutions within the practice and Global responsibility to the Sogeti Global team for Strategic development. Dan also sits on the Global Innovation Board which is responsible for evaluation of potential Innovations for inclusion in the Sogeti QA/Testing Solutions. Prior to joining Sogeti Dan was the CIO for the Conna Corporation Convenience Stores chain a division of Dairy Mart Convenience Stores.

5. 5 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Agenda Introducing the World Quality Report Brief Overview North America Global Key Findings and how these relate to QA/Testing Organizations and Professionals Key findings by Topic  Quality Budgets  Testing Centers of Excellence  Mobile Testing  Cloud  Quality Assurance Resources Key findings by Sector Q&A

6. 6 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 What is the World Quality Report?  Only global report for application quality covering: Outsourcing trends, tools, technology, organization Industries: CPRD; E&U; FS; High-Tech; Public; TME Geographic analysis: ANZ; Brazil; China; France; Germany; Netherlands; North America; Nordics; UK  Co-sponsored report by Capgemini, Sogeti & HP Capgemini Group (world leader in testing services) HP (World leader in application testing technologies  Research sample and methodology 1,553 telephone interviews with CIOs, CFOs, IT directors and senior managers involved in testing and QA based on a structured questionnaire.  Fourth year the report has been published

7. 7 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 World Quality Report: Interviews by Region  WQR research based on 1,553 telephone interviews covering 25 countries  Data from questionnaire and customer quotes

8. 8 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 World Quality Report: Interviews by Sector and Job Title Interviews by SectorInterviews by Job Title

9. 9 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 2012-13 World Quality Report Details 6 x 2 page sector analysis9 x 2 page country analysis, top trends

10. 10 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 North America  Respondents data Number of respondents: 296 Type of companies: Medium and Large Private Sector companies, Government and Public Sector Organizations, Breakdown as Follows: Based on FTE Headcount 10,000+ (119), 5,000-9,999 (99), 1,000-4999 (78) Telephone interviews carried out April – May 2012 Research conducted by specialist B2B market research company, analysis done by our own specialists in the Industry  Other information on country/sector 58% of NA Companies plan to use Testing-As-A- Service in the next 12 Months 44% of NA Companies say budgets have increased with 50% saying additional increase by 2015

11. 11 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 North America  Other information on country/sector The Cloud is seen as a way to optimize cost management, improve flexibility and help align IT with the needs of the business. Only 20% of NA organizations rate internal testing resources as above average in terms of quality 35% of organizations report that the testing function is highly decentralized and a further 41% operate combined centralized and decentralized teams 64% of companies report that internal Testing functions are performed by business analysts or development teams. 30% of companies plan to implement an internally managed TCOE in the next 2 years 19% of organizations intend to use 3 rd party TCOE capability

12. 12 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 North America  Other information on country/sector 1 in 10 organizations is still implementing a TCOE started in 2011, but only a minority have made the full transition. The commitment to testing is demonstrated by the allocation of IT budget to testing, at 18% it is on par with the global average, but more encouraging is that 40% of this budget is allocated to innovation/new transformational projects. 44% of organizations report that the IT budget is increasing and half are reporting that they expected continued increases thru 2015. 6% of organizations state clearly that the budget is either static or decreasing, not particular sector was identified. 60% or organizations reported that the greatest increase in investment is in tools and outsourcing

13. Key Findings and their implications for Organizations

14. 14 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 QA budgets: Stepping up Majority of organizations expect testing budgets to rise between now and 2015.

15. 15 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 QA budget: Stepping up  General and universal trend over regions and sectors  42% reported their testing budget has increased last year  same level of investment in quality is maintained: show importance of QA.  53% expect their QA budget to rise between now and 2015 Indicate optimism for future Testing spend on: –41% new transformational work (testing new application) –59% maintenance work (maintenance of existing software)

16. 16 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 “ “ QA budgets: Stepping up MY INVESTMENT GOING FORWARD WILL [FOCUS ON] BRINGING MY INTERNAL TEAMS UP TO STANDARD, INCREASING THE LEVEL OF AUTOMATION USED, AND DEVELOPING GREATER EFFICIENCIES THROUGHOUT. ALTHOUGH OUR TESTING BUDGET IS NOT SEPARATE FROM THE WIDER IT BUDGET, THE LEVEL OF MONITORING AND PERFORMANCE MEASURING HAS INCREASED – WE NEED TO JUSTIFY OUR COSTS. – AN AUTOMOTIVE BUSINESS, BRAZIL THE PROBLEM IS INCREASING PRESSURE TO GET THINGS DONE YESTERDAY. WE HAVE THIS CONFLICT BETWEEN TESTING ADEQUATELY TO OUR SATISFACTION AND THE TESTING TIME EXPECTED BY THOSE ON THE BUSINESS SIDE. INVESTMENT HAS INCREASED BUT THEN EXPECTATION IN SPEED OF DELIVERY HAS ALSO INCREASED. IT ’S NOT EASY, AS THE ORGANIZATION NEEDS TO BE ABLE TO JUMP INTO A MUCH FASTER TESTING MODE WHILE MAINTAINING QUALITY STANDARDS. – A MANUFACTURING BUSINESS, CZECH REPUBLIC

17. 17 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 QA budgets: Stepping up Figure 3 Areas of Greatest Increase in Spend

18. 18 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 QA Budget: Stepping up  Investment priorities: Budgetary line item: upgrade existing process and tools Why? Move to newer application lifecycle platforms and software-on-demand models 2015: 46% of businesses will dedicate their budget to purchase external resources to supplement their internal QA team.  Investment priorities vary by region: Eastern Europe invests more in new testing tool (33% compared to 19% generally and 15% for North America)  Public sector leads the way for increased QA budget :  rise of 48% compared to the previous year despite budget cuts.

19. 19 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Testing Centers of Excellence: A growing priority Organizations are turning to COEs to consolidate their QA operations in response to market pressures, technology demands, and emerging models of testing delivery.

20. 20 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Testing Centers of Excellence: A growing priority  Market unpredictability: some businesses still looking to shave 30-40% off their testing budgets. While QA budgets are increasing, still a need to control costs  Technology expectations: growing demand to deliver applications as quickly, efficiently and as cheaply as possible  Diversity of delivery models: QA departments are maximising on efficiency gains offered by the cloud, and agile testing (currently being used by 37% of testers)

21. 21 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 “ “ Testing Centers of Excellence: A growing priority A TCOE IS SOMETHING I’M BUILDING HERE; IT REPRESENTS A SIGNIFICANT CHANGE IN OUR APPROACH BUT ONE THAT I PERSONALLY BELIEVE TO BE VITAL TO OUR BUSINESS SINCE I’VE COME FROM AN ORGANIZATION WITH AN OPERATING TESTING CENTER. WE KNOW THAT IT CAN REDUCE COSTS AND OVERALL TIME OF TESTING PRACTICES, AND GIVEN THE COMPETITIVE NATURE OF THE MARKET WE OPERATE IN, IT’S CRITICAL TO GET SPEED AND COSTS DOWN WHILE GETTING QUALITY UP. WE BELIEVE A TCOE CAN DO THIS. FOR US, THE MOVE TOWARDS A TCOE IS PART OF THE WIDER UNION BETWEEN THE BUSINESS AND IT SIDE OF THE ORGANIZATION. WE NOW HAVE A MUCH STRONGER LINK BETWEEN THE TWO, AND WHILE THAT MEANS WE FEEL MORE ABLE TO UNDERSTAND AND ANSWER DEMANDS, IT DOES INCREASE PRESSURE ON TESTING TO BE MORE EFFICIENT AS A WHOLE – DECENTRALIZED TESTING TEAMS JUST COULDN’T PROVIDE THAT EFFICIENCY AND IT MEANT THAT WALLS EXISTED BETWEEN THE TEAMS, WHEREAS SHARED EXPERIENCE AND BEST PRACTICE ARE FAR EASIER WITHIN A TCOE FRAMEWORK. – A FINANCIAL SERVICES BUSINESS, FINLAND – A MANUFACTURING BUSINESS, UK

22. 22 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Testing Centers of Excellence: A growing priority Figure 3 Expected Benefits from Implementing a Testing Center of Excellence

23. 23 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Testing Centers of Excellence: A growing priority  Why build a TCoE and what benefits to expect? Speed to market: a key of growing TCoE adoption –Compressing time-to-market (36%) –Enhance the agility of QA operations (17%) To cope with challenges of an unpredictable economy: –Produce better and faster –Competition and maximize profits Contribute to enhance quality and better resource management: – An efficient approach to industrialize testing activity – Provide visibility into the level of quality for any software system or project – A centralized pool of resources that can be leveraged across multiple projects in an organization

24. 24 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Mobile Testing: Behind the curve  Only 31% of firms surveyed currently test mobile applications. Why? According to many interviewed for the report they have no appropriate tools or expertise and limited access to the devices to test effectively mobile applications.

25. 25 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Mobile Testing: Behind the curve  Why such a need of mobile testing? Proliferation of devices Need for mobility: performance and usability on the move Increase in demands and expectations  Shift to mobile devices: more than 5 billion mobile devices in the world for only 2 billion computers Quote: “More and more of our business is done online [in general] so it’s something [mobile app] we need to get hold of and understand quickly” A retail business, UK Real need of mobile testing which is not yet fulfilled....why?

26. 26 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Mobile Testing: Behind the curve  Companies are underprepared: Organizations are ill equipped: –65% do not have the right tools –52% do not have access to required devices Fragmentation of mobile devices and frequent releases:  a very changing market which requires adaptability from testing organizations

27. 27 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Mobile Testing: Behind the curve Average: 31% of organizations test mobile application Up to average : Regions with traditionally high levels of mobile application (Australia & NZ, Nordics, Western and Southern Europe) Asian challenges : Explosion of the mobile market in Asia Only 30% of organizations test mobile application so far Focus on portability and compatibility across devices

28. 28 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Mobile Testing: By Sectors  Manufacturing firms are surprisingly more likely to conduct mobile testing  Some sectors have difficulties to adopt mobile testing (Public sector, Financial services...)

29. 29 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Mobile Testing: By sectors Quote on page 28 Retail Business UK  increasing investments are expected over the coming year

30. 30 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Mobile Testing: Priorities when testing mobile applications

31. 31 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Mobile Testing: Priorities when testing mobile applications  Why testing mobile applications? Performance: increase efficiency is a priority for 64% of respondents –More acute in the UK & Ireland: 75% set performance as priority demonstrating the maturity of this market Security: only 18% set security as a priority on average –Suggest changing perspectives in security concerns (Bring-your-on-device culture and protection of data)

32. 32 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Cloud: Gathering Pace  28% of testing currently occurs in the cloud environment  This is set to rise to 39% by 2015  Only 4% reported no plans for Cloud testing, down from 31%, 2 years ago.

33. 33 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 “ “ Cloud: Gathering Pace THE CLOUD HAS BECOME A SIGNIFICANT PRIORITY FOR OUR ORGANIZATIONAL DIRECTION IN THE INFORMATION TECHNOLOGY DEPARTMENT. WITH REGARDS TO TESTING, IT’S OPENING UP A WAY OF TURNING ON AND OFF A STREAM OF NEW SKILLS AND ABILITIES, THAT IS BOTH FAST AND COST-EFFECTIVE. – A FINANCIAL SERVICES BUSINESS, THE NETHERLANDS WE EXPERIENCE PEAKS AND TROUGHS IN OUR TESTING PROGRAM, SO TAAS PROVIDES A CERTAIN DEGREE OF FLEXIBILITY. WHILE SOME APPLICATIONS MAY BE RUN OF THE MILL, SOME MAY HAVE MORE AD HOC REQUIREMENTS. TAAS ALLOWS US TO MEET UNIQUE OR TEMPORARY NEEDS WITHOUT THE BURDEN OF GREAT COST OR ADDING TO PROJECT TIME. – A RETAIL BUSINESS, DENMARK

34. 34 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Cloud: Rapid Growth In the UK the Cloud has more than gathered pace: Only 11% don’t plan to use the Cloud.

35. 35 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Cloud: Benefits Organizations are rapidly turning to the Cloud for cost savings, flexibility, agility better resource and time management.

36. 36 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Quality Assurance Resources: A question of value 59%: qualify their internal QA teams as on “average” Only 4-5% are confident that their resources (internal and external) are best in class

37. 37 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Quality Assurance Resources: A question of value  Critical to assess the quality of software applications for organizations  Need confidence in the quality of QA resources  In developed countries, QA is becoming a recognized and dedicated profession  33% of companies express more confidence in outsourced resources than in their own employees  desire to increase QA skills  Find the right balance between in-house and external teams

38. 38 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 “ “ Quality Assurance Resources: A question of value OUTSOURCED TESTING WILL ALWAYS BE AN IMPORTANT OPTION, BUT HOW WE SOURCE THOSE TESTERS DOES TEND TO DEPEND ON PROJECT OR COST, RATHER THAN ANY SPECIFIC PREDEFINED RULES. WE USED TO USE INDIA-BASED SUPPLIERS A LOT MORE THAN WE DO TODAY, BUT THE COST BENEFITS WERE NOT BALANCED BY OUR INTERNAL CLIENT SATISFACTION FEEDBACK. – A FINANCIAL SERVICES BUSINESS, AUSTRALIA I’D LOVE TO BE ABLE TO PROFESSIONALIZE OUR TESTING FUNCTION – GIVE PEOPLE A CAREER AND THE PAY TO MATCH AND THEY’LL STICK WITH YOU. BUT THE REALITY IS QUITE THE OPPOSITE. TESTING IS SEEN AS A ‘NECESSARY EVIL’ IN MANY ORGANIZATIONS. THIS MEANS ORGANIZATIONS NEVER GIVE [TESTERS] THE PROPER ATTENTION [THEY] DESERVE AND WE END UP BUYING EXTERNAL EXPERTS WHO MAY HAVE THE SKILLS, BUT NOT NECESSARILY THE INTIMATE KNOWLEDGE OF OUR BUSINESS. – A RETAIL BUSINESS, DENMARK

39. 39 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Quality Assurance Resources: A question of value North America: most highly outsourced region for QA (to lower- cost labor market) FS: recognize much more than any other sector the value of experienced QA resources

40. Key findings by sectors

41. 41 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Consumer products, Retail and Distribution  Today’s trends: mobile and internet commerce  Invest in QA/testing to meet higher expectations from customers 41% say that their QA budget has increased (35% previously)  Need of innovation : 45% of testing activities implemented in new or transformational projects  Our survey findings: TCoEs: 6% already functional, 25% plan to develop them Cloud: 21% of their applications are cloud based Mobile : 34% are currently testing mobile application. The key criterion in this domain is the capacity to test application on several networks (60%)

42. 42 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 Energy & Utilities  Undergo major structural transformation (liberalization of markets)  Challenge: maintain antiquated legacy systems and invest in innovative product lines  IT budget has remained largely static this year (for 51% of respondents)  Our survey findings: TCoEs: a large proportion say having no plans for a TCoE (44%) Cloud: 1 in 5 of their applications hosted in the cloud TaaS: 47% plan to use TaaS within next year Mobile: 65% do not test mobile application Preference for upgrading internal expertise

43. 43 Copyright © 2012 Capgemini and Sogeti. All Rights Reserved World Quality Report 2012-13 | September 2012 High Tech  Fiercely competitive sector with a quick pace of change  Evolving relationship and interaction between consumers and organisations 41% say that their IT budget has increased this year Plan to invest in new testing tools by 2015 (45%), much more than any other sector  This sector will lead the way of innovation, what is reflected in its approach of QA  Our survey findings: TCoE: 43% plan to develop TCoE Cloud: 62% of their applications are hosted in the cloud TaaS: 13% use this service and 43% intend to use it within next year Mobile: 30% currently test mobile application

44. www.capgemini.com www.capgemini.com/testing www.sogeti.com/testing www.hp.com The information contained in this presentation is proprietary. It is for internal and intermediary use only. Copyright ©2012 Capgemini and Sogeti. All rights reserved. Rightshore ® is a trademark belonging to Capgemini. No part of this document may be modified, deleted or expanded by any process or means without prior written permission from Capgemini. About Capgemini and Sogeti With around 120,000 people in 40 countries, Capgemini is one of the world's foremost providers of consulting, technology and outsourcing services. The Group reported 2011 global revenues of EUR 9.7 billion. Together with its clients, Capgemini creates and delivers business and technology solutions that fit their needs and drive the results they want. A deeply multicultural organization, Capgemini has developed its own way of working, the Collaborative Business Experience™, and draws on Rightshore ®, its worldwide delivery model. Sogeti, its wholly-owned subsidiary, is a leading provider of local professional services, bringing together more than 20,000 professionals in 15 countries and is present in over 100 locations in Europe, the US and India. Together, Capgemini and Sogeti have developed innovative, business-driven quality assurance (QA) and testing services, combining best-in-breed testing methodologies (TMap ® and TPI ® ) and the global delivery model, Rightshore ®, to help organizations achieve their testing and QA goals. Capgemini and Sogeti have created one of the largest dedicated testing practices in the world, with over 9,500 test professionals and a further 14,500 application specialists, notably through a common center of excellence with testing specialists developed in India. About HP At HP, we don’t just believe in the power of technology. We believe in the power of people when technology works for them. To help you create. To make the digital tangible. To harness the power of human information. At HP, we work to make what you do matter even more. Our Business Technology Optimization (BTO) products, along with our new and complete approach to Application Lifecycle Management (ALM), help our customers to achieve better business outcomes. TMap ®, TMap NEXT ®, TPI ® and TPI NEXT ® are registered trademarks of Sogeti, part of the Capgemini Group.