WEBINAR In The Digital Age, Agile Testing With The Right Data Matters Diego Lo Giudice, Vice President, Principal Analyst @dlogiudice Noel Yuhanna, Principal Analyst @nyuhanna July 19, 2016. Call in at 10:55 a.m. Eastern time

Agenda Agile empowers digital businesses, and more quality has to come with speed. Test data management (TDM) challenges and needs The “accelerated” TDM life cycle The TDM landscape: home grown, services, and tools

Agenda Agile empowers digital businesses, and more quality has to come with speed. Test data management (TDM) challenges and needs The “accelerated” TDM life cycle The TDM landscape: home grown, services, and tools

The age of the customer Delta exploits digital technology to transform the flying experience of customers.. Delta Air Lines exploits digital technology to transform the flying experience of customers.

The digital revolution hits “things” as well

No industry is immune to digital disruption . . .

But what makes a business digital? It’s software, applications, and modern applications! A must for any business to become obsessed with achieving excellence in developing, testing, and delivering great software!

Quality at speed

Agenda Agile empowers digital businesses, and more quality has to come with speed. Test data management (TDM) challenges and needs The “accelerated” TDM life cycle The TDM landscape: home grown, services, and tools

50% 20% Test data impediments Testers Developers Waiting Looking Manipulating Creating

TDM challenges have grown over the years Data explosion that’s impacting testing Need for continuous, faster cycles of testing Need for integrated data across various sources More data sources are needed by applications. Increasing demand for collaboration Growing pressure of regulatory compliance Tighter integration with support for all kinds of data formats, types, and standards

WIM: Weak TDM strategy impacts Agile development More bugs in production causing app issues Higher testing and development costs Duplication of effort — resources, people Impact on performance and scale New app development slows down. Impact on business growth and potential revenue

Retailers, banks, and public organizations tell us that poor TDM leads to: Higher project cost avoidance. Overall poorer productivity. TD testers’ loss of productivity.

Agenda Agile empowers digital businesses, and more quality has to come with speed. Test data management (TDM) challenges and needs The “accelerated” TDM life cycle The TDM landscape: home grown, services, and tools

Test data management is a continuous life cycle Source: “Vendor Landscape: Enterprise Test Data Management” Forrester report

Agile teams look for leaner TDM governance, although production “cloning” and “sub-setting” lead “How frequently do you use the following testing practices? (Please select one)” Automation enjoys growing adoption for both functional regression and nonregression tests. Service virtualization, TDD, and BDD are still far from where they need to be. Base: 160 professionals with knowledge of their firms’ Agile practices; Source: Forrester’s Q2 2015 Global Agile Software Application Development Online Survey

Source: “Five Must-Do’s For Testing Quality At Speed” Forrester report

This is not an obvious shift . . . How it is How it should be Copy test data from production Agile governance to have test data created “on demand” Test data created manually by testers Test data needs to be aligned across Agile teams. Test data not available to testers and developers Test data provisioned continuously from sprint 0 . . . throughout remaining sprints! Large, costly databases of data not easy to maintain All databases are compacted for testing, purposed to speed testing. You can’t be Agile if you don’t have Agile test data!

CD leaders make test data management a first-class citizen: progressive, iterative, and fully integrated in sprints Sprint 1 Sprint 2 Sprint 3 . . . Sprint N S p r i n t 0 Test data Test data Test data Test data Test data End-to- end Test data Integrati on Testing Source: “Consistent Performance In Agile Teams Must Include Testing” Forrester report

Production environment TDM has to feed a multispeed continuous delivery capability, which, over time, will become one speed: fast! Automated continuous delivery pipeline Automated gate checks Release automation Automated unit testing Automated functional testing Automated process testing Automated performance testing Release candidates Test Data Test Data Test Data Source: Forrester adaptation of SVT for dummies Development Build Test environment Stage environment Production environment Retrovert Retrovert Deploy

Agenda Agile empowers digital businesses, and more quality has to come with speed. Test data management (TDM) challenges and needs The “accelerated” TDM life cycle The TDM landscape: home grown, services, and tools

TDM technology is on the moderate success trajectory of our continuous software delivery technology radar ̶ but growing! Large, bloated solutions have dominated the market! Modern tools tie requirements to test cases to test data with automation! Source: “TechRadar™: Continuous Software Delivery, Q2 2015” Forrester report

TDM has many necessary components to support end-to-end testing ̶ which aligns with vendor solutions. Source: “Vendor Landscape: Enterprise Test Data Management” Forrester report

Source: “Vendor Landscape: Enterprise Test Data Management” Forrester report

Source: “Vendor Landscape: Enterprise Test Data Management” Forrester report

Source: “Agile Test Data Management: The New Must-Have” Forrester report

Source “Agile Test Data Management: The New Must-Have” Forrester report

Systems integrators also provide TDM-as-a-service Capgemini, Cigniti, Cognizant, Dell Services, Hexaware, HPE Services, IBM GBS, Infosys, Syntel, Tata Consultancy Services (TCS), Tech Mahindra . . .

Recommendations Prepare test data at the enterprise level. Make data provisioning more repeatable. Build a unified test data repository across apps. Look at automating all TDM functions. Leverage the cloud TDM platform. Consider vendors that provide end-to-end solutions. Look at TDM services.

Key research used for this presentation “The 2015 State Of Agile Development” Forrester report “The 2015 State Of Agile Development: Learn From Agile Expert Firms” Forrester report “Agile Experts Focus On Downstream Delivery” Forrester report “Agile Test Data Management: The New Must-Have” Forrester report “Five Must-Do’s For Testing Quality At Speed” Forrester report “Vendor Landscape: Enterprise Test Data Management” Forrester report

Diego Lo Giudice dlogiudice@forrester.com Twitter: @dlogiudice Noel Yuhanna nyuhanna@forrester.com Twitter: @nyuhanna