An Automated approach towards Dev-Ops based continuous Regression Testing for SAP Landscapes Main Author - Navaneetha Kowdle (Associate Director) Co – Author - Akshay Mullick (Consultant) Cognizant Technologies

Abstract SAP implementations can be extremely complex and test repositories, built over a time, can be voluminous The constant need for changes impact existing functionality continuously and QA in general & Regression testing in particular are key activities to ensure nothing is broken Many of the world’s largest implementers of SAP are continuously looking to improve the effectiveness of an already mature QA organization. Regression Testing, although a key activity, takes time and effort for each release and QA organizations are looking at making this effective and agile Focused testing using an impact based approach can help reduce RT scope whilst maintaining efficacy A customized Dev-Ops solution for Regression Testing SAP systems can dramatically reduce time and effort This presentation presents a successful implementation of a dev-ops based continuous Regression Testing approach using Impact analysis

An Automated approach towards Dev-Ops based continuous Regression Testing for SAP Landscapes Covered in Two Phases Phase 1 - Impact Analysis - Tool Selection & implementation Phase 2 - Continuous RT – adaption of Shift Left approach using DevOps

Phase 1 - Erstwhile approach Vs Impact based approach Normal RT Scoping : Impact based RT Scoping : Regression Test Scope “Baseline” Optional Scenarios fragile (dependency on skills of individuals) Baseline Testing Driven by business critical scenarios covering core processes Understanding the changed objects Limiting Test Scope “Gap Identification” will identify that our RT Capability misses certain test cases and triggers creation of those before RT cycle

Why BPCA (Impact Analysis Tool) for SAP BPCA is a part of SAP-SolMan Suite Provided a means to make use of existing Test repository to build a blueprint, thus providing a 1-1 mapping. BPCA is capable of understanding existing test assets’ coverage (TBoMs) More granular than other tools compared, thus providing finer impact (Subroutine/Form level). Features such as configurable Test Scope Optimization / Multiplicity parameter to define extent of testing Advantageous in building customized solution for continuous testing

Implementing BPCA based RT– Key Steps Business Blueprint Set up of business process hierarchy Business Requirements TBOM Creation (Static/Semi-Dynamic/Dynamic) CHARM Change Document information Transport Information Business Process Change Analyzer Impact Analysis Test Scope Optimization Multiplicity Parameter Connection Setup Test Planning &Setup TAO/UFT Scripts Re-structuring Requirements Mapping Test Lab Creation Test Execution Impacted Automated Test Scenario Execution Impacted Manual Test Scenario Execution Defect Tracking Defect raised and tracked for failed scenarios

Pain Points encountered during BPCA implementation Effort for TBoM creation Manual Also TAO with Association, PFA Consolidation, link to HP ALM Requirements module OSS Notes for enabling TBoM creation (auto and manual) – guinea pig approach TAO scenarios restructuring – PFA consolidation etc to Need to review HP ALM hierarchical structure in order to align with Blueprint / BPCA needs Technical Connection Setup with HP ALM Approach for auto TBoM creation for UFT scenarios Connections between SAP SolMan and Managed Systems

Regression testing – Impact based approach BPCA & TSO Executed with Transports collected from CHARM Developer implements the change and release the transport BPCA & TSO Change and Transport information flows to CHARM S7D4716 S7D4716 S7D4717 QA Environment S7D4713 S7D4714 S7D4712 HP Quality Center S7D4716 Pre-Prd Environment S7D4716 S7D4716 Test Lab created of impacted Scenarios after TSO from BPCA Automated Test Scenarios selected and executed in Pre-PRD

Data Speak – End of Phase 1

…limits speed and flexibility Focus on testing „new“ functionality Phase 2 -Taking it Further – Pioneering work Increasing Test Coverage Continuous RT – adaption of Shift Left approach using DevOps “The V Model” “Shift Left” Gate 3 Regression testing ensures that a change or fix has not caused faults in unchanged parts of the system. Gate 2B Regression Test Light Regression Test Gate 0 Integration testing ensures that the e2e process as described in the design documents function as described. User acceptance testing ensures that changes meet the business requirements. - Business Requirements Gate 1 Gate 2A User Acceptance Test Gate 0 Gate 3 Gate 2B Functional Design - Business Requirements Regression Test Integration Test Cycle 1 / 2 Gate 1 Gate 2A Technical Design User Acceptance Test Functional Design H/H H/H Unit / Component / Assembly Test …turning into Continuous RT… Integration Test Cycle 1 / 2 Technical Design H/H H/H Build Unit / Component / Assembly Test …limits speed and flexibility New or changed requirements are brought to production by projects. Fixes to incidents and problems are brought to production by application maintenance. Build …will enable Fast Track Deployments not compromising on resilience finally resulting into Continuous Deployment… Focus on resilience Focus on testing „new“ functionality

Continuous Automated Regression Testing BPCA & TSO Automated Inbuilt Mechanism Automated BPCA Execution Manual Process Test Data Solution S7D4716 Automated Test Lab Creation Manual Process S7D4717 QA Environment S7D4716 S7D4713 HP Quality Center S7D4714 S7D4712 Auto scenarios Automated Test Execution Manual Process Automated Test Selection Manual Process

Benefits of Impact Analysis Advancing Benefits Through Test-Ops Targeted Testing Reduced Effort Increased Resilience Faster Time to Market Reduced Cost Early Defect Detection

Benefits seen post implementation Test Coverage Gaps identified which are not covered under Baseline Test Scenarios. Gap Fulfillment increased test coverage by approximately 15% in year 1 . Accelerated Approach Shortened overall Release Cycle window by approximately 3 working days Defects are caught earlier in Release Cycle. Cost Save cost by engaging less number of testing resources due to targeted testing. Reduced Regressing Cycle time saved Testing Cost Early defect detection/correction reduced debug/retest effort significantly Tangible Benefits Up to 60% reduction in testing effort. Brought in 25% more agility which helps in faster “Time to Market”.

Author Biography Main Author Co - Author Navneeth Kowdle is an Associate Director  with the  Process & Quality consulting division ( a part of Cognizant Business Consulting group). In this capacity , his role entails overall management of  PQC practice in the Communication ,Media and Technology space, in addition to personally  getting engaged with customers in providing consultancy services in niche  areas of Quality Assurance such as DevOps, Business Process Testing , QA transformation strategy etc Main Author Akshay Mullick is working as an Consultant  with the  Process & Quality consulting division ( a part of Cognizant Business Consulting group. His role is to act as a bridge between business and technology for client and propose solutions which addresses their problem statement. His area of expertise is Agile, Dev-Ops, Change Management, Tools & Automation around Impact based testing Co - Author

Thank You!!! Questions ?