1. An Automated approach towards Dev-Ops based continuous Regression Testing for SAP Landscapes
Main Author - Navaneetha Kowdle (Associate Director)
Co – Author - Akshay Mullick (Consultant)
Cognizant Technologies

2. Abstract
SAP implementations can be extremely complex and test repositories, built over a time, can be voluminous
The constant need for changes impact existing functionality continuously and QA in general & Regression testing in particular are key activities to ensure nothing is broken
Many of the world’s largest implementers of SAP are continuously looking to improve the effectiveness of an already mature QA organization.
Regression Testing, although a key activity, takes time and effort for each release and QA organizations are looking at making this effective and agile
Focused testing using an impact based approach can help reduce RT scope whilst maintaining efficacy
A customized Dev-Ops solution for Regression Testing SAP systems can dramatically reduce time and effort
This presentation presents a successful implementation of a dev-ops based continuous Regression Testing approach using Impact analysis

3. An Automated approach towards Dev-Ops based continuous Regression Testing for SAP Landscapes
Covered in Two Phases
Phase 1 - Impact Analysis - Tool Selection & implementation
Phase 2 - Continuous RT – adaption of Shift Left approach using DevOps

4. Phase 1 - Erstwhile approach Vs Impact based approach
Normal RT Scoping :
Impact based RT Scoping :
Regression
Test Scope
“Baseline”
Optional Scenarios fragile
(dependency on skills of individuals)
Baseline Testing
Driven by business critical scenarios
covering core processes
Understanding the changed objects
Limiting Test Scope
“Gap Identification” will identify that our RT Capability misses certain test cases and triggers creation of those before RT cycle

5. Why BPCA (Impact Analysis Tool) for SAP
BPCA is a part of SAP-SolMan Suite
Provided a means to make use of existing Test repository to build a blueprint, thus providing a 1-1 mapping.
BPCA is capable of understanding existing test assets’ coverage (TBoMs)
More granular than other tools compared, thus providing finer impact (Subroutine/Form level).
Features such as configurable Test Scope Optimization / Multiplicity parameter to define extent of testing
Advantageous in building customized solution for continuous testing

6. Implementing BPCA based RT– Key Steps
Business Blueprint
Set up of business process hierarchy
Business Requirements
TBOM Creation (Static/Semi-Dynamic/Dynamic)
CHARM
Change Document information
Transport Information
Business Process
Change Analyzer
Impact Analysis
Test Scope Optimization
Multiplicity Parameter
Connection Setup
Test Planning &Setup
TAO/UFT Scripts Re-structuring
Requirements Mapping
Test Lab Creation
Test Execution
Impacted Automated Test Scenario Execution
Impacted Manual Test Scenario Execution
Defect Tracking
Defect raised and tracked for failed scenarios

7. Pain Points encountered during BPCA implementation
Effort for TBoM creation
Manual
Also TAO with Association, PFA Consolidation, link to HP ALM Requirements module
OSS Notes for enabling TBoM creation (auto and manual) – guinea pig approach
TAO scenarios restructuring – PFA consolidation etc to
Need to review HP ALM hierarchical structure in order to align with Blueprint / BPCA needs
Technical Connection Setup with HP ALM
Approach for auto TBoM creation for UFT scenarios
Connections between SAP SolMan and Managed Systems

8. Regression testing – Impact based approach
BPCA & TSO Executed with Transports collected from CHARM
Developer implements the change and release the transport
BPCA & TSO
Change and Transport information flows to CHARM
S7D4716
S7D4716
S7D4717
QA Environment
S7D4713
S7D4714
S7D4712
HP Quality Center
S7D4716
Pre-Prd Environment
S7D4716
S7D4716
Test Lab created of impacted Scenarios after TSO from BPCA
Automated Test Scenarios selected and executed in Pre-PRD

9. Data Speak – End of Phase 1

10. …limits speed and flexibility Focus on testing „new“ functionality
Phase 2 -Taking it Further – Pioneering work
Increasing Test Coverage
Continuous RT – adaption of Shift Left approach using DevOps
“The V Model”
“Shift Left”
Gate 3
Regression testing ensures that a change or fix has not caused faults in unchanged parts of the system.
Gate 2B
Regression Test
Light
Regression Test
Gate 0
Integration testing ensures that the e2e process as described in the design documents function as described.
User acceptance testing ensures that changes meet the business requirements. -
Business
Requirements
Gate 1
Gate 2A
User Acceptance Test
Gate 0
Gate 3
Gate 2B
Functional Design -
Business Requirements
Regression Test
Integration Test
Cycle 1 / 2
Gate 1
Gate 2A
Technical Design
User Acceptance Test
Functional Design
H/H
H/H
Unit / Component / Assembly Test
…turning into Continuous RT…
Integration Test
Cycle 1 / 2
Technical Design
H/H
H/H
Build
Unit / Component / Assembly Test
…limits speed and flexibility
New or changed requirements are brought to production by projects. Fixes to incidents and problems are brought to production by application maintenance.
Build
…will enable Fast Track Deployments
not compromising on resilience
finally resulting into Continuous Deployment…
Focus on resilience
Focus on testing „new“ functionality

11. Continuous Automated Regression Testing
BPCA & TSO
Automated Inbuilt Mechanism
Automated BPCA Execution
Manual Process
Test Data Solution
S7D4716
Automated Test Lab Creation
Manual Process
S7D4717
QA Environment
S7D4716
S7D4713
HP Quality Center
S7D4714
S7D4712
Auto scenarios
Automated Test Execution
Manual Process
Automated Test Selection
Manual Process

12. Benefits of Impact Analysis Advancing Benefits Through Test-Ops
Targeted Testing
Reduced Effort
Increased Resilience
Faster Time to Market
Reduced Cost
Early Defect Detection

13. Benefits seen post implementation
Test Coverage
Gaps identified which are not covered under Baseline Test Scenarios.
Gap Fulfillment increased test coverage by approximately 15% in year 1 .
Accelerated Approach
Shortened overall Release Cycle window by approximately 3 working days
Defects are caught earlier in Release Cycle.
Cost
Save cost by engaging less number of testing resources due to targeted testing.
Reduced Regressing Cycle time saved Testing Cost
Early defect detection/correction reduced debug/retest effort significantly
Tangible Benefits
Up to 60% reduction in testing effort.
Brought in 25% more agility which helps in faster “Time to Market”.

14. Author Biography Main Author Co - Author
Navneeth Kowdle is an Associate Director  with the  Process & Quality consulting division ( a part of Cognizant Business Consulting group). In this capacity , his role entails overall management of  PQC practice in the Communication ,Media and Technology space, in addition to personally  getting engaged with customers in providing consultancy services in niche  areas of Quality Assurance such as DevOps, Business Process Testing , QA transformation strategy etc
Main Author
Akshay Mullick is working as an Consultant  with the  Process & Quality consulting division ( a part of Cognizant Business Consulting group. His role is to act as a bridge between business and technology for client and propose solutions which addresses their problem statement. His area of expertise is Agile, Dev-Ops, Change Management, Tools & Automation around Impact based testing
Co - Author

15. Thank You!!!
Questions ?