1. Quantifying Quality in DevOps
Sastry Bvssrs Senior IT Quality Analyst
Nitin Upreti Project Manager
Optum

2. ..then the Strategies… First some concepts… ...then Conclusion.
ABSTRACT
Software Testing started initially as a Traditional Approach with Waterfall Model and then we moved towards V Model where verification and validation will be taken care as a whole for the requirements. Agility started with Scrum practices, then advanced in testing practices like Continuous Integration, Test / Behaviour Driven Development, then advanced with Operations practice like DevOps. But even then the agility of time to market is a challenge with traditional architecture.
This presentation outlines how we can achieve greater agility and also accelerate DevOps QA strategy by defining Efficient Strategies for QA in DevOps.
..then the Strategies…
First some concepts…
DevOps, Agile model, Team structure in DevOps
Business Challenges
What is DevOps?
Shift from Traditional to Devops Testing
(conceptually, Technically, Team & Style)
...then Conclusion.
Benefits to business
Metrics

3. CHALLENGE
In a recent IT Economic survey*, just 27 percent of IT executives said they deliver fast enough for the pace of business
IT Development and IT Operations have different values and ways of working that are often not in alignment.
IT organizations typically spend more time in testing, deploying and releasing software due to complex architecture patterns
A high proportion of production incidents are a result of human errors in the manual release of software
* - Source: Nginx

4. WHAT IS DEVOPS?
Development
Operations
Quality Assurance
DevOps is usually termed as it sits in between of Development, QA and Operations.
DevOps (a clipped compound of "development" and "operations") is a software development and delivery process that emphasizes communication and collaboration between product management, software development, and operations professionals.
(Source – Wikipedia)

5. + + Transition from Agile to Devops
DevOps = {Agile Methodology + Shift Left Approach + Lean Testing}
Agile :
Fast, Automated, Time to Market
Goals of DevOps:
Fast and Contiguous
Early and Often Test, Risk identification in same phase
Speed to Market
Improved Productivity
Low Risk
Improved Code Quality +
Shift Left :
Early and Automated Testing +
Lean:
Remove Waste

6. DEVOPS Might be well-structured inside.
But, can only be deployed as a whole
Traditional
Req Suite
Release
Finalize Build
Manual Testing
Automated
Regression Testing
Manual
Exploratory Testing
Components can only be deployed independently if tests are independent & if your Continuous Delivery Pipeline works
Finalize Build
Manual Testing
Automated
Regression Testing
Manual
Exploratory Testing
System Integration
Testing as a whole
Finalize Build
Manual Testing
Automated
Regression Testing
Manual
Exploratory Testing
DevOps
Release
Requirement Suite
Finalize Build
Manual Testing
Automated
Regression Testing
Manual
Exploratory Testing
Finalize Build
Manual Testing
Automated
Regression Testing
Manual
Exploratory Testing

7. Framework Agile Model Continuous Integration DevOps
Continuous Planning across Requirements
Continuous Testing by enabling Automation
Agile Model
Continuous Integration
DevOps
Continuous Development across Builds
Continuous Deployment across Releases

8. Testing Process Intelligent Testing: Change Impact Based Testing
Optimized Regression Suite
Continuous Development:
Correlating code Analytics with Test Analytics
Shift Left Performance Testing:
Find Performance issues in non-production stages
Service Virtualization in non-production stages
Shift Left Monitoring:
Infra and Application monitoring on demand with environment provisioning for non-production stages
Model Based Approach:
Infra as a Code
Topology Modelling
Test Design Modelling
Integrated Platform for Automation & Traceability:
Data Integration and Correlation

9. Productivity Index Factors Contributing to Productivity Index are:
Speed
Velocity
Faster Code Development
Impact Analysis
Build & Test Automation
Configuration Automation
Time to Market

10. Quality Index Factors Contributing to Quality Index are:
Improved Availability
Deeper Requirements Analysis
Early Business stakeholder support & involvement
Security & Compliance Risk Reduction
Identifying Issues earlier through continuous testing & integration

11. Operating Expense Index
Factors Contributing to Operating Expense Index are:
Cost Avoidance/Optimization
Doing more with what you have
Fail fast and Fail Cheap
Cost Modelling
IT Allocation

12. Capital Expense Index
Factors Contributing to Capital Expense Index are:
Improved Utilization
Technology Transformation
Convergence

13. BENEFITS TO BUSINESS $$
$$$ $
SPEED
TO MARKET
Up to 50% increase in speed to market through streamlined software delivery
Test Coverage
Increased Test Coverage and reduced manual Effort due to Model Based Testing
DELIVERY RISK
RESILENCY
Reduced defects in later test phases by up to 30% and overall higher quality
Operational state is more stable and secure and changes are systematically auditable
Model Based Testing provide more options for Exploratory Testing
Agility in
Architecture
SOA
Micro services
Test Pyramid help us to maintain a balance between the different types of test
Agility in
Operations CD
Cloud
Exploratory
Agility in
Development
/ Testing CI
TDD
BDD
End to End
Agility in
Process
Scrum
Scaled Agile
Component
Greater Agility
Integration Test
Unit Test

14. Author Biography
B V S S R S Sastry works as a Senior IT Quality Analyst at Optum Global Solutions, Hyderabad and have 5+ years of experience in Integrated Test Environment Services, ITIL & CMMI Level 5 assessment Process Improvement in Insurance domain. He holds a Master’s Degree in Technology from JNTU Hyderabad. He is a certified ISTQB professional, ITIL V3 certified. He has published 17 International white papers till date.
Nitin Upreti works as a Project Manager at Optum Global Solutions, Gurgaon. He has a vast experience of 14 + years in the IT industry with expertise ranging from White Box testing, Mainframes, Web technologies and transforming Legacy applications into Big data based solutions. He is a certified professional from ISTQB and the Academy of Health care Management, USA. He Holds a Post Graduate Diploma in Business Management along with a Bachelor degree in Computer Applications.

15. Thank You!!!