Quantifying Quality in DevOps Sastry Bvssrs Senior IT Quality Analyst Nitin Upreti Project Manager Optum

..then the Strategies… First some concepts… ...then Conclusion. ABSTRACT Software Testing started initially as a Traditional Approach with Waterfall Model and then we moved towards V Model where verification and validation will be taken care as a whole for the requirements. Agility started with Scrum practices, then advanced in testing practices like Continuous Integration, Test / Behaviour Driven Development, then advanced with Operations practice like DevOps. But even then the agility of time to market is a challenge with traditional architecture. This presentation outlines how we can achieve greater agility and also accelerate DevOps QA strategy by defining Efficient Strategies for QA in DevOps. ..then the Strategies… First some concepts… DevOps, Agile model, Team structure in DevOps Business Challenges What is DevOps? Shift from Traditional to Devops Testing (conceptually, Technically, Team & Style) ...then Conclusion. Benefits to business Metrics

CHALLENGE In a recent IT Economic survey*, just 27 percent of IT executives said they deliver fast enough for the pace of business IT Development and IT Operations have different values and ways of working that are often not in alignment. IT organizations typically spend more time in testing, deploying and releasing software due to complex architecture patterns A high proportion of production incidents are a result of human errors in the manual release of software * - Source: Nginx

WHAT IS DEVOPS? Development Operations Quality Assurance DevOps is usually termed as it sits in between of Development, QA and Operations. DevOps (a clipped compound of "development" and "operations") is a software development and delivery process that emphasizes communication and collaboration between product management, software development, and operations professionals. (Source – Wikipedia)

+ + Transition from Agile to Devops DevOps = {Agile Methodology + Shift Left Approach + Lean Testing} Agile : Fast, Automated, Time to Market Goals of DevOps: Fast and Contiguous Early and Often Test, Risk identification in same phase Speed to Market Improved Productivity Low Risk Improved Code Quality + Shift Left : Early and Automated Testing + Lean: Remove Waste

DEVOPS Might be well-structured inside. But, can only be deployed as a whole Traditional Req Suite Release Finalize Build Manual Testing Automated Regression Testing Manual Exploratory Testing Components can only be deployed independently if tests are independent & if your Continuous Delivery Pipeline works Finalize Build Manual Testing Automated Regression Testing Manual Exploratory Testing System Integration Testing as a whole Finalize Build Manual Testing Automated Regression Testing Manual Exploratory Testing DevOps Release Requirement Suite Finalize Build Manual Testing Automated Regression Testing Manual Exploratory Testing Finalize Build Manual Testing Automated Regression Testing Manual Exploratory Testing

Framework Agile Model Continuous Integration DevOps Continuous Planning across Requirements Continuous Testing by enabling Automation Agile Model Continuous Integration DevOps Continuous Development across Builds Continuous Deployment across Releases

Testing Process Intelligent Testing: Change Impact Based Testing Optimized Regression Suite Continuous Development: Correlating code Analytics with Test Analytics Shift Left Performance Testing: Find Performance issues in non-production stages Service Virtualization in non-production stages Shift Left Monitoring: Infra and Application monitoring on demand with environment provisioning for non-production stages Model Based Approach: Infra as a Code Topology Modelling Test Design Modelling Integrated Platform for Automation & Traceability: Data Integration and Correlation

Productivity Index Factors Contributing to Productivity Index are: Speed Velocity Faster Code Development Impact Analysis Build & Test Automation Configuration Automation Time to Market

Quality Index Factors Contributing to Quality Index are: Improved Availability Deeper Requirements Analysis Early Business stakeholder support & involvement Security & Compliance Risk Reduction Identifying Issues earlier through continuous testing & integration

Operating Expense Index Factors Contributing to Operating Expense Index are: Cost Avoidance/Optimization Doing more with what you have Fail fast and Fail Cheap Cost Modelling IT Allocation

Capital Expense Index Factors Contributing to Capital Expense Index are: Improved Utilization Technology Transformation Convergence

BENEFITS TO BUSINESS $$ $$$ $ SPEED TO MARKET Up to 50% increase in speed to market through streamlined software delivery Test Coverage Increased Test Coverage and reduced manual Effort due to Model Based Testing DELIVERY RISK RESILENCY Reduced defects in later test phases by up to 30% and overall higher quality Operational state is more stable and secure and changes are systematically auditable Model Based Testing provide more options for Exploratory Testing Agility in Architecture SOA Micro services Test Pyramid help us to maintain a balance between the different types of test Agility in Operations CD Cloud Exploratory Agility in Development / Testing CI TDD BDD End to End Agility in Process Scrum Scaled Agile Component Greater Agility Integration Test Unit Test

Author Biography   B V S S R S Sastry works as a Senior IT Quality Analyst at Optum Global Solutions, Hyderabad and have 5+ years of experience in Integrated Test Environment Services, ITIL & CMMI Level 5 assessment Process Improvement in Insurance domain. He holds a Master’s Degree in Technology from JNTU Hyderabad. He is a certified ISTQB professional, ITIL V3 certified. He has published 17 International white papers till date. Nitin Upreti works as a Project Manager at Optum Global Solutions, Gurgaon. He has a vast experience of 14 + years in the IT industry with expertise ranging from White Box testing, Mainframes, Web technologies and transforming Legacy applications into Big data based solutions. He is a certified professional from ISTQB and the Academy of Health care Management, USA. He Holds a Post Graduate Diploma in Business Management along with a Bachelor degree in Computer Applications.

Thank You!!!