True ROI of Automation? Allscripts India LLP

Slides:



Advertisements
Similar presentations
Requirements for a UI Test Framework Stanislaw Wozniak Bernie Miles.
Advertisements

The 4 T’s of Test Automation:
Hexawares Test Accelerator for eBaoTech® GeneralSystem Software.
Café Master Powerful Pc control with billing system Develop By:
© 2010 Wipro Ltd - Confidential SGSN Automation Testing Using TTCN3 Authors: Jyothi Gavara Nikhil Rahul Ekka.
Test Automation Success: Choosing the Right People & Process
1 The Database Application Development Process The Database Application Development Process.
Multiple Tiers in Action
© 2006, Cognizant Technology Solutions. All Rights Reserved. The information contained herein is subject to change without notice. Automation – How to.
© 2004 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice Automation Fundamental Concepts &
Functional Automation Testing Case Study 360logica Software Testing Services.
Automated Acceptance Testing and Continuous Delivery Larry Apke Agile Expert
Automated Testing April 2001WISQA Meeting Ronald Utz, Automated Software Testing Analyst April 11, 2001.
CONTROL-M Training At Global Online Trainings IND: Skype: Global.onlinetrainings USA:
Leverage your Business with Selenium Automation Testing
TEST AUTOMATION IN BDD WAY
CASE Tools and Joint and Rapid Application Development
Building Custom Workflows
Understanding of Automation Framework
Mastering the Database Testing. Mastering the Database Testing: Considered as the most pivotal testing tool many young aspirants who aim to work on high.
Extended BDD Automation for Future Agile Applications
aBAP – NextGen QA Delivery Gear
On the road: Test automation in practice for a BMW map update service
Quality Management Perfectqaservices.
Application and content management framework for railway operators
Test Automation for IoT solutions A Paradigm shift
SENIOR MANAGER - SOFTWARE TESTING PRACTICE
Effective way to build test Automation strategy in Agile
Database Testing in Azure Cloud
Automation – “A Critical Component of Agile testing”
Galen - Automated testing of look and feel
DILV -Data Integrity and Lifecycle Validator
USAGE OF VARIOUS AUTOMATION TOOLS TO ACHIEVE WIDER TEST COVERAGE
Introduction SWE 619.
Program Management Overview
Advantages OF BDD Testing
API Testing for Effective Regression
Software Product Testing
Automated Test Execution & Reporting (TER) Plugin using JIRA
Importance of RPA (Robotic Process Automation) in software Testing.
Yakub Reddy Gurijala –Sr.Technical Architect
Rapid fire performance testing of 250 websites
Faster delivery using Device Farm
Machine Learning in Test Automation
HATS – Hierarchical Automated Test Sequencer Platform
ARTIFICIAL INTELLIGENCE IN SOFTWARE TESTING
Why many Automation Frameworks? when ONE can do ALL
Workflow-based Automation Framework for Agile Software Development
Automation Leveraging Artificial Intelligence
Seamless E2E Automation on Interdependent Systems
Unleashing the power of customized reports testing framework
Project insights using mining software repositories
Transforming Automation through Artificial Intelligence
Architectural Roadmap
Model Based Testing Venkata Ramana Bandari, Expert Software Engineer
Automated Testing and Integration with CI Tool
Enabling Agile with an Assessment for Delivery Transformation
ML Integrated Software Testing First American India Private Limited
How much is Enuf?! – A Risk Based Layered Regression Test Strategy
DevOps - Extreme Automation using Cucumber, Selenium, Ruby
Application Problem Resolution The “Invisible Problem” or
Measure Reliability of Automation – using Machine learning
Addressing Test coverage in Continuous Testing
True ROI of Automation? Allscripts India LLP
Open Source Tool Based Automation solution with Continuous Integration and end to end BDD Implementation Arun Krishnan - Automation Manager Maria Afzal-
SOFTWARE DEVELOPMENT LIFE CYCLE
Requirements Engineering
SO-Architectural Roadmap
QTP Test Process
Presentation transcript:

True ROI of Automation? Allscripts India LLP Sarbajit Sahani, Expert Software Engineer Raushan Raj, Associate Software Engineer Allscripts India LLP

Abstract Measurement of ROI on automation is a keen-witted situation. Deriving ROI can be obtained during various stages of SDLC such as development, client testing and maintenance. It is also important to consider the size and nature of AUT. Most importantly ROI should be re-visited periodically. If we can calculate it by using a mathematical formula then it will be more acceptable.

Method One approach to calculating the ROI is to use a framework called ‘Value Based Framework’, which calculates the ROI of automation testing using a mathematical formula which is based on a number of factors.

ROI Calculation By Using Value Based Framework Factors Considered: Application Details Product Size – Number of Screens or Functional Points. Product Maturity – In Development Stage or a live product. Test Objective Presentation Layer – UI Automation by using a tool. Middle Tier – Server Layer Automation directly dealing with Class Files. Database – Service Layer or Database testing by considering SPs and GPs. Automation Cost Development – Cost of developing the Automation Test Cases. Execution – Cost of running the automated test cases. Maintenance – Cost of Maintaining the automated test cases. Environment – Cost of Maintaining Environments. Automation Life Span Test Life Span – For how many runs the test will add value. Functionality Life Span – For how many days testing the functionality will add value. Frequency of Regression

Value Based Framework ROI = (M * R) – ((C * F) + R * Mc) M - Manual Testing Cost R - Number of Runs C - Cost of Automation F - Factors need to consider for Automation Mc - Automation Maintenance cost

Value Based Framework M – Manual Testing Cost Cost Involved for manual testing which includes test case writing, execution etc. Cost which can be avoided for the test cases which is planned for automation

Value Based Framework R – Number of Runs Number of runs considered to calculate ROI for Automation

Value Based Framework C – Cost of Automation UI Automation – 0% to 100% Server Layer Automation – 0% to 100% Hybrid Automation – 0% to 100% % of Value addition with respect to Automation Development Cost

Value Based Framework F – Factors need to consider for Automation Stage Of Automation In Sprint Automation – 0% to 100% After GA Automation – 0% to 100% % of Value addition with respect to Automation Development Cost Type of Automation Pre-Requisite Creation – 0% to 100% Single flow for multiple Iteration – 0% to 100% Localization Testing – 0% to 100% % of Value addition with respect to Automation Development Cost

Value Based Framework F – Factors need to consider for Automation Business Complexity High Complexity – 0% to 100% Medium Complexity – 0% to 100% Low Complexity – 0% to 100% % of Value addition with respect to Automation Development Cost Customer Complexity High Complexity – 0% to 100% Medium Complexity – 0% to 100% Low Complexity – 0% to 100% % of Value addition with respect to Automation Development Cost

Mc – Automation Maintenance cost Automation Tool Environment Automation Training Result Analysis Script Maintenance

Tool to generate ROI of Automation

Tool to generate ROI of Automation

References & Appendix https://www.infoq.com/news/2009/04/testing-roi

Sarbajit Sahani Raushan Raj Author Biography: Lead automation engineer at Allscripts instrumental for strategizing, designing and implementing effective test automation for multiple Products. Over 12 years’ industry experience in feasibility study, framework design and automation testing. Connect me at LinkedIn: https://www.linkedin.com/in/sarbajit-sahani-b8b37887 Co-Author Biography: Raushan Raj New entrant to automation world with less than two years of industry experience but unbound energy and passion for automation makes me question everything and try every tool in town. Connect me at LinkedIn: https://www.linkedin.com/in/raushan-raj-a4b7b536/

Thank You!!!