Integrating Automation into Manual Testing

Slides:



Advertisements
Similar presentations
What is Test Director? Test Director is a test management tool
Advertisements

© by cellconsult.com Application Testing & Test Management.
Test process essentials Riitta Viitamäki,
Acceptance Testing.
Prashant Lambat Sr. Manager SQA Engineering Symantec Corporation, Pune Date: 29 th January 2011.
ARE YOU READY FOR TEST AUTOMATION GAME? - Kerry Zallar (STQE Magazine) (Nov/Dec 2001 Issue) CONCEPT/ DEFINITION:  Use of software to control the execution.
Test Automation An Approach to Automated Software Regression Testing Presented by Adnet, Inc Feb 2015.
Automation Testing Presentation Phil Hunter Phil Hunter - Automation Presentation 1.
By SAG Objectives Cross platform QA Automation for web applications Scheduling the automation Automatically build the test scripts Generate the.
David Woo (dxw07u).  What is “White Box Testing”  Data Processing and Calculation Correctness Tests  Correctness Tests:  Path Coverage  Line Coverage.
Mike Azocar Sr. Developer Technical Specialist Microsoft Corporation
Requirements Analysis 5. 1 CASE b505.ppt © Copyright De Montfort University 2000 All Rights Reserved INFO2005 Requirements Analysis CASE Computer.
Software Testing Prasad G.
Automated Testing Nathan Weiss April 23, Overview History of Testing Advantages to Automated Testing Types of Automated Testing Automated Testing.
Agile Testing with Testing Anywhere The road to automation need not be long.
© Company Confidentialwww.itcinfotech.com Business Case for Test Automation S.Janardhanan Chief Technology Officer ITC Infotech India Limited Business.
Software Testing Test Design and Implementation. Agenda Test Design Test Implementation Test Design Sources Automated Testing 2.
© 2006, Cognizant Technology Solutions. All Rights Reserved. The information contained herein is subject to change without notice. Automation – How to.
Test Automation Best Practices
Software testing techniques Automated software testing Presentation on the seminar Kaunas University of Technology.
NYC Technology Forum Introduction to Test Automation 11/2/07 All rights reserved Not to be reproduced without permission Bill Rinko-Gay Solutions Director,
Introduction to Computer Technology
© 2004 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice Automation Fundamental Concepts &
When is a Project Ready for Software Automation? Michael Christesen Mat Krueper Ty Henson 1.
Chapter 3 – Agile Software Development 1Chapter 3 Agile software development.
Applied Software Project Management Andrew Stellman & Jennifer Greene Applied Software Project Management greene.com 1 Applied Software.
Introduction to Unit Testing Jun-Ru Chang 2012/05/03.
Software Testing Life Cycle
CPIS 357 Software Quality & Testing
Winrunner Usage - Best Practices S.A.Christopher.
Automated Acceptance Testing and Continuous Delivery Larry Apke Agile Expert
1 Introduction to Software Testing. Reading Assignment P. Ammann and J. Offutt “Introduction to Software Testing” ◦ Chapter 1 2.
Testing, Testing & Testing - By M.D.ACHARYA QA doesn't make software but makes it better.
Automated Testing Gireendra Kasmalkar Prabodhan Exports Pvt. Ltd.
CASE (Computer-Aided Software Engineering) Tools Software that is used to support software process activities. Provides software process support by:- –
July, 2008 Impati – Software Test Solutions. July, Contents Testing Service Overview and Approach Test Services and Industries Key Services Offering.
MTA EXAM Software Testing Fundamentals : OBJECTIVE 6 Automate Software Testing.
CSC444F'07Lecture 41 CSC444 Software Engineering Top 10 Practices.
ITC Software ITC AUTOMATION TESTING SERVICES Date (Day Month, Year) Place (City, Country)
QC – User Interface QUALITY CENTER. QC – Testing Process QC testing process includes four phases: Specifying Requirements Specifying Requirements Planning.
Zhuhai Test Automation Overview Ryan Li Team lead of test automation Foglight QA.
By SPEC INDIA. TestComplete – An Introduction An automated testing tool by SmartBear – TestComplete is a comprehensive product with umpteen features and.
Automation Testing Trainer: Eran Ruso. Training Agenda Automation Testing Introduction Microsoft Automation Testing Tool Box Coded UI Test and Unit Test.
SELF INTRODUCTION 1. SOFTWARE TESTING By Navin and Bidyut 2.
SOFTWARE TESTING TRAINING TOOLS SUPPORT FOR SOFTWARE TESTING Chapter 6 immaculateres 1.
Real Testing Scenario Strategy: A Real-life TestOps Environment
Items to consider before automating an application
From manual test shop to fully automated test coverage: A How-To session to speed up your journey Jayshree Bhakta ITHAKA/JSTOR.
Agile Metrics that Matter
SOFTWARE TESTING Date: 29-Dec-2016 By: Ram Karthick.
Leverage your Business with Selenium Automation Testing
Where Agile Business Meets Agile Development
aBAP – NextGen QA Delivery Gear
Automation – “A Critical Component of Agile testing”
Applied Software Implementation & Testing
Advantages OF BDD Testing
Real Testing Scenario Strategy: Bringing this all together – Success!
Introduction to Software Testing
Automation Of Software Test
Sharing the good, the bad, the ugly & What can we do about it?
CS240: Advanced Programming Concepts
Agile test automation = big challenges
Course: Module: Lesson # & Name Instructional Material 1 of 32 Lesson Delivery Mode: Lesson Duration: Document Name: 1. Professional Diploma in ERP Systems.
Open Source Tool Based Automation solution with Continuous Integration and end to end BDD Implementation Arun Krishnan - Automation Manager Maria Afzal-
Bringing more value out of automation testing
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
Testing Maximo Time to automate?
Open Source Tool Based Automation solution with Continuous Integration and end to end BDD Implementation Arun Krishnan - Automation Manager Maria Afzal-
Presentation transcript:

Integrating Automation into Manual Testing automation WILL NOT replace manual testing

Why Automation? Automation is the best way to increase the effectiveness, efficiency, coverage of testing, and higher quality Benefits of automation Reusability on smoke tests, regression tests Preparing test data Complex business logics Cross platforms (different OS, browsers, etc.) Execute in numbers of iterations Candidates of Automation Select the correct test cases to achieve higher Return On Investment There are no standard procedures for determining the correct test cases for automation. It depends on the application you are testing

Where do we start for automation Testing? Understand not every software development project is able to achieve efficient automation Stable products Factors to consider before starting an automation project Why do we want to automate? Which tests should we automate? When should we do it? Who should create/execute automated tests? How should we automate these tests?

Why do we want to automate? Increase effectiveness Increase efficiency Increase coverage of testing Increase higher quality Reusability of testing

Which tests should we automate? Choose the type of Framework to Develop Automation (Data-driven, Modularity-driven, Keyword-driven, Hybrid, Model-based, Code driven, Behavior driven testing) Success of Automation Project is based on success of Manual Testing Project Not all of the test cases can be or need to be automated Test cases take too long to automate between releases – areas change a lot between release Details in the following 5 slides

Select correct test cases for automation Testing Step 1 Identify the factors in below: Test case executed with different set of data Test case executed with different browser Test case executed with different environment Test case executed with complex business logic Test case executed with different set of users Test case Involves large amount of data Test case has any dependency Test case requires Special data

Select correct test cases for automation Testing Step 2 Break each application into modules, identify which modules can be used for automation TC Id Description With different set of data? Different browser Different environment Complex business logic Different set of users Involves large amount of data Any dependency Requires Special data Candidate for automation Comments TC01 abc Y N TC02 TC03 TC04 TC05 TC06

Select correct test cases for automation Testing Step 3 – Combine and group the number of test cases for each module Module No. of TCs with different set of data No. of TCs with different browser No. of TCs with different environment No. of TCs with complex business logic No. of TCs with different set of users No. of TCs with involves large amount of data No. of TCs having dependencies No. of TCs with requires special data Times (in mins) to execute manually Mod1 3 2 180 Mod2 x Mod3 Mod4 Mod5 Mod6

Select correct test cases for automation Testing Step 4 – Summary Name of Module Total number of test cases to Automate Times required to execute manually Time to run using automation scripts Mod1 19 5 1.5 Mod2 x Mod3 Mod4

Determine Factors of deterring the ROI Purchasing and licensing cost of the tool Time to develop the scripts Time to maintain the scripts. Time to analyze the results manually and automatically Time and cost to train the resources. Management overheads

When should we do it? User Story Design and Development are completed User Story Manual Testing is done Defects all fixed Test Cases all passed Automation is ready to start

Who shall create/execute automated tests? Basic Rules: Treat Manual and Automation Team as Independent Teams Manual and Automation team must work together Each team complements of each other even with different skills sets To produce better results they must work together in a unified approach Dev Tester – User Story/UAT QA Architect – Feature/Functionality Test Level Automation Developer –Automation Development Feature Test Level

How should we automate these tests? Select the right automation tool to automate manual test cases into automation tool Software Testing Tools: Free software testing tools(Checkstyle, RIPS,Tao) Graphical user interface testing (Ranorex, SilkTest, Selenium, HP WinRunner, TestComplete) Load testing tools(HP Load Runner, Load Testing, WebLOAD) Security testing tools(AddressSanitizer, Metasploit, Project) Unit testing frameworks(Parasoft, Selenium, Test::More, Jtest, Junit, Xunit, Xunit.net)

Automation High Maintenance Automation requires high maintenance Maintenance is critical All tests must be maintained and passed Rules: Run all tests and results are passed before check in new automation code Fix all automation failures – defects, infra issues, functional changes Constantly tuning and improving automation methodology, frameworks, test cases