Presentation is loading. Please wait.

Presentation is loading. Please wait.

UNIT-V SMQA. Principle 1Testing shows presence of defects Principle 2Exhaustive testing is impossible Principle 3Early Testing Principle 4Defect Clustering.

Similar presentations


Presentation on theme: "UNIT-V SMQA. Principle 1Testing shows presence of defects Principle 2Exhaustive testing is impossible Principle 3Early Testing Principle 4Defect Clustering."— Presentation transcript:

1 UNIT-V SMQA

2 Principle 1Testing shows presence of defects Principle 2Exhaustive testing is impossible Principle 3Early Testing Principle 4Defect Clustering Principle 5Pesticide Paradox Principle 6Testing is context dependent Principle 7Absence of errors – fallacy (use of Invaild) Principles of Testing:

3 Software Testing Life Cycle:

4 PhaseActivityDeliverables Requirements/ Design Review You review the software requirements/ design (Well, if they exist.)  ‘Review Defect’ Reports Test Planning Once you have gathered a general idea of what needs to be tested, you ‘plan’ for the tests.  Test Plan  Test Estimation  Test Schedule Test Designing You design/ detail your tests on the basis of detailed requirements/design of the software (sometimes, on the basis of your imagination).  Test Cases/ Test Scripts /Test Data  Requirements Traceability Matrix Test Environment Setup You setup the test environment (server/ client/ network, etc) with the goal of replicating the end-users’ environment.  Test Environment Test Execution You execute your Test Cases/ Scripts in the Test Environment to see whether they pass.  Test Results (Incremental)  Defect Reports Test Reporting You prepare various reports for various stakeholders.  Test Results (Final)  Test/ Defect Metrics  Test Closure Report  Who Worked Late & on Weekends (WWLW) Report [Depending on how busy your Management is]

5 Automation Testing Automation testing or Test Automation is a process of automating the manual process to test the application/system under test

6 Advantages of Automated Testing: Automated Software Testing Saves Time and Money Testing Improves Accuracy Automation Does What Manual Testing Cannot Vastly Increases Your Test Coverage Automated QA Testing Helps Developers and Testers

7 Manual Testing Automation Testing 1. Manual Testing is a process which is done manually. 1. Automation Testing is a process which is done by the help of automated tools. 2. All the famous phases of STLC like test planning, test deployment, result analysis, test execution, bug tracking and reporting tools are obviously comes under the category of Manual Testing and done successfully by human efforts. 2. In Automation Testing all the popular phases of STLC are done by various open sources and purchased tools like Selenium, J meter, QTP, Load Runner, Win Runner and so on. 3. Manual Testing is a start of Testing, without this testing we can’t start Automation Testing. 3. Automation Testing is a continuous part of Manual Testing. 4. In Manual Testing testers are allowed to do Random Testing to find the Bugs. 4. In Automation Testing we always test through Running Scripts. 5. In Manual Testing we find more bugs than automation by Error Guessing. 5. In Automation Testing we test the repetitive functionalities of the application. 6. It takes lot of time.6. It takes less time. 7. Manual Testing would be run sequentially. 7. Automation Testing is done on different machines at same time. 8. Regression Testing process is tough in Manual Testing 8. Regression Testing process is easy in Automation Testing by Tools.

8 Manual Testing Automation Testing 9. It is not expensive.9. It is expensive. 10. More testers are required in Manual Testing because in this testing test cases need to be executed manually. 10. Few testers are required in Automation Testing because in this testing test cases need to be executed by using Automation Tools. 11. It gives low accuracy result. 12. It gives high accuracy result. 12. It is considered as low quality.12. It is considered as high quality. 13. In this Testing we cannot do batch testing. 13. In this Testing we can do multiple types of batch testing. 14. It is considered as less reliable.14. It is considered as more reliable. 15. No need of programming in Manual Testing. 15. Need of programming is must in Automation Testing. 16. It is done without interaction of any Tool.16. It is always done using tools.

9 Functional testing is a quality assurance (QA) process and a type of black-box testing that bases its test cases on the specifications of the software component under test. Regression testing is a type of software testing that verifies that software that was previously developed and tested still performs correctly after it was changed or interfaced with other software. Changes may include software enhancements, patches, configuration changes, etc. Load testing is the process of putting demand on a software system or computing device and measuring its response. Load testing is performed to determine a system's behavior under both normal and anticipated peak load conditions. Performance testing, a non-functional testing technique performed to determine the system parameters in terms of responsiveness and stability under various workload. Performance testing measures the quality attributes of the system, such as scalability, reliability and resource usage.

10 1. Selenium-IDE: Functional Testing & Regression Testing Features of Selenium: It is free and open source It have cross Browser compatibility (Firefox, chrome, Internet Explorer etc.) It have great platform compatibility (Windows, Mac OS, Linux etc.) It supports multiple programming languages (Java, C#, Ruby, Python, Pearl etc.) It has fresh and regular repository developments It supports distributed testing It supports Functional Testing & Regression Testing Other features includes Recording and adding commands in a test Saving the recorded test Saving the test suite Executing the recorded test

11 1. Selenium-IDE Limitations of Selenium: Selenium supports testing of only web based applications Mobile applications cannot be tested using Selenium Captcha and Bar code readers cannot be tested using Selenium Reports can only be generated using third party tools like TestNG or Junit (Unit Testing Framework). As Selenium is a free tool, thus there is no ready vendor support though the user can find numerous helping communities. User is expected to possess prior programming language knowledge

12 1. Selenium-IDE Different Selenium Components: Selenium Integrated Development Environment (IDE) – Selenium IDE is a record and playback tool. It is distributed as a Firefox Plugin. Selenium Integrated Development Environment (IDE) Selenium Remote Control (RC) – Selenium RC is a server that allows user to create test scripts in a desired programming language. It also allows executing test scripts. Selenium WebDriver – WebDriver is a different tool altogether that has various advantages over Selenium RC. WebDriver directly communicates with the web browser and uses its built-in compatibility to automate. Selenium WebDriver Selenium Grid – Selenium Grid is used to distribute your test execution on multiple platforms and environments concurrently. Selenium Grid

13 2. Apache JMeter: Load and Performance testing. Features of JMeter: Being an open source software, it is freely available. It has a simple and natural GUI. JMeter can conduct load and performance test for many different server types − Web - HTTP, HTTPS, Database via JDBC, LDAP, JMS, Mail - POP3, etc. It is a platform-independent tool. On Linux/Unix, JMeter can be invoked by clicking on JMeter shell script. On Windows, it can be invoked by starting the JMeter.bat file. JMeter store its test plans in XML format. This means you can generate a test plan using a text editor. It is highly extensible. It can also be used to perform automated and functional testing of the applications.

14 2. Apache JMeter: How Jmeter works?

15 2. Apache JMeter: JMeter – Environment Setup: Step 1 − Verify Java Installation using Java -version command Step 2 − Set Java Environment My Computer- Properties-Advanced tab-Environment variables- c:\Program Files\java\jdk\bin Step 3 − Download Jmeter Step 4 − Run Jmeter

16 2. Apache JMeter: JMeter Test Plan: A Test Plan can be viewed as a container for running tests. It defines what to test and how to go about it. Some of the test plan elements are: Thread Group Controllers Listeners Timers Configuration Elements Pre-Processor Elements Post-Processor Elements

17 2. Apache JMeter: JMeter - Web Test Plan: Follow the steps given below to write a Web Test plan − Start JMeter Rename the Test Plan Add Thread Group Add Sampler Add Listener Run the Test Plan View the Output

18 3. QTP (QuickTest Professional): It is a product of Hewlett Packard (HP). HP QTP uses Visual Basic Scripting (VBScript). VBScript is NOT a object oriented language but it is object based language. It need not be installed exclusively as it is available part of the Windows OS. The Current version of VBScript is 5.8 which is available as part of Win 7.

19 3. QTP (QuickTest Professional): Used for regression testing Why QTP is the best testing tool? It is an icon based tool that automates the regression and functional testing of an application. Both technical as well as non-technical tester can use QTP It provides both features- Record as well as Playback We can test Desktop (window based) as well as the Web based applications It supports largest pool of software development environments like SAP, Oracle etc.

20 3. QTP (QuickTest Professional): Used for regression testing Advantages of QTP: It helps tester in referring the screen object properties It supports different add-ins (a device or piece of software that can be added to a computer to give extra features or functions.) like Oracle, Java, SAP, Web Forms etc..Java It supports popular automation frameworks- keyword driven testing approach, modular testing approach, data driven testing approach, etc.. It comes with an inbuilt IDE It can be integrated with Test management tools like Quality Center, Test Director, and WinrunnerTest managementQuality Center It supports XML Test reporting is possible through QTP for analysis purpose Easy to maintain

21 3. QTP (QuickTest Professional): Used for regression testing Disadvantages of QTP: Unlike Selenium, QTP works in Windows operating system only. Doesn’t supports all versions of browsers and the testers need to wait for the patch to be released for each one of the major versions. It is a commercial tool, the licensing cost is very high. Even though scripting time is less, the execution time is relatively higher as it puts load on CPU & RAM.

22 FeatureSeleniumQuick Test Professional (QTP) Browser Compatibility Selenium supports almost all the popular browsers like Firefox, Chrome, Safari, Internet Explorer, Opera etc QTP supports Internet Explorer, Firefox and Chrome. QTP only supports Windows Operating System Distribution Selenium is distributed as an open source tool and is freely available QTP is distributed as a licensed tool and is commercialized Application under Test Selenium supports testing of only web based applications QTP supports testing of both the web based application and windows based application Object Repository Object Repository needs to be created as a separate entity QTP automatically creates and maintains Object Repository Language Support Selenium supports multiple programming languages like Java, C#, Ruby, Python, Perl etc QTP supports only VB Script Vendor Support As Selenium is a free tool, user would not get the vendor’s support in troubleshooting issues Users can easily get the vendor’s support in case of any issue Difference between Selenium and QTP:

23 4. WinRunner: It is an automated functional GUI testing tool that allowed a user to record and play back user interface (UI) interactions as test scripts. Automatic Recovery WinRunner Allows us to continue the test run after an exception event occurs. This functionality is especially useful when errors or crashes could interrupt the testing process. Silent Installation Now you can install WinRunner in an unattended mode using previously recorded installation preferences.

24 4. WinRunner: Enhanced Integration with TestDirector WinRunner works with both TestDirector 6.0, which is client/server-based, and TestDirector 7.x, which is Web-based. When reporting defects from WinRunner’s test results window, basic information about the test and any checkpoints can be automatically populated in TestDirector’s defect form. WinRunner now supports version control, which enables updating and revising test scripts while maintaining old versions of each test. Support for Terminal Servers Support for Citrix and Microsoft Terminal Servers makes it possible to open several window clients and run WinRunner on each client as a single user. Also, this can be used with LoadRunner to run multiple WinRunner users.

25 4. WinRunner: Support for More Environments WinRunner 7.5 includes support for Internet Explorer 6.x and Netscape 6.x, Windows XP and Sybase's PowerBuilder 8, in addition to 30+ environments already supported by WinRunner 7. WinRunner provides the most powerful, productive and cost- effective solution for verifying enterprise application functionality. Significantly increase power and flexibility of tests without any programming

26 Use multiple verification types to ensure sound functionality WinRunner provides checkpoints for text, GUI, bitmaps, URL links and the database, allowing testers to compare expected and actual outcomes and identify potential problems with GUI objects and their functionality. Verify data integrity in your back-end database Built-in Database Verification confirms values stored in the database and ensures transaction accuracy and the data integrity of records that have been updated, deleted and added. Test multiple environments with a single application WinRunner supports more than 30 environments, including Web, Java, Visual Basic, etc. In addition, it provides targeted solutions for such leading ERP/CRM applications as SAP, Siebel, PeopleSoft and a number of others.

27 Limitations of WinRunner in testing: It should not support Dot net applications. It should not support XML. It should not support Multimedia. It's twice more expensive than the others products!!

28 Advantage of QTP over WinRunner Advantages: 1. Lot easier than winrunner to record a script. 2. Records mouse over functionality. 3. Identifies double clicks 4. Uses programming language "VBScript". 5. Check points and data driven tests can be implemented easily. 6. Can enhance the script without the Applicaion under test being opened using Active window functionlity. 7. Integrates with winrunner and testdirector. 8. Supports.NET environment. 9. Supports XML based web sites. 10. Support mouse drag funcitonality.

29 Disadvantage of QTP over WinRunner Disadvantages: 1. We do not have sufficient resources on QT pro. 2. Must know VBscipt in order to program. 3. In order to implement advanced futures of QT pro you must be a VBScript developer. 4. the "Object Repository" is not user friendly. You cannot work with object repository as you do with Winrunner.

30 ISO 9000 Standards Define the required elements of an effective quality management system Can be applied to any company ISO 9000 is a generic standard - means that the standard can be applied to any organization, large or small, whatever its product in any sector of activity Policy and measurable quality objectives are set and renewed. Processes are identified, analyzed, and managed. Customer satisfaction is measured. Data are collected, analyzed, and used. System effectiveness is constantly improved.

31 elements of the standards: Management responsibility Resource management Quality System Contract Review Design Control Document Control Purchasing Purchaser-Supplied Product Product Identification and Traceability Process Control Management responsibility Resource management Quality System Contract Review Design Control Document Control Purchasing Purchaser-Supplied Product Product Identification and Traceability Process Control

32 CMM: Capability Maturity Model Developed by the Software Engineering Institute of the Carnegie Mellon University to assist dept. of defense in assessing quality of its Vendor (Contractor) Framework that describes the key elements of an effective software process. Provides guidance on how to gain control of processes for developing and maintaining software

33 Level 1: Measurement t provides bassline to improve the process & product Level 2: Focus on Project Management Level 3: Measures intermediate & final products during development Level 4: Allows to control individual activities of process Level 5: Allows to provide feedback foe dynamically changing process during project development Maturity level indicates level of process capability: oInitial oRepeatable oDefined oManaged oOptimizing

34 COMPARISON OF ISO 9000 MODEL WITH CMM CMM ISO 9000 SERIES CMM is 5-level framework for measuring s/w engineering practices ISO 9000 define a minimum level of generic attribute for a quality management program Orientation of CMM is s/w development process Orientation is quality system management CMM address only s/wISO 9000 address entire organization CMM designed specifically for s/w development process/practices ISO 9000 designed specifically for generic quality management model Objective:- to provide orderly, disciplined framework to address s/w management Objective:- 1. provide guidance for selection & use of series of international standards for quality management purpose 2. To clarify distinction & interrelationship among principles quality concepts It take restricted view of risk that concern s/w project alone It doesn’t discuss about risk management

35 COMPARISON OF ISO 9000 MODEL WITH CMM CMM ISO 9000 SERIES It has no reference to media control It has reference to media control CMM discuss how to assess processes being used for developing s/w functionality ISO 9000 discuss organizing quality management function for a company Weakness:- 1.Granularity 2.Site comparison 3.Objective measurement 4.Focus on technology, not on problem solving 5.People,product,process Weakness:- 1.Complexity 2.Repeatability 3.Inherent structure 4.Key audit factors 5.Process/product improvement


Download ppt "UNIT-V SMQA. Principle 1Testing shows presence of defects Principle 2Exhaustive testing is impossible Principle 3Early Testing Principle 4Defect Clustering."

Similar presentations


Ads by Google