E MBEDDED S YSTEMS S OFTWARE T RAINING C ENTER T EST D ESIGN T ECHNIQUES C OPYRIGHT © 2012 DSR C ORPORATION

Objectives Understand which test design techniques exist and how to choose the correct ones C OPYRIGHT © 2012 DSR C ORPORATION 2

Class Materials Software Engineering Introduction diagrams are available here: Hands-on Exercises are available here: C OPYRIGHT © 2012 DSR C ORPORATION 3

Agenda 1.Categories of Test Design Techniques 2.Specification-Based Techniques 3.Test Coverage 4.Structure-Based Techniques 5.Experience-Based Techniques 6.Usage of Test Design Techniques C OPYRIGHT © 2012 DSR C ORPORATION 4

E MBEDDED S YSTEMS S OFTWARE T RAINING C ENTER C ATEGORIES OF T EST D ESIGN T ECHNIQUES C OPYRIGHT © 2012 DSR C ORPORATIONS

Test Design Techniques Classification C OPYRIGHT © 2012 DSR C ORPORATION Foundations of Software Testing. ISTQB Certification. Dorothy Graham, Erik Van Veenendaal 6

Test Cases Designing with Decision Tables C OPYRIGHT © 2012 DSR C ORPORATION Foundations of Software Testing. ISTQB Certification. Dorothy Graham, Erik Van Veenendaal Loan Calculation Example: The final step of this technique is to write test cases to exercise each of the four rules in the table. Test cases may be enhanced with EP and BVA approaches. 7

State Transition Testing with State Diagram C OPYRIGHT © 2012 DSR C ORPORATION Foundations of Software Testing. ISTQB Certification. Dorothy Graham, Erik Van Veenendaal TC1. Normal Case: the correct PIN is entered the first time. TC2. Error case enters an incorrect PIN each time so that the system eats the card. TC3. PIN was incorrect the first time but OK the second time. TC4. PIN was correct on the third try. 8

Testing for Invalid Transitions: State Matrix C OPYRIGHT © 2012 DSR C ORPORATION Foundations of Software Testing. ISTQB Ceritfication. Dorothy Graham, Erik Van Veenendaal 9

Use Case Example C OPYRIGHT © 2012 DSR C ORPORATION Foundations of Software Testing. ISTQB Certification. Dorothy Graham, Erik Van Veenendaal 10

Summary The test design techniques are determined by their primary sources and are used to find different defects, so a composition of them must be used to achieve good product quality. Specification-based test design techniques are good to use when there is good specification. Equivalence partitioning, boundary analysis, decision tables, and state transition techniques are the most useful. Code-based test design techniques involve code analysis and various code coverage criteria. It allows finding many anomalies in the code. The decision/condition code coverage criterion is the most useful. Experience-based techniques are complementary to code-based and specification-based techniques and are applicable for low-risk systems in conditions that lack requirements and are time pressured. C OPYRIGHT © 2012 DSR C ORPORATION 11

Questions 1.Classify the Test Design Techniques. What is the most useful to make testing most effective? 2.What is a key characteristic of specification-based testing techniques? 3.What is a key characteristic of structure-based testing techniques? 4.What code coverage metrics do you know? What are they used for? What are the strong and week sides of every metric? C OPYRIGHT © 2012 DSR C ORPORATION 12

Task 1 C OPYRIGHT © 2012 DSR C ORPORATION 13 Postal rates for 'light letters' are 25p up to l0g, 35p up to 50g plus an extra l0p for each additional 25g up to l00g. Suggest the test design techniques for this functionality. Describe the test design in any form. Foundations of Software Testing. ISTQB Certification. Dorothy Graham, Erik Van Veenendaal

Task 2 C OPYRIGHT © 2012 DSR C ORPORATION 14 If you are flying with an economy ticket, there is a possibility that you may get upgraded to business class, especially if you hold a gold card in the airline's frequent flier program. If you don't hold a gold card, there is a possibility that you will get bumped off the flight if it is full and you check in late. This is shown on the activity diagram below. Suggest a test technique to test the program that implements this functionality. Describe the test design using this technique. Foundations of Software Testing. ISTQB Certification. Dorothy Graham, Erik Van Veenendaal

Task 3 C OPYRIGHT © 2012 DSR C ORPORATION 15 Analyze the diagram below. Suggest a test technique to test the program that implements this functionality. Describe the test design using this technique. What coverage value have you achieved? Foundations of Software Testing. ISTQB Certification. Dorothy Graham, Erik Van Veenendaal

Task 4 C OPYRIGHT © 2012 DSR C ORPORATION 16 Analyze the part of software code below. Define the test cases that allow you to achieve 100% coverage for the following criteria: Statement coverage Decision coverage Condition coverage if ((x>0) && ((y>0)|| (z>0))) statement1; else statement2;

References 1.Foundations of Software Testing. ISTQB Certification. Dorothy Graham, Erik Van Veenendaal, Isabel Evans, Rex Black 2.SWEBOK. Guide to the Software Engineering. Body of Knowledge Version / A project of the IEEE Computer Society Professional Practices Committee 3.IEEE Std , IEEE Standard Glossary of Software Engineering Terminology 4.Code Coverage Analysis. By Steve Cornett. Copyright © Bullseye Testing Technology Testing Technologyhttp:// 5.DO-178B, Software Considerations in Airborne Systems and Equipment Certification, RCTA, December 1992, pp.31, 74.RCTA gcova Test Coverage Program. 8.LCOV - the LTP GCOV extension. C OPYRIGHT © 2012 DSR C ORPORATION 17