Evaluating Testing Methods by Delivered Reliability

Slides:



Advertisements
Similar presentations
4.1 Triangles and Angles.
Advertisements

Overview Functional Testing Boundary Value Testing (BVT)
Decision Table Based Testing
Extension of E(Θ) metric for Evaluation of Reliability.
Exam 1 Review u Scores Min 30 Max 96 Ave 63.9 Std Dev 14.5.
Equivalence Class Testing
Classify Triangles Standard 4C.
1 740f02frankl25 Evaluating Testing Methods by Delivered Reliability Frankl, Hamlet, Littlewood, Strigini IEEE TOSE Aug98.
TRIANGLES (There are three sides to every story!).
Triangles & Congruence Advanced Geometry Triangle Congruence Lesson 1.
Triangle Basics Parts of a Triangle Sides A B C Segment AB, AC, BC Points A, B, C Angles A, B, C Angles Vertices.
1841f06detprob3 MM Stroustrup Ch26 u Comments? u Agree or disagree with his testing approach?
1 Equivalence Class Testing Chapter 6. 2 Introduction Boundary Value Testing derives test cases with Massive redundancy Serious gaps Equivalence Class.
Summarizing “Structural” Testing Now that we have learned to create test cases through both: – a) Functional (blackbox)and – b) Structural (whitebox) testing.
841f07frankl12oct21 Evaluating Testing Methods by Delivered Reliability Frankl, Hamlet, Littlewood, Strigini IEEE TOSE Aug98.
Software Testing. Software testing is the execution of software with test data from the problem domain. Software testing is the execution of software.
Triangle A polygon with three sides and three angles. A triangle can be names by its’ side lengths and angles. – Side lengths: isosceles, equilateral,
1841f07subdomains2Aug23 Question u What is the main purpose of software testing?
EXAMPLE 1 Standardized Test Practice SOLUTION Let ( x 1, y 1 ) = ( –3, 5) and ( x 2, y 2 ) = ( 4, – 1 ). = (4 – (–3)) 2 + (– 1 – 5) 2 = = 85 (
Exam 1 Review u Scores Min 30 Max 96 Ave 63.9 Std Dev 14.5.
1 Input Space Partitioning(2). Reading Assignment P. Ammann and J. Offutt “Introduction to Software Testing” ◦ Chapter 4  Section 4.1  Section
Holt CA Course Triangles Vocabulary Triangle Sum Theoremacute triangle right triangleobtuse triangle equilateral triangle isosceles triangle scalene.
TRIANGLES AND TYPES OF TRIANGLES. A triangle has three sides.
Types of Triangles. Equilateral Triangle All sides are the same length and all the angles are the same length.
Triangles 1st year P26 Chapter 4.
1 Software Testing. 2 Equivalence Class Testing 3 The use of equivalence class testing has two motivations: –Sense of complete testing –Avoid redundancy.
Time for Triangles. What is a triangle? A triangle is a polygon. It has 3 sides and 3 angles. It can also be called a trigon.
1841f06detprob3 Testing Basics Detection probability.
Evaluating Testing Methods by Delivered Reliability Frankl, Hamlet, Littlewood, Strigini IEEE TOSE Aug98 Section 3.4.
Scalene triangle: A scalene triangle is a triangle that has no equal sides. The following is a scalene triangle.
Learning Objective Identify triangles using their sides.
1841f06detprob4 Testing Basics Detection probability.
Properties of Triangles
Notes Over 10.1 Finding the Distance Between Two Points Find the distance between the two points.
Angles In Triangles Types of Triangles Isosceles triangle
Cause & Effect Graph Comparison Testing
Mid Unit 5 Review 2-Dimensional Figures.
Triangles.
Software Testing Structural testing 540f07testing17oct25 1.
Software Testing Structural testing 1.
Boundaries and C0,C1 Pressman pp
Triangles.
TRIANGLE A B C.
Mid Unit 5 Review 2-Dimensional Figures.
Triangles.
7.7.3 Triangles.
Angles In Triangles Types of Triangles Isosceles triangle
Special Right Triangles
Overview Functional Testing Boundary Value Testing (BVT)
Detection probability
Section 4.1 : Classifying Triangles
Triangles A polygon with 3 sides.
Triangles Created by G. Antidormi 2005.
Applications of the Distance Formula
Angles In Triangles Types of Triangles Isosceles triangle
Coordinate Proofs Lesson 6-2.
Failure Size Proportional Models

Objective - To classify triangles.
Evaluating Testing Methods by Delivered Reliability
Overview Functional Testing Boundary Value Testing (BVT)
Identify type of triangle
Types of Triangles Thursday, 11 April 2019.
Types of Triangles Thursday, 11 April 2019.
Possible Triangle Constructions
Triangles.
Front of Flipbook Right Triangles Acute Triangles Obtuse Triangles
Intro to Triangles.
4-1 Classifying Triangles
Area and Perimeter Triangles.
Presentation transcript:

Evaluating Testing Methods by Delivered Reliability Frankl, Hamlet, Littlewood, Strigini IEEE TOSE Aug98 841f07frankl12oct2

841fall06 exam1 question 1 (25 pts) Calculations – given the following table, estimate the E(Q) using the MFR est and the subdomain formula. Assume that subdomains a and c are twice as likely as the other subdomains. You can simplify the table by projections” on each axis. Show your work. State and justify any assumptions that you must make. subdomain F1 F2 F3 Domain Size a 10 50 b 5 2 150 c 15 d 4 e 20 f

841fall06 exam1 question 2a 2. (30 pts) Modeling Assume that boundary testing randomly picks 2 test cases from each subset that makes the two sides in a relational expression equal (e.g. if the decision was “x < y”, the set would be those points where the value of x was equal to the value of y.} Boundary testing for the whole program will do this for each relational expression. Use Frankl’s formulas to estimate the E(Q) for this approach.

841f06 exam1 question 2b Consider the following program. Assume the operation profile is uniform and consists of all pairs of integers between 1 and 5. E.g. (1,1) , (1,2), etc cin >> a >> b; out = “X”; if (a > b + 1) out = “Y”; if (a < 2*b ) out = “Z”; cout<< out; Seed two faults: Change “b+1” to “b+2” Change “2*b” to “b”

841f06 exam1 question 3 3. (30 pts) Analysis Consider the following code. Find the largest set of mutually exclusive subdomains that might be useful for thorough testing of the code. Justify why they would be useful. Express the sets with relational conditions on a and b and draw a 2D map of the subdomains. Consider these three faults: 1) change “b+3” to “b+2” ; 2) change “a<b” to “a>b” ; 3) change “a+2” to “a+3” Can these subdomains reveal these faults? cin >> a >> b; out = “X”; if (a > b + 3) out = “Y”; a = a + 2; if (a < b ) out = “Z”; cout<< out;

841f06 exam1 question 4 4. (15 pts) Discussion Suppose that your testing effort is restricted to n tests and you have identified 2*n important subdomains in the product. How do you decide which subdomains to test? Can you use seeded faults to help select? What faults would you seed?

Empirical Tool – version 3 841f07frankl12oct2

Triangle Example cin >> a >> b >> c ; type = “scalene”; if (a == b || a == c || b == c) type= “isosceles”; if (a == b && a == c) type = “equilateral”; if (a >= b+c || b >= a+c || c >= a+b) type=“not a triangle”; if (a <= 0 || b <= 0 || c <= 0) type=“bad input”; cout<< type; 841f07frankl12oct2

Triangle Domain. all combinations of integers 0 – 5 Faults Triangle Domain all combinations of integers 0 – 5 Faults flt 1 - line 3: change a==b to a==a flt 2 – line 4: change “equilateral” to “isosceles” flt 3 – line 5: change a >= to a> flt 4 – line 5: change a+b to b+b

Types of testing What subdomains? Boundary testing? 841f07frankl12oct2

For Tuesday, Oct 2 Failure sets for triangle and faults 1-4 841f07frankl12oct2

Empirical Tool For Tues, Oct 9 Use your empirical tool to calculate E(theta) for subdomain testing of the triangle problem with the given faults shown in lecture 11 and 12. Compare with Frankl’s formulas. Make the comparision as fair as possible. Choose the number of tests and subdomains carefully Turn in hardcopy at start of class, Tues 10/9 841f07frankl12oct2