Presentation is loading. Please wait.

Presentation is loading. Please wait.

1841f06detprob4 Testing Basics Detection probability.

Similar presentations


Presentation on theme: "1841f06detprob4 Testing Basics Detection probability."— Presentation transcript:

1 1841f06detprob4 Testing Basics Detection probability

2 L5asg – detprob for subdomain tests u What is the probability of detection with one randomly chosen test case per path? u What is the probability of detection with an equal number of randomly chosen test cases?

3 3841f06detprob4 Control Flow Graph Operational profile 3,3,3abcdegiequi 3,3,4abcegiisos 3,3,5abcegiisos 3,3,6abcefginot 3,4,3abcegiisos 3,4,4abcegiisos 3,4,5acegiscal 3,4,6acegiscal All inputs are equally likely

4 4841f06detprob4 What are the failure probability for each color (separately)? cin >> a >> b >> c ; type = “scalene”; if (a == b || a == c && b == c) type= “isosceles”; if (a == b || a == c) type = “equilateral”; if (a >= b+c || b >= a+c || c > a+b) type=“not a triangle”; if (a <= 0 || b <= 0 || c <= 0) type=“bad input”; cout<< type; Blue GreenRed

5 TTYP – smaller subdomains u What might be better smaller subdomains? u Would MCC (multiple condition coverage) be better subdomains

6

7

8 TTYP2 – C0 and C1 coverage u How do we deal with C0 and C1 coverage since they are not subdomain testing methodologies?

9 9841f06detprob4 Evaluating Testing Methods by Delivered Reliability Frankl, Hamlet, Littlewood, Strigini IEEE TOSE Aug98

10 Testing u Debug u Operational

11 Fault Detection Probability u Probability of a testing methodology finding a fault (if it existed)

12 Partition vs Random

13 Tests, Specifications, meets u Test or test case –single value of program input –functional program - one input produces an output u Specification - S –set of input-output pairs u Program meets specification –iff for all x in spec, actual output matches spec output

14 Q: probability distribution u Q - probability distribution over input domain –Q:D -> [0,1] and  Q(t) = 1

15  : Failure Probability   - failure probability for a randomly drawn point is  Q*  –Where  (t) = 1 if  and 0 if  –and  -phi(failure) and  -sigma(success) u How does this relate to our notation?

16 Reliability  R(N) = (1-  ) N

17 Assumptions of initial model

18 Terms uquduqud

19 3.2 SFR, w/o subdomains  d =  tinF V(t)  P(  ) = 1-(1-d) T  P(  q) = (1-d) T  E(  ) = 0* P(  ) +q* P(  q) u = q(1-d) T

20 Thurs, Sep 6 u Read next section of article


Download ppt "1841f06detprob4 Testing Basics Detection probability."

Similar presentations


Ads by Google