1841f06detprob4 Testing Basics Detection probability

L5asg – detprob for subdomain tests u What is the probability of detection with one randomly chosen test case per path? u What is the probability of detection with an equal number of randomly chosen test cases?

3841f06detprob4 Control Flow Graph Operational profile 3,3,3abcdegiequi 3,3,4abcegiisos 3,3,5abcegiisos 3,3,6abcefginot 3,4,3abcegiisos 3,4,4abcegiisos 3,4,5acegiscal 3,4,6acegiscal All inputs are equally likely

4841f06detprob4 What are the failure probability for each color (separately)? cin >> a >> b >> c ; type = “scalene”; if (a == b || a == c && b == c) type= “isosceles”; if (a == b || a == c) type = “equilateral”; if (a >= b+c || b >= a+c || c > a+b) type=“not a triangle”; if (a <= 0 || b <= 0 || c <= 0) type=“bad input”; cout<< type; Blue GreenRed

TTYP – smaller subdomains u What might be better smaller subdomains? u Would MCC (multiple condition coverage) be better subdomains

TTYP2 – C0 and C1 coverage u How do we deal with C0 and C1 coverage since they are not subdomain testing methodologies?

9841f06detprob4 Evaluating Testing Methods by Delivered Reliability Frankl, Hamlet, Littlewood, Strigini IEEE TOSE Aug98

Testing u Debug u Operational

Fault Detection Probability u Probability of a testing methodology finding a fault (if it existed)

Partition vs Random

Tests, Specifications, meets u Test or test case –single value of program input –functional program - one input produces an output u Specification - S –set of input-output pairs u Program meets specification –iff for all x in spec, actual output matches spec output

Q: probability distribution u Q - probability distribution over input domain –Q:D -> [0,1] and  Q(t) = 1

 : Failure Probability   - failure probability for a randomly drawn point is  Q*  –Where  (t) = 1 if  and 0 if  –and  -phi(failure) and  -sigma(success) u How does this relate to our notation?

Reliability  R(N) = (1-  ) N

Assumptions of initial model

Terms uquduqud

3.2 SFR, w/o subdomains  d =  tinF V(t)  P(  ) = 1-(1-d) T  P(  q) = (1-d) T  E(  ) = 0* P(  ) +q* P(  q) u = q(1-d) T

Thurs, Sep 6 u Read next section of article