1. © 2000 Hans Schaefer Slide no. 1 Integration between reviews and test Can you save test work after inspections? Self assessment about how you do inspections Integration between reviews and testing Hans Schaefer Hans.Schaefer@ieee.org

2. © 2000 Hans Schaefer Slide no. 2 Integration between reviews and test Can you cut down test after good reviews and inspections? Can you rely on inspections alone? What is a good inspection? How to know? What to cut down?

3. © 2000 Hans Schaefer Slide no. 3 Integration between reviews and test Can you rely on inspections alone? NO! You need to measure the FINAL quality. Test finds issues inspections don't find well: Issues that are hidden in the connections between many parts. Performance problems New errors introduced after inspection Surviving errors

4. © 2000 Hans Schaefer Slide no. 4 Integration between reviews and test Cleanroom Software Engineering and Testing Cleanroom heavily relies on inspections. Inspections replace unit test. System test replaced by statistical usage testing (software reliability engineering). Reasoning: ”If you have no chance to test your unit, you will de better inspections!” But: This has never been verified in large projects. Conclusion: Cleanroom PLUS traditional testing!

5. © 2000 Hans Schaefer Slide no. 5 Integration between reviews and test What is a good inspection? The right (qualified) people attended They had time to prepare Well led meeting 3 to 7 people Meeting in chunks of <= 2 hours Material met entry criteria Check lists Concentration on MAJOR issues Follow up of issues found People know inspection technique Defect detection percentage known Assess yourself!

6. © 2000 Hans Schaefer Slide no. 6 Integration between reviews and test How to know inspections were good enough? And the results as well? Inspection database Check against other inspections Experience in how testing goes after good inspections - in YOUR organization! Experience in which defects disappear from testing

7. © 2000 Hans Schaefer Slide no. 7 Integration between reviews and test What you can cut down after inspections Defect repair time during testing Test re-execution (less faults require less repairs and regression test) Getting the test to execute at all (Start trouble) Some, but not all unit testing Other testing only after experience data available Do more test where inspection found many defects!

8. © 2000 Hans Schaefer Slide no. 8 Integration between reviews and test Danger If an inspection finds few defects: Maybe the software is good? Maybe the inspection was bad?