1. University of Southern California Center for Software Engineering C S E USC ISERN 2005 November 15, 2005 Stefan Biffl, Aybuke Aurum, Rick Selby, Dan Port, Barry Boehm Value-Based Empirical Methods (VBEM) Session

2. University of Southern California Center for Software Engineering C S E USC 11/15/03©USC-CSE2 Summary VBEM’s support better use of scarce resources –Focus on high-value aspects –Some ISESE 2005 results VBEM’s present challenges –Values vary by situation, time –Mix of qualitative and quantitative data –Data often competitively sensitive Speakers provide 10-minute experience summaries –Major opportunity areas, problem areas –Followed by discussion of these

3. University of Southern California Center for Software Engineering C S E USC 11/15/03©USC-CSE3 Value-Based Testing: Empirical Data and ROI — LiGuo Huang, ISESE 2005 (a) (b)

4. University of Southern California Center for Software Engineering C S E USC 11/15/03©USC-CSE4 COCOMO II: 012223454Added % test time COQUALMO: 1.0.475.24.1250.06P q (L) Value-Based:3.01.68.96.54.30S q (L): Pareto Value-Neutral:3.02.331.65.975.30S q (L): Linear Market Risk:.008.027.09.301.0RE m Sweet Spot Value/Risk-Driven Testing: 40% Gain — LiGuo Huang, ISESE 2005

5. University of Southern California Center for Software Engineering C S E USC 11/15/03©USC-CSE5 By NumberP-value% Gr A higherBy ImpactP-value% Gr A higher Average of Concerns 0.20234 Average Impact of Concerns 0.04965 Average of Problems 0.05651 Average Impact of Problems 0.01289 Average of Concerns per hour 0.02655 Average Cost Effectiveness of Concerns 0.004105 Average of Problems per hour 0.02361 Average Cost Effectiveness of Problems 0.007108 Group A: 15 IV&V personnel using VBR procedures and checklists Group B 13 IV&V personnel using previous value-neutral checklists – Significantly higher numbers of trivial typo and grammar faults Experiment Value-Based Reading (VBR) Experiment — Keun Lee, ISESE 2005