1. 10.10.2000 Hawaii, Honolulu 1 Qualitative and Quantitative methods in SPI - some experiences ISERN meeting October 8, 2000 Seija Komi-Sirviö seija.komi-sirvio@vtt.fi

2. 10.10.2000 Hawaii, Honolulu 2 Pr 2 imer improvement method Practical Process Improvement for Embedded Real-time Software PDCA-style integration of software process analysis, modelling, improvement and measurement Since -94 over 20 SPI cases

3. 10.10.2000 Hawaii, Honolulu 3 Current State Analysis

4. 10.10.2000 Hawaii, Honolulu 4 Qualitative analysis Semi-Structured Interviews Output: descriptive process models (actual process, methods and tools used) + strengths and weaknesses +Provides –An overview of current situation –Fairly quick start for improvement initiatives –Good starting point for prescriptive process modelling –If applied solely, does not give best basis to analyse later the anticipated improvement effects –Depends on the opinions and expertise of interviewee

5. 10.10.2000 Hawaii, Honolulu 5 Quantitative analysis Use of Metrics +Provides quantitative basis for improvement planning and evaluation of improvement effects –Requires mature measurement practices, otherwise can take too long time to get any results to start SPI –Cannot be applied to get an overview of current processes

6. 10.10.2000 Hawaii, Honolulu 6 Quantitative analysis Process Assessment (CMM, Bootstrap, Spice, …) +Provides quantitative (type) basis for improvement planning and evaluation of improvement effects +Gives an overview of the maturity of current processes –Does not give a description of the actual process –Risk: selected improvement areas can be too much “maturity model driven”

7. 10.10.2000 Hawaii, Honolulu 7 Few Lessons Learned The ideal solution: combine qualitative and quantitative analysis, you get –Actual process to be improved –Quantitative basis to plan and follow the effects of improvement initiatives Some interview recommendations –2 interviewers per interview with different role –Interview people from different positions: quality manager, product manager, project manager, experienced designer, novice designer, test responsible person,... –The maximum length of interview session is <3 hours. Positive, helping attitude is a master key to get sincere answers to the questions!