1. WM-001 - Software Process & QualityDetermining Ratings -slide#1©P. Sorenson Rating Concepts and Scales ðDetermine highest capability level to rate ðProcess context - see scope ðProcess and process instances under scope  Assessment purpose must always be kept in mind N: Not achieved P: Partially achieved L: Largely achieved F: Fully achieved Concepts Scales - +

2. WM-001 - Software Process & QualityDetermining Ratings -slide#2©P. Sorenson Process Attribute Rating Scale N N ot achievedNo evidence of achievement of the defined attribute P P artially achievedSome achievement of the defined attribute L L argely achievedSignificant achievement of the defined attribute F F ully achievedFull achievement of the defined attribute

3. WM-001 - Software Process & QualityDetermining Ratings -slide#3©P. Sorenson Process Attribute Ratings ïRating references can be expressed in the form: PC.PR (Instance Reference); CL.PA where - PC = Process Category - PR = Process - (instance reference) = number or list - CL = Capability Level - PA = Process Attribute

4. WM-001 - Software Process & QualityDetermining Ratings -slide#4©P. Sorenson Expressing Rating ðExample: For a single instance of process ENG.2 (Develop Software Requirements) which is referred to as ‘SEAF-des-1’, a capability rating is determined for each attribute at Level 3, the Well-Defined Level. The ratings might be expressed as: ENG.2(SEAF-des-1);3.1 = L ENG.2(SEAF-des-1);3.2 = P

5. WM-001 - Software Process & QualityDetermining Ratings -slide#5©P. Sorenson Ratings Determination Process Profile Capability lev. 1 rating Process indicator Process purpose statement Organization’s processes contains determined against satisfies used to assess òPerformance of relevant tasks provides 1st indication that an implemented process meets purpose òThe existence of work- products is the second indication. Sample work- product types must exist. Base Practices

6. WM-001 - Software Process & QualityDetermining Ratings -slide#6©P. Sorenson Ratings Determination Process Profile Capability rating level 2-5 Process capability indicator Process attribute Organization’s processes contains determined against is applied to used to assess Higher (Management) Capabilities òuse the set of process capability indicators òtake into account the capability level and the attribute definitions òa rating is assigned and justified by the assessor

7. WM-001 - Software Process & QualityDetermining Ratings -slide#7©P. Sorenson Ratings Determination - Overall Process Profile Capability lev. 1 rating Process indicator Process purpose statement Capability rating level 2-5 Process capability indicator Process attribute Organization’s processes contains determined against satisfies is applied to used to assess

8. WM-001 - Software Process & QualityDetermining Ratings -slide#8©P. Sorenson Relationship between Reference Model and the Assessment Model PROCESS DIMENSION CAPABILITY DIMENSION Indicators of process performance Indicators of process capability Base Practices WPs & characteristics Management practices Attribute indicators Process categories Processes Process purposes Capability levels Process attributes REFERENCEMODEL Indicators of practices performance ASSESSMENTINDICATORS

9. WM-001 - Software Process & QualityDetermining Ratings -slide#9©P. Sorenson Capability Level Determination Lev.0 Lev.1 Lev.2 Lev.3 Lev.4 Lev.5 Continuous Imprvm’t - 5.2 Process Change- 5.1 Process Control - 4.2 Process Measurement - 4.1 Process Resource - 3.2 Proc. Def’n & Tailoring - 3.1 Work Product Mngmt - 2.2 Performance Mngmt - 2.1 Process Performance - 1.1 Largely achieved Fully achieved

10. WM-001 - Software Process & QualityDetermining Ratings -slide#10©P. Sorenson Calculating Capability Level Ratings - Levels 1 - 3 Capability Level Process AttributesRating Level 1 (Inc) PA1.1Process PerformanceL or F Level 2PA1.1Process PerformanceF (Performed) PA2.1Performance MgmtL or F PA2.2Work Product MgmtL or F Level 3PA1.1Process PerformanceF (Managed) PA2.1Performance MgmtF PA2.2Work Product MgmtF PA3.1Process DefinitionL or F PA3.2Process ResourceL or F

11. WM-001 - Software Process & QualityDetermining Ratings -slide#11©P. Sorenson Calculating Capability Level Ratings - Level 4 (Predictable) Capability Level Process AttributesRating Level 4PA1.1Process PerformanceF PA2.1Performance MgmtF PA2.2Work Product MgmtF PA3.1Process DefinitionF PA3.2Process ResourceF PA4.1 Process MeasurementL or F PA4.2 Process ControlL or F

12. WM-001 - Software Process & QualityDetermining Ratings -slide#12©P. Sorenson Calculating Capability Level Ratings - Level 5 (Optimized) Capability Level Process AttributesRating Level 5PA1.1Process PerformanceF PA2.1Performance MgmtF PA2.2Work Product MgmtF PA3.1Process DefinitionF PA3.2Process ResourceF PA4.1 Process MeasurementL or F PA4.2 Process ControlL or F PA5.1Process ChangeL or F PA5.2 Continuous ImprovemtL or F

13. WM-001 - Software Process & QualityDetermining Ratings -slide#13©P. Sorenson Rating Examples Man.2 1.1 2.1 2.2 3.1 3.2 4.1 4.2 5.1 5.2 LEV, Proj1 F L F L P N 2 Proj2 L P L P L P N 1 Proj3 P N P N P N 0 Proj4 F L P N 3 Proj5 F L F L P N P N 2 F = Fully L = Largely P = Partially N = None

14. WM-001 - Software Process & QualityDetermining Ratings -slide#14©P. Sorenson Rating Examples Accumulated F = Fully L = Largely P = Partially N = None Man.2(*)1.1 = [0%N, 20%P, 20%L, 60%F] Man.2(*)2.1 = [20%N, 40%P, 20%L, 20%F] Man.2(*)2.2 = [0%N, 20%P, 40%L, 40%F] Man.2(*)3.1 = [20%N, 20%P, 20%L, 40%F] Man.2(*)3.2 = [0%N, 20%P, 0%L, 80%F] Man.2(*)4.1 = [20%N, 80%P, 0%L, 0%F] Man.2(*)4.2 = [100%N, 0%P, 0%L, 0%F] Man.2(*)5.1 = [80%N, 20%P, 0%L, 0%F] Man.2(*)1.1 = [100%N, 0%P, 0%L, 0%F] Man.2(*)1.1 = [0%N, 20%P, 20%L, 60%F] Man.2(*)2.1 = [20%N, 40%P, 20%L, 20%F] Man.2(*)2.2 = [0%N, 20%P, 40%L, 40%F] Man.2(*)3.1 = [20%N, 20%P, 20%L, 40%F] Man.2(*)3.2 = [0%N, 20%P, 0%L, 80%F] Man.2(*)4.1 = [20%N, 80%P, 0%L, 0%F] Man.2(*)4.2 = [100%N, 0%P, 0%L, 0%F] Man.2(*)5.1 = [80%N, 20%P, 0%L, 0%F] Man.2(*)1.1 = [100%N, 0%P, 0%L, 0%F]

15. WM-001 - Software Process & QualityDetermining Ratings -slide#15©P. Sorenson Distribution of Attribute Ratings

16. WM-001 - Software Process & QualityDetermining Ratings -slide#16©P. Sorenson Example Process Attribute Ratings %

17. WM-001 - Software Process & QualityDetermining Ratings -slide#17©P. Sorenson Deriving a Process Profile Organization’s Processes Process Profile Evidence of Process Performance (Capability Lev 1) Indicators of Process Performance Input and output work products and their characteristics Base Practices Based on judgement of is derived from used to assess consisting of Evidence of Process Capability (Capability Lev 2-5) Indicators of Process Capability Management Practices Characteristics of practice performance Characteristics of resources & infrastructure Associated Processes Based on judgement of consisting of