Finding the Few Critical Process Steps That Are Essential for Success Bill Schoening

Claims, Expectations & Questions Fashionable to claim Fashionable to claim Organization is process basedOrganization is process based Assessed at Maturity Level 5 for CMMIAssessed at Maturity Level 5 for CMMI (Flawed) Expectations (Flawed) Expectations High assessment scores lead to successHigh assessment scores lead to success Highly rated processes & their implementation are sufficientHighly rated processes & their implementation are sufficient Questions for a business seeking success Questions for a business seeking success Are the processes contributing to success?Are the processes contributing to success? Do the assessments measure what contributes to success?Do the assessments measure what contributes to success? Should there be more to our processes?Should there be more to our processes? Should we be measuring something else?Should we be measuring something else?

Unmet Expectations & Unintended Consequences ML 5 organizations failing to execute SDD efforts adequately ML 5 organizations failing to execute SDD efforts adequately Processes viewed as cumbersome and without value Processes viewed as cumbersome and without value Loss of faith in systems engineering and its processes Loss of faith in systems engineering and its processes Critical steps bypassed, further speeding the decent into chaos Critical steps bypassed, further speeding the decent into chaos

Root Causes Processes assessment mentality has skewed how we measure success Assessments rely on audits of processes compliance Compliance easily observable for objective evidence Objective evidence most easily created for administrative activities Intellectual content is difficult to characterize and evaluate as objective evidence

CMMI Risk Management Specific Practices Define Risk Parameters Establish a Risk Management Strategy Identify Risks Evaluate, Categorize, and Prioritize Risks Develop Risk Mitigation Plans Implement Risk Mitigation Plans Seldom ask: Does the strategy make sense? Are the risks relevant? Do the mitigation plans actually mitigate the risks? Are we executing the plans effectively?

Solving the Right Problem Identify the critical steps that should be in processes Focus energy on ensuring critical steps are carried out effectively

What Risk Management Must Accomplish 1. Identify significant risks 2. Develop effective handling plans 3. Effectively implement mitigation plans Other activities are secondary Tough to audit compliance

What Requirements Development Must Prevent 1. Requirements are not viable 2. Requirements fail to represent (or maybe even misrepresent) user needs 3. Requirements fail to reflect significant changes in user needs during development 4. Requirements developed without adequate regard for the scenarios in which the product or service is to be used, including relevant business processes and rules Other activities are secondary Tough to audit compliance

What Trade Studies Must Accomplish 1. Well informed recommendation with adequate discovery in support of a quality decision 2. Visibility into all supporting materials 3. Well prepared to revisit decisions when additional information is received 4. Avoid corporate memory associated with completed trade studies walking out the door as the result of personnel turnover Other activities are secondary Tough to audit compliance

What Is the Cause? CMMI is not the cause CMMI is not the cause Our processes are not the cause Our processes are not the cause Taking the easy way out is Taking the easy way out is Performing admin tasks is not doing the workPerforming admin tasks is not doing the work Measuring admin tasks and not intellectual content addresses the wrong problemMeasuring admin tasks and not intellectual content addresses the wrong problem

What Do We Do? Focus attention on the critical steps Focus attention on the critical steps Reduce emphasis on administrivia Reduce emphasis on administrivia Train PMs, SEs and engineers about what is happening and what needs to change Train PMs, SEs and engineers about what is happening and what needs to change