Integrated Processes: On the Horizon PRODUCTIVITY CONSORTIUM SOFTWARE Integrated Processes: On the Horizon Carlos C. Galvan August 25, 2000

Agenda Introduction CMMI Models CMMI Assessments Getting Started Summary

Current Situation Software Division I wonder when they’ll give us our requirements? Management Aeronautical Communication Electrical Manufacturing Payload Adapted from “Transitioning to the CMMI via MBASE” briefing by Dr. Barry Boehm, presented to SEA2000.

Current Situation: Implications Organizational processes not aligned Business, acquisition Systems engineering, software engineering Hardware engineering, security engineering Separate Process Improvement efforts Compete for resources Create stove piped processes Resulting in sub-optimal enterprise processes!

Solution Areas Integrate Processes Create organizational processes with Well coordinated interfaces Common process where possible Careful consideration of negotiation and commitment process Emphasis on critical information flows Industry example responses: University of Southern California’s MBASE Consortium’s Integrated Systems and Software Engineering Process (ISSEP) Integrate Process Improvement initiatives Industry response: CMMISM SM – CMMI and CMM Integration are service marks of Carnegie Mellon University

How did we get here? CMMI-SE/SW V1.0 August 11, 2000 CMM for Software V1.0 1991 SE-CMM V1.1 1996 SECAM But, what about SA-CMM P-CMM PSP SPICE / ISO 15504 ISO 12207 and others? CMM® for Software V1.1 1993 EIA/IS 731 1999 SW-CMM V2.0 Draft C* 1997 * Not released CMMI-SE/SW V1.0 IPD-CMM V0.98* 1997 August 11, 2000 ® Capability Maturity Model and CMM are registered with the U.S. Patent and Trademark Office

CMMI Objectives of CMMI CMM EIA/IS 731 IPD-CMM Encourage integration of disciplines Integrate models Eliminate duplication of material Remove conflicts between models More efficient to have an integrated model for: Process improvement Process assessment Improve the models Equally applicable and important to government (defense and civil) agencies, aerospace & defense and systems integration companies, as well as commercial organizations CMMI

CMMI Project Sponsored by DoD and NDIA Project team includes representatives from Government Industry SEI Coordinated by SEI

CMMI Project

CMMI Project Plan CMMI-SE/SW V1.0 published August 11, 2000 (Note: IPPD process areas are scheduled to be added within one month.) http://www.sei.cmu.edu/cmmi/ for models, news, and plans

Agenda Introduction CMMI Models CMMI Assessments Getting Started Summary

Model Architectures But the architectures are different... Capability Levels Level Key Process Areas Continuous Improvement Heroes Focus 4 Optimizing 3 2 1 5 Process change management Technology change management Defect Prevention Software quality management Quantitative process management Organization process focus Organization process definition Peer Reviews Training program Intergroup coordination Software product engineering Integrated software management Requirements management Software project planning Software project tracking & oversight Software subcontract management Software quality assurance Software configuration management Managed Defined Repeatable Initial Product and Process Quality Engineering Process Project Management Training Product Evolution Sample Results Define Process Tracking Process Areas Configuration Mgmt. Verify & Validate Integrate System Architecture Analyze Solutions CMM for Software - Staged Model 1 2 3 4 5 SE-CMM - Continuous Model SEI Solution: Include both Model Representations – An elegant solution, but difficult to implement CMMI-SE/SW Staged or Continuous Representation CMMI-SE/SW/IPPD Staged or Continuous Representation Staged Maturity Level - Process Areas are assessed using the practices Continuous Capability Level - Process Areas are assessed using the specific practices within an area and the generic practices required for a specific level CMMI “Informative Material” provides implementation detail for representative or anticipated Systems, Software, and IPPD usages

Staged Model Structure Process Areas are assessed to determine the Maturity Level Maturity Levels Process Areas Specific Goals Generic Goals Commitment to Perform Ability to Perform Directing Implementation Verifying Implementation Specific Practices Generic Practices Informative Material

Continuous Model Structure Process Areas are assessed using the Generics to determine the capability level Process Management Project Management Engineering Support Categories Process Areas Capability Levels Generic Goals Specific Practices Specific Goals Generic Practices Informative Material

Major Sources of Changes Generalized wording to applied to both systems and software engineering Took “union” of source models “Raised the bar” on some legacy elements Expanded Software Product Engineering KPA Requirements Development Technical Solution Product Integration Verification Validation

Maturity Levels of Staged Models The names of the levels have changed, but the concepts remain the same. 5 Optimizing  4 Managed  Quantitatively Managed 3 Defined  2 Repeatable  Managed 1 Initial  Performed

Software Model Relationships Source of Change CMM V1.1 CMMI Level 2 - Repeatable Level 2 - Managed Requirements Management Software Project Planning Software Project Tracking and Oversight Software Subcontract Management Software Quality Assurance Software Configuration Management Requirements Management Project Planning (incls DM) Project Monitoring and Control Supplier Agreement Management Measurement and Analysis Process and Product Quality Assurance Configuration Management Generalize CMM V2.0 C Consolidate EIA/IS 731 CMMI Level 1 – Performed (No Process Areas)

Software Model Relationships Source of Change CMM V1.1 CMMI Level 3 - Defined Level 3 - Defined Organization Process Focus Organization Process Definition Training Program Integrated Software Management Software Product Engineering Intergroup Coordination Peer Reviews* *(Now part of CMMI Product Verification Required Goal) Organizational Process Focus Organizational Process Definition Organizational Training Integrated Project Management Requirements Development Technical Solution Product Integration Verification Validation Risk Management Decision Analysis and Resolution Generalize EIA/IS 731

The Engineering Process Areas Software Product Engineering KPA has been expanded to five new process areas Requirements Management Requirements Development Technical Solution Product Integration Verification Validation Software Product Engineering Requirements Management Adapted from “Transitioning to the CMMI Product Suite” briefing by Jon Gross, presented to SSQ on 4/11/2000.

Software Model Relationships Source of Change CMM V1.1 CMMI Level 4 – Quantitatively Managed Level 4 - Managed Generalize + statistical Generalize Quantitative Process Management Software Quality Management Defect Prevention Technology Change Management Process Change Management Quantitative Project Management Organizational Process Performance Causal Analysis and Resolution Organizational Innovation and Deployment Level 5 - Optimizing Level 5 – Optimizing

System Model Relationships SE-CMM SECM CMMI Engineering Technical Engineering PA06 Understand Customer Needs and Expectations PA02 Derive and Allocate Requirements PA03 Evolve System Architecture PA01 Analyze Candidate Solutions PA05 Integrate System PA07 Verify and Validate System PA04 Integrate Disciplines 1.1 Define Stakeholder and System Level Requirements 1.2 Define Technical Requirements 1.3 Define Solution 1.4 Assess and Select 1.5 Integrate System 1.6 Verify System 1.7 Validate System SW Req’s Management Req’s Development Technical Solution Product Integration Verification Validation Support 2.3 EIA/IS 731

System Model Relationships SE-CMM SECM CMMI Project Management Project Management PA12 Plan Technical Effort PA11 Monitor and Control Technical Effort PA10 Manage Risk PA09 Manage Configurations PA08 Ensure Quality Project Planning Project Mon and Ctl Supplier Agree Mgt Integrated Proj Mgt Risk Management Quantitative Proj Mgt 2.1 Plan and Organize 2.2 Monitor and Control 2.3 Integrate Disciplines 2.4 Coordinate with Suppliers 2.5 Manage Risk 2.6 Manage Data 2.7 Manage Configurations 2.8 Ensure Quality PA04 PA18 L4 GP Support * Configuration Mgt Proc and Prod QA Meas and Analysis Causal Anl and Res Decision Anl and Resolution L2 GP L5 GP EIA/IS 731 1.4 * Not in SE-CMM

System Model Relationships SE-CMM SECM CMMI Organization Environment Process Management PA13 Define Organization’s SE Process PA14 Improve Organization’s SE Process PA17 Provide Ongoing Knowledge and Skills PA15 Manage Product Line Evolution PA16 Manage SE Support Environment PA18 Coordinate With Suppliers 3.1 Define and Improve the SE Process 3.2 Manage Competency 3.3 Manage Technology 3.4 Manage SE Support Environment Org Process Focus Org Process Definition Organizational Tng Org Process Perf Org Innovation and Deployment SW L4 GP 2.4

Integrated Product and Process Development IPPD Model Components Additions Additions and amplifications of CMMI SE/SW process areas Additional IPPD process areas: Level 2 Collaborative Leadership Shared Vision Building Level 3 Organizational Environment for Integration Integrated Team Some modifications to CMMI model components will be included only when IPPD is selected to be part of the CMMI model to be used. Amplifications were added to many process areas and a new goal and practices were added to the Integrated Project Management process area. The purpose of Collaborative Leadership is to make effective decisions in a collaborative and efficient way. The participants in leadership and decision making are appropriately rewarded for their efforts. The purpose of Shared Vision is to establish a common vision that encompasses the aspirations, goals, behaviors and values of a group. The purpose of Organizational Environment for Integration is to enable, promote, and reward integration across all business and technical disciplines while stimulating both team and individual excellence. The purpose of Integrated Team is to form and sustain an integrated team for the development of products. 29405 From CMMI-SE/SW/IPPD Staged Representation, initially released December 1999 To be Released, concurrently, as part of the CMMI, either in August 2000 (CMMI 1.0 release date, as announced by DOD, Dr. Delores Etter, Deputy Under Secretary of Defense (Science & Technology), at the STC Conference May 2, 2000) or within one month after release of the CMMI

Agenda Introduction CMMI Models CMMI Assessments Getting Started Summary

CMMI Process Assessments Plan is to support a variety of assessment types Quick-look assessments First assessments Reassessments First effort will focus on CBA IPI like assessment method called: Standard CMMI Assessment Method for Process Improvement “SCAMPI”

Assessment Challenges Assessment method issues to be resolved Breadth versus depth Spot checks versus complete coverage Interpretations in SW, SE, and integrated environments Assessment team Number of team members increased Domain expertise of team members Length (and cost) of assessment related to number of practices CMM V1.1: 316 practices EIA/IS 731: 383 practices CMMI V0.2 SE/SW: 431 practices CMMI SE/SW/IPPD: 501 practices

Agenda Introduction CMMI Models CMMI Assessments Getting Started Summary

What Should You Do Now? Identify your business objectives Evaluate current processes Identify areas of the process infrastructure that overlaps and will support integration efforts Identify threads that cross discipline boundaries that are critical Identify processes that are used by both systems and software engineering Decide on Staged vs. Continuous PI Approach

Business Objectives Identify your business objectives Reduce costs of PI, while continuing to improve Align organizational processes Develop common processes across organization Maintain maturity level credentials

Quagmap Evaluate Processes ® Evaluate current processes Map existing processes to models and standards of interest: CMM, EIA/IS 731, SE-CMM, ISO 9000, high level enterprise processes Map existing processes to CMMI V1.0 Perform a quick-look evaluation Quagmap ® ® Quagmap is registered with the U.S. Patent and Trademark Office

Process Infrastructure Identify areas of the process infrastructure that overlap and can support integration efforts Begin now to consolidate the infrastructure Sponsorship Steering committee Process group Process asset library Process database

Process Threads Identify threads that cross discipline boundaries and are critical Begin now to improve these processes Requirements process Integration Verification

Common Processes Identify processes that are used by both systems and software engineering Begin now to create one common process Quality assurance Configuration management Inspections Risk management Project management

Agenda Introduction CMMI Models CMMI Assessments Getting Started Summary

Consortium CMMI Plans CMMI CMM EIA/IS 731 IPD-CMM Author team participation and review Assessment methods Training and other deployment support products Impact Assessment Summarize changes Transition course Consortium product and service updates

The Frameworks Quagmire PSP SDCCR MIL-Q -9858 MIL-STD-1679 SW-CMM SW-CMM SDCE DOD- STD- 2168 People CMM SCE DOD-STD -2167A IEEE Stds. 730,828 829, 830,1012,1016 1028,1058,1063 NATO AQAP1,4,9 SA-CMM ISO 15504 (SPICE) DOD-STD -7935A EQA MIL-STD- 498 FAA- iCMM CMMI** Baldrige Trillium BS 5750 IPD- CMM* EIA/IEEE J-STD-016 DO- 178B ISO/IEC 12207 SECM (EIA/IS 731) DOD IPPD SE-CMM SECAM IEEE 1074 TickIT ISO 9000 Series AF IPD Guide SSE- CMM IEEE 1220 Q9000 IEEE/EIA 12207 EIA/IS 632 ISO 10011 MIL-STD -499B* ISO 15288* EIA 632 * Not released ** Aug 11, 2000 Also see: www.software.org/quagmire

The Future??? PSP MIL-Q -9858 MIL-STD-1679 ISO 15504 (SPICE) DOD- STD- 2168 DOD-STD -2167A IEEE Stds. 730,828 829, 830,1012,1016 1028,1058,1063 NATO AQAP1,4,9 DOD-STD -7935A EQA Software Systems IPPD Acquisition Security People MIL-STD- 498 CMMI Baldrige Trillium BS 5750 EIA/IEEE J-STD-016 DO- 178B ISO/IEC 12207 DOD IPPD IEEE 1074 TickIT ISO 9000 Series AF IPD Guide IEEE 1220 Q9000 IEEE/EIA 12207 EIA/IS 632 ISO 10011 MIL-STD -499B* ISO 15288* EIA 632 * Not released

Conclusions: A Recommended Approach Begin now to: Integrate your Processes Integrate your Process Improvement Initiatives and Infrastructures Begin or Continue to Improve your Systems Engineering Processes Complete “Next/Near Term” Scheduled Assessment Study CMMI and Impact on PI Program Determine Business Case for CMMI Formulate CMMI Transition Strategy Plans Determine how to Establish, Expand, Update, and/or Integrate SE/SW/IPPD Process Areas Determine Staged vs. Continuous PI Business Case Approach for SE/SW/IPPD The Consortium can provide a wide variety of Products and Services to support your CMMI Systems and Software Engineering Process Integration and Improvement efforts.

CMMI – Web Links Software Engineering Institute (SEI) http://www.sei.cmu.edu/cmmi Software productivity Consortium (SPC) http://www.software.org Software Technology Support Center http://www.stsc.hill.af.mil

Acronyms CBA IPI CMM Based Appraisal for Internal Process Improvement Capability Maturity Model for Software CMMI Integrated Capability Maturity Model DoD Department of Defense EIA/IS Electronics Industries Alliance / Interim Standard FAA Federal Aviation Administration GP Generic Practice IPD-CMM Integrated Product Development Capability Maturity Model IPPD Integrated Product and Process Development ISO International Organization for Standardization ISSEP Integrated Systems and Software Engineering Process http://www.software.org for more information KPA Key Process Area MBASE Model Based (System) Architecting and Software Engineering http://sunset.usc.edu/research/MBASE/index.html for more info NDIA National Defense Industrial Association

Acronyms NSA National Security Agency PA Process Area P-CMM People Capability Maturity Model PDT Product Development Team PI Process Improvement PSP Personal Software Process SA-CMM Software Acquisition Capability Maturity Model SCAMPI Standard CMMI Assessment Method for Process Improvement SE Systems Engineering SECAM Systems Engineering Capability Assessment Model SE-CMM Systems Engineering Capability Maturity Model SEI Software Engineering Institute SPC Statistical Process Control SPICE Software Process Improvement and Capability deTermination SW Software SW-CMM Software Capability Maturity Model