1. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 1 Integrated Processes: On the Horizon PRODUCTIVIT Y CONSORTIUM SOFTWARE Carlos C. Galvan August 25, 2000

2. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 2 Agenda  Introduction CMMI Models CMMI Assessments Getting Started Summary

3. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 3 Software Division I wonder when they’ll give us our requirements? Management Aeronautical Communication Electrical Manufacturing Payload Current Situation Adapted from “Transitioning to the CMMI via MBASE” briefing by Dr. Barry Boehm, presented to SEA2000.

4. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 4 Current Situation: Implications Organizational processes not aligned Business, acquisition Systems engineering, software engineering Hardware engineering, security engineering Separate Process Improvement efforts Compete for resources Create stove piped processes Resulting in sub-optimal enterprise processes!

5. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 5 Solution Areas Integrate Processes Create organizational processes with –Well coordinated interfaces –Common process where possible –Careful consideration of negotiation and commitment process –Emphasis on critical information flows Industry example responses: –University of Southern California’s MBASE –Consortium’s Integrated Systems and Software Engineering Process (ISSEP) Integrate Process Improvement initiatives Industry response: CMMI SM SM – CMMI and CMM Integration are service marks of Carnegie Mellon University

6. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 6 How did we get here? CMM for Software V1.0 1991 CMM ® for Software V1.1 1993 SE-CMM V1.1 1996 SECAM 1996 But, what about SA-CMM P-CMM PSP SPICE / ISO 15504 ISO 12207 and others? SW-CMM V2.0 Draft C* 1997 IPD-CMM V0.98* 1997 * Not released CMMI-SE/SW V1.0 EIA/IS 731 1999 ® Capability Maturity Model and CMM are registered with the U.S. Patent and Trademark Office August 11, 2000

7. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 7 Objectives of CMMI Encourage integration of disciplines Integrate models Eliminate duplication of material Remove conflicts between models More efficient to have an integrated model for: Process improvement Process assessment Improve the models Equally applicable and important to government (defense and civil) agencies, aerospace & defense and systems integration companies, as well as commercial organizations CMMEIA/IS 731 IPD-CMM CMMI

8. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 8 CMMI Project Sponsored by DoD and NDIA Project team includes representatives from Government Industry SEI Coordinated by SEI

9. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 9 CMMI Project

10. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 10 CMMI Project Plan CMMI-SE/SW V1.0 published August 11, 2000 (Note: IPPD process areas are scheduled to be added within one month.) http://www.sei.cmu.edu/cmmi/ for models, news, and plans

11. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 11 Agenda Introduction  CMMI Models CMMI Assessments Getting Started Summary

12. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 12 012345 Analyze Solutions Architecture Integrate System Verify & Validate Configuration Mgmt. Tracking Define Process Product Evolution Training But the architectures are different... CMM for Software - Staged Model SEI Solution: Include both Model Representations – An elegant solution, but difficult to implement CMMI-SE/SW Staged or Continuous Representation CMMI-SE/SW/IPPD Staged or Continuous Representation Capability Levels SE-CMM - Continuous Model Sample Results Staged Maturity Level - Process Areas are assessed using the practices Continuous Capability Level - Process Areas are assessed using the specific practices within an area and the generic practices required for a specific level CMMI “Informative Material” provides implementation detail for representative or anticipated Systems, Software, and IPPD usages LevelKey Process Areas Continuous Improvement Heroes Focus 4 Optimizing 3 2 1 5 Process change management Technology change management Defect Prevention Software quality management Quantitative process management Organization process focus Organization process definition Peer Reviews Training program Intergroup coordination Software product engineering Integrated software management Requirements management Software project planning Software project tracking & oversight Software subcontract management Software quality assurance Software configuration management Managed Defined Repeatable Initial Product and Process Quality Engineering Process Project Management Model Architectures Process Areas

13. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 13 Staged Model Structure Informative Material Maturity Levels Process Areas Specific Goals Process Areas are assessed to determine the Maturity Level Specific Practices Directing Implementation Verifying Implementation Ability to Perform Commitment to Perform Generic Goals Generic Practices

14. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 14 Continuous Model Structure Process Areas are assessed using the Generics to determine the capability level Continuous Models Informative Material Process Areas Specific Practices Specific Goals Capability Levels Generic Goals Generic Practices Process Management Project Management Engineering Support Categories

15. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 15 Major Sources of Changes Generalized wording to applied to both systems and software engineering Took “union” of source models “Raised the bar” on some legacy elements Expanded Software Product Engineering KPA Requirements Development Technical Solution Product Integration Verification Validation

16. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 16 5 Optimizing  Optimizing 4 Managed  Quantitatively Managed 3 Defined  Defined 2 Repeatable  Managed Maturity Levels of Staged Models 1 Initial  Performed The names of the levels have changed, but the concepts remain the same.

17. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 17 Level 2 - Repeatable CMM V1.1 Level 2 - Managed CMMI Software Model Relationships Requirements Management Project Planning (incls DM) Project Monitoring and Control Supplier Agreement Management Measurement and Analysis Process and Product Quality Assurance Configuration Management Requirements Management Software Project Planning Software Project Tracking and Oversight Software Subcontract Management Software Quality Assurance Software Configuration Management Generalize CMM V2.0 C Consolidate Generalize EIA/IS 731 Generalize Source of Change CMMI Level 1 – Performed (No Process Areas)

18. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 18 Level 3 - Defined CMM V1.1 Level 3 - Defined CMMI Organizational Process Focus Organizational Process Definition Organizational Training Integrated Project Management Requirements Development Technical Solution Product Integration Verification Validation Risk Management Decision Analysis and Resolution Organization Process Focus Organization Process Definition Training Program Integrated Software Management Software Product Engineering Intergroup Coordination Peer Reviews* *(Now part of CMMI Product Verification Required Goal) Generalize EIA/IS 731 Software Model Relationships Source of Change

19. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 19 The Engineering Process Areas Software Product Engineering KPA has been expanded to five new process areas Software Product Engineering Requirements Management Adapted from “Transitioning to the CMMI Product Suite” briefing by Jon Gross, presented to SSQ on 4/11/2000. Requirements Management Requirements Development Technical Solution Product Integration Verification Validation

20. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 20 Level 4 - Managed CMM V1.1 Level 4 – Quantitatively Managed CMMI Quantitative Project Management Organizational Process Performance Causal Analysis and Resolution Organizational Innovation and Deployment Quantitative Process Management Software Quality Management Defect Prevention Technology Change Management Process Change Management Generalize + statistical Generalize Source of Change Level 5 - Optimizing Level 5 – Optimizing Software Model Relationships

21. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 21 Engineering PA06 Understand Customer Needs and Expectations PA02 Derive and Allocate Requirements PA03 Evolve System Architecture PA01 Analyze Candidate Solutions PA05 Integrate System PA07 Verify and Validate System PA04 Integrate Disciplines SE-CMM Engineering CMMI Technical 1.1 Define Stakeholder and System Level Requirements 1.2 Define Technical Requirements 1.3 Define Solution 1.4 Assess and Select 1.5 Integrate System 1.6 Verify System 1.7 Validate System SECM 2.3 Req’s Management Req’s Development Technical Solution Product Integration Verification Validation Support SW System Model Relationships EIA/IS 731

22. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 22 Project Management Project Planning Project Mon and Ctl Supplier Agree Mgt Integrated Proj Mgt Risk Management Quantitative Proj Mgt * Not in SE-CMM SE-CMM Management 2.1 Plan and Organize 2.2 Monitor and Control 2.3 Integrate Disciplines 2.4 Coordinate with Suppliers 2.5 Manage Risk 2.6 Manage Data 2.7 Manage Configurations 2.8 Ensure Quality SECM * Project PA12 Plan Technical Effort PA11 Monitor and Control Technical Effort PA10 Manage Risk PA09 Manage Configurations PA08 Ensure Quality CMMI PA04 PA18 Support Configuration Mgt Proc and Prod QA Meas and Analysis Causal Anl and Res Decision Anl and Resolution 1.4 L2 GP System Model Relationships EIA/IS 731 L4 GP L5 GP

23. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 23 SE-CMM Environment 3.1 Define and Improve the SE Process 3.2 Manage Competency 3.3 Manage Technology 3.4 Manage SE Support Environment SECM Organization PA13Define Organization’s SE Process PA14Improve Organization’s SE Process PA17 Provide Ongoing Knowledge and Skills PA15 Manage Product Line Evolution PA16 Manage SE Support Environment PA18Coordinate With Suppliers CMMI Org Process Focus Org Process Definition Organizational Tng Org Process Perf Org Innovation and Deployment Process Management 2.4 L4 GP SW System Model Relationships

24. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 24 Integrated Product and Process Development IPPD Model Components Additions Additions and amplifications of CMMI SE/SW process areas Additional IPPD process areas: Level 2 Collaborative Leadership Shared Vision Building Level 3 Organizational Environment for Integration Integrated Team From CMMI-SE/SW/IPPD Staged Representation, initially released December 1999 To be Released, concurrently, as part of the CMMI, either in August 2000 (CMMI 1.0 release date, as announced by DOD, Dr. Delores Etter, Deputy Under Secretary of Defense (Science & Technology), at the STC Conference May 2, 2000) or within one month after release of the CMMI

25. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 25 Agenda Introduction CMMI Models  CMMI Assessments Getting Started Summary

26. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 26 CMMI Process Assessments Plan is to support a variety of assessment types Quick-look assessments First assessments Reassessments First effort will focus on CBA IPI like assessment method called: Standard CMMI Assessment Method for Process Improvement “SCAMPI”

27. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 27 Assessment Challenges Assessment method issues to be resolved Breadth versus depth Spot checks versus complete coverage Interpretations in SW, SE, and integrated environments Assessment team Number of team members increased Domain expertise of team members Length (and cost) of assessment related to number of practices CMM V1.1: 316 practices EIA/IS 731: 383 practices CMMI V0.2 SE/SW: 431 practices CMMI SE/SW/IPPD: 501 practices

28. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 28 Agenda Introduction CMMI Models CMMI Assessments  Getting Started Summary

29. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 29 What Should You Do Now? Identify your business objectives Evaluate current processes Identify areas of the process infrastructure that overlaps and will support integration efforts Identify threads that cross discipline boundaries that are critical Identify processes that are used by both systems and software engineering Decide on Staged vs. Continuous PI Approach

30. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 30 Business Objectives Identify your business objectives Reduce costs of PI, while continuing to improve Align organizational processes Develop common processes across organization Maintain maturity level credentials

31. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 31 Evaluate Processes Evaluate current processes Map existing processes to models and standards of interest: CMM, EIA/IS 731, SE-CMM, ISO 9000, high level enterprise processes Map existing processes to CMMI V1.0 Perform a quick-look evaluation ® ® Quagmap is registered with the U.S. Patent and Trademark Office

32. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 32 Process Infrastructure Identify areas of the process infrastructure that overlap and can support integration efforts Sponsorship Steering committee Process group Process asset library Process database Begin now to consolidate the infrastructure

33. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 33 Process Threads Identify threads that cross discipline boundaries and are critical Requirements process Integration Verification Begin now to improve these processes

34. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 34 Common Processes Identify processes that are used by both systems and software engineering Quality assurance Configuration management Inspections Risk management Project management Begin now to create one common process

35. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 35 Agenda Introduction CMMI Models CMMI Assessments Getting Started  Summary

36. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 36 Consortium CMMI Plans Author team participation and review Assessment methods Training and other deployment support products Impact Assessment Summarize changes Transition course Consortium product and service updates CMMEIA/IS 731 IPD-CMM CMMI

37. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 37 SW-CMM Also see: www.software.org/quagmire The Frameworks Quagmire MIL-Q -9858 Trillium Baldrige IEEE Stds. 730,828 829, 830,1012,1016 1028,1058,1063 ISO 15504 (SPICE) People CMM IPD- CMM* DOD IPPD SECAM AF IPD Guide SDCCR SCE NATO AQAP1,4,9 BS 5750 MIL-STD- 498 DOD-STD -2167A DOD-STD -7935A MIL-STD -499B* ISO/IEC 12207 IEEE 1220 ISO 10011 SDCE SE-CMM SECM (EIA/IS 731) EIA/IS 632 ISO 9000 Series EIA/IEEE J-STD-016 IEEE/EIA 12207 EIA 632 MIL-STD-1679 IEEE 1074 TickIT SSE- CMM ISO 15288* EQA * Not released ** Aug 11, 2000 CMMI** PSP SA-CMM Q9000 DOD- STD- 2168 FAA- iCMM DO- 178B SW-CMM

38. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 38 The Future??? MIL-Q -9858 Trillium Baldrige IEEE Stds. 730,828 829, 830,1012,1016 1028,1058,1063 ISO 15504 (SPICE) DOD IPPD AF IPD Guide NATO AQAP1,4,9 BS 5750 MIL-STD- 498 DOD-STD -2167A DOD-STD -7935A MIL-STD -499B* ISO/IEC 12207 IEEE 1220 ISO 10011 EIA/IS 632 ISO 9000 Series EIA/IEEE J-STD-016 IEEE/EIA 12207 EIA 632 MIL-STD-1679 IEEE 1074 TickIT ISO 15288* EQA * Not released CMMI PSP Q9000 DOD- STD- 2168 DO- 178B Software Systems IPPD Acquisition Security People

39. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 39 Conclusions: A Recommended Approach Begin now to: Integrate your Processes Integrate your Process Improvement Initiatives and Infrastructures Begin or Continue to Improve your Systems Engineering Processes Complete “Next/Near Term” Scheduled Assessment Study CMMI and Impact on PI Program Determine Business Case for CMMI Formulate CMMI Transition Strategy Plans Determine how to Establish, Expand, Update, and/or Integrate SE/SW/IPPD Process Areas Determine Staged vs. Continuous PI Business Case Approach for SE/SW/IPPD The Consortium can provide a wide variety of Products and Services to support your CMMI Systems and Software Engineering Process Integration and Improvement efforts.

40. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 40 CMMI – Web Links Software Engineering Institute (SEI) http://www.sei.cmu.edu/cmmi Software productivity Consortium (SPC) http://www.software.org Software Technology Support Center http://www.stsc.hill.af.mil

41. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 41 Acronyms CBA IPICMM Based Appraisal for Internal Process Improvement CMMCapability Maturity Model for Software CMMIIntegrated Capability Maturity Model DoDDepartment of Defense EIA/ISElectronics Industries Alliance / Interim Standard FAAFederal Aviation Administration GPGeneric Practice IPD-CMMIntegrated Product Development Capability Maturity Model IPPDIntegrated Product and Process Development ISOInternational Organization for Standardization ISSEPIntegrated Systems and Software Engineering Process http://www.software.org for more information KPAKey Process Area MBASEModel Based (System) Architecting and Software Engineering http://sunset.usc.edu/research/MBASE/index.html for more info NDIANational Defense Industrial Association

42. Copyright © 2000, Software Productivity Consortium NFP, Inc. All rights reserved. 42 Acronyms NSANational Security Agency PAProcess Area P-CMMPeople Capability Maturity Model PDTProduct Development Team PIProcess Improvement PSPPersonal Software Process SA-CMMSoftware Acquisition Capability Maturity Model SCAMPIStandard CMMI Assessment Method for Process Improvement SESystems Engineering SECAMSystems Engineering Capability Assessment Model SE-CMMSystems Engineering Capability Maturity Model SEISoftware Engineering Institute SPCStatistical Process Control SPICESoftware Process Improvement and Capability deTermination SWSoftware SW-CMMSoftware Capability Maturity Model