CMMI Model overview Practical experience

Copyright © 2014 Accenture All rights reserved. 2 Education 2004 graduated LU, Faculty of Physics and Mathematics, Computer Science Work experience 2003 – 2005: IT Alise Testing Software analysis and design Since 2005: Accenture Latvia Quality Management Metrics reporting Experience with CMMI Since > CMMI v1.1, CMMI v1.2, CMMI v1.3 for DEV Sigita Livina

Copyright © 2014 Accenture All rights reserved Introduction 2. CMMI for DEV 3. Practical experience Agenda

Copyright © 2014 Accenture All rights reserved. 4 PRODUCT defines WHAT 1. Business needs analysis 2. Requirements 3. Prototyping 4. Testing, testing, testing to assure WHAT will be delivered “Quality” in software life cycle PROCESS defines HOW 1. Life cycle 2. Methodology 3. Tools 4. “Know how’s” and lessons learned to assure THAT will be delivered

Copyright © 2014 Accenture All rights reserved. 5 CMMI Background Relationship to Other Models There are a lot of standards out there Each industry standard has its own focus/domain: Each standard has a different appraisal body CMMI-DEV CMMI-ACQ CMMI-SVC eSCM-SP eSCM-CL P-CMM TMM PSP/TSP ISO 9001 ISO ISO ISO ISO 20000/BS15000 ISO 27001/BS7799 Six Sigma Lean ITIL CobiT SAS70 COPC JD Power Malcolm Baldrige PMBOK PRINCE2 OSHA IEEE (various) Mil (various) focus is on the quality management system Applies best to organization end to end quality view focus is on improving process performance, both speed and quality Applies best to defined process improvement initiatives focus is on aligning IT services with the needs of business Applies best to Infrastructure Outsourcing and Infrastructure Consulting eSCM-SP focus is on outsourcing best practices Applies best to Application Outsourcing, Business Process Outsourcing, Infrastructure Outsourcing

Copyright © 2014 Accenture All rights reserved. 6 None? – Reinventing the wheel – Structure and discipline – Control and knowledge – Limitations in public (or private) sector All? – Costs a lot of money – Too heavy to maintain Some? – Decisions required – Business needs Which standard does your organization need? It is a Management Decision

Copyright © 2014 Accenture All rights reserved. 7 How CMMI helps organizations? CMMI provides guidance for improving an organization’s processes and ability to manage the development, acquisition and maintenance of products or services. CMMI places proven approaches into a structure that helps an organization: 1. appraise its organizational maturity or process area capability 2. establish priorities for improvement 3. implement these improvements

Copyright © 2014 Accenture All rights reserved. 8 Capability Maturity Model Integration Collections of best practices that help organizations to improve their processes These models were developed by product teams with members from industry, government, and the Carnegie Mellon Software Engineering Institute (*), taken over from SEI in 2012 by the CMMI Institute 3 Models represented in different standards: CMMI for Development (CMMI-DEV) - Product and service development CMMI for Services (CMMI-SVC) - Service establishment, management CMMI for Acquisition (CMMI-ACQ) - Product and service acquisition CMMI Overview * Standard development 2002 CMMI V CMMI V CMMI V1.3 20xx CMMI V1.4 CMMI project - improve the usability of maturity models by integrating many different models into one framework

Copyright © 2014 Accenture All rights reserved. 9 CMMI Background Model Structure – Maturity Levels Quality/ Productivity Risk/ Rework Continuous Process Improvement 5 Optimizing Quantitatively Managed Defined Managed Initial Quantitative Management 4 Process Standardization 3 Basic Project Management 2 Process unpredictable 1

Copyright © 2014 Accenture All rights reserved. 10 Organizational Training Integrated Project Management Risk Management Decision Analysis and Resolution CMMI for DEV Background Model Structure 5Optimizing Organizational Performance Management Causal Analysis and Resolution 4Quantitatively Managed Organizational Process Performance Quantitative Project Management 3Defined Requirements Development Technical Solution Product Integration Verification Validation Organizational Process Focus Organizational Process Definition 2Managed Requirements Management Project Planning Project Monitoring and Control Supplier Agreement Management Measurement and Analysis Process and Product Quality Assurance Configuration Management 1Initial No Process Areas LevelsCMMI-DEV v1.3 Process Areas Quality/ Productivity Risk/ Rework

Copyright © 2014 Accenture All rights reserved. 11 CMMI Background Model Structure – Maturity Levels Maturity Levels Process Area 1Process Area 2 Process Area 3 Generic Goals Generic Practices Specific Goals Specific Practices 1.Organization Maturity Level (ML) expectation 2.Each ML has predefined set of Process Areas (PA) 3.Each PA has predefined Specific Goals (SG) – objectives of PA 4.Each SG has predefined Specific Practices (SP) – tools or tasks that help to achieve specific goal 5.ML 2 &3 has predefined list of Generic Goals (GG) applied to each PA. 6.Each GG has predefined Generic Practices (GP) – tools or tasks that help to achieve generic goal Artifacts Affirmations Practice Implementation Indicators

Copyright © 2014 Accenture All rights reserved. 12 CMMI Background Staged VS Continuous representation ML 1 ML2 ML3 ML4 ML5 Continuous Select single process area or set of process areas critical to business to improvement path. PA Process Area Capability PA Staged Select predefined set of processes for the improvement path as suggested by model.

Copyright © 2014 Accenture All rights reserved. 13 CMMI Background Model Structure – Capability Levels Quality/ Productivity Risk/ Rework Optimizing Quantitatively Managed Defined Managed Initial Defined 3 Managed 2 Performed 1 Incomplete 0

Copyright © 2014 Accenture All rights reserved. 14 SCAMPI Method – 3 appraisal levels 1. SCAMPI C – informal, documentation library review – length not defined 2. SCAMPI B – informal, documentation review – interviews – length - 5 w/days 3. SCAMPI A – results in final assessment – formal, documentation review – interviews – length ~ 10 w/days Assessment Roles: 1. Lead Assessor – person certified by SEI (CMMI Institute) 2. Assessment team – at least 4 people (external and internal to organization) Assessment approach

Copyright © 2014 Accenture All rights reserved Introduction 2. CMMI for DEV 3. Practical experience Agenda

Copyright © 2014 Accenture All rights reserved. 16 CMMI for DEV 1.3 Process Areas Process Management PA OPDOrganizational Process Definition OPFOrganizational Process Focus OPMOrganizational Process Management OPPOrganizational Process Performance OTOrganizational Training Project Management PA PPProject Planning PMCProject Monitoring and Control REQMRequirements Management RSKMRisk Management IPMIntegrated Project Management SAMSupplier Agreement Management QPMQuantitative Project Management Engineering PA TSTechnical Solution PIProduct Integration RDRequirements Development VALValidation VERVerification Supporting PA CMConfiguration Management DARDecision Analysis and Resolution MAMeasurement and analysis PPQAProcess and Product Quality Assurance CARCausal Analysis and Resolution

Copyright © 2014 Accenture All rights reserved. 17 CMMI for DEV 1.3 Capability Levels (relationship with Generic Goals) Defined 3 Managed 2 Performed 1 Incomplete 0 All SP of the process is performed Process is planned and executed in accordance to policies GG2 Institutionalize a Managed Process GP2.1Establish organizational policy GP2.2Plan the process GP2.3Provide Resources GP2.4Assign Responsibility GP2.5Train People GP2.6Control Work Products GP2.7Identify and involve relevant stakeholders GP2.8Monitor and Control the Process GP2.9Objectively Evaluate Adherence GP2.10Review status with higher level management Managed process that is tailored from organizational set of standards GG3 Institutionalize a Defined Process GP3.1Establish a defined process GP3.2Collect process related experiences

Copyright © 2014 Accenture All rights reserved. 18 CMMI for DEV 1.3 Maturity Level 1 - Initial Process Management PA Project Management PA Engineering PA Supporting PA Process is ad hoc and chaotic Organization does not provide stable environment to support process Success depends on competence and luck of individuals, not proven process ! Does not mean that organizations can not deliver

Copyright © 2014 Accenture All rights reserved. 19 Projects have ensured process are planned and executed according to policy People are assigned, trained and have right competences Work products are planned, controlled and does satisfy specified process descriptions Status is controlled and communicated with relevant stakeholders CMMI for DEV 1.3 Maturity Level 2 - Managed Process Management PA Project Management PA PPProject Planning PMCProject Monitoring and Control REQMRequirements Management SAMSupplier Agreement Management Engineering PA Supporting PA CMConfiguration Management MAMeasurement and analysis PPQAProcess and Product Quality Assurance GG2 Institutionalize a Managed Process

Copyright © 2014 Accenture All rights reserved. 20 CMMI for DEV 1.3 ML2 – Project Planning SGSP Description SG1 Establish estimates SP1.1 Estimate the scope of the project SP1.2 Establish estimates of work product and task attributes SP1.3 Define project life cycle phases SP1.4 Estimate effort and cost SG2 Develop a Project Plan SP2.1 Establish the budget and schedule SP2.2 Identify project risks SP2.3 Plan data management SP2.4 Plan the project resources SP2.5 Plan needed knowledge and skills SP2.6 Plan stakeholder involvement SP2.7 Establish the project SG3 Obtain commitment to the plan SP3.1 Review plans that affect the project SP3.2 Reconcile work and resource levels SP3.3 Obtain plan commitment

Copyright © 2014 Accenture All rights reserved. 21 CMMI for DEV 1.3 ML2 – Project Monitoring and Control SGSP Description SG1 Monitor the project against the plan SP1.1 Monitor project planning parameters SP1.2 Monitor commitments SP1.3 Monitor project risks SP1.4 Monitor data management SP1.5 Monitor stakeholders involvement SP1.6 Conduct progress reviews SP1.7 Conduct milestones reviews SG2 Manage corrective actions to closure SP2.1 Analyze issues SP2.2 Take corrective action SP2.3 Manage corrective action

Copyright © 2014 Accenture All rights reserved. 22 CMMI for DEV 1.3 ML2 – Requirements Management SGSP Description SG1 Manage requirements SP1.1 Understand requirements SP1.2 Obtain commitment to requirements SP1.3 Manage requirement changes SP1.4 Maintain bidirectional traceability SP1.5 Ensure alignment between project work and requirements

Copyright © 2014 Accenture All rights reserved. 23 CMMI for DEV 1.3 ML2 – Supplier agreement management SGSP Description SG1 Establish supplier agreements SP1.1 Determine acquisition type SP1.2 Select suppliers SP1.3 Establish supplier agreements SG2 Satisfy supplier agreements SP2.1 Execute supplier agreement SP2.2 Accept the acquired product SP2.3 Ensure transition of products

Copyright © 2014 Accenture All rights reserved. 24 CMMI for DEV 1.3 ML2 – Configuration Management SGSP Description SG1 Establish baselines SP1.1 Identify configuration items SP1.2 Establish a configuration management system SP1.3 Create or release baselines SG2 Track and control changes SP2.1 Track change requests SP2.2 Control configuration items SG3 Establish integrity SP3.1 Establish configuration management records SP3.2 Perform configuration audits

Copyright © 2014 Accenture All rights reserved. 25 CMMI for DEV 1.3 ML2 – Measurement and Analysis SGSP Description SG1 Align measurement and analysis activities SP1.1 Establish measurement objectives SP1.2 Specify measures SP1.3 Specify data collection and storage procedures SP1.4 Specify analysis procedures SG2 Provide measurement results SP2.1 Obtain measurement data SP2.2 Analyze measurement data SP2.3 Store data and results SP2.4 Communicate results

Copyright © 2014 Accenture All rights reserved. 26 CMMI for DEV 1.3 ML2 – Process and product quality assurance SGSP Description SG1 Objectively evaluate process and work products SP1.1 Objectively evaluate processes SP1.2 Objectively evaluate work products SG2 Provide objective insight SP2.1 Communicate and resolve noncompliance issues SP2.2 Establish records

Copyright © 2014 Accenture All rights reserved. 27 CMMI for DEV 1.3 ML2 – Generic Goal and practices GG2 Institutionalize a Managed Process GP2.1Establish organizational policy GP2.2Plan the process GP2.3Provide Resources GP2.4Assign Responsibility GP2.5Train People GP2.6Control Work Products GP2.7Identify and involve relevant stakeholders GP2.8Monitor and Control the Process GP2.9Objectively Evaluate Adherence GP2.10Review status with higher level management

Copyright © 2014 Accenture All rights reserved. 28 Process is described in organizational standards, tools, procedures and methods Organizational process is improved over time based on previous experience and lessons learned, samples from completed projects. Projects tailor organizational set of standards based on tailoring guidelines. A defined process clearly states purpose, inputs, entry criteria, activities, roles, measures, verification steps, outputs and exit criteria CMMI for DEV 1.3 Maturity Level 3 - Defined Process Management PA OPDOrganizational Process Definition OPFOrganizational Process Focus OTOrganizational Training Project Management PA RSKMRisk Management IPMIntegrated Project Management Engineering PA TSTechnical Solution PIProduct Integration RDRequirements Development VALValidation VERVerification Supporting PA DARDecision Analysis and Resolution GG3 Institutionalize a Organizational Process

Copyright © 2014 Accenture All rights reserved. 29 CMMI for DEV 1.3 ML3 – Organizational Process Definition SGSP Description SG1 Establish organizational process assets SP1.1 Establish standard processes SP1.2 Establish lifecycle model descriptions SP1.3 Establish tailoring criteria and guidelines SP1.4 Establish the organizations measurement repository SP1.5 Establish the organizations process assets library SP1.6 Establish work environment standards SP1.7 Establish rules and guidelines for teams

Copyright © 2014 Accenture All rights reserved. 30 CMMI for DEV 1.3 ML3 – Organizational Process Focus SGSP Description SG1 Determine process improvement opportunities SP1.1 Establish organizational process needs SP1.2 Appraise the organizations process SP1.3 Identify the organizations process improvements SG2 Plan and implement process actions SP2.1 Establish process action plan SP2.2 Implement process action plan SG3 Deploy organizational process assets and incorporate experiences SP3.1 Deploy organizational process assets SP3.2 Deploy standard processes SP3.3 Monitor the implementation SP3.4 Incorporate experiences into organizational process assets

Copyright © 2014 Accenture All rights reserved. 31 CMMI for DEV 1.3 ML3 – Organizational Process Training SGSP Description SG1 Establish and organizational training capability SP1.1 Establish strategic training needs SP1.2 Determine which training needs are the responsibility of the organization SP1.3 Establish an organizational training tactical plan SP1.4 Establish training capability SG2 Provide training SP2.1 Deliver training SP2.2 Establish training records SP2.3 Asses training effectiveness

Copyright © 2014 Accenture All rights reserved. 32 CMMI for DEV 1.3 ML3 – Risk management SGSP Description SG1 Prepare for risk management SP1.1 Determine risk sources and categories SP1.2 Define risk parameters SP1.3 Establish a risk management strategy SG2 Identify and analyze risks SP2.1 Identify risks SP2.2 Evaluate, categorize and prioritize risks SG3 Mitigate risks SP3.1 Develop risk mitigation plans SP3.2 Implement risk mitigation plans

Copyright © 2014 Accenture All rights reserved. 33 CMMI for DEV 1.3 ML3 – Integrated project management SGSP Description SG1 Use the projects defined process SP1.1 Establish the projects defined process SP1.2 Use organizational process assets for planning project activities SP1.3 Establish the projects work environment SP1.4 Integrate plans SP1.5 Manage the project using integrated plans SP1.6 Establish Teams SP1.7 Contribute to organizational process assets SG2 Coordinate and collaborate with relevant stakeholders SP2.1 Manage stakeholder involvement SP2.2 Manage dependencies SP2.3 Resolve coordination issues

Copyright © 2014 Accenture All rights reserved. 34 CMMI for DEV 1.3 ML3 – Requirements Development SGSP Description SG1 Develop customer requirements SP1.1 Elicit needs SP1.2 Transfer stakeholder needs into customer requirement SG2 Develop product requirements SP2.1 Establish product and product component requirements SP2.2 Allocate product component requirements SP2.3 Identify interface requirements SG3 Analyze and validate requirements SP3.1 Establish operational concepts and scenarios SP3.2 Establish a definition of required functionality and quality attributes SP3.3 Analyze requirements SP3.4 Analyze requirements to achieve balance SP3.5 Validate requirements

Copyright © 2014 Accenture All rights reserved. 35 CMMI for DEV 1.3 ML3 – Technical Solution SGSP Description SG1 Select product component solutions SP1.1 Develop alternative solutions and selection criteria SP1.2 Select product component solutions SG2 Develop the design SP2.1 Design the product or product component SP2.2 Establish a technical data package SP2.3 Design interfaces using criteria SP2.4 Perform make, buy or reuse analysis SG3 Implement the product design SP3.1 Implement the design SP3.2 Develop product support documentation

Copyright © 2014 Accenture All rights reserved. 36 CMMI for DEV 1.3 ML3 – Product Integration SGSP Description SG1 Prepare for product integration SP1.1 Establish and integration strategy SP1.2 Establish the product integration environment SP1.3 Establish product integration procedures and criteria SG2 Ensure interface compatibility SP2.1 Review interface descriptions for completeness SP2.2 Manage interface SG3 Assemble product components and deliver the product SP3.1 Confirm readiness of product components for integration SP3.2 Assemble product components SP3.3 Evaluate assembled product components SP3.4 Package and deliver the product or product component

Copyright © 2014 Accenture All rights reserved. 37 CMMI for DEV 1.3 ML3 – Verification SGSP Description SG1 Prepare for verification SP1.1 Select work products for verification SP1.2 Establish the verification environment SP1.3 Establish the verification procedures and criteria SG2 Perform Peer Reviews SP2.1 Prepare for Peer Reviews SP2.2 Conduct Peer Reviews SP2.3 Analyze Peer Reviews data SG3 Verify selected work products SP3.1 Perform verification SP3.2 Analyze verification results

Copyright © 2014 Accenture All rights reserved. 38 CMMI for DEV 1.3 ML3 – Validation SGSP Description SG1 Prepare for validation SP1.1 Select products for validation SP1.2 Establish the validation environment SP1.3 Establish validation procedures and criteria SG2 Validate product or product components SP2.1 Perform validation SP2.2 Analyze validation results

Copyright © 2014 Accenture All rights reserved. 39 CMMI for DEV 1.3 ML3 – Decision Analysis and resolution SGSP Description SG1 Evaluate alternatives SP1.1 Establish guidelines for decision analysis SP1.2 Establish evaluation criteria SP1.3 Identify alternative solutions SP1.4 Select Evaluation methods SP1.5 Evaluate alternative solutions SP1.6 Select solutions

Copyright © 2014 Accenture All rights reserved. 40 Organization and projects establish quantitative objectives for quality and process performance Specific measures of process performance are collected and statistically analyzed Process performance baselines and models are used to set performance objectives Process performance is more predictable than in previous Maturity Levels CMMI for DEV 1.3 Maturity Level 4 – Quantitatively Managed Process Management PA OPPOrganizational Process Performance Project Management PA QPMQuantitative Project Management Engineering PA Supporting PA

Copyright © 2014 Accenture All rights reserved. 41 CMMI for DEV 1.3 ML4 – Organizational Process Performance SGSP Description SG1 Establish performance baselines and models SP1.1 Establish quality and process performance objectives SP1.2 Select Processes SP1.3 Establish process performance measures SP1.4 Analyze process performance and establish process performance baselines SP1.5 Establish process performance models

Copyright © 2014 Accenture All rights reserved. 42 CMMI for DEV 1.3 ML4 – Quantitative Project Management SGSP Description SG1 Prepare for quantitative management SP1.1 Establish the projects objectives SP1.2 Compose the defined process SP1.3 Select sub-process and attributes SP1.4 Select measures and analytic techniques SG2 Quantitatively manage the project SP2.1 Monitor the performance of selected sub-processes SP2.2 Manage project performance SP2.3 Perform root cause analysis

Copyright © 2014 Accenture All rights reserved. 43 Organization continuously improve processes based on quantitative objectives Organizational quality process and performance objectives are continuously revised and adjusted to meet business needs Focus on organizational rather project performance CMMI for DEV 1.3 Maturity Level 5 - Optimizing Process Management PA OPMOrganizational Performance Management Project Management PA Engineering PA Supporting PA CARCausal Analysis and Resolution

Copyright © 2014 Accenture All rights reserved. 44 CMMI for DEV 1.3 ML5 – Organizational Performance Management SGSP Description SG1 Manage business performance SP1.1 Maintain business objectives SP1.2 Analyze process performance data SP1.3 Identify potential areas for improvements SG2 Select improvements SP2.1 Elicit suggested improvements SP2.2 Analyze suggested improvements SP2.3 Validate improvements SP2.4 Select and implement improvements for deployment SG3 Deploy improvements SP3.1 Plan for deployment SP3.2 Manage the deployment SP3.3 Evaluate improvement effects

Copyright © 2014 Accenture All rights reserved. 45 CMMI for DEV 1.3 ML5 – Causal analysis and resolution SGSP Description SG1 Determine causes of selected outcomes SP1.1 Select outcomes for analysis SP1.2 Analyze causes SG2 Address causes of selected outcomes SP2.1 Implement action proposals SP2.2 Evaluate the effect of implemented actions SP2.3 Record causal analysis data

Copyright © 2014 Accenture All rights reserved Introduction 2. CMMI for DEV 3. Practical experience Agenda

Copyright © 2014 Accenture All rights reserved. 47 CMMI Implementation Level Quality/ Productivity Risk/ Rework Continuous Process Improvement 5 Optimizing Quantitatively Managed Defined Managed Initial Quantitative Management 4 Process Standardization 3 Basic Project Management 2 Process unpredictable 1

Copyright © 2014 Accenture All rights reserved. 48 Decision on applicable scope (projects): Project type Project life cycle Team size Business value Technology Etc. CMMI Implementation Scope in organization

Copyright © 2014 Accenture All rights reserved. 49 CMMI Implementation ML3 Implementation Establish organizational standard Pilot organizational standard & gather lessons learned Improve organizational standard and deploy Institutionali zation SCAMPI BSCAMPI A 3 to 6 month Full cycle (1 year) 1 week 2 week > 3 months Grand total – 1.5 to 2 years

Copyright © 2014 Accenture All rights reserved Focus Points Artifact gathering for all Specific Goals Process institutionalization All projects follow the same standard Methodology/process trainings 2. Issues Decision on representation and maturity levels Consistence of artifacts across projects (tailoring to client needs) People commitment to continuous process improvements (sharing samples, ideas) CMMI Implementation Major focus points and issues

Copyright © 2014 Accenture All rights reserved CMMI Institute related costs Trainings SCMAPI B SCAMPI A 2. People costs – quality team At least 2 full time employees 3. People costs – project teams Time for trainings Time for deliverables creation Time for continuous improvement (lessons learned, knowledge exchange, Subject Matter Experts review of submitted samples) CMMI Implementation Costs of implementation

Copyright © 2014 Accenture All rights reserved Organizational processes Less “reinventing the wheel” Organizational lessons learned Consistency in delivery Not very popular across all individuals 2. People Organizational knowledge library Boundaries, guidelines and limitations 3. Maturity Level 5 Focusing on decrease cost and increasing value Scope of selected processes CMMI Implementation Benefits of implementation

Copyright © 2014 Accenture All rights reserved. 53

Copyright © 2014 Accenture All rights reserved. 54 Thank you for attention. Questions?