1. COSYSMO Adoption Process 21 st International Forum on COCOMO and Software Cost Modeling November 9, 2006 Chris MillerRicardo Valerdi

2. 2 Agenda Motivation The Adoption Process Next Steps

3. 3 Motivation Tacit knowledge of model adoption is scarce beyond core members of the COSYSMO working group CSSE Affiliates are rolling out COSYSMO to other sites in their organization New companies are joining the effort but with: –Little or no training –Limited knowledge of parameter definition discussions –No implementation guidance or lessons learned to leverage Help prevent COSYSMO from falling into the silver bullet trap (i.e., “We tried to use COSYSMO but it didn’t work”) –Existence of systematic adoption process mitigates risk and provides a structured approach based on proven success

4. 4 SE Cost Estimation Life Cycle using COSYSMO Historical Data Collection Call for Participation Check Relevance / Informal Mapping Understand inputs and identify pilot programs Informal mapping at the WBS level Test run Industry Calibrated model Tailor COSYSMO to organization Local Calibration Large-scale rollout to other projects Train Champion Training for Users Piloting Institutionalization / adoption = V&V opportunity

5. 5 Call for Participation Marketing material Elevator speech –“COSYSMO can give your organization a competitive advantage by providing a way to estimate systems engineering cost in a repeatable and accurate fashion.” Resources: –COSYSMO Call for Participation brochure

6. 6 Check Relevance / Informal Mapping Description: –Initial feasibility assessment of adopting COSYSMO in target organization Tasks: 1.Provide overview of COSYSMO 2.Company assessment of adopting COSYSMO 3.Identify internal champion Facilitator Role: –Provide overview of COSYSMO Company Role: –High-level assessment of model relevance of COSYSMO in target organizations decision-making process, historical data availability Resources: –Tools/Materials: TBD –Training: COSYSMO Overview presentation Inputs: Expressed interest by target organization Outputs: Go / No Go decision to train champion

7. 7 Train Champion Description: –Provide champion with necessary resources and knowledge to drive the adoption of COSYSMO in the organization Tasks: –Work to give visibility of COSYSMO to key stakeholders in the organization –Customize existing COSYSMO briefings for internal use and buy-in –When possible, attend COSYSMO Working Group meetings Facilitator Role: –Share experiences from success and failures of past champions Company Role: –Provide an individual with the right amount of expertise and influence Resources: –Tools/Materials: COSYSMO User Manual, COSYSMO briefings –Training: Train the trainer format Inputs: Initial relevance check inputs Outputs: Sufficient ammunition to start selling the idea within the organization

8. 8 Understand inputs and identify pilot programs Description: –Understand inputs and identify pilot programs Tasks: Learn and internalize COSYSMO definitions and terminology Identify candidate programs (based on similarity to academicCOSYSMO) Assessment of degree of institutionalization possible (based on current decision-making) and forecast ROI of COSYSMO adoption Provide assessment results and recommendation Facilitator Role: –Provide COSYSMO information and insight Company Role: –Provide target organization information and details about candidate programs Resources: –Tools/Materials: COSYSMO book, COSYSMO User Manual –Training: COSYSMO board game, COSYSMO Exercise (e.g., Loony bird by G. Thomas) Inputs: –Go decision to train a champion and identification of a champion Outputs: –Assessment results and recommendation on how to proceed

9. 9 Informal mapping at the WBS level Description: –Modify off-the-shelf COSYSMO WBS to reflect target company systems engineering activities Tasks: 1.Review target company WBS/time collection structure 2.Map against COSYSMO WBS 3.Identify inconsistencies 4.Develop mapping to account for target company decision-making needs Facilitator Role: –Provide COSYSMO WBS knowledge and facilitate mapping, both in terms of leading effort and supplying mapping tools Company Role: –Provide target company WBS and insight pertaining to systems engineering data collection Resources: –Tools/Materials: COSYSMO Mapping spreadsheet –Training: COSYSMO Users Manual, COSYSMO Book Inputs: –Target company WBS Outputs: –Industry-calibrated model (modified to reflect target company SE activities)

10. 10 Test Run Industry Calibrated Model Description: –Test run COSYSMO Tasks: 1.Using data from completed projects, determine inputs required for COSYSMO 2.Input data 3.Run model 4.Compare COSYSMO output to actual systems engineering effort 5.Perform PRED analysis 6.Compile test run results (and tailoring recommendations) Facilitator Role: –Provide documentation, support, and usage experience Company Role: –Provide data from completed projects and corresponding expertise Resources: –Tools/Materials: academicCOSYSMO, COSYSMO User Manual –Training: Champion should lead this effort with the support of project teams from which the data is being reported Inputs: –Industry-calibrated model Outputs: –Test Run Results (PRED Levels for target company) –Tailoring Recommendations (action plan)

11. 11 Tailor COSYSMO to Organization Description: –Modify base COSYSMO to target company Tasks: 1.Clarify/revise parameter definitions (e.g., counting rules, assumptions, …) with local terminology 2.Define and clarify scope, activities, and life phases (i.e., local definition of SE) to be represented by the estimate 3.Develop estimation procedure for new model (including training, identifying life cycle-oriented decision points, … ETVX+) 4.Review of estimation procedure (by key stakeholders: users, sponsors, …) 5.Work off of review feedback 6.Develop mock up of use of estimation procedure (to be used to help obtain historical data and be integrated in training materials) Facilitator Role: –Provide guidance as to the breadth and depth of tailoring required –Lead the parameter definition clarification Company Role: –Solicit required personnel with the appropriate project expertise to support tasks –Draft estimation procedure Resources: –Tools/Materials: TBD –Training: TBD Inputs: –Tailoring Recommendations (action plan) Outputs: –Estimation procedure –Estimation mock-up example –Updated model parameter definitions (target company specific guidance)

12. 12 Historical Data Collection Description: –Collect and verify historical data from target company Tasks: 1.Follow criteria for selecting appropriate data points for COSYSMO 2.Set-up data collection repository based on existing measurement capabilities 3.Ensure Data Collection Instrument (DCI) reflects tailoring of COSYSMO previously defined 4.Identify candidate historical project list w/ management input 5.Collect size driver information and effort on completed projects 6.Identify SMEs for cost driver 7.Perform cost driver ratings for each completed project Facilitator Role: –Provide guidance Company Role: –Facilitate access to data for completed programs Resources: –Tools/Materials: Data Collection Instrument (DCI) –Training: TBD Inputs: –Tailored parameter definitions and scope –Estimation procedure Outputs: –Historical data set (sufficient to perform local calibration)

13. 13 Training for Users Description: –As a parallel activity, a training course for the general audience of COSYSMO users should be developed Tasks: –Identify audience for training course –Adapt to existing training course offerings and determine if this should be a module for an existing course or a stand alone course Facilitator Role: –Provide general training template and experiences with such courses Company Role: –Solicit support from Training/Human Resource to incorporate COSYSMO training into existing course offerings Resources: –Tools/Materials: existing COSYSMO briefings and experiences from mapping and tailoring activities Inputs: Mapping results, updated model parameter definitions Outputs: –Systems Engineering Cost Estimation Course

14. 14 Local Calibration Description: –Use your organization’s historical data to influence the calibration constant in COSYSMO for improved accuracy and relevance Tasks: –Ensure historical data has been accurately collected –Feed data into Calico (free calibration tool offered by SoftStar Systems) –Update COSYSMO model with new calibration constant Facilitator Role: –Assist with use of Calico and interpretation of results Company Role: –Ensure that historical data is representative of other projects in the organization Resources: –Tools/Materials: Calico, COSYSMO User Manual Inputs: Historical data Outputs: Calibrated model constant

15. 15 Large-scale rollout to other projects Description: –Once COSYSMO has been calibrated it can be rolled out to a larger audience of projects as a secondary bidding tool Tasks: –Announce the local calibration and training associated with COSYSMO –Provide internal organizations with the resources needed to use the model –Develop COSYSMO data repository for future data collection Facilitator Role: –Assist with the establishment of a metrics collection program Company Role: –Promote the use of COSYSMO internally –Facilitate process of gathering usage experiences from large-scale rollout for future model tailoring –Establish systems engineering data collection program to feed future calibrations Resources: –Tools/Materials: academicCOSYSMO, COSYSMO User Manual, Data Collection Instrument –Training: provided by “COSYSMO User Training” course Inputs: Calibrated COSYSMO Outputs: Usage experiences

16. 16 Next Steps Short Term Refine adoption process based on inputs from the field Publish paper with detailed descriptions and examples Mold into Chapter 2 of the COSYSMO book Offer as a service to SSCI Members Longer Term Integrate industry SE measurement activities –Combine LAI SE Leading Indicators Guide, COSYSMO input parameters, INCOSE Measurement Working Group Guidance, PSM guidance,... Provide continual guidance on SE estimation to affiliates