1 Reggie Cole Lockheed Martin Senior Fellow Garry Roedler Lockheed Martin Fellow

Slides:



Advertisements
Similar presentations
On Representing Uncertainty In Some COCOMO Model Family Parameters October 27, 2004 John Gaffney Fellow, Software & Systems.
Advertisements

1 Schedule Risk Assessment (SRA) Overview July 2013 NAVY CEVM.
Example © 2012 Lockheed Martin Corporation. All Rights Reserved. October 2012 Proxy Estimation Costing for Systems (PECS) Reggie Cole Lockheed Martin Senior.
COCOMO Suite Model Unification Tool Ray Madachy 23rd International Forum on COCOMO and Systems/Software Cost Modeling October 27, 2008.
COSYSMO 2.0 Workshop Summary (held Monday, March 17 th 2008) USC CSSE Annual Research Review March 18, 2008 Jared Fortune.
University of Southern California Center for Systems and Software Engineering ©USC-CSSE1 Ray Madachy, Ricardo Valerdi USC Center for Systems and Software.
Working Group Meeting (Outbrief) Ricardo Valerdi, Indrajeet Dixit, Garry Roedler Tuesday.
Proposed Way Forward for SERC EM Task Barry Boehm, USC-CSSE 30 January 2009.
March 2002 COSYSMO: COnstructive SYStems Engineering Cost MOdel Ricardo Valerdi USC Annual Research Review March 11, 2002.
©2006 BAE Systems. COSYSMO Application At BAE Systems Gan Wang COSYSMO Workshop 23 rd International Forum on COCOMO and Systems/Software Cost Modeling.
COSYSMO Workshop Jared Fortune, USC USC ARR 2010 Los Angeles, CA.
Grid-based GIS Modeling Nigel Trodd Modified from Berry JK, GIS Modeling, presented at Grid-based Map Analysis Techniques and Modeling Workshop,
COSYSMO Adoption Process 21 st International Forum on COCOMO and Software Cost Modeling November 9, 2006 Chris MillerRicardo Valerdi.
11/08/06Copyright 2006, RCI1 CONIPMO Workshop Out-brief 21 st International Forum on COCOMO and Software Cost Modeling Donald J. Reifer Reifer Consultants,
1 COSYSMO 3.0: Future Research Directions Jared Fortune University of Southern California 2009 COCOMO Forum Massachusetts Institute of Technology.
University of Southern California Center for Software Engineering CSE USC ©USC-CSE 10/23/01 1 COSYSMO Portion The COCOMO II Suite of Software Cost Estimation.
Extensions of COSYSMO to Represent Reuse 21 st International Forum on COCOMO and Software Cost Modeling November 9, 2006 Ricardo ValerdiJohn Gaffney Garry.
COSYSMO Reuse Extension 22 nd International Forum on COCOMO and Systems/Software Cost Modeling November 2, 2007 Ricardo ValerdiGan Wang Garry RoedlerJohn.
1 Systems Engineering Reuse Principles Jared Fortune, USC Ricardo Valerdi, MIT COSYSMO COCOMO Forum 2010 Los Angeles, CA.
1 Results of Reuse Survey Jared Fortune, USC Ricardo Valerdi, MIT Gan Wang, BAE COSYSMO COCOMO Forum 2008 Los Angeles, CA.
University of Southern California Center for Systems and Software Engineering 1 November 2010 Mauricio Peña Dr. Ricardo Valerdi COSYSMO Requirements Volatility.
COSYSMO Reuse Extension 22 nd International Forum on COCOMO and Systems/Software Cost Modeling November 2, 2007 Ricardo ValerdiGan Wang Garry RoedlerJohn.
An evaluation framework
System-of-Systems Cost Modeling: COSOSIMO July 2005 Workshop Results Jo Ann Lane University of Southern California Center for Software Engineering.
University of Southern California Center for Systems and Software Engineering 1 November 2010 Mauricio Peña Dr. Ricardo Valerdi CHARACTERIZING THE IMPACT.
1 Discussion on Reuse Framework Jared Fortune, USC Ricardo Valerdi, MIT COSYSMO COCOMO Forum 2008 Los Angeles, CA.
Estimating System of Systems Engineering (SoSE) Effort Jo Ann Lane, USC Symposium on Complex Systems Engineering January 11-12, 2007.
Expert COSYSMO Update Raymond Madachy USC-CSSE Annual Research Review March 17, 2009.
Trade Study Training Need and Goals Need Consistent methodologies and practices performing trade studies Pros/cons, advantages/disadvantages, customer/management.
1 COSYSMO 2.0: A Cost Model and Framework for Systems Engineering Reuse Jared Fortune University of Southern California Ricardo Valerdi Massachusetts Institute.
UNCLASSIFIED Schopenhauer's Proof For Software: Pessimistic Bias In the NOSTROMO Tool (U) Dan Strickland Dynetics Program Software Support
COSOSIMO* Workshop Outbrief 14 March 2006 Jo Ann Lane University of Southern California Center for Software Engineering CSE.
COSYSMO Reuse Extension COSYSMO Workshop – USC CSSE Annual Research Review March 17, 2008 Ricardo ValerdiGan Wang Garry RoedlerJohn Rieff Jared Fortune.
©2006 BAE Systems. Practical Implementation of COSYSMO Reuse Extension Gan Wang, Aaron Ankrum, Cort Millar, Alex Shernoff, Ricardo Valerdi.
Towards COSYSMO 2.0: Update on Reuse Jared Fortune, USC Ricardo Valerdi, MIT USC ARR 2009 Los Angeles, CA.
Copyright © 2001, Software Productivity Consortium NFP, Inc. SOFTWARE PRODUCTIVITY CONSORTIUM SOFTWARE PRODUCTIVITY CONSORTIUM COSYSMO Overview INCOSE.
Lecture 11 Implementation Issues – Part 2. Monte Carlo Simulation An alternative approach to valuing embedded options is simulation Underlying model “simulates”
Computer Simulation A Laboratory to Evaluate “What-if” Questions.
Using SysML to Estimate SoS Engineering and Development Effort Jo Ann Lane Tim Bohn COCOMO.
OFC 200 Microsoft Solution Accelerator for Intranets Scott Fynn Microsoft Consulting Services National Practices.
Interoperability Updates -National Interoperability Roadmap 8/20/2014 Erica Galvez, ONC Interoperability Portfolio Manager.
Towards Appropriate Selection of Analysis Tools and Methods.
Gan Wang BAE Systems Ricardo Valerdi University of Arizona Garry J. Roedler Lockheed Martin Mauricio Pena Boeing Systems Engineering Reuse Delphi – Workshop.
University of Southern California Center for Systems and Software Engineering COSATMO/COSYSMO Workshop Jim Alstad, USC-CSSE Gan Wang, BAE Systems Garry.
GOES Users’ Conference IV May 1-3, 2006 Broomfield, CO Prepared by Integrated Work Strategies, LLC 1 GOES USERS’ CONFERENCE IV: Discussion Highlights Algorithm.
9/17/2002 COSYSMO Usage Experience Panel: What is Happening at Lockheed Martin Garry Roedler, Lockheed Martin Engineering Process Improvement Center
1 Reggie Cole Lockheed Martin Senior Fellow Garry Roedler Lockheed Martin Fellow
Crystal Ball: Risk Analysis  Risk analysis uses analytical decision models or Monte Carlo simulation models based on the probability distributions to.
Outline of Chapter 9: Using Simulation to Solve Decision Problems Real world decisions are often too complex to be analyzed effectively using influence.
Gan Wang 22 October th International Forum on COCOMO® and Systems/Software Cost Modeling in conjunction with the Practical Software and Systems.
1 Preferred citation style for this presentation Balmer, M. (2006) Next Steps: Detail Discussion of Forthcoming Tasks, MATSIM-T Developer Workshop, Castasegna,
Monté Carlo Simulation  Understand the concept of Monté Carlo Simulation  Learn how to use Monté Carlo Simulation to make good decisions  Learn how.
University of Southern California Center for Systems and Software Engineering COCOMO Suite Toolset Ray Madachy, NPS Winsor Brown, USC.
Harmonizing Systems and Software Estimation 23 rd International Forum on COCOMO and Systems/Software Cost Modeling and ICM Workshop USC Campus, Los Angeles,
GOES-R Recommendations from past GOES Users’ Conference: Jim Gurka Tim Schmit Tom Renkevens NOAA/ NESDIS Tony Mostek NOAA/ NWS Dick Reynolds Short and.
Geospatial LoB: Lifecycle WG Update November 3, 2009.
Exploiting Group Recommendation Functions for Flexible Preferences.
Calibrating a Complex Environmental Model to Historic Data San Francisco, October 25-26, Goldsim User Conference Presented By: Alan Keizur, P.E.
MAT 4830 Mathematical Modeling 04 Monte Carlo Integrations
Evaluation of statistical methods for meta-analysis Julian Higgins School of Social and Community Medicine University of Bristol, UK 1 Cochrane Methods.
Overview of Addressing Risk with COSYSMO Garry Roedler & John Gaffney Lockheed Martin March 17, 2008.
Evaluate SE Methods, Processes and Tools Technical Task Plan USC Workshop Los Angeles, CA 16 March 2009.
Probabilistic Slope Stability Analysis with the
University of Southern California Center for Systems and Software Engineering 26 th Annual COCOMO Forum 1 November 2 nd, 2011 Mauricio E. Peña Dr. Ricardo.
Developing an Evaluation Strategy George Selvanera Senior Consultant Cordis Bright Ltd
Integrating MBSE into a Multi-Disciplinary Engineering Environment A Software Engineering Perspective Mark Hoffman 20 June 2011 Copyright © 2011 by Lockheed.
COCOMO II Security Extension Workshop Report
Towards COSYSMO 2.0: Update on Reuse
Core Capability Drive-Through Workshop
Generalized Reuse Model for COSYSMO Workshop Outbrief
Presentation transcript:

1 Reggie Cole Lockheed Martin Senior Fellow Garry Roedler Lockheed Martin Fellow October 24, 2013 Outbrief for: COSYSMO Extension as a Proxy for Systems Cost Estimation

2 Overview of Cost Analysis Approach & Results Requirements Baseline Architecture Baseline Optimistic Expected Pessimistic Requirements Interfaces Algorithms Scenarios Bias Function Risky Range Target Cost Target Reserve Effort Conversion Factor Stochastic Adder Factors Run Monte Carlo Simulations and Generate Cumulative Distribution of Costs

3 Workshop Objectives Validation of the Approach – Review the basic approach and get a consensus on its overall validity Improvement of the Approach – Recommendations on how the approach might be improved Decide on Next Steps for the Community – How do we move forward with the approach?

4 Conclusions and Recommendations (1 of 3) Validity of overall approach – Unanimous support – approach is valid and should continue to be developed and refined for wider application – Feedback was all focused on ensuring all factors had been considered and areas for refinement – no discussion resulted in conclusion that the approach had major issues – Appropriately uses the concepts of COSYSMO and tailors the perspective for systems

5 Conclusions and Recommendations (2 of 3) Improvement of Approach – Best distribution to use? Cumulative, frequency, or other? – Preference is to not change the Scale Factor Want to retain as close to COSYSMO as possible – ready to leverage COSYSMO 3 – Review and refine the bias function and calibration of the bias function May consider adding in other COCOMO factors, as applicable May need to establish rules for when to leverage a HW model using the same approach to use as input for HW, when highly HW intensive May need to consider calibration for different types/classes of systems Bottom line – User needs to consider what tailoring/adaptation of the bias function is needed for the system application – Determine under what conditions it OK to eliminate a cost factor – Additional use cases? Should include Impact Analysis / Change Evaluation

6 Conclusions and Recommendations (3 of 3) Thoughts on moving forward – Form small, diverse working group – Periodic meetings (USC ARR, COCOMO Forum, INCOSE IW, …) – Validation through pilots Use on completed programs – Access the more robust data points from COSYSMO data – Comparison of estimates Use on non-LM programs – Incorporate feedback from validation and refine – Can this support the SERC project for COSATMO?

7