Jairus Hihn Jet Propulsion Laboratory, California Institute of Technology Tim Menzies North Carolina State University Data Mining Methods and Cost Estimation.

Slides:



Advertisements
Similar presentations
Paper Presentation CST 294 – Topic: Interactive Graphics & Visual Analytics Experiences using Visualization Techniques to Present Requirements, Risks to.
Advertisements

Copyright 2000, Stephan Kelley1 Estimating User Interface Effort Using A Formal Method By Stephan Kelley 16 November 2000.
Poetic Analysis 3: Turning your P.E.E paragraphs into a complete essay! I think that... I am going to write about… I believe that… NEVER!
Keys to Successful Essay Writing. A thesis statement is a one- sentence summarization of the argument or analysis that is to follow. Think of the thesis.
1 The Cost of Organizational Structures and Interfaces prepared for Ground System Architectures Workshop by Darryl W. Webb Business and Operations Analysis.
Aug. 20, JPL, SoCalBSI '091 The power of bioinformatics tools in cancer research Early Detection Research Network, JPL Mentors: Dr. Chris Mattmann,
Part 1: Introducing User Interface Design Chapter 1: Introduction –Why the User Interface Matters –Computers are Ubiquitous –The Importance of Good User.
Jairus Hihn Jet Propulsion Laboratory, California Institute of Technology Domain-Oriented Modeling, Estimation and Improvement for Aerospace November 2,
A GIS Lesson. Only a hundred years ago, scientists thought that they understood the history of the Earth and how it got to be the way it is. But they.
UI Standards & Tools Khushroo Shaikh.
Project Management.
Software Engineering Incorporating Interface Design Into Software Engineering.
Identifying needs and establishing requirements Chapter 7b.
MEsA Future Trends Panel Discussion Jairus Hihn 22nd International Forum on COCOMO and Systems/Software Cost Modeling (2007)
“2cee” A 21 st Century Effort Estimation Methodology Tim Menzies Dan Baker Jairus Hihn Karen Lum
Research in Empirical Software Eng. Reduced-Parameter Modeling (RPM) for Cost Estimation Models Zhihao Chen
Software Process CS 414 – Software Engineering I Donald J. Bagert Rose-Hulman Institute of Technology December 17, 2002.
Everyone has a writing process. What is yours?
1. Learning Outcomes At the end of this lecture, you should be able to: –Define the term “Usability Engineering” –Describe the various steps involved.
Rapid Prototyping Model
What is Business Analysis Planning & Monitoring?
1.
Introduction to Interactive Media 02. The Interactive Media Development Process.
Flight-like Flight Software Testing Methods Celina A Garcia Jet Propulsion Laboratory California Institute of Technology ©2009 California Institute of.
RUP Fundamentals - Instructor Notes
Fermi Large Area Telescope (LAT) Integration and Test (I&T) Data Experience and Lessons Learned LSST Camera Workshop Brookhaven, March 2012 Tony Johnson.
IMac and Design Principles By Max Patera. “Think Different” Jobs asks Lee Clow (1984) to come back Clow’s team comes up with new slogan Jobs cries thinking.
Understanding the Mars Mission and soil studies by using the web A Web project.
© 2012 PRICE Systems, LLC. All Rights Reserved. Optimize tomorrow today. ® Understanding and Measuring the Impact of Design and Systems Engineering Decisions.
California Produce Reports Kristin Havens Placer Hills Elementary, Meadow Vista, CA FinalPresentation CTAP 295 Teaching with Technology.
1 Customer Dimension Table Maintenance Program for Insurance Released 28/11/ Today I am pleased to announce that the availability of a suite of.
INTRODUCTION TO EMBEDDED SYSTEMS INTERFACING TO THE FREESCALE 9S12 Power Point Presentation Local Variables and Parameter Passing 8-1.
Get Best practices Lessons learned Case studies Tactics – the manual for how to be a product manager Product rollout, communications, marketing Building.
SE-3910 Real-time Systems Week 9, Classes 1 and 2 – Announcement* (regexp style) – Significance Testing – Failure statistics – Data flow diagrams SE-3910.
THE VALUE OF BREADTH Christopher Oster Lockheed Martin SERC Fellow Copyright Christopher Oster © 2012 All Rights Reserved.
Agents on the Semantic Web – a roadmap to the future An arial view from feet.
Software Requirements Engineering CSE 305 Lecture-2.
Software Life Cycle Requirements and problem analysis. –What exactly is this system supposed to do? Design –How will the system solve the problem? Coding.
NMP EO-1 TECHNOLOGY WORKSHOP Section 2 Meeting Objectives.
Chapter 7 Applying UML and Patterns Craig Larman
9th October 2001Confidential to Ian Mitchell1 Customer On Site Ian Mitchell, FNZCS.
JPL/Caltech proprietary. Not for public release or redistribution. This document has been reviewed for export control and it does NOT contain controlled.
TESTING LEVELS Unit Testing Integration Testing System Testing Acceptance Testing.
Prototyping 101 (from idea to solution). Thomas A. Edison “I have not failed, I've just found 10,000 ways that won’t work”
March 4, 1999Lethbridge1 Empirical Studies of Software Engineers: Some Experience and Pragmatic Considerations Dr. Timothy C. Lethbridge University of.
22-January-2003cse FunctionalSpecs © 2003 University of Washington1 Functional Specs CSE 403, Winter 2003 Software Engineering
Project Estimation techniques Estimation of various project parameters is a basic project planning activity. The important project parameters that are.
NASA/Air Force Cost Model presented by Keith Smith Science Applications International Corporation 2002 SCEA National Conference June
Page 1 JUSTIFY define and validate REQUIRE- MENTS define initial management DOCUMENTS define INFRA- STRUCTURE allocated maintenance changes management.
1  TandemSeven Inc tandemseven.com | Interaction Design in Industry Lawrence J. Najjar, Ph.D. 5th Annual Regional.
ST5 PDR June 19-20, 2001 NMP 2-1 EW M ILLENNIUM P ROGRA NNMM Program Overview Dr. Christopher Stevens Jet Propulsion Laboratory, California Institute of.
T Iteration demo T Iteration Demo Neula PP Iteration
Tatiana Kichkaylo with Dave Barnhart and Lucy Hoag USC Information Sciences Institute.
Product Management in Outsourcing: How it works? Roman Pavlyuk, SoftServe Lviv 2015.
SE-3910 Real-time Systems Week 9, Classes 1 and 2 – Announcement* (regexp style) – Significance Testing – Failure statistics – Structured Analysis & Design.
Using Symbolic PathFinder at NASA Corina Pãsãreanu Carnegie Mellon/NASA Ames.
COMP2110 Software Design in 2003 ● a(nother) framework for Software Engineering ● the Software Engineering ideas and concepts in comp2110 ● Organisation.
PBCAT Upgrade - Progress and Plans State HSIS Liasons’ Meeting October , 2002 Chapel Hill, North Carolina.
Jet Propulsion Laboratory The research described in this paper was carried out at the Jet Propulsion Laboratory, California Institute of Technology, under.
Data Systems Integration Committee of the Earth Science Data System Working Group (ESDSWG) on Data Quality Robert R. Downs 1 Yaxing Wei 2, and David F.
Information Quality Cluster - Introduction H. K. (Rama) Ramapriyan Science Systems and Applications, Inc. & NASA Goddard Space Flight Center David Moroni.
It’s Not UX Without User Research Dorian Freeman 4/22/15.
Data Flow Diagrams Slide 1. Key Definitions Data flow diagramming shows business processes and the data that flows between them Slide 2.
Lessons learned - viewpoints on increasing analytical capabilities Elizabeth Riczko, FCAS, MAAA, CPCU 1.
Project Cost Management
Chapter Outline Innovation, Technological Change, and Competition
Applied Software Implementation & Testing
Usability Testing CS 4501 / 6501 Software Testing
A quick guide to understanding and conducting a usability study.
20th International Forum on COCOMO and Software Cost Modeling
Presentation transcript:

Jairus Hihn Jet Propulsion Laboratory, California Institute of Technology Tim Menzies North Carolina State University Data Mining Methods and Cost Estimation Models Why is it so hard to infuse new ideas ? © All rights reserved. ACTION15: Actionable Analytics for Software Engineering Lincoln, Ne.

Introduction  In this talk we will describe our experiences and lessons learned from our ten year journey in conducting and infusing data mining methods into the world of cost estimation  10 years ago with 2CEE we failed to make it to the launch pad  This time we have launched and even have a few early users but will we make it to a stable earth orbit 2

Background  Everyone in an organization knows just enough about cost to be dangerous  Current cost methods have been in use for over 30 years and even then there is still some resistance to the use of cost models over expert judgment bottom up methods  Infusing new ways of doing things is hard and takes time  There is minimal to no cross fertilization of ideas between academia and practitioners in industry  Stakeholder Communication is layered 3

A Script Writers Version of the Conversation Between a SME and DME 4  SME: Is there a “model” I can show my stakeholders?  DME: Sort of but it changes everytime as it depends on what you are comparing to.  SME: The cluster make no sense.  DME: But the MREs are great.  DME: By the way I have a brand new method that works even better.  SME: (Walks away feeling as if they are walking on quicksand wondering why he ever got involved with this DME) SME: (Frustrated) What are the actual parameter values in the locally calibrated COCOMO so I can see if they make any sense. DME: We do not know we just know how the different types of models perform. That’s a lower order question. We can do all sorts of things.

History of Industry Cost Estimation Methods 5

One of the Keys to Success was this time we have a hook  The purpose of the model is to  Supplement current estimation capabilities  Be effective in the very early lifecycle when our knowledge is fuzzy  uses high level systems information (Symbolic Data)  Be usable by Cost Estimators, Software Engineers and Systems Engineers  Methodology handles  small sample sizes  noisy and sparse data 6

7 Keys to Success - 1

8 Keys to Success - 2

9 First Stab Prototype Interface

10 Next Step This capability will be released through the NASA ONCE Portal on December 4 th for use by NASA and its contractors so we will launch But …