University of Southern California Center for Systems and Software Engineering Productivity Data Analysis and Issues Brad Clark, Thomas Tan USC CSSE Annual Research Review March 8, 2010

University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar Table of Contents Background Productivity Data Analysis by Application Domain Reducing the number of domains: Application Difficulty Topics for further discussion This work is sponsored by the Air Force Cost Analysis Agency

University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar Background DoD has been collecting Software resource data for a number of years –Product and development description –Product size –Resources and schedule –Product quality Analyzing ~140 records out of ~300 –Additional data is coming in Objective: Improved cost estimation of future DoD software- intensive systems, as well as to the DoD cost community. –Characterize different Application Domains within DoD –Analyze collected data for simple cost estimating relationships within each domain –Develop rules-of-thumb for missing data Make collected data useful to oversight and management entities

University of Southern California Center for Systems and Software Engineering Software Resources Data Report USC CSSE Annual Research Review - Mar 20104

University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar SRDR Data Notes: SRDR: Software Resources Data Report Missing Domains: Internet, Maintenance and Diagnostics, Spacecraft bus

University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop Preliminary Results - Do Not Use!

University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar Preliminary Results - Do Not Use!

University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop Preliminary Results - Do Not Use!

University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop Preliminary Results - Do Not Use!

University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop Preliminary Results - Do Not Use!

University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop Preliminary Results - Do Not Use!

University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop Preliminary Results - Do Not Use!

University of Southern California Center for Systems and Software Engineering Ground System Architecures Workshop Preliminary Results - Do Not Use!

University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar PM = A * (EKSLOC) B Simple Cost Estimating Relationships Notes: PM: Person Months (152 labor hours / month) EKSLOC: Equivalent Thousands of Source Lines of Code Preliminary Results - Do Not Use!

University of Southern California Center for Systems and Software Engineering Sizing Issues -1 Multiple SLOC counting methods –Physical: total number of lines in a file –Non-commented Source: no blank or comment lines –Logical No Deleted Code Counts SLOC Conversion Experiment –Use the results of USC’s Code Count Tool to find conversion ratios –Physical to Logical –NCSS to Logical –Results segregated by programming language USC CSSE Annual Research Review - Mar

University of Southern California Center for Systems and Software Engineering NCSS to Logical Conversion USC CSSE Annual Research Review - Mar Ada: 45% C/C++: 61% C#: 61% Java: 72%

University of Southern California Center for Systems and Software Engineering Sizing Issues -2 No Modified Code parameters –Percent Design Modified (DM) –Percent Code Modified (CM) –Percent Integration and Test Modified (IM) –Software Understanding (SU) –Programmer Unfamiliarity (UNFM) Program interviews provided parameters for some records USC CSSE Annual Research Review - Mar

University of Southern California Center for Systems and Software Engineering Effort Issues Missing effort reporting for different lifecycle phases –Software requirements analysis (REQ) –Software architectural design (ARCH) –Software coding and testing (CODE) –Software integration (INT) –Software qualification testing (QT) –Software management, CM, QA, etc. (Other – very inconsistent) USC CSSE Annual Research Review - Mar

University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar Collapsing Application Domains Propose to reduce the number of application domains –Currently have a “sparse” data table Use a model-independent approach –5-level scale to capture the “difficulty” (and therefore impact) of an application domain on productivity

University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar Software Application Difficulties Difficulty would be described in terms of required software reliability, database size, product complexity, integration complexity, information assurance, real- time requirements, different levels of developmental risks, etc.

Application DomainsVery EasyEasyNominalChallengingVery Challenging Business Systems Large biz system Trillion $/day transaction Internet Simple web pages Web application (shopping) Mega-web application Tools and Tool Systems Verification toolsSafety critical Scientific Systems Offline data reduction Large dataset Simulation and Modeling Low fidelity simulator Physical phenomenon Test and Evaluation Usual Distributed debugging TrainingSet of screens Simulation network Command and Control Taxi-cab dispatch SOS (C4ISR) Mission Management Usual Multi-level security and safety Weapon Delivery and Control Weapon spaceSafety Communications Noise, anomalies handling Radio Safety/Security Frequency- hopping Application Difficulty Issues 21USC CSSE Annual Research Review - Mar 2010

University of Southern California Center for Systems and Software Engineering USC CSSE Annual Research Review - Mar Questions? For more information, contact: Thomas Tan Or Brad Clark