Metrics Organizational Guidelines [1] [1] Robert Grady, Practical Software Metrics for Project Management and Process Improvement, Prentice-Hall, 1992 ©USC-CSSE

Goal-Question-Metric Paradigm GQM is a framework for developing a metrics program [1] Steps: Generate a set of organizational goals What do you want to improve? Derive a set of questions relating to the goals Answers provide visibility into meeting the goals Develop a set of metrics needed to answer the questions [1] Victor Basili, Software Modeling and Measurement: The Goal/Question/Metric Paradigm, CS-TR-2956, University of Maryland, 1992 ©USC-CSSE

GQM Goal Definition Template Purpose: To (characterize, evaluate, predict, motivate, etc.) the (process, product, model, metric, etc.) in order to (understand, assess, manage, engineer, learn, improve, etc.) it. Perspective: Examine the (cost, effectiveness, correctness, defects, changes, product metrics, reliability, etc.) from the point of view of the (developer, manager, customer, corporate perspective, etc.) Environment: The environment consists of the following: process factors, people factors, problem factors, methods, tools, constraints, etc. ©USC-CSSE

Sample Goal Trees (1/2) Improve software process predictability Project planning goal area: Predict the process in order to manage it Improve software process predictability Project tracking goal area: Evaluate the project in order to manage it Execute successful project Improve effort predictability Improve defect predictability Achieve business value Improve schedule predictability Deliver a quality product within cost and schedule constraints ©USC-CSSE

Sample Goal Trees (2/2) Improve the software process Improve quality Process change management goal area: Evaluate the process in order to improve it Improve the software process Improve quality Minimize schedule Improve productivity Maximize reuse Defect prevention goal area: Characterize defects in order to prevent them Characterize the process to understand it Prevent defects (minimize defect fixing costs, improve product quality) ©USC-CSSE

Sample GQM Map for Inspections Organizational Process Improvement Inspection Process Goal Efficiently use inspections to improve process Increase quality Increase productivity Question Is defect density being reduced over time? Is productivity increasing over time? How well are inspections performing? What is the return of inspections? What are high-leverage opportunities for defect prevention? What are optimal inspection parameters? Is the inspection process under control? How effective have process changes been? Metric inspection efficiency defect removal effectiveness inspection ROI defect density trends productivity trends inspection rate control chart effectiveness vs. inspection rate defect categorization effectiveness vs. preparation/inspection time effectiveness vs. # of inspectors defect finding rate control chart ©USC-CSSE