James Nowotarski 04 May 2004 IS 553 Advanced Systems Development Practices.

Slides:



Advertisements
Similar presentations
Page 2 Agenda Page 3 History –Blue Print, 2000 –GIS Process 1.2, 2001 (training only) –GIS Process 2.0, (ITIL based - not implemented) –Supply/Demand.
Advertisements

Software Quality Assurance Plan
Chapter 7: Key Process Areas for Level 2: Repeatable - Arvind Kabir Yateesh.
More CMM Part Two : Details.
W5HH Principle As applied to Software Projects
SE 470 Software Development Processes James Nowotarski 2 June 2003.
SE 470 Software Development Processes James Nowotarski 12 May 2003.
Managing the Information Technology Resource Jerry N. Luftman
SE 470 Software Development Processes James Nowotarski 05 May 2003.
James Nowotarski 27 April 2004 IS 553 Advanced Systems Development Practices.
IS 421 Information Systems Analysis James Nowotarski 11 November 2002.
SE 325/425 Goal, Question, Metric Approach Autumn 2006
IS 421 Information Systems Analysis James Nowotarski 4 November 2002.
James Nowotarski 6 November 2008 SE 325/425 Principles and Practices of Software Engineering Autumn 2008.
SE 470 Software Development Processes James Nowotarski 28 April 2003.
project management office(PMO)
Readiness Index – Is your application ready for Production? Jeff Tatelman SQuAD October 2008.
How ISO 9001 Fits Into The Software World? Management of Software Projects and Personnel CIS 6516 March 6, 2006 Prepared by Olgu Yilmaz Swapna Mekala.
An Agile View of Process
Integrated Process Model - v2
Charting a course PROCESS.
Release & Deployment ITIL Version 3
Information Technology Audit
Gaining Support for a Sustainable Agile Transformation Dennis Stevens, VP Enterprise Engagements LeadingAgile November 12, 2013.
What is Business Analysis Planning & Monitoring?
Six Sigma By: Tim Bauman April 2, Overview What is Six Sigma? Key Concepts Methodologies Roles Examples of Six Sigma Benefits Criticisms.
Software Project Management
How get your project management or professional services organization ISO 9001 certified.
An Introduction to AlarmInsight
PMP® Exam Preparation Course
Continual Service Improvement Process
MEASUREMENT PLAN SOFTWARE MEASUREMENT & ANALYSIS Team Assignment 15
1 Achieving Change in a Manufacturing Environment.
Unit 8 Syllabus Quality Management : Quality concepts, Software quality assurance, Software Reviews, Formal technical reviews, Statistical Software quality.
Introduction PMBOK® © Whizlabs.
- 1 - Roadmap to Re-aligning the Customer Master with Oracle's TCA Northern California OAUG March 7, 2005.
Chapter 5 Internal Control over Financial Reporting
CS 360 Lecture 3.  The software process is a structured set of activities required to develop a software system.  Fundamental Assumption:  Good software.
Certificate IV in Project Management Introduction to Project Management Course Number Qualification Code BSB41507.
Chapter 6 : Software Metrics
GBA IT Project Management Final Project - Establishment of a Project Management Management Office 10 July, 2003.
Service Transition & Planning Service Validation & Testing
1 Chapter 5 Project management. 2 Project management : Is Organizing, planning and scheduling software projects.
IT Requirements Management Balancing Needs and Expectations.
Team Assignment 15 Team 04 Class K15T2. Agenda 1. Introduction 2. Measurement process 3. GQM 4. Strength Weakness of metrics.
Test Metrics. Metrics Framework “Lord Kelvin, a renowned British physicist, is reputed to have said: ‘When you can measure what you are speaking about,
UKSMA 2005 Lessons Learnt from introducing IT Measurement Peter Thomas –
BSBPMG505A Manage Project Quality Manage Project Quality Project Quality Processes Diploma of Project Management Qualification Code BSB51507 Unit.
Formulating a Simulation Project Proposal Chapter3.
Apply Quality Management Techniques Project Quality Processes Certificate IV in Project Management Qualification Code BSB41507 Unit Code BSBPMG404A.
Computing and SE II Chapter 15: Software Process Management Er-Yu Ding Software Institute, NJU.
Chapter 3: Software Project Management Metrics
Cmpe 589 Spring 2006 Lecture 2. Software Engineering Definition –A strategy for producing high quality software.
BSBPMG404A Apply Quality Management Techniques Apply Quality Management Techniques Project Quality Processes C ertificate IV in Project Management
2015 Pipeline Safety Trust Conference November 20 th, 2015 | New Orleans, LA API RP 1175 Pipeline Leak Detection Program Management – New RP Highlights.
AGILE XP AND SCRUM © University of LiverpoolCOMP 319slide 1.
Chapter © 2012 Pearson Education, Inc. Publishing as Prentice Hall.
CYSSC - Cluster 2.0 Partner Management Final Deliverable High Sensitivity Sep 2, 2011 Cluster 2.0 Project Team.
Software Development Process CS 360 Lecture 3. Software Process The software process is a structured set of activities required to develop a software.
HOW A PMO CAN DRIVE A PROJECT MANAGEMENT CULTURE Allan R. Loucks, M.A., Psy.D. Robert J. Hess, PMP January 27, 2010.
Core Competencies Training for Supervisors
Six-Sigma : DMAIC Cycle & Application
Software Project Management
TechStambha PMP Certification Training
Introduction to Software Engineering
Software Project Management
Project Quality Management
Software metrics.
Metrics Organizational Guidelines [1]
Presentation transcript:

James Nowotarski 04 May 2004 IS 553 Advanced Systems Development Practices

2 Course Map Underpinnings. Introduction. Essentials Content. Rational Unified Process. Agile Implementation. Metrics. CMM. Distributed development. Tools & training Briefings (Term Papers) Assignments Quizzes Week (RUP)(Agile)(CMM) (Distr. Dev.)

3 Background on Continuous Improvement Understand basics of Software Metrics Objectives Defining Metrics Metrics Programs Market Players, Products, Gurus Sources/Links Today’s Objectives

4 Topic Duration Quiz 2 and Agile Recap15 minutes Software Metrics60 minutes *** Break15 minutes Current Event Reports30 minutes Software Metrics (cont.)60 minutes Today’s Agenda

5 Topic Duration Quiz 2 and Agile Recap15 minutes Software Metrics60 minutes *** Break15 minutes Current Event Reports30 minutes Software Metrics (cont.)60 minutes Today’s Agenda

6 ApproachReferences XPwww.extremeprogramming.org M. Marchesi et al, Extreme Programming Perspectives, Addison-Wesley, CrystalA. Cockburn, Agile Software Development, Addison-Wesley, 2001 SCRUMK. Schwaber and M. Beedle, Agile Software Development with Scrum, Prentice Hall, Adaptive Software Development J. Highsmith, Adaptive Software Development, Dorset House, FDDS. Palmer, A Practical Guide to Feature-Driven Development, Prentice Hall, Agile - Generalhttp:// Agile/Lightweight Methods

7 Topic Duration Quiz 2 and Agile Recap15 minutes Software Metrics60 minutes *** Break15 minutes Current Event Reports30 minutes Software Metrics (cont.)60 minutes Today’s Agenda

8 Why Measure? “You can’t control what you can’t measure” (Tom Demarco) “You can’t understand... “You can’t improve... “Show me how you will measure me, and I will show you how I will perform” (Eli Goldratt)

9 Scope of our discussion Director - IS/IT Manager, Systems Development & Maintenance Manager, Computer Operations Financial Systems Manufacturing Systems Customer Fulfillment Systems Our focus Sample IT Organization

10 Examples of systems development metrics CategoryMetricUnits of measure Speed of delivery Delivery rate Elapsed months/Function point Schedule reliability Duration variance % Schedule variance % Software quality Fault density Faults/Function point ProductivityProductivity rate Functions points/Staff month

11 Example: Speed of delivery Developed Function Points Elapsed Months = Is a single project release (Average elapsed months =14.8, n=33). Industry Average line is determined from Software Productivity Research

12 Function Points Function Points (FP) are a language- and technology-independent measure of application size Two flavors: Delivered size = total application size delivered, including packages, assets, etc. Developed size = portion built for the release Takes into account: Inputs Outputs Inquiries Table updates External interfaces 1 Function Point ≈ 100 lines of Cobol

13 Example: Schedule reliability 0% 10% 20% 30% 40% 50% 60% Developed Function Points Schedule Variance above commitment = Is a single project release (n=33). Industry Average line is determined from Software Productivity Research

14 Example: Software quality Developed Function Points Faults (3 months) Faults reported over the first three months in operations (n=27) An estimated industry average for faults found in the first three months of operations. The assumption is that half the total faults are found in the first three months in operation. This average is one half of the industry average of the total faults from C. Jones, Applied Software Measurement, 1996, p.232.

15 Example: Productivity Developed Function Points Function Points per Staff Month Is a single project release (n=33) Industry Average line is determined from Software Productivity Research.

16 Objectives of Software Measurement

17 Hawthorne Effect Famous study conducted in the Hawthorne plant of General Electric Corporation Plant managers implemented changes in working conditions and recorded data on the plant’s production output They found that production increased no matter what changes in working conditions they implemented! What does this example reveal about how people act when they know that an experiment is being conducted?

18 Goal Question Metric Goal 1Goal 2 Question Metric

19 Goal Question Metric Technique for identifying suitable measurements to collect Assumption: It is only worthwhile measuring things to satisfy goals Goals are desired end states Questions identify the information needs associated with goals, help determine whether or not goals are being met Metrics are specific items that can be measured to answer the questions

20 GQM Example (High Level) Improve systems delivery performance Goal What is the quality of our deliverable? How predictable is our process? How quickly do we deliver? How efficient are we? Question Metric Fault density Delivery rateProductivity rate Duration variance percentage

21 Topic Duration Quiz 2 and Agile Recap15 minutes Software Metrics60 minutes *** Break15 minutes Current Event Reports30 minutes Software Metrics (cont.)60 minutes Today’s Agenda

22 Topic Duration Quiz 2 and Agile Recap15 minutes Software Metrics60 minutes *** Break15 minutes Current Event Reports30 minutes Software Metrics (cont.)60 minutes Today’s Agenda

23 Topic Duration Quiz 2 and Agile Recap15 minutes Software Metrics60 minutes *** Break15 minutes Current Event Reports30 minutes Software Metrics (cont.)60 minutes Today’s Agenda

24 Measurement and Continuous Improvement Continuous Improvement Measurement Focuses program objectives Enables tracking of improvement progress Enables communication of program benefit Clarifies measurement’s purpose and role Clarifies which measures to collect Provides a mechanism for acting on findings Enables top-to-bottom organizational support

25 Continuous Process Improvement Approach to Quality and Measurement Plan Do Check Act 1. Identify performance standards and goals 2. Measure project performance 3. Compare metrics against goals 4. Eliminate causes of deficient performance - fix defects - fix root causes

26 Metrics Program Change Plan QUALITY MANAGEMENT Enable Change Technology Process People Metrics Awareness Education Metrics Network Vital Few Metrics Definitions Vital Few Metrics Implementation Technology Strategy KM Support for Measurement Community of Practice Measurement Process Improvement Large Project Network Metrics Strategy Commitment / Ownership Distributed Support Units Metrics Repository and tools Measurement Process Definition Roles & Responsibilities PROGRAM MANAGEMENT Achieve-1 Change Sustain Change Achieve-2 Change Metrics Rollout Education/Training Pilot Project Group Ongoing Metrics Education / Training System Building Improvement Goals Metrics Definition & Implementation for Delivery Centers Metrics Embedded in System Building Methods Dashboard metrics Implementation Pilot Selected Projects and Selected Delivery Centers Enable Large Projects and Remaining Centers

27 Measurement Program Mortality Most programs fail, usually within 2 years Number of companies Year Cumulative starts Cumulative successes

28 Reasons for Metric Program Failure Lack of executive sponsorship Lack of alignment with organizational goals Tendency to collect too much data Measures not calibrated, normalized, or validated Not comparing apples-to-apples Fear of [individual] evaluation Learning curve (e.g., function points) Cost overhead

29 Key Success Factors Ensure that measurement is part of something larger, typically performance improvement “Trojan Horse” strategy Ensure alignment with organizational goals Start small, iterate Strongly recommend doing a pilot test Automate capture of metrics data Rigorously define a limited, balanced set of metrics “Vital Few” Portfolio approach Comparability Aggregate appropriately Focus should be on processes, not individuals Obtain [visible] executive sponsorship Understand and address the behavioral implications

30 Increasingly, performance is judged on business metrics Example: For a billing system implementation, metric is billing accuracy rates Issue: Assessing IT’s contributions to business goals has always been difficult

31 How to Measure Software Size? How many physical source lines are there in this C language program? #define LOWER 0/* lower limit of table */ #define UPPER 300/* upper limit */ #define STEP 20/* step size */ main()/* print a Fahrenheit-Celsius conversion table */ { int fahr; for(fahr=LOWER; fahr<=UPPER; fahr=fahr+STEP) printf(“%4d %6.1f\n”, fahr, (5.0/9.0)*(fahr-32)); }

32 How to Measure Software Size? Need standards to ensure repeatable, consistent size counts IncludeExclude 1.Executable 2.Nonexecutable 3.Declarations 4.Compiler directives 5.Comments 6.On their own lines 7.On lines with source...

33 How to Measure Software Size? “Lines of code is a useless measurement in the face of code that shrinks when we learn better ways of programming” (Beck, p.42)

34 How to Measure Hours? IncludeExclude Overtime Compensated (paid) Uncompensated (unpaid) Contract Temporary employees Subcontractor Consultant Management Test personnel Software quality assurance...

35 Other Quotes “Count what is countable, measure what is measurable, and what is not measurable, make measurable” Galileo

36 Other Quotes “Anything that can’t be measured doesn’t exist” Locke, Berkeley, Hume (Beck, p.45)

37 Other Quotes “In God we trust – All others must bring data” W. Edwards Deming

38 Measurement and CMM Measurement supports each maturity level Process maturity level Project focus Product focus Process focus Process improvement focus Optimizing Managed Defined Repeatable Initial