1. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.1 © Copyright OSEL 2002 Beyond Numbers SPIN September 2002

2. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.2 © Copyright OSEL 2002

3. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.3 © Copyright OSEL 2002 Some views on measurement… “What is not measurable, make measurable.”- Galileo “When you can measure what you are speaking about and express it in numbers you know something about it; but when you cannot measure it, when you cannot express it in numbers your knowledge is of a meagre and unsatisfactory kind.” - Lord Kelvin “…This remark [above] has been quoted with an approval it does not altogether deserve - it does not, for example, do justice to the work of Darwin or Pasteur, to name only two of Kelvin’s contemporaries.” - G.U.Yule (statistician) “You can’t control what you can’t measure.” - DeMarco “Metrics is crap.” - Dijkstra

4. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.4 © Copyright OSEL 2002

5. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.5 © Copyright OSEL 2002 Learning to Count

6. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.6 © Copyright OSEL 2002 Learning to Count –labelling

7. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.7 © Copyright OSEL 2002 Learning to Count –labelling –ordering

8. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.8 © Copyright OSEL 2002 Learning to Count –labelling –ordering –differences

9. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.9 © Copyright OSEL 2002 Learning to Count –labelling –ordering –differences –division

10. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.10 © Copyright OSEL 2002 Learning to Count –labelling –ordering –differences –division –sets

11. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.11 © Copyright OSEL 2002 Learning to Count –labelling ( ~ nominal) –ordering (ordinal) –differences (interval) –division ( ~ ratio) –sets ( ~ absolute)

12. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.12 © Copyright OSEL 2002 Learning to Count –labelling ( ~ nominal) –ordering (ordinal) –differences (interval) –division ( ~ ratio) –sets ( ~ absolute) … a Measurement Maturity Model

13. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.13 © Copyright OSEL 2002

14. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.14 © Copyright OSEL 2002 Empirical relational system

15. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.15 © Copyright OSEL 2002 Empirical relational system Formal relational system measurement real worldmathematical world

16. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.16 © Copyright OSEL 2002 Empirical relational system Formal relational system Results measurement mathematics and statistics real worldmathematical world

17. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.17 © Copyright OSEL 2002 Empirical relational system Formal relational system Results measurement interpretation mathematics and statistics real worldmathematical world Relevant empirical information

18. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.18 © Copyright OSEL 2002 Empirical relational system Formal relational system Results measurement interpretation mathematics and statistics decisions and actions real worldmathematical world Relevant empirical information From Pfleeger 1998

19. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.19 © Copyright OSEL 2002 Empirical relational system Formal relational system Results refined measurement improved interpretation mathematics and statistics better decisions and actions real worldmathematical world Relevant empirical information

20. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.20 © Copyright OSEL 2002

21. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.21 © Copyright OSEL 2002

22. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.22 © Copyright OSEL 2002

23. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.23 © Copyright OSEL 2002

24. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.24 © Copyright OSEL 2002

25. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.25 © Copyright OSEL 2002

26. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.26 © Copyright OSEL 2002

27. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.27 © Copyright OSEL 2002 Validating Measurements –do the data reveal the truth? –is the representation accurate? –are the data carefully documented? –do the methods of display avoid spurious reading of the data? –are appropriate contexts and comparisons shown?

28. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.28 © Copyright OSEL 2002

29. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.29 © Copyright OSEL 2002 O X F O R D S O F T W A R E E N G I N E E R I N G L I M I T E D 9 Spinners Court, 53 West End, Witney, Oxfordshire OX28 1NH Tel. +44 (0) 1993 700878 Fax. +44 (0) 1993 774132 www.osel.co.uk

30. OXFORD SOFTWARE ENGINEERING Software Engineering Services & Consultancy Slide 1.30 © Copyright OSEL 2002