1. MEASUREMENT

2. Measurement “If you can’t measure it, you can’t manage it.” Bob Donath, Consultant

3. Measurement Selecting measurable phenomena Developing a set of mapping rules Applying the mapping rule to each phenomenon

4. What is to be measured? CONCEPTS/CONSTRUCTS/VARIABLES Operational Definitions Operational Definitions - Dimensions - Elements Scales Scales

5. CONCEPT A GENERALIZED IDEA ABOUT A CLASS OF OBJECTS, ATTRIBUTES, OCCURRENCES, OR PROCESSES. (e.g., Technology, Dynamism, Adoption, Learning)

6. CONSTRUCT An image or idea specifically invented for a given research and/or theory-building purpose An image or idea specifically invented for a given research and/or theory-building purpose Higher level concepts for specialised scientific explanatory purposes that are not directly observable and for thinking about and communicating abstractions Higher level concepts for specialised scientific explanatory purposes that are not directly observable and for thinking about and communicating abstractions Concepts and constructs are used at theoretical levels

7. VARIABLE Used at empirical level Used at empirical level Accept numeral or values for the purpose of testing and measurement Accept numeral or values for the purpose of testing and measurement

8. OPERATIONAL DEFINITION A definition for a construct stated in terms of specific criteria for testing or measurement A definition for a construct stated in terms of specific criteria for testing or measurement Specifies what the researcher must do to measure the concept/construct under investigation Specifies what the researcher must do to measure the concept/construct under investigation

9. SCALE - Definition SERIES OF ITEMS SERIES OF ITEMS ARRANGED ACCORDING TO VALUE ARRANGED ACCORDING TO VALUE FOR THE PURPOSE OF QUANTIFICATION FOR THE PURPOSE OF QUANTIFICATION A CONTINUOUS SPECTRUM A CONTINUOUS SPECTRUM

10. SCALE PROPERTIES UNIQUELY CLASSIFIES UNIQUELY CLASSIFIES PRESERVES ORDER PRESERVES ORDER DISTANCE/EQUAL INTERVALS DISTANCE/EQUAL INTERVALS NATURAL ORIGIN (ZERO) NATURAL ORIGIN (ZERO)

11. Types of Scales Ordinal Interval Ratio Nominal

12. NOMINAL SCALE

13. Nominal Scales Mutually exclusive and collectively exhaustive categories Mutually exclusive and collectively exhaustive categories Exhibits the classification characteristic only Exhibits the classification characteristic only

14. NOMINAL SCALE PROPERTIES UNIQUELY CLASSIFIES Male/Female Male/Female Academic/Admin Academic/Admin Asian/European Asian/European Strategy types Strategy types Adopters/Non Adopters Adopters/Non Adopters

15. Levels of Measurement Ordinal Interval Ratio Nominal Classification

16. ORDINAL SCALE

17. Ordinal Scales Characteristics of nominal scale plus an indication of order Implies statement of greater than and less than

18. ORDINAL SCALE PROPERTIES UNIQUELY CLASSIFIES PRESERVES ORDER Win, Place & Show Win, Place & Show Podium/Grid positions Podium/Grid positions Ranking Ranking

19. Levels of Measurement Ordinal Interval Ratio Nominal Classification Order Classification

20. INTERVAL SCALE

21. Interval Scales Characteristics of nominal and ordinal scales plus the concept of equality of interval. Characteristics of nominal and ordinal scales plus the concept of equality of interval. Equal distance exists between numbers Equal distance exists between numbers

22. INTERVAL SCALE PROPERTIES UNIQUELY CLASSIFIES PRESERVES ORDER EQUAL INTERVALS Consumer Price Index (Base 100) Consumer Price Index (Base 100) Fahrenheit Temperature Fahrenheit Temperature Assessment of attitude, beliefs, intention Assessment of attitude, beliefs, intention

23. Levels of Measurement Ordinal interval Ratio Nominal Classification Order Classification Order Classification Distance

24. RATIO SCALE

25. Ratio Scales Characteristics of previous scales plus an absolute zero point Characteristics of previous scales plus an absolute zero point Examples Examples  Weight  Height  Number of children

26. RATIO SCALE PROPERTIES UNIQUELY CLASSIFIES PRESERVES ORDER EQUAL INTERVALS NATURAL ZERO Weight and distance Weight and distance Age, years of service Age, years of service

27. Levels of Measurement Ordinal Interval Ratio Nominal Classification Order Classification Order Classification Distance Natural Origin Order Classification Distance

28. Goodness of Measures Accurately measuring what actually the concept one sets out to measure Accurately measuring what actually the concept one sets out to measure Should be easy and efficient to use Should be easy and efficient to use

29. Evaluating Measurement Tools Criteria Validity Practicality Reliability

30. Validity The ability of a scale to measure what was intended to be measured.

31. Validity Determinants Content Construct Criterion

32. Increasing Content Validity Content Literature Search Expert Interviews Group Interviews Question Database

33. ……Goodness of Measures Validity Validity  Content Validity  Includes Face Validity  How well the dimensions and elements of a concept have been delineated  Professional agreement that a scale logically appears to accurately measure what it is intended to measure

34. Validity Determinants Content Construct

35. Increasing Construct Validity New measure of trust Known measure of trust Empathy Credibility

36. ……Goodness of Measures  Construct Validity – when empirical evidence generated by a measure is consistent with the theoretical logic of the concept  Convergent Validity – the measure should “converge” with other similar measures  Discriminant Validity – when the measure has low correlation with measures of dissimilar concept

37. Judging Criterion Validity Relevance Freedom from bias Reliability Availability Criterion

38. Criterion-Related Validity  Concurrent – When the scale discriminates individuals who are known to be different; A type of criterion validity whereby a new measure correlates with a criterion measure taken at the same time.  Predictive Validity – Ability to differentiate among individuals with reference to a future criterion

39. VALIDITY

40. Reliability The degree to which measures are free from random error and therefore yield consistent results.

41. Reliability Estimates Stability Internal Consistency Equivalence

42. Reliability Estimates Stability Internal Consistency Equivalence

43.  Stability of Measures  Test-Retest Reliability – the administering of the same scale or measure to the same respondents at two separate points in time  Parallel-Form Reliability - when responses on two comparable sets of measures tapping the same construct are highly correlated … Reliability

44. Reliability Estimates Stability Internal Consistency Equivalence

45. Variations at one point in time among observers and samples of items Variations at one point in time among observers and samples of items

46. Reliability Estimates Stability Internal Consistency Equivalence

47. … Reliability  Internal Consistency Measures  Interitem Consistency Reliability - where items that are independent measures of the same concept correlate with one another.  Split-Half Reliability – reflects the correlations between two halves of an instrument

48. RELIABILITY

49. Understanding Validity and Reliability

50. Practicality EconomyInterpretability Convenience

51. SENSITIVITY A measurement instrument’s ability to accurately measure variability in stimuli or responses. A measurement instrument’s ability to accurately measure variability in stimuli or responses.

52. Rating Scales Used to elicit responses with regard to the object, event, or person studies: Dichotomous scale Category scale Likert scale Numerical scale Semantic differential scale

53. ….. Rating Scales Itemised rating scale Fixed or constant sum rating scale Stapel scale Graphic rating scale Consensus scale

54. Ranking Scales To tap preferences between two or more objects or items Paired Comparison Paired Comparison Forced Choice Forced Choice Comparative Comparative