1. SOCI 2003B: Sociological Methods Colleen Anne Dell, Ph.D. Carleton University, Department of Sociology & Anthropology Canadian Centre on Substance Abuse October 12, 2006 Conceptualization, Operationalization & Measurement

2. OUTLINE 1. What does measurement mean? 2. The measurement process a. Conceptualization b. Operationalization c. Structuring of indicators (Levels of measurement) d. Testing for reliability and validity 3. Indexes and Scales

3. WORKSHOP: Research team problem solving – Groups 1-7

4. 1.WHAT DOES MEASUREMENT MEAN? “A process which consists of rules for assigning numbers or values to attributes or objects being observed”. …refers to how you assign numbers (or values) to the variables you have chosen to study the relationship between. There are 4 stages: (1) conceptualization (2) operationalization (3) structuring the indicators (4) testing your measurement techniques

5. Concept The word or symbols in language that we use to represent mental images.

6. A. CONCEPTUALIZATION The assignment of a clear, concise and meaningful definition to a concept being measured. Important factors to acknowledge during conceptualization: 1. Restrictive or single meaning to a concept 2. Perfect definition is not possible 3. Exhaustive meaning is not possible REIFICATION: The process of regarding as real things that are not.

7. B. OPERATIONALIZATION The process by which a feasible INDICATOR of the meaning attached to a concept is selected. TO SELECT AN ACCEPTABLE INDICATOR YOU MUST CONSIDER: (1) The indicator should provide an empirical referent to the meaning that was assigned to the concept (2) An indicator should provide as accurate a reflection of the meaning of the concept as possible

8. C. STRUCTURING THE INDICATORS Levels of Measurement… Nominal Ordinal Interval Ratio

9. LEVELS OF MEASUREMENT LEVEL PROPERTIES OBSERVATIONS REFLECT… Ratio- true zero - equal intervals - rank order - classification - measurable difference in amount Interval- equal intervals - rank order - classification - measurable difference in amount Ordinal- rank order - classification - difference in degree Nominal- classification- difference in kind

10. D. Testing for Reliability and Validity 1. Is the indicator RELIABLE? Looking for consistent results 2. Is the indicator VALID? Are you measuring what you claim to be measuring?

11. RULE: An indicator can be reliable but not valid. An indicator cannot be valid without being reliable.

12. TESTS OF RELIABILITY: (1) Test-retest reliability procedure (2) The parallel forms reliability technique (3) The split-half reliability method

13. TESTS OF VALIDITY: (1) The face validity procedure (2) Criterion/predictive validity procedure (3) Content/concurrent validity procedure (4) Construct validity procedure (Page 128 – define for next class)

14. 3. INDEXES, SCALES AND TYPOLOGIES Indexes: Accumulating scores assigned to individual attributes. Scales: Assigning scores to patterns of responses.

15. Index Construction 1. SELECTING POSSIBLE ITEMS 2. EXAMINING EMPIRICAL RELATIONSHIPS 3. SCORING THE INDEX 4. VALIDATING THE INDEX

16. Scale Construction

17. Typology