Measurement ConceptualizationOperationalization Level of Measurement Validity and Reliability

Scientists can measure any thing that is “real,” and most things that are not real. Much of what we study is made up Much of what we study is made up Therefore, how can we measure something that is not “real” Therefore, how can we measure something that is not “real” Shared understanding of what a concept means Shared understanding of what a concept means

Conceptualization An agreement about some observed social pattern An agreement about some observed social pattern Produces concepts Produces concepts Terms that represent the shared agreement Terms that represent the shared agreement DANGER = Reification DANGER = Reification

Indicators Some sign of presence or absence of a concept Some sign of presence or absence of a concept Different indicators of the same concept Different indicators of the same concept “Behave the same way” = same dimension “Behave the same way” = same dimension Behave differently = possible that they tap different dimensions of the same concept Behave differently = possible that they tap different dimensions of the same concept

Definitions of Concepts Real, Nominal, and Operational Definitions Real, Nominal, and Operational Definitions Clarification, expansion, and change in concepts Clarification, expansion, and change in concepts ANOMIE ANOMIE Overt time, consensus and clarity can emerge Overt time, consensus and clarity can emerge Sometimes, concepts change over time, and things become less clear, or more complex Sometimes, concepts change over time, and things become less clear, or more complex

Differences in operational definitions (or “indicators”) are more crucial for descriptive than for explanatory research WHY?

Operationalization: Decision Making Range of Variation Range of Variation Defining Variables and Attributes Defining Variables and Attributes Levels of measurement Levels of measurement Nominal Nominal Ordinal Ordinal Interval Interval Ratio Ratio Single versus Multiple Indicators Single versus Multiple Indicators

Measurement Quality Precision and Accuracy Precision and Accuracy Reliability and Validity Reliability and Validity

How to Check/Demonstrate… Reliability Reliability Test-retest Test-retest Split-half method Split-half method Inter-rater reliability Inter-rater reliability Validity Validity Face validity Face validity Criterion & Construct validity Criterion & Construct validity

Tension among reliability and validity Reliability often comes by sacrificing some validity Reliability often comes by sacrificing some validity Fit with quantitative, structured, nomothetic methods Fit with quantitative, structured, nomothetic methods More valid measures are often less reliable More valid measures are often less reliable Fit with qualitative, idiographic methods Fit with qualitative, idiographic methods