COM 633: Content Analysis Measurement; Validity Kimberly A. Neuendorf, Ph.D. Cleveland State University Fall 2010.

Slides:

Advertisements

Similar presentations

Allyn & Bacon 2003 Social Work Research Methods: Qualitative and Quantitative Approaches Topic 7: Basics of Measurement Examine Measurement.

Advertisements

Conceptualization, Operationalization, and Measurement

Conceptualization and Measurement

Chapter 5 Measurement, Reliability and Validity.

4/25/2015 Marketing Research 1. 4/25/2015Marketing Research2 MEASUREMENT  An attempt to provide an objective estimate of a natural phenomenon ◦ e.g.

Part II Sigma Freud & Descriptive Statistics

Part II Sigma Freud & Descriptive Statistics

Social Research Methods

5/15/2015Marketing Research1 MEASUREMENT  An attempt to provide an objective estimate of a natural phenomenon ◦ e.g. measuring height ◦ or weight.

Data and the Nature of Measurement

Concepts, Operationalization, & Measurement

Operationalizing Concepts Issues in operationally defining your concepts, validity, reliability and scales.

MEASUREMENT. Measurement “If you can’t measure it, you can’t manage it.” Bob Donath, Consultant.

Concept of Measurement

Beginning the Research Design

Measurement Concepts. CONSTRUCT VALIDITY OF MEASURES Indicators of Construct Validity Face validity Aggression questionnaire Not enough to really determine.

1 Measurement PROCESS AND PRODUCT. 2 MEASUREMENT The assignment of numerals to phenomena according to rules.

© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 5 Making Systematic Observations.

1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION.

FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,

Social Research Methods: Qualitative and Quantitative Approaches, 5e

Dr. Satyendra Singh, Department of Adminstrative Studies Welcome to the Class of Univariate Data Analysis & Marketing Research Questions.

1 Measurement Adapted from The Research Methods Knowledge Base, William Trochim (2006). & Methods for Social Researchers in Developing Counries, The Ahfad.

Conceptualization and Operationalization

The Practice of Social Research

Measurement and Data Quality

Measurement in Survey Research MKTG 3342 Fall 2008 Professor Edward Fox.

Defining and Measuring Variables Slides Prepared by Alison L. O’Malley Passer Chapter 4.

Slide 9-1 © 1999 South-Western Publishing McDaniel Gates Contemporary Marketing Research, 4e Understanding Measurement Carl McDaniel, Jr. Roger Gates Slides.

MEASUREMENT OF VARIABLES: OPERATIONAL DEFINITION AND SCALES

Instrumentation.

Bryman: Social Research Methods, 4 th edition What is a concept? Concepts are: Building blocks of theory Labels that we give to elements of the social.

Chapter Eight The Concept of Measurement and Attitude Scales

McGraw-Hill/Irwin Business Research Methods, 10eCopyright © 2008 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 11 Measurement.

Measurement Neuman and Robson Ch. 6. What is it? The process of creating measurable concrete variables from abstract concepts Extends the senses (empirical)

6. Conceptualization & Measurement

Measurement Cameron G. Thies University of Iowa. The Measurement Process What is measurement? – The process of assigning numbers or labels to units of.

The Nature of Quantitative Research

1 Reliability and Validity Research Methods in AD/PR COMM Fall 2007 Nan Yu.

Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.

Content Analysis: Measurement and Validity Kimberly A. Neuendorf, Ph.D. Cleveland State University Fall 2011.

Chapter 4 – Research Methods in Clinical Psych Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

Chapter 8 Validity and Reliability. Validity How well can you defend the measure? –Face V –Content V –Criterion-related V –Construct V.

CHAPTER OVERVIEW The Measurement Process Levels of Measurement Reliability and Validity: Why They Are Very, Very Important A Conceptual Definition of Reliability.

Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.

Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.

Reliability & Validity  Reliability  “dependability”  is the indicator consistent?  same result every time?  Does not necessary measure what you think.

Introducing Communication Research 2e © 2014 SAGE Publications Chapter Five Measurement: Research Using Numbers.

Measurement and Scaling

S519: Evaluation of Information Systems Social Statistics Inferential Statistics Chapter 16: reliability and validity.

Lesson 3 Measurement and Scaling. Case: “What is performance?” brandesign.co.za.

Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.

Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.

S519: Evaluation of Information Systems Social Statistics Inferential Statistics Chapter 16: reliability and validity.

© 2009 Pearson Prentice Hall, Salkind. Chapter 5 Measurement, Reliability and Validity.

Data Collection Methods NURS 306, Nursing Research Lisa Broughton, MSN, RN, CCRN.

Chapter 2 Theoretical statement:

Ch. 5 Measurement Concepts.

Social Research Methods MAN-10 Erlan Bakiev, Ph. D.

Associated with quantitative studies

Social Research Methods MAN-10 Erlan Bakiev, Ph. D.

Tests and Measurements: Reliability

Sociological Research Methods

Measuring Social Life: How Many? How Much? What Type?

Social Research Methods

Reliability & Validity

Reliability & Validity

Content Analysis Content Analysis -- a research technique for categorizing observational data for the purpose of describing the phenomenon or testing.

Measurement Concepts and scale evaluation

Presentation transcript:

COM 633: Content Analysis Measurement; Validity Kimberly A. Neuendorf, Ph.D. Cleveland State University Fall 2010

Measurement “Assignment of numerals to objects or events according to rules” (Stevens, 1951)

Operationalization (Measurement) Categories that are exhaustive and mutually exclusive High and appropriate level of measurement Ratio Interval Ordinal Nominal

Evaluating Measures: Comparing Reliability, Accuracy (lack of Bias), and Precision Targets…see p. 114 of book. See also: Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. Newbury Park, CA: Sage Publications.

Validity Internal Conceptual definition =matches= Operationalization The standard of having a “good” measure—”Are we hitting the target we want?” External Generalizability Sample Ecological validity Replicability

Validity “Face” Criterion Relate to established standard or behavior Concurrent Predictive e.g., Oliver & Kalyanaraman (2002) study of sexual and violent content in trailers and films... Criterion is the MPAA rating

Validity Content Construct

Validity Content

Validity Content Construct = ???

Validity Content High reliability...

Validity Construct Related to other measures (constructs) in ways consistent with theory Convergent—relationships as expected Discriminant—lack of relationships, as expected

Construct Validity Smith volume (1992) on “thematic content analysis”—psychographic applications—has examples Trust-mistrust coding system for TAT stories construct validated against: Other thematic coding systems (e.g., Affiliation; Intimacy) Demographics (e.g., Mothers’ feeding habits during infancy (more or less principled), moderated by gender & age) Self-reported behaviors (e.g., Reported positive relationships with others; Divorce, family fights in last year; Drug use) Personality measures (e.g., Impulsivity; Locus of Control)

Validity Assessment & CATA Short et al. (2010) provides a model for validity and CATA, using tests of a new dictionary for “entrepreneurial orientation” Content Validity Deductive Inductive External Validity Reliability Dimensionality (a type of Construct Validity--Discriminant) Predictive Validity (seems to really be Construct Validity— Convergent)