Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.

Slides:



Advertisements
Similar presentations
Copyright 2005, Prentice Hall, Sarafino
Advertisements

Standardized Scales.
Chapter 8 Flashcards.
“If a thing exists, it exists in some amount; and if it exists in some amount, it can be measured.” –E. L. Thorndike (1914)
How good are our measurements? The last three lectures were concerned with some basics of psychological measurement: What does it mean to quantify a psychological.
Data Analysis Using R: 2. Descriptive Statistics Tuan V. Nguyen Garvan Institute of Medical Research, Sydney, Australia.
Conceptualization and Measurement
Some (Simplified) Steps for Creating a Personality Questionnaire Generate an item pool Administer the items to a sample of people Assess the uni-dimensionality.
Quiz Do random errors accumulate? Name 2 ways to minimize the effect of random error in your data set.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Quantum One: Lecture Postulate II 3 Observables of Quantum Mechanical Systems 4.
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 13 Nonlinear and Multiple Regression.
Reliability, the Properties of Random Errors, and Composite Scores.
Data Analysis Outline What is an experiment? What are independent vs. dependent variables in an experimental study? What are our dependent measures/variables.
Zakaria A. Khamis GE 2110 GEOGRAPHICAL STATISTICS GE 2110.
1 Single Indicator & Composite Measures UAPP 702: Research Design for Urban & Public Policy Based on notes by Steven W. Peuquet. Ph.D.
(Hierarchical) Log-Linear Models Friday 18 th March 2011.
5.5 Solution Possibilities
Common Factor Analysis “World View” of PC vs. CF Choosing between PC and CF PAF -- most common kind of CF Communality & Communality Estimation Common Factor.
Role and Place of Statistical Data Analysis and very simple applications Simplified diagram of scientific research When you know the system: Estimation.
Role and Place of Statistical Data Analysis and very simple applications Simplified diagram of a scientific research When you know the system: Estimation.
Role and Place of Statistical Data Analysis and very simple applications Simplified diagram of a scientific research When you know the system: Estimation.
Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.
Latent variables in psychology and social sciences: theoretical positions, assumptions, and methodological conundrums Alina Zlati.
Quiz Name one latent variable Name 2 manifest variables that are indicators for the latent variable.
Measurement of Abstract Concepts Edgar Degas: Madame Valpincon with Chrysantehmums, 1865.
1 COMM 301: Empirical Research in Communication Kwan M Lee Lect3_1.
Measuring Social Life Ch. 5, pp
Chapter 1: Introduction to Statistics
Goals for Today Review the basics of an experiment Learn how to create a unit-weighted composite variable and how/why it is used in psychology. Learn how.
Non-parametric Tests. With histograms like these, there really isn’t a need to perform the Shapiro-Wilk tests!
Experimental Research Methods in Language Learning Chapter 2 Experimental Research Basics.
1 Lesson 3: Choosing from distributions Theory: LLN and Central Limit Theorem Theory: LLN and Central Limit Theorem Choosing from distributions Choosing.
CH. 8 MEASUREMENT OF VARIABLES: OPERATIONAL DEFINITION AND SCALES
1 Psych 5510/6510 Chapter 10. Interactions and Polynomial Regression: Models with Products of Continuous Predictors Spring, 2009.
The Examination of Residuals. Examination of Residuals The fitting of models to data is done using an iterative approach. The first step is to fit a simple.
Multiple linear indicators A better scenario, but one that is more challenging to use, is to work with multiple linear indicators. Example: Attraction.
Classroom Assessment A Practical Guide for Educators by Craig A. Mertler Chapter 13 Assessing Affective Characteristics.
ANOVA and Linear Regression ScWk 242 – Week 13 Slides.
Variables and their Operational Definitions
Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.
Methodological Problems in Cognitive Psychology David Danks Institute for Human & Machine Cognition January 10, 2003.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Multiple linear indicators A better scenario, but one that is more challenging to use, is to work with multiple linear indicators. Example: Attraction.
Operational definitions and latent variables As we discussed in our last class, many psychological variables of interest cannot be directly observed These.
Issues in Estimation Data Generating Process:
The Practice of Statistics
Reliability, the Properties of Random Errors, and Composite Scores Week 7, Psych R. Chris Fraley
Three Frameworks for Statistical Analysis. Sample Design Forest, N=6 Field, N=4 Count ant nests per quadrat.
1 Overview of Experimental Design. 2 3 Examples of Experimental Designs.
Part II: Measuring Psychological Variables In the last section, we discussed reasons why scientific approaches to understanding psychology may be useful.
Stats 845 Applied Statistics. This Course will cover: 1.Regression –Non Linear Regression –Multiple Regression 2.Analysis of Variance and Experimental.
Scaling and Index Construction
SEM Basics 2 Byrne Chapter 2 Kline pg 7-15, 50-51, ,
Chapter 8: Simple Linear Regression Yang Zhenlin.
Education 795 Class Notes Factor Analysis Note set 6.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Answering Descriptive Questions in Multivariate Research When we are studying more than one variable, we are typically asking one (or more) of the following.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Chapter 6 - Standardized Measurement and Assessment
University of Warwick, Department of Sociology, 2012/13 SO 201: SSAASS (Surveys and Statistics) (Richard Lampard) Logistic Regression II/ (Hierarchical)
BIOL 582 Lecture Set 2 Inferential Statistics, Hypotheses, and Resampling.
Classical Test Theory Psych DeShon. Big Picture To make good decisions, you must know how much error is in the data upon which the decisions are.
Determining Levels, Understanding Constructs
Quantum One.
Reliability, the Properties of Random Errors, and Composite Scores
Dr. Debaleena Chattopadhyay Department of Computer Science
Psychological Measurement: Reliability and the Properties of Random Errors The last two lectures were concerned with some basics of psychological measurement:
Graph Review Skills Needed Identify the relationship in the graph
Cases. Simple Regression Linear Multiple Regression.
Presentation transcript:

Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement used for categorical and continuous variables. However, we deliberately side-stepped an important question: How do we determine “what matters” when we try to measure a variable?

Simple Example Let’s consider a relatively simple example: Let’s try to measure crying. Before we can do so, we need to decide “what counts” as crying behavior. What examples come to mind?

Definition of an Operational Definition It is critical that the set of rules, or operations, that we use to measure a behavior be as explicit and clear-cut as possible. These rules, or operations, constitute the operational definition of a variable.

Complex Example Now let’s consider a more complex variable: the experience of humor. Whether or not someone finds something funny is a much more challenging (i.e., less tangible) thing to measure than crying. In-Class Example: Two sets of operational definitions, and three students listening to jokes.

Important Distinction Latent vs. Observed variables –An observed variable, like crying, is directly observable and can be measured relatively easily once observers agree upon what counts as an instance of crying and what does not. –A latent variable or construct is not directly observable. Instead, it is inferred from variables that can be observed.

Measuring Latent Variables Latent variables can be measured, but their measurement is much more complicated than that of observed variables. The first thing we need to do is identify, usually on an intuitive or theoretical basis, the scale of the latent variable. Is it categorical or continuous? If continuous, should we scale it on an interval metric or a ratio metric? Next, we need to identify the indicators of the latent variable (i.e., the observable consequences or manifestations of the latent variable).

Measuring Latent Variables Let’s answer the following question: Someone who finds something funny should be likely to behave in the following ways: __________. These things (e.g., laughing)—which also need to be operationally defined—can be considered observable indicators of the unobserved state of “finding something humorous.”

Measuring Latent Variables So, to operationally define a latent variable, we need to –specify the scale of the variable, –identify the observable manifestations of that latent variable –operationally define those observable manifestations. Next, we need to know how the operational definitions of the observable variables map onto the latent variable.

Mapping Mapping—specifying the relationship between the latent and manifest variable— tends to be handled differently by different researchers. Two considerations: –How many indicators to use? –Can we assume a linear relationship between the measured variables and the latent variable?

> 1One Linear Nonlinear Multiple non- linear indicators (Very Complex) Single non- linear relationship (Complex) Multiple linear indicators (Simple) Equivalence relation (Simplest) How many indicators? Mathematical Mapping

Equivalence Relationship Simplest case: The equivalence relationship. In this case, we use one indicator and assume that the relation between the latent variable and the manifest variable is linear. The scale of the latent variable is identical to the scale chosen for the manifest variable. Example: We may operationally define laughing, and then measure humor as if it is equal to laughing.

Humor Laughing For each extra laugh, we assume the person thought the joke was one unit more funny Someone who laughs 8 times would get a humor score of 8.

Equivalence Relationship Advantages: –Explicit and straight-forward –Doesn’t require complicated mathematics –Other researchers can easily determine what you did Disadvantages: –Behaviors are influenced by many things. Thus, part of what you’re measuring may be unrelated to the latent variable of interest. –Latent variables manifest themselves in a variety of ways. By focusing on one variable, our measurements are not as rich or compelling.