Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.

Slides:



Advertisements
Similar presentations
Standardized Scales.
Advertisements

Chapter 8 Flashcards.
“If a thing exists, it exists in some amount; and if it exists in some amount, it can be measured.” –E. L. Thorndike (1914)
How good are our measurements? The last three lectures were concerned with some basics of psychological measurement: What does it mean to quantify a psychological.
Objectives 10.1 Simple linear regression
Situation Calculus for Action Descriptions We talked about STRIPS representations for actions. Another common representation is called the Situation Calculus.
Conceptualization and Measurement
Quiz Do random errors accumulate? Name 2 ways to minimize the effect of random error in your data set.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
TYPES OF DATA. Qualitative vs. Quantitative Data A qualitative variable is one in which the “true” or naturally occurring levels or categories taken by.
3.2 OLS Fitted Values and Residuals -after obtaining OLS estimates, we can then obtain fitted or predicted values for y: -given our actual and predicted.
Quantum One: Lecture Postulate II 3 Observables of Quantum Mechanical Systems 4.
Review of the Basic Logic of NHST Significance tests are used to accept or reject the null hypothesis. This is done by studying the sampling distribution.
Psy B07 Chapter 6Slide 1 CATEGORICAL DATA & χ 2. Psy B07 Chapter 6Slide 2 A Quick Look Back  Reminder about hypothesis testing: 1) Assume what you believe.
Reliability, the Properties of Random Errors, and Composite Scores.
Part III: Designing Psychological Research In Part II of the course, we discussed what it means to measure psychological variables, and how to do so.
Data Analysis Outline What is an experiment? What are independent vs. dependent variables in an experimental study? What are our dependent measures/variables.
Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.
Histograms. Definition of a Histogram A Histogram displays a range of values of a variable that have been broken into groups or intervals. Histograms.
Zakaria A. Khamis GE 2110 GEOGRAPHICAL STATISTICS GE 2110.
The Game of Algebra or The Other Side of Arithmetic The Game of Algebra or The Other Side of Arithmetic © 2007 Herbert I. Gross By Herbert I. Gross & Richard.
Comp 205: Comparative Programming Languages Semantics of Imperative Programming Languages denotational semantics operational semantics logical semantics.
Copyright 2004 David J. Lilja1 What Do All of These Means Mean? Indices of central tendency Sample mean Median Mode Other means Arithmetic Harmonic Geometric.
Research Methods in MIS
When Measurement Models and Factor Models Conflict: Maximizing Internal Consistency James M. Graham, Ph.D. Western Washington University ABSTRACT: The.
Intro to Statistics for the Behavioral Sciences PSYC 1900 Lecture 10: Hypothesis Tests for Two Means: Related & Independent Samples.
The Basics of Regression continued
Item Response Theory. Shortcomings of Classical True Score Model Sample dependence Limitation to the specific test situation. Dependence on the parallel.
Importing our Web data and Answering Descriptive Questions about Single Variables Psych 437.
Analysis of Individual Variables Descriptive – –Measures of Central Tendency Mean – Average score of distribution (1 st moment) Median – Middle score (50.
Role and Place of Statistical Data Analysis and very simple applications Simplified diagram of a scientific research When you know the system: Estimation.
Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.
Latent variables in psychology and social sciences: theoretical positions, assumptions, and methodological conundrums Alina Zlati.
Quiz Name one latent variable Name 2 manifest variables that are indicators for the latent variable.
Measurement of Abstract Concepts Edgar Degas: Madame Valpincon with Chrysantehmums, 1865.
Algebra Problems… Solutions
Three Common Misinterpretations of Significance Tests and p-values 1. The p-value indicates the probability that the results are due to sampling error.
Chapter 1: Introduction to Statistics
Quantitative vs. Categorical Data
Determining Sample Size
Developing Personal Identity & Character
Testing Theories: Three Reasons Why Data Might not Match the Theory Psych 437.
Goals for Today Review the basics of an experiment Learn how to create a unit-weighted composite variable and how/why it is used in psychology. Learn how.
Advanced Business Research Method Intructor : Prof. Feng-Hui Huang Agung D. Buchdadi DA21G201.
Experimental Research Methods in Language Learning Chapter 2 Experimental Research Basics.
1 Psych 5500/6500 t Test for Two Independent Means Fall, 2008.
Multiple linear indicators A better scenario, but one that is more challenging to use, is to work with multiple linear indicators. Example: Attraction.
Operational Definitions Science requires observation of variables Some variables are easy to observe or measure. –Height –Weight But most variables that.
Methodological Problems in Cognitive Psychology David Danks Institute for Human & Machine Cognition January 10, 2003.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Multiple linear indicators A better scenario, but one that is more challenging to use, is to work with multiple linear indicators. Example: Attraction.
Operational definitions and latent variables As we discussed in our last class, many psychological variables of interest cannot be directly observed These.
University of Windsor School of Computer Science Topics in Artificial Intelligence Fall 2008 Sept 11, 2008.
Discussion of time series and panel models
Mixed Numbers and Percents © Math As A Second Language All Rights Reserved next #7 Taking the Fear out of Math 275%
Reliability, the Properties of Random Errors, and Composite Scores Week 7, Psych R. Chris Fraley
Part II: Measuring Psychological Variables In the last section, we discussed reasons why scientific approaches to understanding psychology may be useful.
SEM Basics 2 Byrne Chapter 2 Kline pg 7-15, 50-51, ,
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Answering Descriptive Questions in Multivariate Research When we are studying more than one variable, we are typically asking one (or more) of the following.
Psychology 3051 Psychology 305: Theories of Personality Lecture 1.
Chapter 6 - Standardized Measurement and Assessment
Outline of Today’s Discussion 1.The Chi-Square Test of Independence 2.The Chi-Square Test of Goodness of Fit.
Principal Component Analysis
T-tests Chi-square Seminar 7. The previous week… We examined the z-test and one-sample t-test. Psychologists seldom use them, but they are useful to understand.
Measures of Central Tendency: Just an Average Topic in Statistics.
Part III: Designing Psychological Research
Reliability, the Properties of Random Errors, and Composite Scores
Subscript and Summation Notation
Psychological Measurement: Reliability and the Properties of Random Errors The last two lectures were concerned with some basics of psychological measurement:
Presentation transcript:

Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement used for categorical and continuous variables. However, we deliberately side-stepped an important question: How do we determine “what matters” when we try to measure a variable?

Simple Example Let’s consider a relatively simple example: Let’s try to measure crying. Before we can do so, we need to decide “what counts” as crying behavior. Examples:

Definition of an Operational Definition It is critical that the set of rules, or operations, that we use to measure a behavior be explicit and as clear-cut as possible. These rules, or operations, constitute the operational definition of a variable.

Complex Example Now let’s consider a more complex variable: the experience of humor. Whether or not someone finds something funny is a much more abstract (i.e., less tangible) thing to measure than crying. In-Class Example: Two sets of operational definitions, and three students listening to jokes.

Important Distinction Latent vs. Observed variables –An observed variable, like crying, is directly observable and can be measured easily. –A latent variable or construct is not directly observable. Instead, it is inferred from variables than can be observed.

Measuring Latent Variables Latent variables can be measured, but their measurement is much more complicated than that of observed variables. The first thing we need to do is identify, usually on an intuitive or theoretical basis, the scale of the latent variable. Is it categorical or continuous? Next, we need to identify the indicators of the latent variable (i.e., the observable consequences or manifestations of the latent variable).

Measuring Latent Variables Let’s answer the following question: Someone who finds something funny should be likely to behave in the following ways: __________. These things (e.g., laughing), operationally defined, of course, can be considered as observable indicators of the unobserved state of “finding something humorous.”

Measuring Latent Variables So, to operationally define a latent variable, we need to (a) specify the scale of the variable, (b) identify the observable manifestations of that latent variable, and (c) operationally define those observable manifestations. Next, we need to know how the operational definitions of the observable variables map onto the latent variable.

Mapping This mapping tends to be handled differently by different researchers. Two considerations: –How many indicators to use? –Can we assume a linear relationship between the measured variables and the latent variable?

> 1One Linear Nonlinear Multiple non- linear indicators (Very Complex) Single non- linear relationship (Complex) Multiple linear indicators (Simple) Equivalence relation (Simplest) How many indicators? Mathematical Mapping

Equivalence Relationship Simplest case: The equivalence relationship. In this case, we use one indicator and assume that the relation between the latent variable and the manifest variable is linear. Example: We may operationally define laughing, and then measure humor as if it is equal to laughing.

Humor Laughing For each extra laugh, we assume the person thought the joke was one unit more funny Someone who laughs 8 times would get a humor score of 8.

Equivalence Relationship Advantages: –Explicit and straight-forward –Doesn’t require complicated mathematics –Other researchers can easily determine what you did Disadvantages: –Behaviors are influenced by many things. Thus, part of what you’re measuring may be unrelated to the latent variable of interest. –Latent variables manifest themselves in a variety of ways. By focusing on one variable, our measurements are not as rich or compelling.

Multiple linear indicators A better scenario, but more difficult to work with, is to use multiple indicators under the assumption of a linear relationship. Example: Attraction

attraction heart beattalkingphone calls We assume that when someone is attracted to someone else (a latent variable), that person is more likely to have an increased heart rate, talk more, and make more phone calls (all observable variables).

attraction heart beat attraction talking attraction phone calls We assume that each observed variable has a linear relationship with the latent variable. Note, however, that each observed variable has a different metric (one is heart beats per minute, another is time spent talking). Thus, we need a different metric for the latent variable.

allow the lowest measured value to represent the lowest value of the latent variable allow the highest measured value to represent the highest value of the latent variable the line between these points maps the relationship between them Latent Observed

attraction heart beat attraction talking attraction phone calls After the relationship has been specified between the latent variable and each measured variable, the latent scores for each measured variable can be averaged to scale the person on the latent variable. In this example: ( )/3 = 5/3 = 1.67

Multiple linear indicators Advantages –By using multiple indicators, the uniqueness of each one gets washed out by what is common to each of them Disadvantages –More complex to use –There is more than one way to scale the latent variable, thus, unless a scientist is very explicit, you might not know exactly what was done to obtain the measurements.

Multiple linear indicators: Caution On that last note, I should mention an important problem. When using multiple indicators, researchers typically sum or average the scores to scale people on the construct Example: time spent talking + heart rate = LOVE Person A: = 82 Person B: = 123

Multiple linear indicators: Caution Why may this be a problem? First, the resulting metric for the latent variable doesn’t make much sense. Person A: 2 minutes talking + 80 beats per minute = 82 minutes talking/beats per minute???

Multiple linear indicators: Caution Second, the variables may have different ranges. If this is true, then some indicators will count more than others.

Multiple linear indicators: Caution Variables with a large range will influence the latent score more than variable with a small range PersonHeart rate Time spent talking Total A80282 B80383 C D * Heart rate has a greater range than time spent talking and, therefore, influences the total score more (i.e., the score on the latent variable)

Operational Definitions In psychology, there is an interesting assortment of variables that we try to measure Some variables are concrete and observable (e.g., kissing); others are abstract (e.g., love)