Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.

Slides:



Advertisements
Similar presentations
Standardized Scales.
Advertisements

“If a thing exists, it exists in some amount; and if it exists in some amount, it can be measured.” –E. L. Thorndike (1914)
Conceptualization and Measurement
Testing Theories: Three Reasons Why Data Might not Match the Theory.
Quiz Do random errors accumulate? Name 2 ways to minimize the effect of random error in your data set.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Review of the Basic Logic of NHST Significance tests are used to accept or reject the null hypothesis. This is done by studying the sampling distribution.
Sociology 690 – Data Analysis Simple Quantitative Data Analysis.
Reliability, the Properties of Random Errors, and Composite Scores.
Part III: Designing Psychological Research In Part II of the course, we discussed what it means to measure psychological variables, and how to do so.
Data Analysis Outline What is an experiment? What are independent vs. dependent variables in an experimental study? What are our dependent measures/variables.
Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.
Beginning the Research Design
When Measurement Models and Factor Models Conflict: Maximizing Internal Consistency James M. Graham, Ph.D. Western Washington University ABSTRACT: The.
Quiz Name one latent variable Name 2 manifest variables that are indicators for the latent variable.
The Game of Algebra or The Other Side of Arithmetic The Game of Algebra or The Other Side of Arithmetic © 2007 Herbert I. Gross by Herbert I. Gross & Richard.
Measurement of Abstract Concepts Edgar Degas: Madame Valpincon with Chrysantehmums, 1865.
Standard Error of the Mean
Standard Error and Research Methods
Chapter 1: Introduction to Statistics
LEARNING PROGRAMME Hypothesis testing Intermediate Training in Quantitative Analysis Bangkok November 2007.
1 Psych 5500/6500 Chi-Square (Part Two) Test for Association Fall, 2008.
Theory testing Part of what differentiates science from non-science is the process of theory testing. When a theory has been articulated carefully, it.
1 Today Null and alternative hypotheses 1- and 2-tailed tests Regions of rejection Sampling distributions The Central Limit Theorem Standard errors z-tests.
Testing Theories: Three Reasons Why Data Might not Match the Theory Psych 437.
Evidence Based Medicine
Goals for Today Review the basics of an experiment Learn how to create a unit-weighted composite variable and how/why it is used in psychology. Learn how.
Experimental Research Methods in Language Learning Chapter 2 Experimental Research Basics.
1 Psych 5500/6500 t Test for Two Independent Means Fall, 2008.
Multiplying Whole Numbers © Math As A Second Language All Rights Reserved next #5 Taking the Fear out of Math 9 × 9 81 Single Digit Multiplication.
Multiple linear indicators A better scenario, but one that is more challenging to use, is to work with multiple linear indicators. Example: Attraction.
Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.
Methodological Problems in Cognitive Psychology David Danks Institute for Human & Machine Cognition January 10, 2003.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Multiple linear indicators A better scenario, but one that is more challenging to use, is to work with multiple linear indicators. Example: Attraction.
Operational definitions and latent variables As we discussed in our last class, many psychological variables of interest cannot be directly observed These.
The Practice of Statistics
Mixed Numbers and Percents © Math As A Second Language All Rights Reserved next #7 Taking the Fear out of Math 275%
Reliability, the Properties of Random Errors, and Composite Scores Week 7, Psych R. Chris Fraley
Univariate Descriptive Research Recall that the objective of univariate descriptive research is to describe a single psychological variable.
The Commutative Property Using Tiles © Math As A Second Language All Rights Reserved next #4 Taking the Fear out of Math.
The Theory of Sampling and Measurement. Sampling First step in implementing any research design is to create a sample. First step in implementing any.
Part II: Measuring Psychological Variables In the last section, we discussed reasons why scientific approaches to understanding psychology may be useful.
SEM Basics 2 Byrne Chapter 2 Kline pg 7-15, 50-51, ,
Variables It is very important in research to see variables, define them, and control or measure them.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Conceptualization, Operationalization and Measurement Concepts, Levels of Measurement, and Measurement Validity.
Copyright © 2009 Pearson Education, Inc. 8.1 Sampling Distributions LEARNING GOAL Understand the fundamental ideas of sampling distributions and how the.
Answering Descriptive Questions in Multivariate Research When we are studying more than one variable, we are typically asking one (or more) of the following.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Outline of Today’s Discussion 1.The Chi-Square Test of Independence 2.The Chi-Square Test of Goodness of Fit.
Reliability a measure is reliable if it gives the same information every time it is used. reliability is assessed by a number – typically a correlation.
Research Methodology. Topics of Discussion Variable Measurement.
T-tests Chi-square Seminar 7. The previous week… We examined the z-test and one-sample t-test. Psychologists seldom use them, but they are useful to understand.
Plenary 3. So how do we decide what to teach? You might be inspired by an approach you see potential in. Here’s an example very popular in some places.
MBF1413 | Quantitative Methods Prepared by Dr Khairul Anuar 8: Time Series Analysis & Forecasting – Part 1
The inference and accuracy We learned how to estimate the probability that the percentage of some subjects in the sample would be in a given interval by.
The accuracy of averages We learned how to make inference from the sample to the population: Counting the percentages. Here we begin to learn how to make.
Lesson 3 Measurement and Scaling. Case: “What is performance?” brandesign.co.za.
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
Statistical Concepts Basic Principles An Overview of Today’s Class What: Inductive inference on characterizing a population Why : How will doing this allow.
Classical Test Theory Psych DeShon. Big Picture To make good decisions, you must know how much error is in the data upon which the decisions are.
32931 Technology Research Methods Autumn 2017 Quantitative Research Component Topic 4: Bivariate Analysis (Contingency Analysis and Regression Analysis)

In other words the relationship between variables
Theme 4 Describing Variables Numerically
Inference for Proportions
Part III: Designing Psychological Research
Reliability, the Properties of Random Errors, and Composite Scores
Psychological Measurement: Reliability and the Properties of Random Errors The last two lectures were concerned with some basics of psychological measurement:
Presentation transcript:

Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement used for categorical and continuous variables.

Simple Example Today we’re going to discuss operational definitions. Let’s begin by assuming we’re interested in the question of whether the use of cell phones while driving impairs safe driving.

Definition of an Operational Definition There are many ways we could potentially measure “safe driving” –Examples It is critical that the set of rules, or operations, that we use to measure a variable be as explicit, concrete, and as quantifiable as possible. These rules, or operations, constitute the operational definition of a variable.

Complex Example Safe driving is a relatively simple example because it doesn’t involve references to abstract concepts. Now let’s consider a more complex, abstract variable: psychological distress.

Important Distinction Latent vs. Observed variables –An observed variable, like using a cell phone, is directly observable and can be measured relatively easily once observers agree upon what counts as an instance of using a cell phone and what does not. –A latent variable or construct, such as stress, is not directly observable. Instead, it is inferred from variables that can be observed.

Measuring Latent Variables Latent variables can be measured, but their measurement is much more complicated than that of observed variables. The first thing we need to do is identify the indicators of the latent variable (i.e., the observable consequences or manifestations of the latent variable).

Measuring Latent Variables Let’s answer the following question: Someone who is distressed should be likely to do the following things: __________. These things—which also need to be operationally defined—can be considered observable indicators of the unobserved state of stress.

Measuring Latent Variables Let’s focus on one potential indicator for the moment: The number of things a person has to do by Friday—a “to do” list. We could operationalize this in a relatively simple way by asking people “How many things do you need to do before Friday?” and recording the response. The answer essentially becomes the person’s score on the latent variable: an equivalence relationship.

Stress Number of things to do by Friday For each extra task, we assume the person is more distressed. Someone who has 8 things to do would get a stress score of 8.

PersonNumb of things to do Latent score estimate Prof. Fraley 13 b c d e

Equivalence Relationship Advantages: –Explicit and straight-forward –Doesn’t require complicated mathematics –Other researchers can easily determine what you did Disadvantages: –Behaviors are influenced by many things. Thus, the indicator (e.g., “things to do”) might be a better measure of “being employed” rather than “stress” per se. –Latent variables manifest themselves in a variety of ways. By focusing on one indicator, our measurements are not as rich or compelling.

Multiple indicators A more ideal situation is to use multiple indicators to assess a latent variable. Example: Stress

stress heart ratecomplaintsTo do list We assume that when someone is experiencing stress (a latent variable), that person is more likely to have an increased heart rate, complain more, and report having more things to do (all of these need to be operationally defined).

PersonIndicator 1 complaints Indicator 2 To do list Average Prof. Fraley b c d e

Multiple indicators: Caution When using multiple indicators, there is a temptation to average the observed scores to scale people on the construct Example: (complaints + heart rate)/2 = stress Person A: (2 + 80)/2 = 82/2 = 41 Person B: ( )/2 = 123/2 = 62

Multiple linear indicators: Caution This can lead to several problems if each manifest variable is measured on a different scale. First, the resulting metric for the latent variable doesn’t make much sense. Person A: 2 complaints + 80 beats per minute = 41 complaints/beats per minute???

Multiple linear indicators: Caution Second, the variables may have different ranges. If this is true, then some indicators will “count” more than others.

Multiple linear indicators: Caution Variables with a large range will influence the latent score more than variable with a small range PersonHeart rate Complaints Average A80241 B80342 C D * Moving between lowest to highest scores matters more for one variable than the other * Heart rate has a greater range than time spent talking and, therefore, influences the total score more (i.e., the score on the latent variable)

Mapping One solution to this problem is to (a) define a metric for the latent variable and (b) formalize the mapping of the indicator onto the latent variable. Mapping—specifying the relationship between the latent and manifest/observed variable.

stress heart beat /10 stress Complaints stress Sleep problems In our example we might assume that stress is on an interval metric, with values ranging between -4 and + 4. Note, however, that each observed variable has a different metric (one is heart beats per minute, another is number of complaints). Thus, we need to specify how the measured scores translate into the latent scores.

Allow the lowest measured value to represent the lowest value of the latent variable. Allow the highest measured value to represent the highest value of the latent variable. Draw a line between these points to map the relationship between the observed and latent variable. Latent Observed

Stress heart beat / 10 Stress Complaints Stress Things to do Now we can map the observed scores for each measured variable onto the scale for the latent variable. For example, the observed heart rate score of 120 maps onto a stress score of 2. Ten complaints over a week maps onto a stress score of zero. Thirteen things to do maps to a high stress score of 3.

attraction heart beat/10 attraction talking attraction phone calls This mapping process provides us with three estimates of the latent stress score: 2, 0, and 3. Because we are trying to estimate a single number for stress and because these numbers are on the same scale, we can simply average these three estimates to obtain our measurement of attraction. In this example: ( )/3 = 5/3 = 1.67 (somewhat stressed)

Estimating latent scores PersonIndicator 1 (complaints) Latent score estimate 1 Indicator 2 (to do list) Latent score estimate 2 Averaged latent score Prof. Fraley (0+3)/2 = 1.5 b c d e

Multiple indicators Advantages –By using multiple indicators, the uniqueness of each indicator gets washed out by what is common to all of the indicators. ( example: heart rate and running up the stairs ) Disadvantages –More complex to use –There is more than one way to scale the latent variable, thus, unless a scientist is very explicit, you might not know exactly what he or she did to obtain the measurements.

Summary Recap of what we did –Identified two (or more) indicators of the latent variable and operationally defined those. –Determined the metric of the latent variable –Mapped the relationship between the latent variable and each observed variable –Using this mapping, we calculated the latent scores for each person with each observed variable. –Averaged the latent score estimates for each person to get a single estimate of where that person falls on the latent variable. –This is often called a “composite score” and is used as an estimate of the person’s standing on the latent variable of interest.