Causal inferences This week we have been discussing ways to make inferences about the causal relationships between variables. One of the strongest ways.

Slides:



Advertisements
Similar presentations
Lecture 2 The Science of Psychology
Advertisements

Making Inferences about Causality In general, children who watch violent television programs tend to behave more aggressively toward their peers and siblings.
Making Inferences about Causality In general, children who watch violent television programs tend to behave more aggressively toward their peers and siblings.
Testing Theories: Three Reasons Why Data Might not Match the Theory.
Experimentation. Variables Variable = an aspect of events or things that differs according to the particular event or thing being considered but has a.
Linear Regression and Binary Variables The independent variable does not necessarily need to be continuous. If the independent variable is binary (e.g.,
1 Language of Research Partially Adapted from: 1. The Research Methods Knowledge Base, William Trochim (2006). 2. Methods for Social Researchers in Developing.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
PHSSR IG CyberSeminar Introductory Remarks Bryan Dowd Division of Health Policy and Management School of Public Health University of Minnesota.
Correlation AND EXPERIMENTAL DESIGN
Studying Behavior. Midterm Review Session The TAs will conduct the review session on Wednesday, October 15 th. If you have questions, your TA and.
47.269: Research I: The Basics Dr. Leonard Spring 2010
Non-Experimental designs: Developmental designs & Small-N designs
N The Experimental procedure involves manipulating something called the Explanatory Variable and seeing the effect on something called the Outcome Variable.
EXPERIMENTS AND OBSERVATIONAL STUDIES Chance Hofmann and Nick Quigley
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
Standard Error of the Mean
Chapter 8 Experimental Research
Chapter 2: The Research Enterprise in Psychology
1 Psych 5500/6500 Confounding Variables Fall, 2008.
Theory testing Part of what differentiates science from non-science is the process of theory testing. When a theory has been articulated carefully, it.
Copyright © 2010 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
Experiments and Observational Studies. Observational Studies In an observational study, researchers don’t assign choices; they simply observe them. look.
Copyright © 2010 Pearson Education, Inc. Slide
Chapter 13 Notes Observational Studies and Experimental Design
Chapter 13 Observational Studies & Experimental Design.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 13 Experiments and Observational Studies.
Final Study Guide Research Design. Experimental Research.
Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.
Experimental Research Validity and Confounds. What is it? Systematic inquiry that is characterized by: Systematic inquiry that is characterized by: An.
Chapter 1: The Research Enterprise in Psychology.
Chapter 10 Experimental Research: One-Way Designs.
The Research Enterprise in Psychology. The Scientific Method: Terminology Operational definitions are used to clarify precisely what is meant by each.
Experimental Research Methods in Language Learning Chapter 2 Experimental Research Basics.
Scientific Research Methods in Geography
SLWK – 609 Research Methods- online- M. Secret Podcast 5 BASIC CONCEPTS OF RESEARCH DESIGN
Module 4 Notes Research Methods. Let’s Discuss! Why is Research Important?
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
Techniques of research control: -Extraneous variables (confounding) are: The variables which could have an unwanted effect on the dependent variable under.
Causal inferences During the last two lectures we have been discussing ways to make inferences about the causal relationships between variables. One of.
Between groups designs (2) – outline 1.Block randomization 2.Natural groups designs 3.Subject loss 4.Some unsatisfactory alternatives to true experiments.
Testing Theories: The Problem of Sampling Error. The problem of sampling error It is often the case—especially when making point predictions—that what.
Section 7.4 ~ The Search for Causality Introduction to Probability and Statistics Ms. Young.
STUDYING BEHAVIOR © 2009 The McGraw-Hill Companies, Inc.
Copyright © 2010 Pearson Education. All rights reserved. Chapter 2 Methodology: How Social Psychologists Do Research.
It gives reliable and systematic ways to answer psychological questions like: How do I analyze dreams? Why are boys so weird? Other sources of info like.
CHAPTER 4 – RESEARCH METHODS Psychology 110. How Do We Know What We Know? You can know something because a friend told you You can know something because.
Causal inferences Most of the analyses we have been performing involve studying the association between two or more variables. We often conduct these kinds.
Research Strategies. Why is Research Important? Answer in complete sentences in your bell work spiral. Discuss the consequences of good or poor research.
Chapter 10 Finding Relationships Among Variables: Non-Experimental Research.
Psy 311: Methods1 GOALS OF DEVELOPMENTAL PSYCHOLOGY l Describe, explain, and optimize human development.
C82MST Statistical Methods 2 - Lecture 1 1 Overview of Course Lecturers Dr Peter Bibby Prof Eamonn Ferguson Course Part I - Anova and related methods (Semester.
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
CORRELATIONS: PART II. Overview  Interpreting Correlations: p-values  Challenges in Observational Research  Correlations reduced by poor psychometrics.
Aim: What factors must we consider to make an experimental design?
Chapter Two Methods in the Study of Personality. Gathering Information About Personality Informal Sources of Information: Observations of Self—Introspection,
Experimental and Ex Post Facto Designs
Chapter 13: Part III AP Statistics.
Producing Data: Experiments BPS - 5th Ed. Chapter 9 1.
Making Inferences about Causality In general, children who watch violent television programs tend to behave more aggressively toward their peers and siblings.
4.1 Statistics Notes Should We Experiment or Should We Merely Observe?
Non-Experimental Design Where are the beakers??. Cautions A relationship between two variables does NOT mean one causes the other (Think about the correlation.
Chapter 10: The Nuts and Bolts of correlational studies.
Chapter 8 Control.
EXPERIMENTAL RESEARCH
Chapter 4: Studying Behavior
RESEARCH METHODS Lecture 33
Non-Experimental designs: Correlational & Quasi-experimental designs
Reminder for next week CUELT Conference.
RESEARCH METHODS Lecture 33
Presentation transcript:

Causal inferences This week we have been discussing ways to make inferences about the causal relationships between variables. One of the strongest ways to make causal inferences is to conduct an experiment (i.e., systematically manipulate a variable to study its effect on another).

Causal inferences Unfortunately, we cannot experimentally study a lot of the important questions in personality psychology for practical or ethical reasons. For example, if we’re interested in how people’s prior experiences in close relationships might influence their future relationships, we can’t use an experimental design to manipulate the kinds of relational experiences that people have.

Causal inferences How can we make inferences about causality in these circumstances? There is no fool-proof way of doing so, but today we’ll discuss some techniques that are commonly used. –control by selection –statistical control

Control by selection The biggest problem with inferring causality from correlations is the third variable problem. For any relationship we may study in psychology, there are a number of confounding variables that may interfere with our ability to make the correct causal inference.

Control by selection Stanovich, a psychologist, has described an interesting example involving public versus private schools. It has been established empirically that children attending private schools perform better on standardized tests than children attending public schools. Many people believe that sending children to private schools will help increase test scores. test scores “quality” of school +

Control by selection One of the problems with this inference is that there are other variables that could influence both the kind of school a kid attends and his or her test scores. For example, the financial status of the family is a possible confound. financial status test scores “quality” of school ++

Control by selection Recall that a confounding variable is one that is associated with both the dependent variable (i.e., test scores) and the independent variable (i.e., type of school). Thus, if we can create a situation in which there is no variation in the confounding variable, we can remove its potential effects on the other variables of interest.

Control by selection To do this, we might select a sample of students who come from families with the same financial status. If there is a relationship between “quality” of school and test scores in this sample, then we can be reasonably certain that it is not due to differences in financial status because everyone in the sample has the same financial status.

Control by selection In short, when we control confounds via sample selection, we are identifying possible confounds in advance and controlling them by removing the variability in the possible confound. One limitation of this approach is that it requires that we know in advance all the confounding variables. In an experimental design with random assignment, we don’t have to worry too much about knowing exactly what the confounds could be.

Statistical control Another commonly used method for controlling possible confounds involves statistical techniques, such as multiple regression and partial correlation. In short, this approach is similar to what we just discussed. However, instead of selecting our sample so that there is no variation in the confounding variable, we use statistical techniques that essentially remove the effects of the confounding variable.

Statistical control If you know the correlations among three variables (e.g, X, Y, and Z), you can compute a partial correlation, r YZ.X. A partial correlation characterizes the correlation between two variables (e.g., Y and Z) after statistically removing their association with a third variable (e.g., X).

Statistical control If this diagram represents the “true” state of affairs, then here are correlations we would expect between these three variables: financial status test scores “quality” of school.5 XYZ X1.50 Y 1.25 Z X YZ We expect Y and Z to correlate about.25 even though one doesn’t cause the other.

Statistical control financial status test scores “quality” of school.5 XYZ X1.50 Y 1.25 Z X YZ The partial correlation between Y and Z is 0, suggesting that there is no relationship between these two variables once we control for the confound.

Statistical control What happens if we assume that quality of school does influence student test scores? Here is the implied correlation matrix for this model: financial status test scores “quality” of school.5 XYZ X Y Z 1 X YZ.5

Statistical control financial status test scores “quality” of school.5 XYZ X Y Z 1 X YZ.5 The partial correlation is.65, suggesting that there is still an association between Y and Z after controlling X.

Statistical control Like “control by selection,” statistical control is not a foolproof method. If there are confounds that have not been measured, these can still lead to a correlation between two variables. In short, if one is interested in making causal inferences about the relationship between two variables in a non-experimental context, it is wise to try to statistically control possible confounding variables.