Causal inferences During the last two lectures we have been discussing ways to make inferences about the causal relationships between variables. One of.

Slides:



Advertisements
Similar presentations
Educational Research: Causal-Comparative Studies
Advertisements

Lecture 2 The Science of Psychology
Making Inferences about Causality In general, children who watch violent television programs tend to behave more aggressively toward their peers and siblings.
Making Inferences about Causality In general, children who watch violent television programs tend to behave more aggressively toward their peers and siblings.
Non-experimental Designs
Testing Theories: Three Reasons Why Data Might not Match the Theory.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Statistical Methods Lecture 30
Linear Regression and Binary Variables The independent variable does not necessarily need to be continuous. If the independent variable is binary (e.g.,
1 Language of Research Partially Adapted from: 1. The Research Methods Knowledge Base, William Trochim (2006). 2. Methods for Social Researchers in Developing.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
PHSSR IG CyberSeminar Introductory Remarks Bryan Dowd Division of Health Policy and Management School of Public Health University of Minnesota.
Correlation AND EXPERIMENTAL DESIGN
The Methods of Social Psychology
Studying Behavior. Midterm Review Session The TAs will conduct the review session on Wednesday, October 15 th. If you have questions, your TA and.
Non-Experimental designs: Developmental designs & Small-N designs
The Psychologist as Detective, 4e by Smith/Davis © 2007 Pearson Education Chapter Twelve: Designing, Conducting, Analyzing, and Interpreting Experiments.
N The Experimental procedure involves manipulating something called the Explanatory Variable and seeing the effect on something called the Outcome Variable.
EXPERIMENTS AND OBSERVATIONAL STUDIES Chance Hofmann and Nick Quigley
Experimental Research
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
Standard Error of the Mean
1 Psych 5500/6500 Confounding Variables Fall, 2008.
Theory testing Part of what differentiates science from non-science is the process of theory testing. When a theory has been articulated carefully, it.
Copyright © 2010 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
Experiments and Observational Studies. Observational Studies In an observational study, researchers don’t assign choices; they simply observe them. look.
Copyright © 2010 Pearson Education, Inc. Slide
Chapter 13 Observational Studies & Experimental Design.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 13 Experiments and Observational Studies.
EVAL 6970: Cost Analysis for Evaluation Dr. Chris L. S. Coryn Nick Saxton Fall 2014.
Research methods in adult development
Testing Theories: Three Reasons Why Data Might not Match the Theory Psych 437.
Chapter 8 Experimental Design: Dependent Groups and Mixed Groups Designs.
Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.
Experimental Research Validity and Confounds. What is it? Systematic inquiry that is characterized by: Systematic inquiry that is characterized by: An.
Making decisions about distributions: Introduction to the Null Hypothesis 47:269: Research Methods I Dr. Leonard April 14, 2010.
The Research Enterprise in Psychology. The Scientific Method: Terminology Operational definitions are used to clarify precisely what is meant by each.
Scientific Research Methods in Geography
SLWK – 609 Research Methods- online- M. Secret Podcast 5 BASIC CONCEPTS OF RESEARCH DESIGN
Chapter 9: Causal-Comparative Research
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
Techniques of research control: -Extraneous variables (confounding) are: The variables which could have an unwanted effect on the dependent variable under.
Computer Science Education Debra Lee Davis, M.S., M.A., Ph.D.
Correlational Research Chapter Fifteen Bring Schraw et al.
Testing Theories: The Problem of Sampling Error. The problem of sampling error It is often the case—especially when making point predictions—that what.
Copyright © 2010 Pearson Education. All rights reserved. Chapter 2 Methodology: How Social Psychologists Do Research.
CHAPTER 9: Producing Data: Experiments. Chapter 9 Concepts 2  Observation vs. Experiment  Subjects, Factors, Treatments  How to Experiment Badly 
It gives reliable and systematic ways to answer psychological questions like: How do I analyze dreams? Why are boys so weird? Other sources of info like.
CHAPTER 4 – RESEARCH METHODS Psychology 110. How Do We Know What We Know? You can know something because a friend told you You can know something because.
Causal inferences Most of the analyses we have been performing involve studying the association between two or more variables. We often conduct these kinds.
Chapter 10 Finding Relationships Among Variables: Non-Experimental Research.
Psy 311: Methods1 GOALS OF DEVELOPMENTAL PSYCHOLOGY l Describe, explain, and optimize human development.
SOCW 671: #6 Research Designs Review for 1 st Quiz.
CORRELATIONS: PART II. Overview  Interpreting Correlations: p-values  Challenges in Observational Research  Correlations reduced by poor psychometrics.
Single-Subject and Correlational Research Bring Schraw et al.
Chapter Two Methods in the Study of Personality. Gathering Information About Personality Informal Sources of Information: Observations of Self—Introspection,
Experimental and Ex Post Facto Designs
Causal inferences This week we have been discussing ways to make inferences about the causal relationships between variables. One of the strongest ways.
Making Inferences about Causality In general, children who watch violent television programs tend to behave more aggressively toward their peers and siblings.
Non-Experimental Design Where are the beakers??. Cautions A relationship between two variables does NOT mean one causes the other (Think about the correlation.
Methods of Presenting and Interpreting Information Class 9.
Chapter 8 Control.
EXPERIMENTAL RESEARCH
2 independent Groups Graziano & Raulin (1997).
Experiments and Observational Studies
RESEARCH METHODS Lecture 33
Quasi-Experimental Designs
Non-Experimental designs: Correlational & Quasi-experimental designs
Reminder for next week CUELT Conference.
RESEARCH METHODS Lecture 33
Presentation transcript:

Causal inferences During the last two lectures we have been discussing ways to make inferences about the causal relationships between variables. One of the strongest ways to make causal inferences is to conduct an experiment (i.e., systematically manipulate a variable to study its effect on another).

Causal inferences Unfortunately, we cannot experimentally study a lot of the important questions in psychology for practical or ethical reasons. For example, if we’re interested in how a person’s prior history in close relationships might influence his or her future relationships, we can’t use an experimental design to manipulate the kinds of relational experiences that he or she had.

Causal inferences How can we make inferences about causality in these circumstances? There is no fool-proof way of doing so, but today we’ll discuss some techniques that are commonly used. –control by selection –statistical control

Control by selection The biggest problem with inferring causality from correlations is the third variable problem. For any relationship we may study in psychology, there are a number of confounding variables that may interfere with our ability to make the correct causal inference.

Control by selection Stanovich, a psychologist, has described an interesting example involving public versus private schools. It has been established empirically that children attending private schools perform better on standardized tests than children attending public schools. Many people believe that sending children to private schools will help increase test scores.

Control by selection One of the problems with this inference is that there are other variables that could influence both the kind of school a kid attends and his or her test scores. For example, the financial status of the family is a possible confound. test scores “quality” of school financial status ++

Control by selection Recall that a confounding variable is one that is associated with both the dependent variable (i.e., test scores) and the independent variable (i.e., type of school). Thus, if we can create a situation in which there is no variation in the confounding variable, we can remove its effects on the other variables of interest.

Control by selection To do this, we might select a sample of students who come from families with the same financial status. If there is a relationship between “quality” of school and test scores in this sample, then we can be reasonably certain that it is not due to differences in financial status because everyone in the sample has the same financial status.

Control by selection In short, when we control confounds via sample selection, we are identifying possible confounds in advance and controlling them by removing the variability in the possible confound. One limitation of this approach is that it requires that we know in advance all the confounding variables. In an experimental design with random assignment, we don’t have to worry too much about knowing exactly what the confounds could be.

Statistical control Another commonly used method for controlling possible confounds involves statistical techniques, such as multiple regression and partial correlation. In short, this approach is similar to what we just discussed. However, instead of selecting our sample so that there is no variation in the confounding variable, we use statistical techniques that essentially remove the effects of the confounding variable.

Statistical control If you know the correlations among three variables (e.g, X, Y, and Z), you can compute a partial correlation, r YZ.X. A partial correlation characterizes the correlation between two variables (e.g., Y and Z) after statistically removing their association with a third variable (e.g., X).

Statistical control If this diagram represents the “true” state of affairs, then here are correlations we would expect between these three variables: financial status test scores “quality” of school.5 XYZ X1.50 Y 1.25 Z X YZ We expect Y and Z to correlate about.25 even though one doesn’t cause the other.

Statistical control financial status test scores “quality” of school.5 XYZ X1.50 Y 1.25 Z X YZ The partial correlation between Y and Z is 0, suggesting that there is no relationship between these two variables once we control for the confound.

Statistical control What happens if we assume that quality of school does influence student test scores? Here is the implied correlation matrix for this model: financial status test scores “quality” of school.5.75 XYZ X Y Z 1 X YZ

Statistical control financial status test scores “quality” of school.5.75 XYZ X Y Z 1 X YZ The partial correlation is.65, suggesting that there is still an association between Y and Z after controlling for X.

Statistical control Like “control by selection,” statistical control is not a foolproof method. If there are confounds that have not been measured, these can still lead to a correlation between two variables. In short, if one is interested in making causal inferences about the relationship between two variables in a non-experimental context, it is wise to try to statistically control possible confounding variables.

Directionality and time A second limitation of correlational research for making inferences about causality is the problem of direction. Two variables, X and Y, may be correlated because X causes Y or because Y causes X (or both). Example: In the 1990’s there was a big push in California to increase the self-esteem of children. This initiative was due, in part, to findings showing positive correlations between self-esteem and achievement, ability, etc.

Directionality and time It is possible, however, that self-esteem does not cause achievement. It could be the case that achievement leads to increases in self-esteem. Both of these alternatives (as well as others) would lead to a correlation between self-esteem and achievement.

Directionality and time One of the best ways to deal with the directionality problem non-experimentally is to take measurements at different points in time. Longitudinal research design For example, if we were to measure children’s self- esteem early in the school year and then measure their achievement later in the school year, we could be reasonably confident that the later measure of achievement did not cause self-esteem at an earlier point in time.

self- esteem + achievement + + self- esteem achievement day 1day 2day 3 The combination of a longitudinal design with partial correlation methods is an especially powerful way to begin to separate causal influences in a non-experimental situation.

self- esteem + achievement + + self- esteem achievement day 1day 2day 3 The combination of a longitudinal design with partial correlation methods is an especially powerful way to begin to separate causal influences in a non-experimental situation.

self- esteem + achievement + + self- esteem achievement day 1day 2day 3 The combination of a longitudinal design with partial correlation methods is an especially powerful way to begin to separate causal influences in a non-experimental situation.

Evenings per month at Bars On Line Chat28 not on-line57 on-line68 Quiz a main effect of Evenings at Bars, no main effect of On Line Chat, and no interaction no main effect of Evenings at Bars, a main effect of On Line Chat, and no interaction a main effect of Evenings at Bars, a main effect of On Line Chat, and no interaction a main effect of Evenings at Bars, a main effect of On Line Chat, and an interaction Dates Per Month

Evenings per month at Bars On Line Chat2 Evenings8 Evenings not on-line5 dates7 dates on-line6 dates8 dates Quiz a main effect of Evenings at Bars, no main effect of On Line Chat, and no interaction no main effect of Evenings at Bars, a main effect of On Line Chat, and no interaction a main effect of Evenings at Bars, a main effect of On Line Chat, and no interaction a main effect of Evenings at Bars, a main effect of On Line Chat, and an interaction Dates Per Month