Detecting Causal Relations

Slides:



Advertisements
Similar presentations
Research Methods: How We Do Psychology Forming and Testing Hypotheses Theory Integrated set of principles that explain and predict observed events Hypotheses.
Advertisements

2.6 The Question of Causation. The goal in many studies is to establish a causal link between a change in the explanatory variable and a change in the.
Experimental Design.
Chapter 51 Experiments, Good and Bad. Chapter 52 Experimentation u An experiment is the process of subjecting experimental units to treatments and observing.
Basic methods cont. Psych 231: Research Methods in Psychology.
Critical Thinking Lecture 12 Causal Arguments
POSC 202A: Lecture 1 Introductions Syllabus R Homework #1: Get R installed on your laptop; read chapters 1-2 in Daalgard, 1 in Zuur, See syllabus for Moore.
FPP Chapters Design of Experiments. Main topics Designed experiments Comparison Randomization Observational studies “control” Compare and contrast.
Topic 10 - Linear Regression Least squares principle - pages 301 – – 309 Hypothesis tests/confidence intervals/prediction intervals for regression.
Research Methods It is actually way more exciting than it sounds!!!!
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
CORRELATIONS: PART II. Overview  Interpreting Correlations: p-values  Challenges in Observational Research  Correlations reduced by poor psychometrics.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
The Question of Causation
Let’s Get Personal What do you think of when you think of the fall season?
Methods. Scientific Method Theory – an explanation using a set of principles that organizes and predicts observations – it is backed by evidence – Example:
Psychology Research Methods. Characteristics of Good Psychological Research © 2002 John Wiley & Sons, Inc.
The Human Sciences “The function of sociology, as of every science, is to reveal that which is hidden.” - Pierre Boudieu.
Chapter 2 Research Methods.
AP Statistics Exam Review Topic #4
CHAPTER 4 Designing Studies
Chapter 8 Control.
2.7 The Question of Causation
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
Topic 10 - Linear Regression
Experimental and Control Groups
MODULE 2 Myers’ Exploring Psychology 5th Ed.
How to Lie with Statistics
Why We Do Research Chapter 1.
Establishing Causation
It is actually way more exciting than it sounds!!!!
It is actually way more exciting than it sounds!!!!
Hypothesis Expresses a relationship between two variables.
CHAPTER 4 Designing Studies
Thinking Critically with Psychology
Hypothesis Expresses a relationship between two variables.
Chapter 4: Designing Studies
Chapter 4: Designing Studies
Correlational Studies
Psychological Research Why do we have to learn this stuff?
Designing Experiments
CHAPTER 4 Designing Studies
Lesson Using Studies Wisely.
Chapter 4: Designing Studies
Statistical Reasoning December 8, 2015 Chapter 6.2
Do Now What percent of Americans wash their hands after using the bathroom? It depends on how collect data. In a telephone survey of 1006 U.S. adults.
The Business Research Process: An Overview
POSC 202A: Lecture 1 Introductions Syllabus R
Chapter 4: Designing Studies
CHAPTER 4 Designing Studies
Chapter 4: Designing Studies
CHAPTER 4 Designing Studies
Concise Guide to Critical Thinking
Chapter 4: Designing Studies
Experiments & Observational Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
Chapter 4: Designing Studies
Chapter 4: Designing Studies
Chapter 4: Designing Studies
Chapter 4: Designing Studies
Chapter 4: Designing Studies
CHAPTER 4 Designing Studies
Chapter 4: Designing Studies
CHAPTER 4 Designing Studies
Chapter 4: Designing Studies
Chapter 4: Designing Studies
CHAPTER 4 Designing Studies
10/28/ B Experimental Design.
Presentation transcript:

Detecting Causal Relations

Causes are difference-makers. Effect need not be universal/deterministic. Not everyone who is bitten by a cobra dies. Not everyone who dies is bitten by a cobra. But cobra bites still cause death. “Causal factor”

An apparent paradox You can’t infer causation from correlation. But, correlation is the only thing you can infer causation from. All our evidence for causation comes from correlations.

Height/weight correlation

Height/inseam correlation

Height/IQ correlation

Causation and inference to the best explanation Often, the best explanation for a correlation is that the two variables are causally linked. But it might be that: A causes B. B causes A. C causes A and B.

Causation and correlation If height correlates with weight, then weight correlates with height. As one goes up (or down), the other goes up (or down). But, weight doesn’t cause height (being heavy doesn’t make you tall).

Confound A B ? C correlates causes (A) (B) (A) (C) Motorcyclists who wear helmets have fewer fatal accidents. Helmets save lives? Helmet wearers engage in less risky behavior. (A) (C) It’s the behavior, not the helmets, that explains the fatality rates?

Confound An additional variable that: (a) correlates with one or more of the independent variables (b) serves as plausible alternate cause of dependent variable

Can’t infer causation from correlation Because there’s almost always a confound! Always be on the lookout for possible confounds.

Smoking and lung cancer Lung cancer correlates with smoking. But smoking correlates with other things: personality type socioeconomic status genetic factors number of ashtrays owned These confounding variables also correlate with cancer. How to tell whether it’s the smoking that makes the difference?

Controlled experiment “Control for” confounding variable either statistically (observational study) or experimentally (interventional study)

Observational study Control group, experimental group Ensure that control group matches experimental group in all independent variables but one. Compare cancer rates of high socioeconomic smokers vs. high socioeconomic nonsmokers etc.

Limitations Always a worry about self-selection. Whatever sorted the subjects into control vs. experimental groups might also be responsible for examined effect. Control for all variables you’ve thought of.

Interventional study “Controlled experiment” strictly speaking Randomized trials Experimenter intervenes: randomly assigns subjects to control or experimental group Sometimes infeasible, sometimes unethical

Placebo effect: just believing you’re taking a drug has some tendency to improve health. Control groups always given placebo. Double-blind experiment: even the researchers don’t know which subjects are in control, experimental group.

An apparent paradox You can’t infer causation from correlation. But, correlation is the only thing you can infer causation from. All our evidence for causation comes from correlations.

Solution Patterns of correlations do provide evidence of causation. If x really is the only variable that could explain e, then x is probably the cause of e.

Causal Narratives

Imaginative storytelling as reason for believing causal claims Plausibility of story as reason to expect that A would cause B Simple narrative: I can easily see B happening as a result of A. In more complicated cases, chain these together. A would cause B, which would cause C, which would cause D. So, A would cause D.

If we lower taxes on the rich, then they will have more money to spend, which will result in their spending more money on goods and services, and that will lead to more jobs in those industries, and then the people who work those jobs will have paychecks, which they will spend, thus creating even more jobs, and the result is that the economy will improve. So, if we lower taxes on the rich, the economy will (probably) improve.

Causal narratives are most reliable when: Simple, e.g., mechanical subject matter, (e.g., That would probably break if I stood on it.) About which we have fairly direct experience Where we don’t have other (e.g., social or political) motives to believe that narrative

Dangerously unreliable otherwise, especially when chained together. Plausible storytelling is not evidence, on par with correlation, intervention.

Causal Fallacies

Ignoring common cause Thinking A causes B when in fact C causes both A and B. e.g., Ice cream causes violent crime? No, summer weather causes an increase in ice cream sales and an increase in crime.

Confusing cause and effect Correct detection of causal relationship, but inverting causal order. e.g., Drug use and emotional instability?

Post hoc Post hoc, ergo propter hoc after this, therefore because of this. Drawing causal conclusion from temporal succession often after a single event e.g., A rain dance brings rain.

“Name one” fallacy Xs don’t cause Ys (or there isn’t good evidence for Xs causing Ys), because there’s no clear example of an X causing a Y. But, causal generalizations aren’t usually inductive generalizations, so there’s no reason we ought to be able to point out specific instances. Justifying singular causal claim is harder than justifying general causal claim.

Coincidence, confounds, and causation It is always possible that a correlation is coincidental. Causal inference is always inductive. But, coincidence is less plausible for highly significant correlations.