Research Method II Rules of Constructing Causal Theory

Slides:



Advertisements
Similar presentations
Research Method II Case Studies Jaechun Kim. Today, we will discuss case studies… As many quantitative works use statistics, many qualitative studies.
Advertisements

The Fundamental Problem of Causal Inference Confounds and The Fundamental Problem of Causal Inference Probabilistic vs. Deterministic Causality Four Criteria.
Validity Validity of measurement Validity of research
Variables Variable = something that can change in different conditions in a study VARIABLES HAVE TO VARY!!
Chapter 2 Research Process Part 1: Aug 30, Research Methods Importance of scientific method Research Process – develop ideas, refine ideas, test.
Working with Graphs Graphs are used to demonstrate economic theories.
Research Design and Methods. Causal Inference  What is causal inference “…learning about CAUSAL effects from the data observed.” (KKV, 8) -why treaty/policy.
Rules for Constructing Causal Theories King, Keohane and Verba
Variables Variable = something that can change in different conditions in a study VARIABLES HAVE TO VARY!!
Research Methods in Psychology Second Edition
Psychology 242 Research Methods II Dr. David Allbritton
POLITICAL SCIENCE 204A Thad Kousser, Spring 2011.
Reliability and Validity. Criteria of Measurement Quality How do we judge the relative success (or failure) in measuring various concepts? How do we judge.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Behavioral Research Chapter Four Studying Behavior.
Designing Social Inquiry Understanding What to Avoid Jaechun Kim.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
1 PART I: PSYCHOANALYSIS & MOTIVES 2 INTRODUCTION TO THE STUDY OF MOTIVES DEFINITION & PROPERTIES CHARACTERISTICS OF MOTIVATED BEHAVIOR MOTIVES AND PERFORMANCE.
LECTURE DISCUSSION TODAY (9/17/02) LECTURE: RESEARCH METHODS IN SOCIAL PSYCHOLOGY DISCUSSION (time permitting) HUMANS VS. OTHER ANIMALS.
Designing Social Inquiry Challenges to Positivism Jaechun Kim.
ObservationsInferences vs.
Review of Research Methods. Overview of the Research Process I. Develop a research question II. Develop a hypothesis III. Choose a research design IV.
Experimental Design and Statistics. Scientific Method
Epistemology and Methods Data Selection, Operationalization, and Measurement May
Research Design and Methods. Causal Inference  What is causal inference “…learning about CAUSAL effects from the data observed.” (KKV, 8)  Different.
International Relations as Scientific Endeavor: What is Positivism? Designing Social Inquiry International Relations as Scientific Endeavor: What is Positivism?
Political Science Scope and Methods Introduction to Research Design and The Experimental Method.
RESEARCH METHODS Reminder: Topics Due Wednesday. THEORY Explanations –Connect & organize data –Framework for future research –Coherent story.
Introduction to International Relations International Relations as Scientific Endeavor Jaechun Kim.
Introduction to Validity True Experiment – searching for causality What effect does the I.V. have on the D.V. Correlation Design – searching for an association.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
1 Measuring Social Life Ch. 5, pp Measuring Social Life Connecting the specifics you observe in the empirical world to an abstract idea you.
Review of Causal Analysis  Guidelines for Theory Building  The Structure of a Causal Argument (And Key Assumptions)  Common Problems with Operationalization.
Concepts of Social Research GOAL: All research results be verifiable by other investigators.
Experimental Designs Section 7.5. Variables Explanatory variable Response Variable (Independent Variable)(Dependent Variable) "Explains observed outcomes""Measures.
COMM 250 Agenda - Week 5 Housekeeping Hand Back: TP1, TP2 Shoot Rest of the Team Pictures Lecture / Class RAT2 RQs, Hypotheses IV, DV, & Operationalizations.
Political Science 30 Political Inquiry The Fundamental Problem of Causal Inference To rent SPSS for a PC for $40, go to
The Scientific Method. Scientifically Solving a Problem Observe Define a Problem Review the Literature Observe some More Develop a Theoretical Framework.
Chapter 16 PATH ANALYSIS. Chapter 16 PATH ANALYSIS.
Some Terminology experiment vs. correlational study IV vs. DV descriptive vs. inferential statistics sample vs. population statistic vs. parameter H 0.
Reliability and Validity
The Fundamental Problem of Causal Inference
Rules for Constructing Causal Theories
Causation & Experimental Design
WHOOOA BIG SAFETY ISSUE!
Designing Social Inquiry International Relations as Scientific Endeavor: What is Positivism? Jaechun Kim.
Economics 430/530 EXPERIMENTAL ECONOMICS Spring 2012
Economics 430/530 EXPERIMENTAL ECONOMICS Fall 2009
Chapter 1 Definition Theory Causality
Classification, Prediction, and Description
Political Science Scope and Methods
Scientific Method Attitude Process
Chapter 6: MULTIPLE REGRESSION ANALYSIS
Chapter 6 Research Validity.
Experiments and Quasi-Experiments
Experiment Basics: Variables
Establishing the Direction of the Relationship
Experiments and Quasi-Experiments
Studying politics scientifically
Introduction.
-Correlation does not equal causation
Scientific Method Steps
Introduction to Experimental Design
Independent Variables in Experimental Design
EXPERIMENT VS. CORRELATIONAL STUDY
What is science?.
Rules for Constructing Causal Theories
Research Methods & Statistics
SRM II Review of key concepts
CS 594: Empirical Methods in HCC Experimental Research in HCI (Part 1)
Presentation transcript:

Research Method II Rules of Constructing Causal Theory : Causality vs. Correlation Jaechun Kim

 CAUSALITY vs. Correlation Correlation is not causation! Some examples?? e.g., Incumbency advantage of Congressional election in… pp. 77-79 (yI,J – yN,J)  realized causal effect of incumbency advantage… But we cannot rerun the history. We don’t have perfect experimental control… The fundamental problem of causal inference in social science…Holland (1986) p. 79

Assumptions required for estimating causal effects Unit Homogeneity  rerun history (or experiment) in two different units that are homogenous! Weaker version of this is “Constant Effect Assumption!” p. 92-93 Constant Effect Assumption is the assumption underlying the method of comparative case studies p. 93 Conditional Independence – assumption that values of IV should be independent from values of DV… p. 94 Otherwise, Problem of Endogeneity… Examples?? p. 186, 187

Rules when you select your DV DV should be really dependent – cf. problem of endogeneity That is, your IV should be exogenous (independent), whereas your DV is endogenous (dependent)… Do not select observations based on DV!  otherwise, “Selection Bias!” If you do, you research design is subject to selection bias… What is it?? p. 128 US investment  Internal Violence If possible, vary your DV!

Additional advice of KKV Ceteris paribus, use concepts that can be operationalized ! Culture, intentions, motivations, norms are hard to be operationlized…

Rules for Constructing Causal Theories Construct Falsifiable Theories Build Theories that Are Internally Consistent (coherent definitions…) Select Dependent Variables Carefully (when selecting cases, avoid selection bias… make sure DV is dependent on your IV….) Maximize Concreteness (observable implications…) State Theories in as Encompassing Ways as Possible (generalizable theories…)