Political Science Scope and Methods Case Studies, Comparing Cases, and Statistical Analysis.

Slides:



Advertisements
Similar presentations
Country-led impact evaluation: A survey of development practitioners Denis Jobin Vice-President IDEAS.
Advertisements

Mywish K. Maredia Michigan State University
BUS 374 Organization Theory
Increasing your confidence that you really found what you think you found. Reliability and Validity.
Research Method II Case Studies Jaechun Kim. Today, we will discuss case studies… As many quantitative works use statistics, many qualitative studies.
Introduction to Statistics: Political Science (Class 7) Part I: Interactions Wrap-up Part II: Why Experiment in Political Science?
Research System Theory Hypotheses Data Verification Theory building Hypothesis generation Measurement issues Research design Sampling issues Statistical.
Causal-Comparative Research
Research Design and Methods. Causal Inference  What is causal inference “…learning about CAUSAL effects from the data observed.” (KKV, 8) -why treaty/policy.
Thinking Like a Psychologist. Overview Psychologists use scientific reasoning strategies. These strategies can be helpful outside of this class. * Many.
PSYC512: Research Methods PSYC512: Research Methods Lecture 11 Brian P. Dyre University of Idaho.
Sampling and Experimental Control Goals of clinical research is to make generalizations beyond the individual studied to others with similar conditions.
Chapter 2 Research Process Part 2: Sept. 1, 2010.
Types of Evaluation.
USING THE METHODOLOGY FOR EXTERNAL LEGAL EDUCATION QUALITY ASSESSMENT Training on behalf of USAID FAIR Justice project – 27 th and 28 th May 2015.
Survey Experiments. Defined Uses a survey question as its measurement device Manipulates the content, order, format, or other characteristics of the survey.
How to Conduct Systematic Political Research
Chapter 5 Research Methods in the Study of Abnormal Behavior Ch 5.
Chapter 13: Inference in Regression
Political Science Scope and Methods Case Selection.
Selecting a Research Design. Research Design Refers to the outline, plan, or strategy specifying the procedure to be used in answering research questions.
Laws of Logic and Rules of Evidence Larry Knop Hamilton College.
Number Sense Standards Measurement and Geometry Statistics, Data Analysis and Probability CST Math 6 Released Questions Algebra and Functions 0 Questions.
Understanding Statistics
Evaluating the Options Analyst’s job is to: gather the best evidence possible in the time allowed to compare the potential impacts of policies.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Enhancing Rigor in Quantitative Research.
The What and the Why of Statistics The Research Process Asking a Research Question The Role of Theory Formulating the Hypotheses –Independent & Dependent.
Chapter 1: The What and the Why of Statistics  The Research Process  Asking a Research Question  The Role of Theory  Formulating the Hypotheses  Independent.
Program Evaluation Week 3. Tonight Name Tags Your Q’s Quant. vs. Qual Paradigms activity Evaluation developments Context-Adaptive Model HW.
Context Effects: Interpreting the Question Should we ask specific questions before general ones? (e.g., rate course, then curriculum) What about with attitude.
Experimentation in Computer Science (Part 1). Outline  Empirical Strategies  Measurement  Experiment Process.
A Meta-Study of Algorithm Visualization Effectiveness Christopher Hundhausen, Sarah Douglas, John Stasko Presented by David Burlinson 8/10/2015.
Thomson South-Western Wagner & Hollenbeck 5e 1 Chapter Sixteen Critical Thinking And Continuous Learning.
1 Introduction to Policy Processes Dan Laitsch. 2 Overview (Class meeting 5) Sign in Agenda –PBL break out, final project polishing –Centre Jobs –Review.
Research Methods Science of Psychology.
Review of Research Methods. Overview of the Research Process I. Develop a research question II. Develop a hypothesis III. Choose a research design IV.
Warm-Up.
Research Design and Methods. Causal Inference  What is causal inference “…learning about CAUSAL effects from the data observed.” (KKV, 8)  Different.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Research Design. “The best way to escape a problem is to solve it.” -- Brendan Francis.
Section 11.2 Comparing Two Means AP Statistics
Section 11.2 Comparing Two Means AP Statistics Winter 2006.
Political Science Scope and Methods Observation, Measurement, and Political Implications.
Political Science Scope and Methods Observation, Measurement, and Political Implications.
Reasoning in Psychology Using Statistics Psychology
Research Design Week 6 Part February 2011 PPAL 6200.
EXPERIMENTS AND EXPERIMENTAL DESIGN
Political Science Scope and Methods Introduction to Research Design and The Experimental Method.
PSY 285 Research Methods *A Review*. To All Students… Research and Statistical Support –All notes available online indefinitely – me if you need.
Do I need statistical methods? Samu Mäntyniemi. Learning from experience Which way a bottle cap is going to land? Think, and then write down your opinion.
Introduction to Validity True Experiment – searching for causality What effect does the I.V. have on the D.V. Correlation Design – searching for an association.
CJ490: Research Methods in Criminal Justice UNIT #4 SEMINAR Professor Jeffrey Hauck.
A. Strategies The general approach taken into an enquiry.
CHAPTER 19: Two-Sample Problems ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Political Science 30 Political Inquiry Quasi-Experiments: Good Enough for Social Science.
Case Studies and Case Selection Research Methods Workshops Oisín Tansey.
Some Terminology experiment vs. correlational study IV vs. DV descriptive vs. inferential statistics sample vs. population statistic vs. parameter H 0.
What is a theory? 1. a set of interrelated propositions
Quasi-Experiments: Good Enough for Social Science
Experimental Research
Political Science Scope and Methods
Political Science Scope and Methods
Experiments and Quasi-Experiments
Experiments and Quasi-Experiments
Political Science Scope and Methods
Lesson Using Studies Wisely.
Introduction to Experimental Design
SRM II Review of key concepts
Argument Moves from what is know to what is unknown
Lecture 6 C. D. Canham Lecture 7 Your data and models are never perfect… Making choices in research design and analysis that you can defend.
Presentation transcript:

Political Science Scope and Methods Case Studies, Comparing Cases, and Statistical Analysis

Cases: From few to many Last week: Experiments This week: Everything else Overview  Case studies: what are they good for?  Comparative method  Large N analysis

The logic of Degrees of Freedom Lijphart: small-N analysis a way-station on the road to large-N studies What does more cases buy us? Degrees of freedom  Need as much (if not more) information as inferences  Like equations and unknowns problem in algebra

Case Studies What are case studies good for?  Theory generation?  Theory testing: Process Tracing (Van Evera) Break down causal links; look for evidence Multiple tests in a single case (?) Congruence Paradigm Compare values of IV and DV to “normal” values Getting comparative…

Comparative Method Controlled comparison of cases  Van Evera – skeptical  Other authors – advocates How do you pick cases to make the strongest inferences?  How do you design a “strong test”?  Case selection (more next week)

Strategies of Controlled Comparison Most different vs. most similar “Method of difference”  Select cases that are as similar as possible except in their value on the IV of interest “Method of agreement”  Select cases that similar on IV, but different in other ways

Case Study Example: Silent Voices (the book) Examine interaction between individual survey response and political context Look at effects of changes in context Case studies: 3 issue areas, 6 cases (and 3-12 observations within each case) Example: Racial policy questions:  “Method of difference”  “Method of agreement.”

Yes Don’t Know Response 2: Opinion Withholding Are there costs associated with the free expression of opinion? Are there particular benefits to answering the survey question? YesNo Respondent Reveals Opinion: Opinion expressed is the same as opinion formed Opinion Expression Opinion Formation YesNo Can the respondent easily form an opinion? Don’t Know Response 1: Absence of Coherent Evaluation Respondent evaluates target Can respondent construct a representation of target object? YesNo Respondent Edits Opinion: Opinion expressed is not the same as opinion formed, but respondent answers question

Typology of Issue Difficulty

Case Selection

School 1972 Employment 1972 School 1990 School 1992 School 1994 Employment 1992 School 1972 Employment 1972A School 1990DD School 1992DDA School 1994 DDAA Employment 1992DDAAA Case Selection: Racial Policy Issues

Large N (Statistical) Analysis Internal vs. External validity tradeoff  Be mindful of C&S’s threats to Quasi- Experiments Questions of robustness  In random data 5% of relationships appear significant  Account for competing theories  Look at independent data sets

Large N (Statistical) Analysis (Cont.) Be honest about results  Report uncertainty Art and science