RESEARCH DESIGN. TOPICS Non experimental research design Experimental vs. quasi-experimental research designs Research designs with limited power to assess.

Slides:

Advertisements

Similar presentations

Andrea M. Landis, PhD, RN UW LEAH

Advertisements

RESEARCH DESIGN.

Copyright © Allyn & Bacon (2007) Single-Variable, Independent-Groups Designs Graziano and Raulin Research Methods: Chapter 10 This multimedia product and.

Experimental and Quasi-Experimental Research

Exploring Marketing Research William G. Zikmund

Experimental Research Neuman and Robson, Ch. 9. Introduction Experiments are part of the traditional science model Involve taking “action” and observing.

Non-experimental Designs

GROUP-LEVEL DESIGNS Chapter 9.

Group Discussion Describe the fundamental flaw that prevents a nonequivalent group design from being a true experiment? (That is, why can’t these designs.

Correlation AND EXPERIMENTAL DESIGN

Chapter 9 Group-Level Research Designs. CHARACTERISTICS OF “IDEAL” EXPERIMENTS Controlling the Time Order of Variables Manipulating the Independent Variable.

Non-Experimental designs: Developmental designs & Small-N designs

Types of Group Designs ____________ group design. The experiment compares groups that receive or _______________ the IV (control group) e.g., behavior.

Non-Experimental designs: Developmental designs & Small-N designs

Hypotheses & Research Design

Group-Level Research Designs

Group Discussion Describe the similarities and differences between experiments , non-experiments , and quasi-experiments. Actions for Describe the similarities.

TOOLS OF POSITIVE ANALYSIS

Quantitative Research Design & Methods

Experimental Research Take some action and observe its effects Take some action and observe its effects Extension of natural science to social science.

Chapter 8 Experimental Research

The Classic Experiment (and Its Limitations) Class 6.

RESEARCH DESIGNS FOR QUANTITATIVE STUDIES. What is a research design?  A researcher’s overall plan for obtaining answers to the research questions or.

I want to test a wound treatment or educational program but I have no funding or resources, How do I do it? Implementing & evaluating wound research conducted.

I want to test a wound treatment or educational program but I have no funding or resources, How do I do it? Implementing & evaluating wound research conducted.

Experimental and Quasi-Experimental Designs

I want to test a wound treatment or educational program in my clinical setting with patient groups that are convenient or that already exist, How do I.

Learning Objectives 1 Copyright © 2002 South-Western/Thomson Learning Primary Data Collection: Experimentation CHAPTER eight.

Chapter 3 The Research Design. Research Design A research design is a plan of action for executing a research project, specifying The theory to be tested.

Copyright © 2008 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved. John W. Creswell Educational Research: Planning,

EVAL 6970: Cost Analysis for Evaluation Dr. Chris L. S. Coryn Nick Saxton Fall 2014.

Epidemiology The Basics Only… Adapted with permission from a class presentation developed by Dr. Charles Lynch – University of Iowa, Iowa City.

Modes of Observations (Research Designs) –Experiments –Survey Research –Field Research –Unobtrusive Research –Evaluation Research Each of these methods.

Chapter 11 Experimental Designs

Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.

Choosing Research Designs II Nonexperimental Methods.

Learning Objectives Copyright © 2002 South-Western/Thomson Learning Primary Data Collection: Experimentation CHAPTER eight.

Group Quantitative Designs First, let us consider how one chooses a design. There is no easy formula for choice of design. The choice of a design should.

Experimentation Chapter 14 Cooper and Schindler. What is Experimentation? Causal method Allow the researcher to alter systematically the variables of.

URBDP 591 A Lecture 8: Experimental and Quasi-Experimental Design Objectives Basic Design Elements Experimental Designs Comparing Experimental Design Example.

RESEARCH DESIGN & SURVEYS

Experimental Designs. Experiments are conducted to identify how independent variables influence some change in a dependent variable.

Ch. 2 Tools of Positive Economics. Theoretical Tools of Public Finance theoretical tools The set of tools designed to understand the mechanics behind.

Experimental Designs Leedy and Ormrod, Ch. 10. Introduction Experiments are part of the traditional science model Involve taking “action” and observing.

Choosing Research Designs I Experimental and Quasi-Experimental.

Introduction section of article

Modeling Political Phenomena Using Control Variables and Gauging Validity.

Research Design ED 592A Fall Research Concepts 1. Quantitative vs. Qualitative & Mixed Methods 2. Sampling 3. Instrumentation 4. Validity and Reliability.

Chapter 10 Finding Relationships Among Variables: Non-Experimental Research.

Experimental & Quasi-Experimental Designs Dr. Guerette.

EXPERIMENTS AND EXPERIMENTAL DESIGN

Journalism 614: Experimental Methods Experimental Research  Take some action and observe its effects –Extension of natural science to social science.

1. /32  A quasi-experimental design is one that looks like an experimental design but lacks the key ingredient -- random assignment. 2.

Political Science 30 Political Inquiry Quasi-Experiments: Good Enough for Social Science.

Can you hear me now? Keeping threats to validity from muffling assessment messages Maureen Donohue-Smith, Ph.D., RN Elmira College.

School of Public Administration & Policy Dr. Kaifeng Yang 研究设计 : 实验研究的基本问题.

Experimental Research Neuman and Robson, Ch. 9. Introduction Experiments are part of the traditional science model Involve taking “action” and observing.

William M. Trochim James P. Donnelly Kanika Arora 8 Introduction to Design.

Chapter 9 Scrutinizing Quantitative Research Design.

Quasi-Experiments: Good Enough for Social Science

Experimental Research

The Non-Experimental and Quasi- Experimental Strategies:

Single-Variable, Independent-Groups Designs

2 independent Groups Graziano & Raulin (1997).

Making Causal Inferences and Ruling out Rival Explanations

Introduction to Design

The Nonexperimental and Quasi-Experimental Strategies

External Validity.

Positive analysis in public finance

Types of Designs: R: Random Assignment of subjects to groups

Presentation transcript:

RESEARCH DESIGN

TOPICS Non experimental research design Experimental vs. quasi-experimental research designs Research designs with limited power to assess cause and effect Research design with more power to assess cause and effect

DEVELOPMENT & INCOME DISTRIBUTION The economic development theory suggests that as countries get richer income distribution worsens but eventually income distribution improves. LEVEL OF DEVELOPMENT GAP DIST. LOWHIGH LOW HIGH

Non experimental CROSS SECTIONAL LONGITUDINAL TREND COHORT PANEL Source: Sampieri et al. 1998:192

NON EXPERIMENTAL RESEARCH CROSS SECTIONAL: The researcher would take a sample of countries with different levels of development (low, medium, high) and analyze the match between the theory and facts. This approach is the weakest to determine causality, but strong in generalizing.

GINI CONCENTRATION RATIOS LOW INCOMEGINI Bangladesh.375 Sri Lanka.485 MIDDLE INCOME Mexico.523 Brazil.569 Costa Rica.485 HIGH INCOME USA.369 Sweden.288 Canada.338 Japan.285 GINI=0 TOTAL EQUALITY GINI =1 TOTAL INEQUALITY

NON EXPERIMENTAL RESEARCH LONGITUDINAL: The researcher would select a country or countries that have move from lower to higher levels of development (eg. USA, Canada, etc.) and determine whether income distribution over time followed the trend suggested by the theory Causality can be infer but lacks detail about the true causes as well as weak on generalization.

LONGITUDINAL TENDENCY: EVOLUTION OF INCOME DISTRIBUTION OVER TIME IN MEXICO. COHORT: EVOLUTION OF INCOME DISTRIBUTION OVER TIME OF MEXICAN WOMEN BORN AFTER PANEL: EVOLUTION OF INCOME DISTRIBUTION OF THE SAME GROUP OF WOMEN OVER TIME (MARIA, SUSAN, BRENDA, JOAN, GLORIA & ISABEL)

CASE (S) STUDY The researcher will take a case (s) study and analyze in depth what factors (policies, institutions, political systems, culture, etc.) are associated with improving income distribution in a given country. Why is income distribution better in Chile than in Mexico and Brazil despite having the same level of development? Improves details and understanding of causes and effect but lacks generalization.

Experimental vs. Quasi- experimental Research Designs Experimental research design: The researcher has control over the experiment in terms of sample selection, treatment, environment, etc. Experimental designs are typical in psychology, medicine, education, etc. Quasi-experiments: The researcher does not have control over the experiment, rather the experiment occurs in a “natural” setting. Quasi-experimental design are typical in economics, sociology, public administration, urban planning, political sciences, etc.

Things to consider as rival or alternative hypothesis A rival hypothesis is an alternative explanation that may invalidate what we think as the cause. History: Events that happen in the outside world during the experiment. Maturation: Acquisition and processing of information by subjects is not constant through time.

Instrumentation: How the instrument (e.g. survey) is conducted. Selection: Who is and who isn’t included in the experiment. Rivalry between treatment and control group: How aware are the subjects of the experiment. A combination (interaction) between the above threats to validity. (e.g. instrumentation-history )

RESEARCH DESIGN 0 t = Observation in time t of experimental group X = Treatment 0 c = Control group

Research design with limited power POST-TEST ONLY X O 1 POST-TEST WITH CONTROL GROUP XO 1 O c

PRE-TEST POST-TEST O 1 XO 2 PRE-TEST POST-TEST WITH CONTROL GROUP O 1 XO 2 O c

Research designs with more causal power CONTROL WITH MORE OBSERVATION IN THE PRETEST O 1 O 2 O 3 XO 4 O c O c

PRE-TEST POST-TEST REMOVING THE TREATMENT O 1 XO 2 XO 3 X0 4

CHANGES TO LOOK FOR CONVERGENCE-DIVERGENCE 1. Positive change in the treatment group without change in the control group Treatment Control Treatment Pre-testPost-test

Divergence Positive increments at a different rate Treatment Control Pre-test Post-test

Convergence The treatment group catches up with the control group Control Treatment Pre-testPostest

Cross pattern The treatment group overpass the control group Treatment Control Pre-testPost-test

Research design with more power (time series) Pre-test post-test O 1 O 2 O 3 XO 4 O 5 O 6 Pre-test post-test with control group O 1 O 2 O 3 XO 4 O 5 O 6 O c O c O c

Changes to look for in time series TIME X No effect Change on the rate or slope Change on the intercept PRE-TEST POST-TEST

Several possible problems arise that are related to model misspecification and spurious relationships. Thus, we need to control for confounding factors and alternative explanations!!!

Model Misspecification and Spuriousness Antecedent variable: A variable that indirectly affecting the relationship between two other variables. For example, Ivy league education increases income. However, parental wealth and legacy admissions affect Ivy league education. Thus, income of graduates from Ivy League schools may not be random.

Model Misspecification and Spuriousness Intervening Variable: These may be spuriously related to another relationship. Drinking coffee causes cancer. Drinking coffee may not be the cause of cancer, but rather the fact that smokers are also coffee drinkers.

Model Misspecification and Spuriousness Alternative Variables: We also want to control for variables that would bias our results if omitted. In this case, the X variables in a model would produce biased estimates, undermining their validity and producing error that leads to inaccurate inferences. To forecast correctly the number of medals we need to know something about institutions and sports culture of a country besides level of development.