Chapter 8: Between Subjects Designs

Slides:



Advertisements
Similar presentations
Ch 8: Experimental Design Ch 9: Conducting Experiments
Advertisements

Variance in Research Design Sources, threats to internal validity, and “Noise”
Control Any means used to rule out threats to validity Example –Hypothesis: Rats learned to press a bar when a light was turned on. –Data for 10 rats bar.
PSY 250 Chapter 7: Experimental Research Strategy.
Questions  Is Exam 2 going to be cumulative or will it just cover the second part of the information?  Are cause-and-effect relationships the same as.
Chapter 9: Within Designs
BHS Methods in Behavioral Sciences I April 25, 2003 Chapter 6 (Ray) The Logic of Hypothesis Testing.
EXPERIMENTAL DESIGNS Criteria for Experiments
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Who are the participants? Creating a Quality Sample 47:269: Research Methods I Dr. Leonard March 22, 2010.
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Experimental Design: Single factor designs Psych 231: Research Methods in Psychology.
Experimental Control & Design Psych 231: Research Methods in Psychology.
EXPERIMENTAL DESIGNS What Is Required for a True Experiment? What Are the Independent and Dependent Variables? What Is a Confounding Variable? What Are.
Using Between-Subjects and Within-Subjects Experimental Designs
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 4 Choosing a Research Design.
Experimental Designs Psych 231: Research Methods in Psychology.
Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Sampling and Experimental Control Goals of clinical research is to make generalizations beyond the individual studied to others with similar conditions.
Psych 231: Research Methods in Psychology
Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Experimental Control & Design Psych 231: Research Methods in Psychology.
Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Smith/Davis (c) 2005 Prentice Hall Chapter Twelve Designing and Conducting, Experiments with More than Two Groups PowerPoint Presentation created by Dr.
Smith/Davis (c) 2005 Prentice Hall Chapter Ten Designing and Conducting, Experiments with Two Groups PowerPoint Presentation created by Dr. Susan R. Burns.
Fig Theory construction. A good theory will generate a host of testable hypotheses. In a typical study, only one or a few of these hypotheses can.
+ Controlled User studies HCI /6610 Winter 2013.
Variation, Validity, & Variables Lesson 3. Research Methods & Statistics n Integral relationship l Must consider both during planning n Research Methods.
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Experiments Unit 2 – Mod 5. Experiment Carefully controlled method of investigation used to establish a cause-and-effect relationship Experimenter purposely.
Chapter 8 Experimental Design: Dependent Groups and Mixed Groups Designs.
Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.
Single-Factor Experimental Designs
The Research Enterprise in Psychology. The Scientific Method: Terminology Operational definitions are used to clarify precisely what is meant by each.
ITEC6310 Research Methods in Information Technology Instructor: Prof. Z. Yang Course Website: ec6310.htm Office:
Between- Subjects Design Chapter 8. Review Two types of Ex research Two basic research designs are used to obtain the groups of scores that are compared.
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
The Research Enterprise in Psychology
The success or failure of an investigation usually depends on the design of the experiment. Prepared by Odyssa NRM Molo.
Selecting and Recruiting Subjects One Independent Variable: Two Group Designs Two Independent Groups Two Matched Groups Multiple Groups.
The Research Design. Experimental Design Definition A description of what a researcher would like to find out and how to find it out. Pre-requisites 1.Identification.
©2010 John Wiley and Sons Chapter 3 Research Methods in Human-Computer Interaction Chapter 3- Experimental Design.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Introduction section of article
Experimental Research
Smith/Davis (c) 2005 Prentice Hall Chapter Fourteen Designing and Conducting Experiments with Multiple Independent Variables PowerPoint Presentation created.
McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Using Between-Subjects and Within- Subjects Experimental Designs.
10 Experimental Research: One-Way Designs What types of evidence allow us to conclude that one variable causes another variable? How do experimental research.
1.) *Experiment* 2.) Quasi-Experiment 3.) Correlation 4.) Naturalistic Observation 5.) Case Study 6.) Survey Research.
Chapter Six: The Basics of Experimentation I: Variables and Control.
Simple Experiments. Causal Claim Boldest claim a scientist can make Verbs such as “associated with” and “related to” replaced with “causes, influences,
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
Chapter 6 Conducting & Reading Research Baumgartner et al Chapter 6 Selection of Research Participants: Sampling Procedures.
The Psychologist as Detective, 4e by Smith/Davis © 2007 Pearson Education Chapter Eleven: Designing, Conducting, Analyzing, and Interpreting Experiments.
BHS Methods in Behavioral Sciences I May 9, 2003 Chapter 6 and 7 (Ray) Control: The Keystone of the Experimental Method.
Gaining Control Internal Validity. What is an experiment? Comparison – Manipulation (Independent Variable) Measurement (Dependent Variable) Control.
CHOOSING A RESEARCH DESIGN
Experiments Why would a double-blind experiment be used?
Stats/Methods II JEOPARDY.
Between- Subjects Design
Between-Subjects, within-subjects, and factorial Experimental Designs
Research Methods 3. Experimental Research.
2 independent Groups Graziano & Raulin (1997).
Between-Subjects Experimental Designs
Experiments with Two Groups
Establishing the Direction of the Relationship
Experimental Design: The Basic Building Blocks
Introduction to Between-Subjects Experiments
Chapter Ten: Designing, Conducting, Analyzing, and Interpreting Experiments with Two Groups The Psychologist as Detective, 4e by Smith/Davis.
Presentation transcript:

Chapter 8: Between Subjects Designs PSY 250 Chapter 8: Between Subjects Designs

Experimental Design: The Basic Building Blocks The general plan for selecting participants, assigning participants to experimental conditions, controlling extraneous variables, and gathering data.

Simple between subjects design One independent variable (single factor design) # of groups = # of levels of IV = # treatment conditions Different participants in different groups Each participant exposed to only one level of IV Allows only 1 score per individual (even if average) Look for differences BETWEEN groups

The Two-Group Design How many groups? Although an experiment can have only one IV, it must have at least two groups (levels) The simplest way to find out whether our IV caused a change in behavior is to compare some research participants who have received our IV to some others who have not received the IV Thus, the presence of the IV is contrasted with the absence of the IV If those two groups differ, and we are assured that we controlled potential extraneous variables, then we conclude that the IV caused the participants to differ.

The Two-Group Design Experimental group Control group E.g. the group of participants that receives the IV. Control group the group of participants that does not receive the IV E.g. DV: Aggression in child’s behavior with doll IV: Exposure to : Group A: Violent Images on TV Group B: No TV images

The Two-Group Design Or Compare Two (or more) Experimental Groups Different levels of violence in images (high or low) or (neutral vs. violent) Could have 3 groups: No TV, Neutral TV, Violent TV

The Two-Group Design Equivalent Groups Treated Equally Random Assignment each participant has an equal chance of being in any group (created equally) Composed of equivalent individuals not the same as random selection Restricted random assignment – groups must be equal in size Treated Equally

The Two-Group Design Independent groups Between-subjects comparison The participants in one group have absolutely no ties or links to the participants in the other group. Between-subjects comparison Refers to a contrast between groups of participants who were randomly assigned to groups.

The Two-Group Design Confounded experiment An experiment in which an extraneous variable varies systematically with the IV. Confounding makes drawing a cause-and-effect relation impossible. Confounding may occur if participants are not equal before the start of the experiment.

The Two-Group Design Nonrandom Assignment to Groups. Random assignment tends to create equal groups in the long run. As groups get larger (at least 20), we can place more confidence in random assignment achieving what we want it to. If we are faced with a situation in which we have few potential research participants (5 or less) and we are worried that random assignment may not create equal groups, what can we do?

The Two-Group Design Holding Variables Constant Use participants of all one gender or exact same IQ Restricting Range of Variability Restrict participants to IQ range of 100 and 110 But limits…what??

Advantages of Between Designs Each score is independent Not susceptible to: Practice or experience gained in other treatments Fatigue or boredom Contrast effects

Disadvantages Large # of participants Environmental Confounds Esp. problematic with special populations Environmental Confounds Characteristics of environment that might vary between groups Individual Differences Can become confounding variables Assignment bias Can produce high variability in scores

Comparing Two-Group Designs Error variability Variability in DV scores that is due to factors other than the IV – individual differences, measurement error, and extraneous variation (also known as within-groups variability). It is important to reduce error variability because all statistical tests reduce to the following formula: The possibility of a result occurring by chance decreases as the value of your statistic increases: increase the between-groups variability or decrease the error variability. The larger your test statistic the more likely a significant result

Variability Statistical value that measures the size of the differences from one score to another All similar scores = small variance Big differences = large variance Group A 90 100 100 110 110 100 Group B 70 100 130 70 100 130 10 pt diff. more substantial for group A More variance in group B

Variance cont. Differences BETWEEN groups are desired So… increase diff. between group conditions Variance = background noise Difficult to see real treatment effect with large variance Individual differences – large variance So… big differences WITHIN group are bad Variance must be equal between groups

Minimizing Within Treatment Variance Standardize procedures and treatment setting Limit individual differences Hold participant variable constant or restrict its range Increase sample size But not as effective Also beware of limits on: external validity

Additional Confounds in Between Subjects Designs Differential Attrition May lead to diff. characteristics within groups Diffusion or Imitation of Treatment Compensatory Equalization Compensatory Rivalry/John Henry effect Resentful Demoralization

Statistics With two groups More than two groups Can maximize differences between treatments Easy to interpret significant effects But little information – may get wrong picture More than two groups May blur distinction between groups

Two or More Groups? Exercise Levels