A Within-Subjects Experiment: Homophone Priming of Proper Names

Slides:



Advertisements
Similar presentations
Chapter 9 Choosing the Right Research Design Chapter 9.
Advertisements

CHAPTER 8 EXPERIMENTAL DESIGN.
Research Study Designs
Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 14: Correlated Groups Designs 1.
The Basics of Experimentation I: Variables and Control
Stratification (Blocking) Grouping similar experimental units together and assigning different treatments within such groups of experimental units A technique.
Between- vs. Within-Subjects Designs
Independent & Dependent Variables
1 Chapter 7: The Experimental Research Strategy Manipulating the IV Controlling Extraneous Variance Holding Extraneous Vars Constant Between Subjects Designs.
EXPERIMENTAL DESIGNS Criteria for Experiments
PY 427 Statistics 1Fall 2006 Kin Ching Kong, Ph.D Lecture 9 Chicago School of Professional Psychology.
Basics of Experimentation (1) Experimental Design: Which to Choose and Why?
Single-Factor Experiments What is a true experiment? Between-subjects designs Within-subjects designs.
Experimental Design: Between and Within factors Psych 231: Research Methods in Psychology.
EXPERIMENTAL DESIGNS What Is Required for a True Experiment? What Are the Independent and Dependent Variables? What Is a Confounding Variable? What Are.
Types of Group Designs _________-subject design. The experiment compares _____ group across different levels of the IV. e.g., behavior is studied in 1.
Using Between-Subjects and Within-Subjects Experimental Designs
Experimental Designs Psych 231: Research Methods in Psychology.
Experiment Design 5: Variables & Levels Martin, Ch 8, 9,10.
Experimental Design: Between and within factors Psych 231: Research Methods in Psychology.
Experimental Design: Between and Within factors Psych 231: Research Methods in Psychology.
Lecture 12 Psyc 300A. Review: Inferential Statistics We test our sample recognizing that differences we observe may be simply due to chance. Significance.
Control Techniques ♣ Chapter 9 Introduction  Randomization 
PSYC512: Research Methods PSYC512: Research Methods Lecture 12 Brian P. Dyre University of Idaho.
Factorial Experiments Factorial Design = experiment in which more than one IV (factor) at a time is manipulated Uses all possible combinations of the levels.
Experimental Design: Between and within factors Psych 231: Research Methods in Psychology.
Chapter 8 Experimental Design.
BHS Methods in Behavioral Sciences I May 19, 2003 Chapter 9 (Ray) Within-Subjects Designs (Cont.), Matched-Subjects Procedures.
PSYC2030 Exam Review #2 March 13th 2014.
+ Controlled User studies HCI /6610 Winter 2013.
Research Methods in Psychology
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Matched Pairs, Within-Subjects, and Mixed Designs
Chapter 8 Experimental Design: Dependent Groups and Mixed Groups Designs.
Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.
Which Test Do I Use? Statistics for Two Group Experiments The Chi Square Test The t Test Analyzing Multiple Groups and Factorial Experiments Analysis of.
Single-Factor Experimental Designs
Chapter 10 Experimental Research: One-Way Designs.
Selecting and Recruiting Subjects One Independent Variable: Two Group Designs Two Independent Groups Two Matched Groups Multiple Groups.
Experimental Design. Threats to Internal Validity 1.No Control Group Known as a “one-shot case study” XOXO (IV)(DV)
@ 2012 Wadsworth, Cengage Learning Chapter 10 Extending the Logic of Experimentation: Within-Subjects and Matched-Subjects 2012 Wadsworth,
Introduction section of article
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Using Between-Subjects and Within- Subjects Experimental Designs.
The Psychologist as Detective, 4e by Smith/Davis © 2007 Pearson Education Chapter Six: The Basics of Experimentation I: Variables and Control Chapter Six:
Chapter Six: The Basics of Experimentation I: Variables and Control.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Simple Experiments. Causal Claim Boldest claim a scientist can make Verbs such as “associated with” and “related to” replaced with “causes, influences,
Choosing the right research design
Experimental Design Research Methods.
ITEC6310 Research Methods in Information Technology Instructor: Prof. Z. Yang Course Website: /itec6310.htm Office:
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
ANOVA Overview of Major Designs. Between or Within Subjects Between-subjects (completely randomized) designs –Subjects are nested within treatment conditions.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
8 Experimental Research Design.
7 Control Techniques in Experimental Research.
Experiment Basics: Designs
Research Methods: Concepts and Connections First Edition
Experimental Design-Chapter 8
Within- Subjects Design
7 How to Decide Which Variables to Manipulate and Measure Marziyeh Rezaee.
Within- Subjects Design
Within-Subjects Design
Experiment Basics: Designs
Between-Subjects Experimental Designs
Experiment Basics: Designs
Scientific Method Steps
Scientific Method Steps
Experiment Basics: Designs
CHAPTER 8 EXPERIMENTAL DESIGN © 2012 The McGraw-Hill Companies, Inc.
Presentation transcript:

A Within-Subjects Experiment: Homophone Priming of Proper Names Within-Subjects Factorial Designs Mixed Designs Advantages of Within-Subjects Designs Disadvantages of Within-Subjects Designs Controlling Within-Subjects Designs How Can You Choose a Design?

What is a within-subjects design? In a within-subjects experiment, subjects are assigned to more than one treatment condition. Introduction

Explain the statistical concept of power. Power is an experiment’s ability to detect the independent variable’s effect on the dependent variable. Introduction

Why is statistical power desirable? Statistical power is desirable when it allows us to detect practically significant differences between the experimental conditions. Theoretically, there is a point of diminishing returns where excessive power detects meaningless differences between treatment conditions. Introduction

Why is statistical power desirable? For example, in a study of treatments to lower blood pressure, a difference of 0.1 mm Hg—while statistically significant—would not affect patient health or life expectancy. Introduction

Why do we call this approach a repeated-measures design? In a within-subjects experiment, researchers measure subjects on the dependent variable after each treatment. Introduction

Summarize the basic principles of a within-subjects design. Subjects participate in more than one treatment condition and serve as their own control. We compare their performance on the dependent variable across conditions to determine whether there is a treatment effect. A Within-Subjects Experiment

What is a within-subjects factorial design? A within-subjects factorial design assigns subjects to all levels of two or more independent variables. Within-Subjects Factorial Designs

Mixed Designs What is a mixed design? A mixed design is an experiment where there is at least one between-subjects and one within-subjects variable. Mixed Designs

What are the advantages of within-subjects designs? use fewer subjects save time on training greater statistical power more complete record of subjects’ performance Advantages of Within-Subjects Designs

What are the disadvantages of within-subjects designs? subjects participate longer resetting equipment may consume time treatment conditions may interfere with each other treatment order may confound results Disadvantages of Within-Subjects Designs

When can’t we use a within-subjects design? We can’t use a within-subjects design when one treatment condition precludes another due to interference. Disadvantages of Within-Subjects Designs

Controlling Within-Subjects Designs What is an order effect? Order effects are positive (practice) and negative (fatigue) performance changes due to a condition’s position in a series of treatments. The term, progressive error, encompasses both positive and negative order effects. Controlling Within-Subjects Designs

Controlling Within-Subjects Designs How does counterbalancing control for order effects in within-subjects designs? Counterbalancing is a method of controlling order effects by distributing progressive error across different treatment conditions. Controlling Within-Subjects Designs

Controlling Within-Subjects Designs How does counterbalancing control for order effects in within-subjects designs? Two major counterbalancing strategies are subject-by-subject counterbalancing, which controls progressive error for each subject, and across-subjects counterbalancing, which distributes progressive error across all subjects. Controlling Within-Subjects Designs

What is a fatigue effect? A fatigue effect is form of progressive error where performance declines on the DV due to tiredness, boredom, or irritation. Controlling Within-Subjects Designs

What are practice effects? Subject performance on the dependent variable may improve across the conditions of a within-subjects experiment and these positive changes are called practice effects. Controlling Within-Subjects Designs

What are practice effects? Practice effects may be due to relaxation, increased familiarity with the equipment or task, development of problem-solving strategies, or discovery of the purpose of the experiment. Controlling Within-Subjects Designs

Controlling Within-Subjects Designs Why can’t we eliminate or hold order effects constant in a within-subjects experiment? We can’t eliminate order effects because there is an order as soon as we present two or more treatments. Holding order constant—always assigning subjects to the sequence ABC—would confound the experiment. Controlling Within-Subjects Designs

What is the strategy of subject-by-subject counterbalancing? Subject-by-subject counterbalancing controls progressive error for each subject by presenting all treatment conditions more than once. Two subject-by-subject counterbalancing techniques are reverse counterbalancing and block randomization. Controlling Within-Subjects Designs

How does reverse counterbalancing control progressive error? In reverse counterbalancing, we administer treatments twice in a mirror-image sequence, for example, ABBA. When progressive error is linear, it progressively changes across the experiment so that A and B have the same amount of progressive error. Controlling Within-Subjects Designs

What is nonlinear progressive error? Nonlinear progressive error, which can be curvilinear (inverted-U) or nonomonotonic (changes direction), cannot be graphed as a straight line. Controlling Within-Subjects Designs

Why can’t reverse counterbalancing control for this? Reverse counterbalancing only controls for linear progressive error. When progressive error increases in a straight line, this method actually confounds the experiment Controlling Within-Subjects Designs

What is block randomization? Block randomization is a subject-by-subject counterbalancing technique where researchers assign each subject to several complete blocks of treatments. A block consists of a random sequence of all treatments, so that each block presents the treatments in a different order. Controlling Within-Subjects Designs

What is a problem with subject-by-subject counterbalancing? Since subject-by-subject counterbalancing presents each treatment several times, this can result in long-duration, expensive, or boring procedures. This problem is compounded as the experimenter increases the number of treatments. Controlling Within-Subjects Designs

What are our alternatives? Across-subjects counterbalancing techniques present each treatment once and controls progressive error by distributing it across all subjects. Two techniques are complete and partial counterbalancing. Controlling Within-Subjects Designs

Explain complete counterbalancing. Complete counterbalancing uses all possible treatment sequences an equal number of times. Researchers randomly assign each subject to one of these sequences. Controlling Within-Subjects Designs

Explain partial counterbalancing. Partial counterbalancing is a form of across-subjects counterbalancing, where we present only some of the possible (N!) orders. Two partial counterbalancing techniques are randomized partial and Latin square counterbalancing. Controlling Within-Subjects Designs

When is a within-subjects superior to a between-subjects design? A within-subjects design is usually preferable when you need to control large individual differences or have a small number of subjects. However, it may not be feasible if the experiment is long or there is a risk of asymmetrical carryover. How Can You Choose a Design?