ITEC6310 Research Methods in Information Technology Instructor: Prof. Z. Yang Course Website: /itec6310.htm Office:

Slides:



Advertisements
Similar presentations
Ch 8: Experimental Design Ch 9: Conducting Experiments
Advertisements

Chapter 9 Choosing the Right Research Design Chapter 9.
CHAPTER 8 EXPERIMENTAL DESIGN.
7/20/03Copyright Ed Lipinski and Mesa Community College, All rights reserved. 1 Research Methods Summer 2009 Using Between Subjects and Within.
Questions What is the relationship between ‘research designs’ and ‘research strategies’? Which method of experiments, within subjects or between subjects.
PSYC512: Research Methods PSYC512: Research Methods Lecture 13 Brian P. Dyre University of Idaho.
Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 14: Correlated Groups Designs 1.
Between- vs. Within-Subjects Designs
Chapter 9: Experimental Design
©2005, Pearson Education/Prentice Hall CHAPTER 5 Experimental Strategies.
Questions  Is Exam 2 going to be cumulative or will it just cover the second part of the information?  Are cause-and-effect relationships the same as.
Experimental Designs.
Chapter 9: Within Designs
EXPERIMENTAL DESIGNS Criteria for Experiments
CHAPTER 8 EXPERIMENTAL DESIGN.
Chapter 10 Experimental Research Design ♣ ♣ Introduction   Research Designs with Threats to Internal Validity   Requirements of Experimental Research.
Questions: What is the relationship between all the non- experimental and quasi-experimental designs and validity (internal and external)? What is the.
Types of Group Designs _________-subject design. The experiment compares _____ group across different levels of the IV. e.g., behavior is studied in 1.
Using Between-Subjects and Within-Subjects Experimental Designs
PSYC512: Research Methods PSYC512: Research Methods Lecture 11 Brian P. Dyre University of Idaho.
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 10 Using Specialized Research Designs.
Experimental Designs Psych 231: Research Methods in Psychology.
Basic Logic of Experimentation The design of an Internally valid experimental procedure requires us to: Form Equivalent Groups Treat Groups Identically.
Experimental Design: Between and within factors Psych 231: Research Methods in Psychology.
PSYC512: Research Methods PSYC512: Research Methods Lecture 12 Brian P. Dyre University of Idaho.
© 2001 Dr. Laura Snodgrass, Ph.D.1 Basic Experimental Design Common Problems Assigning Participants to Groups Single variable experiments –bivalent –multivalent.
Experimental Research
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Matched Pairs, Within-Subjects, and Mixed Designs
Chapter 8 Experimental Design: Dependent Groups and Mixed Groups Designs.
Single-Factor Experimental Designs
ITEC6310 Research Methods in Information Technology Instructor: Prof. Z. Yang Course Website: ec6310.htm Office:
1 Experimental Design. 2  Single Factor - One treatment with several levels.  Multiple Factors - More than one treatment with several levels each. 
A Within-Subjects Experiment: Homophone Priming of Proper Names
Psych 5500/6500 Other ANOVA’s Fall, Factorial Designs Factorial Designs have one dependent variable and more than one independent variable (i.e.
@ 2012 Wadsworth, Cengage Learning Chapter 10 Extending the Logic of Experimentation: Within-Subjects and Matched-Subjects 2012 Wadsworth,
ITEC6310 Research Methods in Information Technology Instructor: Prof. Z. Yang Course Website: c6310.htm Office:
Chapter 14 Repeated Measures and Two Factor Analysis of Variance
Introduction section of article
McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Using Between-Subjects and Within- Subjects Experimental Designs.
Latin Square Designs KNNL – Sections Description Experiment with r treatments, and 2 blocking factors: rows (r levels) and columns (r levels)
10 Experimental Research: One-Way Designs What types of evidence allow us to conclude that one variable causes another variable? How do experimental research.
The Psychologist as Detective, 4e by Smith/Davis © 2007 Pearson Education Chapter Six: The Basics of Experimentation I: Variables and Control Chapter Six:
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Using Specialized Research Designs.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Simple Experiments. Causal Claim Boldest claim a scientist can make Verbs such as “associated with” and “related to” replaced with “causes, influences,
Choosing the right research design
Experimental Design Research Methods.
Today: Assignment 2 back on Friday
Within-Subjects (Repeated Measures) Designs Each participant receives all conditions in the experiment Main advantage: increased power Since the number.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
Experimental Design. Talking While Driving: Are Cell Phone Conversations Different from Passenger Conversations? Research Problems Talking on a cellphone.
Experimental Research Designs. Experimental Design Advantages  Best establishes cause-and-effect relationships Disadvantages  Artificiality of experiments.
8 Experimental Research Design.
Experiment Basics: Designs
METHODS IN BEHAVIORAL RESEARCH
Experimental Research Designs
Experimental Design-Chapter 8
Between-Subjects, within-subjects, and factorial Experimental Designs
Within- Subjects Design
Within- Subjects Design
Within-Subjects Design
Psychology 3450W: Experimental Psychology
2 independent Groups Graziano & Raulin (1997).
Experiment Basics: Designs
Between-Subjects Experimental Designs
Latin Square Designs KNNL – Sections
CHAPTER 8 EXPERIMENTAL DESIGN © 2012 The McGraw-Hill Companies, Inc.
Experiment Basics: Designs
Within-Subjects Experiments
Presentation transcript:

ITEC6310 Research Methods in Information Technology Instructor: Prof. Z. Yang Course Website: /itec6310.htm Office: Tel 3049

222 Within-Subjects Designs Subjects are not randomly assigned to treatment conditions –The same subjects are used in all conditions. –Closely related to the matched-groups design Advantages –Reduces error variance due to individual differences among subjects across treatment groups –Reduced error variance results in a more powerful design Effects of independent variable are more likely to be detected.

333 Disadvantages –More demanding on subjects, especially in complex designs –Subject attrition is a problem –Carryover effects: exposure to a previous treatment affects performance in a subsequent treatment Within-Subjects Designs

444 Sources of Carryover Learning –Learning a task in the first treatment may affect performance in the second Fatigue –Fatigue from earlier treatments may affect performance in later treatments Habituation –Repeated exposure to a stimulus may lead to unresponsiveness to that stimulus

555 Sensitization –Exposure to a stimulus may make a subject respond more strongly to another Contrast –Subjects may compare treatments, which may affect behavior Adaptation –If a subject undergoes adaptation (e.g., dark adaptation), then earlier results may differ from later ones Sources of Carryover

666 Dealing with Carryover Effects Counterbalancing –The various treatments are presented in a different order for different subjects –May be complete or partial The Latin Square Design –Used when you make the number of treatment orders equal to the number of treatments

777 Example of a Counterbalanced Single-Factor Design With Three Treatments Subjects First Treatment Administered Second Treatment Administered Third Treatment Administered S1S1 123 S2S2 132 S3S3 213 S4S4 231 S5S5 312 S6S6 321

888 Taking Steps to Minimize Carryover –Techniques such as pretraining, practice sessions, or rest periods between treatments can reduce some forms of carryover Make Treatment Order an Independent Variable –Allows you to measure the size of carryover effects, which can be taken into account in future experiments Dealing with Carryover Effects

999 When to Use a Within-Subjects Design A within-subjects design may be best when –Subject variables are correlated with the dependent variable –It is important to economize on participants or subjects –You want to assess the effects of increasing exposure on behavior

10 Factorial Designs Adding a second independent variable to a single-factor design results in a FACTORIAL DESIGN. Two components can be assessed –The MAIN EFFECT of each independent variable The separate effect of each independent variable Analogous to separate experiments involving those variables Represented by means for each level of each factor –The INTERACTION between independent variables When the effect of one independent variable changes over levels of a second Represented by the “cell means” in your design

11 Example The researcher is interested in a study to investigate the following two hypotheses: Do object-oriented techniques increase the understandability and ease of modification of the resulting design documents over the use of structured techniques? Does the use of perceived ‘good’ and ‘bad’ design principles have any influence on the understandability and ease of modification of these design documents?

12 Higher-Order Factorial Designs More than two independent variables are included in a higher-order factorial design –As factors are added, the complexity of the experimental design increases The number of possible main effects and interactions increases The number of subjects required increases The volume of materials and amount of time needed to complete the experiment increases

13 The Pretest-Posttest Design Pretest administered before exposure to experimental treatment Used to assess the impact of some change on performance There is a problem with pretest sensitization –Taking the pretest may alter the way a person performs in an experiment