Between- Subjects Design Chapter 8. Review Two types of Ex research Two basic research designs are used to obtain the groups of scores that are compared.

Slides:



Advertisements
Similar presentations
Group Discussion Identify two time-related factors that can threaten the internal validity of a within-subjects research study.  In each case, explain.
Advertisements

Questions What is the relationship between ‘research designs’ and ‘research strategies’? Which method of experiments, within subjects or between subjects.
Copyright © Allyn & Bacon (2007) Single-Variable, Independent-Groups Designs Graziano and Raulin Research Methods: Chapter 10 This multimedia product and.
Experimental Design True Experimental Designs n Random assignment n Two comparison groups n Controls threats to internal validity n Strongest evidence.
Experimental Design I. Definition of Experimental Design
Variance in Research Design Sources, threats to internal validity, and “Noise”
Validity of Quantitative Research Conclusions. Internal Validity External Validity Issues of Cause and Effect Issues of Generalizability Validity of Quantitative.
Group Discussion Describe the fundamental flaw that prevents a nonequivalent group design from being a true experiment? (That is, why can’t these designs.
Experimental Research Designs
Copyright © Allyn & Bacon (2010) Single-Variable, Independent-Groups Designs Graziano and Raulin Research Methods: Chapter 10 This multimedia product and.
Questions  Is Exam 2 going to be cumulative or will it just cover the second part of the information?  Are cause-and-effect relationships the same as.
Jeff Beard Lisa Helma David Parrish Start Presentation.
EXPERIMENTAL DESIGNS Criteria for Experiments
CHAPTER 8 EXPERIMENTAL DESIGN.
Chapter 9 Group-Level Research Designs. CHARACTERISTICS OF “IDEAL” EXPERIMENTS Controlling the Time Order of Variables Manipulating the Independent Variable.
Using Between-Subjects and Within-Subjects Experimental Designs
Group-Level Research Designs
Questions What is the best way to avoid order effects while doing within subjects design? We talked about people becoming more depressed during a treatment.
Group Discussion Describe the similarities and differences between experiments , non-experiments , and quasi-experiments. Actions for Describe the similarities.
PowerPoint presentation to accompany Research Design Explained 4th edition ; ©2000 Mark Mitchell & Janina Jolley Chapter 7 The Multiple Group Experiment.
CHAPTER OVERVIEW Experimental Designs
Chapter 9 Experimental Research Gay, Mills, and Airasian
EVALUATING YOUR RESEARCH DESIGN EDRS 5305 EDUCATIONAL RESEARCH & STATISTICS.
Chapter 12 Inferential Statistics Gay, Mills, and Airasian
Applying Science Towards Understanding Behavior in Organizations Chapters 2 & 3.
Group Discussion Explain the difference between assignment bias and selection bias. Which one is a threat to internal validity and which is a threat to.
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Matched Pairs, Within-Subjects, and Mixed Designs
Chapter 8 Experimental Design: Dependent Groups and Mixed Groups Designs.
Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.
Which Test Do I Use? Statistics for Two Group Experiments The Chi Square Test The t Test Analyzing Multiple Groups and Factorial Experiments Analysis of.
ITEC6310 Research Methods in Information Technology Instructor: Prof. Z. Yang Course Website: ec6310.htm Office:
1)Test the effects of IV on DV 2)Protects against threats to internal validity Internal Validity – Control through Experimental Design Chapter 10 – Lecture.
Research Strategies Chapter 6. Research steps Literature Review identify a new idea for research, form a hypothesis and a prediction, Methodology define.
© 2011 Pearson Prentice Hall, Salkind. Pre- and True Experimental Research Designs.
Experimental Design: One-Way Correlated Samples Design
Chapter Four Experimental & Quasi-experimental Designs.
Selecting and Recruiting Subjects One Independent Variable: Two Group Designs Two Independent Groups Two Matched Groups Multiple Groups.
Educational Research Chapter 13 Inferential Statistics Gay, Mills, and Airasian 10 th Edition.
Introduction section of article
McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Using Between-Subjects and Within- Subjects Experimental Designs.
Research Design. Time of Data Collection Longitudinal Longitudinal –Panel study –Trend study –Cohort study Cross-sectional Cross-sectional.
Finishing up: Statistics & Developmental designs Psych 231: Research Methods in Psychology.
Chapter 8: Between Subjects Designs
Chapter Eight: Quantitative Methods
EXPERIMENTAL DESIGNS. Categories Lab experiments –Experiments done in artificial or contrived environment Field experiments –Experiments done in natural.
Copyright c 2001 The McGraw-Hill Companies, Inc.1 Chapter 11 Testing for Differences Differences betweens groups or categories of the independent variable.
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 11 Testing for Differences Differences betweens groups or categories of the independent.
1. /32  A quasi-experimental design is one that looks like an experimental design but lacks the key ingredient -- random assignment. 2.
© 2009 Pearson Prentice Hall, Salkind. Chapter 11 Pre- and True Experimental Research Designs.
CHAPTER 15: THE NUTS AND BOLTS OF USING STATISTICS.
Chapter 11: The Nuts and Bolts of one-factor experiments.
Experiments Why would a double-blind experiment be used?
The Non-Experimental and Quasi- Experimental Strategies:
METHODS IN BEHAVIORAL RESEARCH
Experimental Design-Chapter 8
Between- Subjects Design
Between-Subjects, within-subjects, and factorial Experimental Designs
Single-Variable, Independent-Groups Designs
Within- Subjects Design
Within- Subjects Design
Internal Validity – Control through
2 independent Groups Graziano & Raulin (1997).
Designing an Experiment
Between-Subjects Experimental Designs
The Nonexperimental and Quasi-Experimental Strategies
Experimental Design I. Definition of Experimental Design
Chapter 11 EDPR 7521 Dr. Kakali Bhattacharya
Introduction to Between-Subjects Experiments
CHAPTER 8 EXPERIMENTAL DESIGN © 2012 The McGraw-Hill Companies, Inc.
Presentation transcript:

Between- Subjects Design Chapter 8

Review

Two types of Ex research Two basic research designs are used to obtain the groups of scores that are compared in an experiment: within-subjects design between-subjects design.

Within & Between designs Within Subjects StudentsSilenceMusic A1215 B1314 C1514 D 15 E 14 Between Subjects StudentsSilenceMusic A12 B13 C15 D14 E15 F G 14 H I 15 J 14

Between subjects limitations

More subjects required 1- To compare three different treatment conditions with 30 scores in each treatment, the between- subjects design requires 90 participants.

Two other concerns 2- individual differences, may lead to group differences or assignment bias. 3- Increases variance which makes it hard to find significant differences (explained later)

Example If the participants in one group are generally older ( or smarter, or taller, or faster, etc.) than the participants in the other group, then the experiment has a confounding variable.

Two types of confounding variables Confounding from individual differences, which is called assignment bias. Confounding from environmental variables. one group may be tested in a large room and another group in a smaller room.

Making equivalent groups Random Assignment ( Randomization) Matching Groups ( Matched Assignment) Holding Variables Constant or Restricting Range of Variability

1-Random Assignment It is relatively easy, and does not require any measurement or direct control of extraneous variables. However, random assignment is not perfect and cannot guarantee equivalent groups, especially when a small sample is used. Pure chance is not a dependable process for obtaining balanced equivalent groups.

2-Matching Groups School records are used to determine the IQs of the participants, and each student is classified as high IQ, medium IQ, or low IQ. The high- IQ participants are distributed equally between the two groups; half is assigned to one group and the other half is assigned to the second group using restricted random assignment. However, matching requires pre-testing to measure the variable( s) being controlled, It can become difficult to match several variables simultaneously.

3-Holding a variable constant For example, a researcher concerned about potential IQ differences between groups could restrict participants to those with IQs between 100 and 110. Holding a variable constant guarantees that the variable cannot confound the research, but this process limits the external validity of the research results.

INDIVIDUAL DIFFERENCES AND VARIABILITY high variability can obscure any treatment effects that may exist and therefore can undermine the likelihood of a successful study.

Restricted range

Wide Range

Other threats to internal validity of between- subjects designs Differential attrition (Mortality) (2 Dieting Programs) Diffusion of treatments (communication between groups) Compensatory equalization (computer lab) Compensation rivalry (John Henry) Resentful demoralization

STATISTICAL ANALYSES OF BETWEEN- SUBJECTS DESIGNS single- factor /two- group design or simply the two- group design a mean is computed for each group of participants, and then an independent- measures t-test is used to determine whether there is a significant difference between the means

Advantage It is easy to set up a two- group study, In addition, a two- group design provides the best opportunity to maximize the difference between the two treatment conditions; that is, you may select opposite extreme values for the independent variable.

Disadvantage The primary disadvantage of a two- group design is that it provides relatively little information. With only two groups, a researcher obtains only two real data points for comparison.

Comparing Means for More Than Two Groups a single- factor /multiple- group design may be used. For example, a re-searcher may want to compare driving performance under three telephone conditions: while talking on a cell phone, while texting on a cell phone, and without using a phone.

ANOVA For this study, the mean is computed for each group of participants, and a single- factor analysis of variance ( ANOVA for independent measures). When the ANOVA concludes that significant differences exist, some form of post hoc test or posttest is used to determine exactly which groups are significantly different from each other.

Advantage of ANOVA In addition to revealing the full functional relationship between variables, a multiple- group design also provides stronger evidence for a real cause- and- effect relationship than can be obtained from a two- group design.

Nominal and ordinal variables Because you cannot compute means for these variables, you cannot use an independent- measures t test or an ANOVA ( F test) to compare means between groups. However, it is possible to compare proportions between groups using a chi- square test for independence

Example Math test Teaching methodsPassedfailed Traditional56 Group Work66 Computer Based41