Guidelines for IDing Experimental Design Levels/ participant? One Independent Groups design More than one Repeated Measures design Once: incomplete Yes:

Slides:



Advertisements
Similar presentations
Copyright 2005, Prentice Hall, Sarafino
Advertisements

Chapter 9 Choosing the Right Research Design Chapter 9.
Experimental Design True Experimental Designs n Random assignment n Two comparison groups n Controls threats to internal validity n Strongest evidence.
1 1 Chapter 5: Multiple Regression 5.1 Fitting a Multiple Regression Model 5.2 Fitting a Multiple Regression Model with Interactions 5.3 Generating and.
Experimental Design I. Definition of Experimental Design
Factorial Designs Passer Chapter 9
Randomized Experimental Design
Research Methods in Psychology Complex Designs.  Experiments that involve two or more independent variables studies simultaneously at least one dependent.
1 Chapter 7: The Experimental Research Strategy Manipulating the IV Controlling Extraneous Variance Holding Extraneous Vars Constant Between Subjects Designs.
Design of Experiments and Analysis of Variance
11. Experimental Research: Factorial Design What are factorial experimental designs, and what advantages do they have over one-way experiments? What is.
PSY 307 – Statistics for the Behavioral Sciences
FACTORIAL DESIGNS F Terms for Factorials F Types of Factorial Designs F Notation for Factorials F Types of Effects F Looking at Tables of Means F Looking.
SMALL-N DESIGNS u Experiments conducted on only one or a few subjects u External validity is a problem u Internal validity is often very good - no individual.
CHAPTER 8 EXPERIMENTAL DESIGN.
Sample Selection Issues in Experiment Random sampling (difficult) Convenience & purposive sampling Volunteers External validity Representativeness & generalizability.
Psych 231: Research Methods in Psychology
APA- Abstract, Results & Discussion (Smith & Davis, 2005; Mitchell & Jolley, 2004)
Statistical Analysis of Factorial Designs z Review of Interactions z Kinds of Factorial Designs z Causal Interpretability of Factorial Designs z The F-tests.
Complex Experimental Designs. INCREASING THE NUMBER OF LEVELS OF AN INDEPENDENT VARIABLE Provides more information about the relationship than a two level.
Educational Research by John W. Creswell. Copyright © 2002 by Pearson Education. All rights reserved. Slide 1 Chapter 11 Experimental and Quasi-experimental.
© 2001 Dr. Laura Snodgrass, Ph.D.1 Basic Experimental Design Common Problems Assigning Participants to Groups Single variable experiments –bivalent –multivalent.
S519: Evaluation of Information Systems
Factorial Experiments Factorial Design = experiment in which more than one IV (factor) at a time is manipulated Uses all possible combinations of the levels.
Complex Design. Two group Designs One independent variable with 2 levels: – IV: color of walls Two levels: white walls vs. baby blue – DV: anxiety White.
SMALL-N DESIGNS What is a Small-N Design? What is a Reversal Design?
2x2 BG Factorial Designs Definition and advantage of factorial research designs 5 terms necessary to understand factorial designs 5 patterns of factorial.
Chapter 14 Inferential Data Analysis
L1 Chapter 11 Experimental and Quasi- experimental Designs Dr. Bill Bauer.
Experimental and Quasi- Experimental Designs Chapters 9 & 10.
Evidence-Based Practice Current knowledge and practice must be based on evidence of efficacy rather than intuition, tradition, or past practice. The importance.
More Than One Independent Variable Laying Out a Factorial Design A Research Example Choosing a Between-Subjects Design.
QNT 531 Advanced Problems in Statistics and Research Methods
COMPLEX EXPERIMENTAL DESIGNS © 2012 The McGraw-Hill Companies, Inc.
@ 2012 Wadsworth, Cengage Learning Chapter 9 Applying the Logic of Experimentation: Between-Subjects 2012 Wadsworth, Cengage Learning.
Chapter 7 Experimental Design: Independent Groups Design.
+ Research Methods CYPA AP Psychology Review Session 2.
Statistics Psych 231: Research Methods in Psychology.
1 Experimental Design. 2  Single Factor - One treatment with several levels.  Multiple Factors - More than one treatment with several levels each. 
@ 2012 Wadsworth, Cengage Learning Chapter 10 Extending the Logic of Experimentation: Within-Subjects and Matched-Subjects 2012 Wadsworth,
Mixed-Design ANOVA 5 Nov 2010 CPSY501 Dr. Sean Ho Trinity Western University Please download: treatment5.sav.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Mixed ANOVA Models combining between and within. Mixed ANOVA models We have examined One-way and Factorial designs that use: We have examined One-way.
Choosing the right research design
Evidence-Based Practice Evidence-Based Practice Current knowledge and practice must be based on evidence of efficacy rather than intuition, tradition,
Research Methods and Data Analysis in Psychology Spring 2015 Kyle Stephenson.
Smith/Davis (c) 2005 Prentice Hall Chapter Fifteen Inferential Tests of Significance III: Analyzing and Interpreting Experiments with Multiple Independent.
Research Methods and Data Analysis in Psychology Spring 2015 Kyle Stephenson.
CH 8 Factorial Designs. Section 8.1 and 8.2Two-way Factorials.
Outline of Today’s Discussion 1.Introduction to Factorial Designs 2.Analysis of Factorial Designs 3.Hypotheses For Factorial Designs 4.Eta Squared and.
PowerPoint presentation to accompany Research Design Explained 5th edition ; ©2004 Mark Mitchell & Janina Jolley Chapter 11 Factorial Designs.
SUMMARY EQT 271 MADAM SITI AISYAH ZAKARIA SEMESTER /2015.
Complex Experiments.
8 Experimental Research Design.
Chapter 12: The Nuts and Bolts of Multi-factor experiments.
Chapter 10: Complex Experimental Designs
Experimental Research Designs
Between-Subjects, within-subjects, and factorial Experimental Designs
Research Design & Analysis II: Class 10
PSY 307 – Statistics for the Behavioral Sciences
11. Experimental Research: Factorial Design
Interactions & Simple Effects finding the differences
Scientific Method Steps
Complex Experimental Designs
Psych 231: Research Methods in Psychology
Scientific Method Steps
Analysis of Complex Designs
Experimental Design I. Definition of Experimental Design
CHAPTER 8 EXPERIMENTAL DESIGN © 2012 The McGraw-Hill Companies, Inc.
Presentation transcript:

Guidelines for IDing Experimental Design Levels/ participant? One Independent Groups design More than one Repeated Measures design Once: incomplete Yes: all possible orders No: selected orders Four or fewer conditions? More than once: complete Yes: block randomization No: ABBA counterbalancing Anticipation problems? Times each level/ Participant?

Complex Designs When a two-way is more than spaghetti and chili!

What are they? Simple versus complex designs –One-way versus Two-way, etc. Types of factorial designs –Completely randomized –Completely within –Mixed Variable and level shorthand 2 x 2 2 x 3 2 x 2 x 3

What good are they? Advantages of complex designs Economy Understanding External validityinteractions Example: social facilitation versus evaluation apprehension

Some Data

Identifying Main Effects and Interactions Interpretation –Main effects: the overall effect of one independent variable on the dependent variable. –Interactive effects: the effect of the first independent variable on the dependent variable that is contingent on a particular level of the second independent variable. ordinal interactions disordinal (crossover) interactions

Analysis of Complex Designs Simplest case: the 2 x 2 design –Three classes of scientific hypotheses Main effect of treatment method: e.g., behavioral method will be more effective than the cognitive method Main effect of presenting problem: e.g., treatment will be more effective for habit problems than learning problems Interaction effect of treatment method x presenting problem: e.g., cognitive therapy will be more effective for learning problems, but behavioral therapy will be more effective for habit problems

Interactions: Looking at the picture…

Analysis: When Interaction is Present… Evaluate evidence descriptively –Graphs (non-parallel lines) –Tables (subtraction method) Confirm by inferential statistics: complex ANOVA Qualifies our interpretation of the main effect

Analysis: When Interaction is NOT present… Focus is on interpreting the main effect(s) Analytical comparisons of the marginal means and confidence intervals with planned comparisons

The many faces of 2 x 2s: Possible Results #1 What do we have here?

The many faces of 2 x 2s: Possible Results #2 What do we have here?

The many faces of 2 x 2s: Possible Results #3 What do we have here?

The many faces of 2 x 2s: Possible Results #4 What do we have here?

The many faces of 2 x 2s: Possible Results #5 What do we have here?

The many faces of 2 x 2s: Possible Results #6 What do we have here?

The many faces of 2 x 2s: Possible Results #7 What do we have here?

The many faces of 2 x 2s: Possible Results #8 What do we have here?

Interpreting Interactions Theory testing External validity Ceiling and floor effects Natural groups design