3-way Designs defining 2-way & 3-way interactions all the effects conditional and unconditional effects orthogonality, collinearity & the like kxkxk kxkxq.

Slides:



Advertisements
Similar presentations
Canonical Correlation simple correlation -- y 1 = x 1 multiple correlation -- y 1 = x 1 x 2 x 3 canonical correlation -- y 1 y 2 y 3 = x 1 x 2 x 3 The.
Advertisements

Survey of Major Correlational Models/Questions Still the first & most important is picking the correct model… Simple correlation questions simple correlation.
Automated Regression Modeling Descriptive vs. Predictive Regression Models Four common automated modeling procedures Forward Modeling Backward Modeling.
Statistics for the Social Sciences
ANCOVA Workings of ANOVA & ANCOVA ANCOVA, Semi-Partial correlations, statistical control Using model plotting to think about ANCOVA & Statistical control.
Factorial Designs Passer Chapter 9
Kxk BG Factorial Designs expanding the 2x2 design reasons for larger designs statistical analysis of kxk BG factorial designs using LSD for kxk factorial.
Topic 12 – Further Topics in ANOVA
Factorial ANOVA More than one categorical explanatory variable.
Factorial Hypotheses Some review & practice Identifying main effect and interaction RH: Explicit factorial RH: “Blending” interaction and main effect RH:
3-way Factorial Designs Expanding factorial designs Effects in a 3-way design Causal Interpretations of 3-way factorial effects Defining a 3-way interaction.
Common Factor Analysis “World View” of PC vs. CF Choosing between PC and CF PAF -- most common kind of CF Communality & Communality Estimation Common Factor.
Factorial Designs: Research Hypotheses & Describing Results Research Hypotheses of Factorial Designs Inspecting tables to describe factorial data patterns.
Regression Models w/ k-group & Quant Variables Sources of data for this model Variations of this model Main effects version of the model –Interpreting.
Multiple Group X² Designs & Follow-up Analyses X² for multiple condition designs Pairwise comparisons & RH Testing Alpha inflation Effect sizes for k-group.
ANCOVA Workings of ANOVA & ANCOVA ANCOVA, Semi-Partial correlations, statistical control Using model plotting to think about ANCOVA & Statistical control.
Power Analysis for Correlation & Multiple Regression Sample Size & multiple regression Subject-to-variable ratios Stability of correlation values Useful.
Multiple Regression Models: Some Details & Surprises Review of raw & standardized models Differences between r, b & β Bivariate & Multivariate patterns.
Introduction the General Linear Model (GLM) l what “model,” “linear” & “general” mean l bivariate, univariate & multivariate GLModels l kinds of variables.
Describing Factorial Effects Kinds of means & kinds of effects Inspecting tables to describe factorial data patterns Inspecting line graphs to describe.
Statistical Analysis of Factorial Designs z Review of Interactions z Kinds of Factorial Designs z Causal Interpretability of Factorial Designs z The F-tests.
Multivariate Analyses & Programmatic Research Re-introduction to Programmatic research Factorial designs  “It Depends” Examples of Factorial Designs Selecting.
3-way Factorial Designs Expanding factorial designs Effects in a 3-way design Defining a 3-way interaction BG & WG comparisons Experimental & Non-experimental.
MANOVA LDF & MANOVA Geometric example of MANVOA & multivariate power MANOVA dimensionality Follow-up analyses if k > 2 Factorial MANOVA.
Multivariate Analyses & Programmatic Research Re-introduction to Multivariate research Re-introduction to Programmatic research Factorial designs  “It.
Introduction to Multivariate Research & Factorial Designs
Chapter 10 - Part 1 Factorial Experiments.
Simple Correlation Scatterplots & r Interpreting r Outcomes vs. RH:
2x2 ANOVA BG & MG Models Kinds of Factorial Designs ANOVA for BG, MG & WG designs Causal Interpretation of Factorial Results.
Some Details about Bivariate Stats Tests Conceptualizing the four stats tests Conceptualizing NHST, critical values and p-values NHST and Testing RH: Distinguishing.
Review of Factorial Designs 5 terms necessary to understand factorial designs 5 patterns of factorial results for a 2x2 factorial designs Descriptive &
2x2 BG Factorial Designs Definition and advantage of factorial research designs 5 terms necessary to understand factorial designs 5 patterns of factorial.
An Introduction to Classification Classification vs. Prediction Classification & ANOVA Classification Cutoffs, Errors, etc. Multivariate Classification.
Analysis of Factorial Designs Statistical Analysis of 2x2 Designs Statistical Analysis of kxk Designs.
ANCOVA Lecture 9 Andrew Ainsworth. What is ANCOVA?
Statistical Power 1. First: Effect Size The size of the distance between two means in standardized units (not inferential). A measure of the impact of.
Describing Factorial Effects Kinds of means & kinds of effects Inspecting tables to describe factorial data patterns Inspecting line graphs to describe.
Reintroduction to Factorial Designs (re-)Introduction to factorial designs 5 patterns of factorial results Understanding main effects Research Hypotheses.
BIOL 582 Lecture Set 11 Bivariate Data Correlation Regression.
Coding Multiple Category Variables for Inclusion in Multiple Regression More kinds of predictors for our multiple regression models Some review of interpreting.
Intro to Factorial Designs The importance of “conditional” & non-additive effects The structure, variables and effects of a factorial design 5 terms necessary.
Regression Models w/ 2 Categorical Variables Sources of data for this model Variations of this model Definition and advantage of factorial research designs.
Regression Models w/ 2 Quant Variables Sources of data for this model Variations of this model Main effects version of the model –Interpreting the regression.
Educational Research Chapter 13 Inferential Statistics Gay, Mills, and Airasian 10 th Edition.
Advanced Meta-Analyses Heterogeneity Analyses Fixed & Random Efffects models Single-variable Fixed Effects Model – “Q” Wilson Macro for Fixed Efffects.
Basic Analysis of Factorial Designs The F-tests of a Factorial ANOVA Using LSD to describe the pattern of an interaction.
Mixed-Design ANOVA 5 Nov 2010 CPSY501 Dr. Sean Ho Trinity Western University Please download: treatment5.sav.
Adjusted from slides attributed to Andrew Ainsworth
Regression Models w/ 2-group & Quant Variables Sources of data for this model Variations of this model Main effects version of the model –Interpreting.
Plotting Linear Main Effects Models Interpreting 1 st order terms w/ & w/o interactions Coding & centering… gotta? oughta? Plotting single-predictor models.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 14 Comparing Groups: Analysis of Variance Methods Section 14.3 Two-Way ANOVA.
Analysis and Interpretation: Analysis of Variance (ANOVA)
Smith/Davis (c) 2005 Prentice Hall Chapter Fifteen Inferential Tests of Significance III: Analyzing and Interpreting Experiments with Multiple Independent.
Introduction to “Kinds” of 2-way Factorial Designs Incorporating within-groups comparisons ANOVA for BG, MG & WG designs Applying LSD mmd to kxk designs.
Kxkxk 3-way Factorial Designs kxkxk 3-way designs, effects & causality 3-way interactions describing effects and checking if they are. “descriptive” or.
Descriptive Statistics. Outline of Today’s Discussion 1.Central Tendency 2.Dispersion 3.Graphs 4.Excel Practice: Computing the S.D. 5.SPSS: Existing Files.
Another way to select sample size The sample R-squared method.
Other Ways of Thinking About Interactions Ways of Describing Interactions other than “Simple Effects” Interactions as “other kinds of” cell mean difference.
Outline of Today’s Discussion 1.Introduction to Factorial Designs 2.Analysis of Factorial Designs 3.Hypotheses For Factorial Designs 4.Eta Squared and.
ANCOVA Workings of ANOVA & ANCOVA ANCOVA, partial correlations & multiple regression Using model plotting to think about ANCOVA & Statistical control Homogeneity.
Key understandings in mathematics: synthesis of research Anne Watson NAMA 2009 Research with Terezinha Nunes and Peter Bryant for the Nuffield Foundation.
General Linear Model What is the General Linear Model?? A bit of history & our goals Kinds of variables & effects It’s all about the model (not the data)!!
Linear Discriminant Function Classification vs. Prediction Classification & ANOVA Classification Cutoffs, Errors, etc. Multivariate Classification & LDF.
INF397C Introduction to Research in Information Studies Spring, Day 12
Statistics for the Social Sciences
12 Inferential Analysis.
Interactions & Simple Effects finding the differences
BHS Methods in Behavioral Sciences I
Main Effects and Interaction Effects
12 Inferential Analysis.
Presentation transcript:

3-way Designs defining 2-way & 3-way interactions all the effects conditional and unconditional effects orthogonality, collinearity & the like kxkxk kxkxq kxqxq qxqxq

A 2-way interaction… “emerges” when there are 2 IVs (categorical or quant) is the non-additive/joint effect of the 2 IVs usually describes as “when the effect of one IV is different for different values of the 2nd IV” Expanding this to define 3-ways… “emerges” when there are 3 IVS (categorical or quant) is non-additive/joint effect of the 3 IVs usually identified as the “when the 2-way interaction of 2 IVs is different for different values of the 3 rd IV”

We are going to focus on “full model” 3-ways – designs that have all possible interactions included For a design with the A, B & C IVs/predictors there will be 7 “unconditional effects” All of these effects have the tag “… controlling for the other effects in the model.” AxBxC 3-way interaction – joint effect of A, B & C… AxB 2-way interaction – joint effect of A & B… AxC 2-way interaction – joint effect of A & C… BxC 2-way interaction – joint effect of B & C… A main effect – effect of A… B main effect – effect of B… C main effect – effect of C…

There are lots of simple/conditional effects we might consider Each of these looks at one of the lower-order 2-way or main effects at a specific value of the other IV(s) Simple AxB interaction at different values of C Simple AxC interaction at different values of B Simple BxC interaction at different values of A Simple effect of A at different combinations of B & C values Simple effect of B at different combinations of A & C values Simple effect of C at different combinations of A & B values

Having all these different “effects” raises three important issues for all analyses…. #1 How do we choose to represent and describe the model,. especially the 3-way interaction ?? #2 What do the lower-order terms tell us ?? #2a Do the lower-order terms represent and allow an. inference to populations that we care about and tell us. useful information?? #2b Whether the lower-order terms are “descriptive,”. “misleading” or “potentially misleading” ????

#1 Based on the definition of a 3-way, we have three choices about how to depict and describe the 3-way interaction… 1.Simple AxB interaction at different values of C 2.Simple AxC interaction at different values of B 3.Simple BxC interaction at different values of A Which to choose? 1 st  pick the variable that is most important to you – which IV is most central in your thinking about the DV/behavior you are studying? 2 nd  figure out which of the other two IVs you are most interested in understanding how it changes or moderates the IV you care about most. Now you know which 2-way you’ll use to figure out the 3-way!

Stimulus Type Shape Texture #Practices 1 10 Modality Vision Touch Notice that this layout was chosen to portray the 3-way as how the simple 2-way interaction of Modality x Practice is different for Shape v Texture stimuli. We can then express the simple 2-ways as either modality effects for each # practices or # practice effects for each modality

#2a Related to this is the very important issue of whether or not the 2-way interactions and main effects that are part of the 3- way design “mean anything to us” ??? It all goes back to  “representation & inference” !!! Remember – the purpose of any IV condition or value is to represent some population  so we can infer that the difference between those IV conditions or values represent differences between the populations we really care about! The “cells” in the 3-way each represent a specific population and so, comparisons between them are comparisons between out target populations. But the means/values of all the lower-order effects are “aggregates” – who do they represent???

Let’s use a simpler 2-way model to consider this… We know what population is represented by each of the four cell means! What about the marginal mean for “Paper Presentation”  the aggregate of Easy & Hard Difficulty… 65 Does it represent “any difficulty”… “medium difficulty” ??? What about the marginal mean “Hard Task Difficulty”??? What population is represented by the aggregate of Paper & Computer Task Presentations???? 55

#2b Related to the “meaningfullness” issue, and perhaps the most difficult part about working with these larger 3-way designs is determining which of the lower-order effects (2- ways and main effects) are “descriptive” and which are “misleading” Here’s the rule: Any lower-order effect that is involved in a significant higher- order effect is suspect! You must check if that lower order effect is descriptive or misleading… … by comparing the pattern of the lower order effect with the pattern of all corresponding simple effects at all combinations of the other variables involved in the higher order effect!

Let’s start by looking at a couple of 2-ways… Notice that the main effect of Task Presentation has the same pattern as the simple effect of Task Presentation at each level of Task Difficulty. So, the main effect of Task Presentation is descriptive!

Notice that the main effect of Task Presentation does not have the same pattern as the simple effect of Task Presentation at each level of Task Difficulty. So, the main effect of Task Presentation is potentially misleading – descriptive for Hard, but misleading for Easy!

Notice that the main effect of Task Presentation does not have the same pattern as the simple effect of Task Presentation at either level of Task Difficulty. So, the main effect of Task Presentation is misleading – descriptive for neither Hard nor Easy!

This one is very important – it causes the most mistakes… Notice that the main effect of Task Presentation does not have the same pattern as the simple effect of Task Presentation at either level of Task Difficulty. So, the null main effect of Task Presentation is misleading – descriptive for neither Hard nor Easy!

Back to 3-ways… In a 3-way effect we have 6 lower-order effects 3  2-way interactions 3  Main effects Based on the last part There are 2 situations when we will care! #1  if the aggregates compared in the effect represent a target population that we care about! #2  when the effect is descriptive, and can be used to generalize from the aggregate to all the separate conditions/values (in the current study/design) For each lower-order effect we have to decide… Do we care??? If the aggregates represent meaningful populations, but the effect is misleading  we’ll have to carefully describe the situation – when the pattern is descriptive and misleading, etc. If the effect is neither representative not a useful general description, then we may not care about the effect !!!

#2a Related to this is the very important issue of whether or not the 2-way interactions and main effects that are part of the 3- way design “mean anything to us” ??? It all goes back to  “representation & inference” !!! Remember – the purpose of any design condition or value is to represent some population  so we can infer that the difference between those conditions or values in the design represent differences between the populations we really care about! The “cells” in the 3-way each represent a specific population and so, comparisons between them are comparisons between out target populations. But the means/values of all the lower-order effects are “aggregates” – who do they represent???

Let’s use a simpler 2-way model to consider this… We know what population is represented by each of the four cell means! What about the marginal mean for “Paper Presentation”  the aggregate of Easy & Hard Difficulty… 60 Does it represent “any difficulty”… “medium difficulty” ??? What about the marginal mean “Hard Task Difficulty”??? What population is represented by the aggregate of Paper & Computer Task Presentations???? 60

Let’s take a look at the four kinds of 3-ways, considering how the effects are portrayed and described… kxkxk  all 3 are categorical/qualitative “IVs”  often called a “3-way Factorial ANOVA Design”  all interactions usually included kxkxq  2 categorical/qualitative “IVs” & 1 quant “covariate”  often called a “2-way factorial ANCOVA Design”  usually the interaction of the 2 IVs is included kxqxq  1 categorical/qualitative “IV” & 2 quant “covariates”  often called an “ANCOVA with 2 covariates”  usually no interactions are included qxqxq  all 3 are quantitative “predictors”  if no interactions – usually called a “multiple regression”  if interactions – usually called a “moderated regression” We will include all the interactions in all the models !!!

kxkxk Stimulus Type Shape Texture #Practices 1 10 Modality Vision Touch Bimodal

Effects for this Design 3-way interaction of x Modality x Practice 2-way interaction of Stimulus x Modality 2-way interaction of Stimulus x Practice 2-way interaction of Modality x Practice Main effect ofStimulus Main effect of Modality Main effect of Practice Simple interaction of Stimulus x Modality at dif values of Practice Simple interaction of Stimulus x Practice at dif values of Modality Simple interaction of Modality x Practice at dif values of Stimulus Simple effect of Stimulus at dif combos of Modality & Practice Simple effect of Modality at dif combos of Stimulus & Practice Simple effect of Practice at dif combos of Modality & Practice kxkxk

Vision Touch Bimodal 10 Practices 1 Practice Shape Texture kxkxk

Practices 10 Vision Touch Bimodal Shape Texture kxkxk PERFORMANCEPERFORMANCE

kxkxq Trainer Unfamiliar Familiar Group Size Large Group Small Group Individual Quantitative “covariate” was Motivation

Effects for this Design 3-way interaction of Group Size x Trainer x Motivation 2-way interaction of Group Size x Trainer 2-way interaction of Group Size x Motivation 2-way interaction of Trainer x Motivation Main effect of Group Size Main effect of Trainer Main effect of Motivation Simple interaction of Group Size x Trainer at dif values of Motivation Simple interaction of Group x Motivation at dif values of Trainer Simple interaction of Trainer x Motivation at dif values of Group Size Simple effect of Group Size at dif combos of Trainer & Motivation Simple effect of Trainer at dif combos of Group Size & Motivation Simple effect of Motivation at dif combos of Group Size & Trainer kxkxq

Motivation Large Group Small Group Individual Unfamiliar Familiar kxkxq PERFORMANCEPERFORMANCE

kxqxq Location Friend’s Stanger’s House House Quantitative “covariates” were: Guest Familiarity Social Skills

Effects for this Design 3-way interaction of Location x Familiarity x SoSkill 2-way interaction of Location x Familiarity 2-way interaction of Location x SoSkill 2-way interaction of Familiarity x SoSkill Main effect of Location Main effect of Familiarity Main effect of SoSkill Simple interaction of Location x Familiarity at dif values of SoSkill Simple interaction of Location x SoSkill at dif values of Familiarity Simple interaction of Familiarity x SoSkill at dif values of Location Simple effect of Location at dif combos of Familiarity & SoSkill Simple effect of Familiarity at dif combos of Location & SoSkills Simple effect of SoSkills at dif combos of Familiarity & Location kxqxq

Social Skills High Guest Familiarity Medium Guest Familiarity Low Guest Familiarity kxqxq PERFORMANCEPERFORMANCE Friend’s House Stranger’s House

kxqxq

qxqxq Quantitative “predictors” were: Stress Social Support Income

Effects for this Design 3-way interaction of Stress x SoSupp x Income 2-way interaction of Stress x SoSupp 2-way interaction of Stress x Income 2-way interaction of SoSupp x Income Main effect of Stress Main effect of SoSupp Main effect of Income Simple interaction of Stress x SoSupp at dif values of Income Simple interaction of Stress x Income at dif values of SoSupp Simple interaction of SoSupp x Income at dif values of Stress Simple effect of Stress at dif combos of SoSupp & Income Simple effect of SoSupp at dif combos of Stress & Income Simple effect of Income at dif combos of Stress & SoSupp qxqxq

Stress DepressionDepression High Social Support Medium Social Support Low Social Support High Income Medium Income Low Income qxqxq