1 Mixed and Random Effects Models 1-way ANOVA - Random Effects Model 1-way ANOVA - Random Effects Model 2-way ANOVA - Mixed Effects Model 2-way ANOVA -

Slides:



Advertisements
Similar presentations
Analysis of Variance (ANOVA)
Advertisements

1 Chapter 4 Experiments with Blocking Factors The Randomized Complete Block Design Nuisance factor: a design factor that probably has an effect.
Chapter 4 Randomized Blocks, Latin Squares, and Related Designs
Chapter Fourteen The Two-Way Analysis of Variance.
N-way ANOVA. Two-factor ANOVA with equal replications Experimental design: 2  2 (or 2 2 ) factorial with n = 5 replicate Total number of observations:
The Two Factor ANOVA © 2010 Pearson Prentice Hall. All rights reserved.
Chapter 5 Introduction to Factorial Designs
1 Multifactor ANOVA. 2 What We Will Learn Two-factor ANOVA K ij =1 Two-factor ANOVA K ij =1 –Interaction –Tukey’s with multiple comparisons –Concept of.
Chapter 11 Analysis of Variance
Statistics for Business and Economics
Chapter 7 Blocking and Confounding in the 2k Factorial Design
Experimental Design Terminology  An Experimental Unit is the entity on which measurement or an observation is made. For example, subjects are experimental.
1 Chapter 5 Introduction to Factorial Designs Basic Definitions and Principles Study the effects of two or more factors. Factorial designs Crossed:
Lecture 9: One Way ANOVA Between Subjects
1 Chapter 7 Blocking and Confounding in the 2 k Factorial Design.
13-1 Designing Engineering Experiments Every experiment involves a sequence of activities: Conjecture – the original hypothesis that motivates the.
Outline Single-factor ANOVA Two-factor ANOVA Three-factor ANOVA
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 11 Multifactor Analysis of Variance.
13 Design and Analysis of Single-Factor Experiments:
Repeated Measures ANOVA Used when the research design contains one factor on which participants are measured more than twice (dependent, or within- groups.
Biostatistics-Lecture 9 Experimental designs Ruibin Xi Peking University School of Mathematical Sciences.
Understanding the Two-Way Analysis of Variance
1 14 Design of Experiments with Several Factors 14-1 Introduction 14-2 Factorial Experiments 14-3 Two-Factor Factorial Experiments Statistical analysis.
22-1 Factorial Treatments (§ 14.3, 14.4, 15.4) Completely randomized designs - One treatment factor at t levels. Randomized block design - One treatment.
Factorial Experiments
1 Experimental Statistics - week 7 Chapter 15: Factorial Models (15.5) Chapter 17: Random Effects Models.
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Chapter Comparing Three or More Means 13.
MANOVA Multivariate Analysis of Variance. One way Analysis of Variance (ANOVA) Comparing k Populations.
1 Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 6 Solving Normal Equations and Estimating Estimable Model Parameters.
© Copyright McGraw-Hill CHAPTER 12 Analysis of Variance (ANOVA)
CHAPTER 12 Analysis of Variance Tests
The Randomized Complete Block Design
Chapter 11 Multifactor Analysis of Variance.
IE341 Midterm. 1. The effects of a 2 x 2 fixed effects factorial design are: A effect = 20 B effect = 10 AB effect = 16 = 35 (a) Write the fitted regression.
1 Blocking & Confounding in the 2 k Factorial Design Text reference, Chapter 7 Blocking is a technique for dealing with controllable nuisance variables.
DOX 6E Montgomery1 Design of Engineering Experiments Part 9 – Experiments with Random Factors Text reference, Chapter 13, Pg. 484 Previous chapters have.
Orthogonal Linear Contrasts This is a technique for partitioning ANOVA sum of squares into individual degrees of freedom.
Design Of Experiments With Several Factors
ANOVA: Analysis of Variance.
Chapter 14 Repeated Measures and Two Factor Analysis of Variance
1 Always be contented, be grateful, be understanding and be compassionate.
Latin Squares (Kirk, chapter 8) BUSI 6480 Lecture 7.
1 The Two-Factor Mixed Model Two factors, factorial experiment, factor A fixed, factor B random (Section 13-3, pg. 495) The model parameters are NID random.
Latin Square Designs KNNL – Sections Description Experiment with r treatments, and 2 blocking factors: rows (r levels) and columns (r levels)
Single-Factor Studies KNNL – Chapter 16. Single-Factor Models Independent Variable can be qualitative or quantitative If Quantitative, we typically assume.
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 18 Random Effects.
Two-Factor Studies with Equal Replication KNNL – Chapter 19.
Three or More Factors: Latin Squares
Chapter 4 Analysis of Variance
One-Way Analysis of Variance Recapitulation Recapitulation 1. Comparing differences among three or more subsamples requires a different statistical test.
Copyright © Cengage Learning. All rights reserved. 11 Multifactor Analysis of Variance.
Chapter 9 More Complicated Experimental Designs. Randomized Block Design (RBD) t > 2 Treatments (groups) to be compared b Blocks of homogeneous units.
Factorial Design of Experiments. An Economy of Design Two or more levels of each factor (variable) are administered in combination with the two or more.
1 Design of Engineering Experiments – The 2 k Factorial Design Text reference, Chapter 6 Special case of the general factorial design; k factors, all at.
Fixed effects analysis in a Two–way ANOVA. Problem 5.6 Layout.
Designs for Experiments with More Than One Factor When the experimenter is interested in the effect of multiple factors on a response a factorial design.
Factorial BG ANOVA Psy 420 Ainsworth. Topics in Factorial Designs Factorial? Crossing and Nesting Assumptions Analysis Traditional and Regression Approaches.
Three Factor ANOVA I,J,K = Levels of the factors A,B, C L ijk = The number of obeservations of factor A at level i, factor B at level j, and factor C at.
Experimental Designs The objective of Experimental design is to reduce the magnitude of random error resulting in more powerful tests to detect experimental.
Factorial Experiments
Comparing Three or More Means
Chapter 5 Introduction to Factorial Designs
Chapter 7 Blocking and Confounding in the 2k Factorial Design
Two-Factor Studies with Equal Replication
Two-Factor Studies with Equal Replication
Latin Square Designs KNNL – Sections
The Randomized Complete Block Design
ENM 310 Design of Experiments and Regression Analysis Chapter 3
14 Design of Experiments with Several Factors CHAPTER OUTLINE
STATISTICS INFORMED DECISIONS USING DATA
Presentation transcript:

1 Mixed and Random Effects Models 1-way ANOVA - Random Effects Model 1-way ANOVA - Random Effects Model 2-way ANOVA - Mixed Effects Model 2-way ANOVA - Mixed Effects Model –X ij =  +  i + B j + G ij +  ij –Distributions of B j, G ij &  ij are N(0,  2,B ), N(0,  2,G ), N(0,  2, , ) respectively –Hypothesis Test –Order of testing Interaction first Interaction first Main effects Main effects

2

3 Three Factor ANOVA! Things can start to get messy now! Things can start to get messy now! Consider only fixed effects of the three factors: A,B, and C Consider only fixed effects of the three factors: A,B, and C The number of levels are: I, J, and K, respectively The number of levels are: I, J, and K, respectively L ijk = the number of observations L ijk = the number of observations –L will remain the same for all levels; otherwise it is difficult to do any calculations by hand

4 Three Factor ANOVA Estimators

5 Three Factor ANOVA Table

6

7 Three Factor ANOVA ANOVA table same as usual ANOVA table same as usual F-tests of main effects and interactions are: F-tests of main effects and interactions are: –MSA/MSE, MSB/MSE, MSC/MSE –MSAB/MSE, MSAC/MSE, MSBC/MSE –MSABC/MSE Testing procedure Testing procedure –Three way interaction –Two way interactions –Main effects Interpretation Interpretation –Draw graphs!!

8 Three Factor ANOVA Tukey’s Post Hoc test can be conducted as usual Tukey’s Post Hoc test can be conducted as usual –Second parameter is the number of sample means –Third parameter is df of error Mixed and Random effects Mixed and Random effects

9 Problem 1

10 Problem 1

11 Problem 1

12 Problem 1

13 Problem 1

14 Latin Square Complete layout Complete layout –Factors A,B, and C with levels I, J, and K –Need at least IJK observations Incomplete layout Incomplete layout –Have less than IJK observations Latin Square - Latin Square - –Incomplete layout, but it works because of the combinations –I=J=K –Assume no two-way or three-way interactions

15 Latin Square

16 Latin Square

17 Models for Latin Squares X ij =  ij +  i +  j +  k +  ij(k) X ij =  ij +  i +  j +  k +  ij(k) –Distribution of  ij(k) is N(0,  2, , ) –Hypothesis Test

18 Latin Squares (Notation is a Little Different)

19

20 Example

21 Example

22 Example

23 Graeco Latin Square The Latin Square is a restriction on randomization of the cells The Latin Square is a restriction on randomization of the cells In some experiments one can impose another restriction on randomization - Graeco Latin In some experiments one can impose another restriction on randomization - Graeco Latin –A 4-way ANOVA Consider the following table Consider the following table –In this design, the 3rd restriction is at levels , , , and  –They appear once and only once in each row and column and they appear once and only once with each level of treatment A,B, C, or D –Problem - only 3 df for the error

24 Gaeco Latin Square

25 Gaeco Latin Square

26 Example A composite measure of screen quality was made on screens using 4 lacquer concentrations (A), four standing times (B), four acryloid concentrations (C), and four acetone concentrations (D) A composite measure of screen quality was made on screens using 4 lacquer concentrations (A), four standing times (B), four acryloid concentrations (C), and four acetone concentrations (D)

27 Example

28 Example

29 Example

30 Example

31 Example

32 2 p Factorial Experiments Have lots of variables and want to see which variable(s) impact the response variable Have lots of variables and want to see which variable(s) impact the response variable Consider a plastic injection molding process (p) Consider a plastic injection molding process (p) –shot size –type of plastic –speed –temperature –type of mold –quality- flash Check each at only 2 levels (2) Check each at only 2 levels (2)

33 2 p Factorial Experiments 2 3 experiments 2 3 experiments –3-way ANOVA –SS - Yate’s Method 2 p when p>3 2 p when p>3 Confounding and blocking Confounding and blocking Confounding with more than two blocks Confounding with more than two blocks Fractional Replication Fractional Replication

Factorial Experiment Only 2 parameters, so…. Only 2 parameters, so…. Each effect (main and interaction) will have only one df Therefore...

Factorial Experiment The parameters of the model can be estimated The parameters of the model can be estimated –taking averages over the subscripts of X ijkl ’s and –forming linear combinations of the averages

Factorial Experiment

Factorial Experiment Concept of Contrasts Concept of Contrasts

Factorial Experiment Each estimator is a linear function of the cell totals Each estimator is a linear function of the cell totals Coefficients +1 or -1 Coefficients +1 or -1 Equal number of each Equal number of each Then each function is a contrast in the X ijk.’s Then each function is a contrast in the X ijk.’s

Factorial Experiment Example

40 Example of Computing Contrasts

41 Computing SS for 2 3 Factorial Experiment Each estimate is a contrast in the cell totals which are then multiplied by 1/(8n) Each estimate is a contrast in the cell totals which are then multiplied by 1/(8n) SS(effect) = contrast 2 /(8n) SS(effect) = contrast 2 /(8n) Set up a table of contrasts where coefficient is +1 or -1 for each x ijk Set up a table of contrasts where coefficient is +1 or -1 for each x ijk –Yate’s Method –Note the order of the contrasts - standard order 3 Factors - a,b,ab,c,ac,bc,abc 3 Factors - a,b,ab,c,ac,bc,abc When p>3, such as 4 Factors - a,b,ab,c, ac,bc,abc, d,ad,bd, abd,cd,acd,bcd, abcd When p>3, such as 4 Factors - a,b,ab,c, ac,bc,abc, d,ad,bd, abd,cd,acd,bcd, abcd

Factorial Experiment-Yate’s Contrasts AB contrast = x x x x x x x x 222.

Factorial Experiment-Yate’s Contrasts AB contrast = x x x x x x x x 222. AB contrast = x x x x x x x x 222. SS(effect) = ABcontrast 2 /(8n) SS(effect) = ABcontrast 2 /(8n) Computing the SS’s can be tedious to say the least Computing the SS’s can be tedious to say the least

Factorial Experiment-Yate’s Contrasts Computing SS Easily AB contrast = x x x x x x x x 222.

45 Example

46 Example 2

47 Example 2

48 Example 2

49 Example 2

50 Example 2