Factorial Models Random Effects Random Effects Gauge R&R studies (Repeatability and Reproducibility) have been an expanding area of application Gauge R&R.

Slides:



Advertisements
Similar presentations
Prepared by Lloyd R. Jaisingh
Advertisements

Gage R&R Estimating measurement components
Estimation of Means and Proportions
GENERAL LINEAR MODELS: Estimation algorithms
 Population multiple regression model  Data for multiple regression  Multiple linear regression model  Confidence intervals and significance tests.
Topic 32: Two-Way Mixed Effects Model. Outline Two-way mixed models Three-way mixed models.
Statistical Techniques I EXST7005 Miscellaneous ANOVA Topics & Summary.
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture #19 Analysis of Designs with Random Factor Levels.
Design of Experiments and Analysis of Variance
Classical Regression III
Design of Engineering Experiments - Experiments with Random Factors
Chapter 10 Simple Regression.
Point estimation, interval estimation
Chapter 11 Analysis of Variance
Statistical Background
Chapter 11 Multiple Regression.
13-1 Designing Engineering Experiments Every experiment involves a sequence of activities: Conjecture – the original hypothesis that motivates the.
Copyright © 2014 by McGraw-Hill Higher Education. All rights reserved.
Standard error of estimate & Confidence interval.
1 Advances in Statistics Or, what you might find if you picked up a current issue of a Biological Journal.
AM Recitation 2/10/11.
HAWKES LEARNING SYSTEMS math courseware specialists Copyright © 2010 by Hawkes Learning Systems/Quant Systems, Inc. All rights reserved. Chapter 14 Analysis.
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Chapter Inference on the Least-Squares Regression Model and Multiple Regression 14.
Chapter 13Design & Analysis of Experiments 8E 2012 Montgomery 1.
Inferences in Regression and Correlation Analysis Ayona Chatterjee Spring 2008 Math 4803/5803.
CHAPTER 12 Analysis of Variance Tests
Chapter 10 Analysis of Variance.
1 Chapter 13 Analysis of Variance. 2 Chapter Outline  An introduction to experimental design and analysis of variance  Analysis of Variance and the.
Chapter 11 Linear Regression Straight Lines, Least-Squares and More Chapter 11A Can you pick out the straight lines and find the least-square?
An alternative approach to testing for a linear association The Analysis of Variance (ANOVA) Table.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
6-1 Introduction To Empirical Models Based on the scatter diagram, it is probably reasonable to assume that the mean of the random variable Y is.
The Completely Randomized Design (§8.3)
DOX 6E Montgomery1 Design of Engineering Experiments Part 9 – Experiments with Random Factors Text reference, Chapter 13, Pg. 484 Previous chapters have.
VI. Regression Analysis A. Simple Linear Regression 1. Scatter Plots Regression analysis is best taught via an example. Pencil lead is a ceramic material.
1 The Two-Factor Mixed Model Two factors, factorial experiment, factor A fixed, factor B random (Section 13-3, pg. 495) The model parameters are NID random.
Chapter 7 Point Estimation of Parameters. Learning Objectives Explain the general concepts of estimating Explain important properties of point estimators.
ETM U 1 Analysis of Variance (ANOVA) Suppose we want to compare more than two means? For example, suppose a manufacturer of paper used for grocery.
1 Experiments with Random Factors Previous chapters have considered fixed factors –A specific set of factor levels is chosen for the experiment –Inference.
1 Experimental Statistics - week 9 Chapter 17: Models with Random Effects Chapter 18: Repeated Measures.
Chapter 13 Design of Experiments. Introduction “Listening” or passive statistical tools: control charts. “Conversational” or active tools: Experimental.
Chapter 4 Analysis of Variance
IE241: Introduction to Design of Experiments. Last term we talked about testing the difference between two independent means. For means from a normal.
Copyright © Cengage Learning. All rights reserved. 11 Multifactor Analysis of Variance.
The Mixed Effects Model - Introduction In many situations, one of the factors of interest will have its levels chosen because they are of specific interest.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
CHAPTER- 3.2 ERROR ANALYSIS. 3.3 SPECIFIC ERROR FORMULAS  The expressions of Equations (3.13) and (3.14) were derived for the general relationship of.
ANOVA and Multiple Comparison Tests
1 Experimental Statistics - week 8 Chapter 17: Mixed Models Chapter 18: Repeated Measures.
Sampling Distributions Chapter 18. Sampling Distributions A parameter is a number that describes the population. In statistical practice, the value of.
Analysis of variance approach to regression analysis … an (alternative) approach to testing for a linear association.
Chapter 11 Analysis of Variance
Factorial Models Random Effects
Point and interval estimations of parameters of the normally up-diffused sign. Concept of statistical evaluation.
Factorial Experiments
CHAPTER 13 Design and Analysis of Single-Factor Experiments:
Statistics for Business and Economics (13e)
Chapter 5 Introduction to Factorial Designs
Chapter 9 Hypothesis Testing.
Chapter 11 Analysis of Variance
6-1 Introduction To Empirical Models
Simple Linear Regression
Chapter 7: The Normality Assumption and Inference with OLS
The Analysis of Variance
Chapter 13: Experiments with Random Factors
Experimental Statistics - week 8
Chapter 10 – Part II Analysis of Variance
MGS 3100 Business Analysis Regression Feb 18, 2016
Presentation transcript:

Factorial Models Random Effects Random Effects Gauge R&R studies (Repeatability and Reproducibility) have been an expanding area of application Gauge R&R studies (Repeatability and Reproducibility) have been an expanding area of application Mixed Effects Models Mixed Effects Models

One-way Random Effects The one-way random effects model is quite different from the one-way fixed effects model The one-way random effects model is quite different from the one-way fixed effects model –Yandell has a real appreciation for this difference –We should be surprised that the analytical approaches to the main hypotheses for these models are so similar

One-way Random Effects In Chapter 19, Yandell considers In Chapter 19, Yandell considers –unbalanced designs –Smith-Satterthwaite approximations –Restricted ML estimates We will defer the last two topics to general random and mixed effects models We will defer the last two topics to general random and mixed effects models

One-way Random Effects

One-way Random Effects E(MSTR)

One-way Random Effects Testing By a similar argument, we can show E(MSE)=  2 By a similar argument, we can show E(MSE)=  2 The familiar F-test statistic for testing The familiar F-test statistic for testing

One-way Testing Under the true model, Under the true model, So power analysis for balanced one-way random effects can be studied using a central F-distribution So power analysis for balanced one-way random effects can be studied using a central F-distribution

One-way Random Effects Method of Moment point estimates for  2 and   2 are available Method of Moment point estimates for  2 and   2 are available Confidence intervals for  2 and   2 /  2 are available Confidence intervals for  2 and   2 /  2 are available A confidence interval for the grand mean  is available A confidence interval for the grand mean  is available

Two-way Random Effects Model We will concentrate on a particular application—the Gauge R&R model We will concentrate on a particular application—the Gauge R&R model 20.2 addresses unbalanced models 20.2 addresses unbalanced models –Material is accessible Topics in 20.3 will be addressed later Topics in 20.3 will be addressed later 20.4 and 20.5 can safely be skipped 20.4 and 20.5 can safely be skipped

Gauge R&R Two-way Random Effects Model P-Part P-Part O-Operator O-Operator RR

Gauge R&R With multiple random components, Gauge R&R studies use variance components methodology With multiple random components, Gauge R&R studies use variance components methodology

Gauge R&R Repeatability is measured by Repeatability is measured by Reproducibility is measured by Reproducibility is measured by

Gauge R&R Unbiased estimates of the variance components are readily estimated from Expected Mean Squares (a=# parts, b=# operators, n=# reps) Unbiased estimates of the variance components are readily estimated from Expected Mean Squares (a=# parts, b=# operators, n=# reps)

Gauge R&R Use Mean Sums of Squares for estimation Use Mean Sums of Squares for estimation

Gauge R&R Minitab has a Gauge R&R module Minitab has a Gauge R&R module –Output is specific to industrial methods Consider an example with 3 operators, 5 parts and 2 replications Consider an example with 3 operators, 5 parts and 2 replications

Two-way Random Effects Model Consider results from our expected mean squares. Consider results from our expected mean squares. What would be appropriate tests for A, B, and AB? What would be appropriate tests for A, B, and AB?

Approximate F tests Statistics packages may do this without your being aware of it. Statistics packages may do this without your being aware of it. Example Example –A, B and C random –Replication

Approximate F test SourceEMS

Approximate F test SourceEMS

Approximate F test No exact test of A, B, or C exists No exact test of A, B, or C exists We construct an approximate F test, We construct an approximate F test,

Approximate F test We require E(MS’)=E(MS”) under H o We require E(MS’)=E(MS”) under H o F has an approximate F distribution, with parameters F has an approximate F distribution, with parameters

Approximate F test Note that MS’, MS’’ can be linear combinations of the mean squares and not just sums Note that MS’, MS’’ can be linear combinations of the mean squares and not just sums Returning to our example, how do we test Returning to our example, how do we test

DF for Approximate F tests Restating the result: Restating the result:

DF for Approximate F tests The following argument builds approximate   distributions for the numerator and denominator mean squares (and assumes they are independent) The following argument builds approximate   distributions for the numerator and denominator mean squares (and assumes they are independent) We will review the argument for the numerator We will review the argument for the numerator The argument computes the variance of the mean square two different ways The argument computes the variance of the mean square two different ways

DF for Approximate F tests Remember that the numerator for an F random variable has the form: Remember that the numerator for an F random variable has the form: Note that we already have this result for the constituent MS i Note that we already have this result for the constituent MS i

DF for Approximate F tests For each term in the sum, we have For each term in the sum, we have

DF for Approximate F tests We can derive the variance by another method: We can derive the variance by another method:

DF for Approximate F Tests Equating our two expressions for the variance, we obtain: Equating our two expressions for the variance, we obtain:

DF for Approximate F Tests Replacing expectations by their observed counterparts completes the derivation. Replacing expectations by their observed counterparts completes the derivation.

Two-way Mixed Effects Model

Both forms assume random effects and error terms are uncorrelated Both forms assume random effects and error terms are uncorrelated Most researchers favor the restricted model conceptually; Yandell finds it outdated. It is certainly difficult to generalize. Most researchers favor the restricted model conceptually; Yandell finds it outdated. It is certainly difficult to generalize. SAS tests the unrestricted model using the RANDOM statement with the TEST option; the restricted model has to be constructed “by hand”. SAS tests the unrestricted model using the RANDOM statement with the TEST option; the restricted model has to be constructed “by hand”. Minitab tests unrestricted model in GLM, restricted model option in Balanced ANOVA. Minitab tests unrestricted model in GLM, restricted model option in Balanced ANOVA.

Two-way Mixed Effects Model

The EMS suggests that the fixed effect (A) is tested against the two-way effect (AB) for both forms (F=MSA/MSAB) The EMS suggests that the fixed effect (A) is tested against the two-way effect (AB) for both forms (F=MSA/MSAB) The EMS suggests that the random effect (B) is tested against error (F=MSB/MSE) for the restricted model, but tested against the two-way effect (AB) for the unrestricted model (F=MSB/MSAB) The EMS suggests that the random effect (B) is tested against error (F=MSB/MSE) for the restricted model, but tested against the two-way effect (AB) for the unrestricted model (F=MSB/MSAB)

Two-way Mixed Effects Model For the Gage R&R study, assume that Part is still a random effect, but that Operator is a fixed effect For the Gage R&R study, assume that Part is still a random effect, but that Operator is a fixed effect SAS and Minitab analysis SAS and Minitab analysis