Chapter 15 Analysis of Variance

Slides:



Advertisements
Similar presentations
Chapter 11 Analysis of Variance
Advertisements

Analysis of Variance (ANOVA) ANOVA can be used to test for the equality of three or more population means We want to use the sample results to test the.
1 1 Slide © 2009, Econ-2030 Applied Statistics-Dr Tadesse Chapter 10: Comparisons Involving Means n Introduction to Analysis of Variance n Analysis of.
Statistics for Managers Using Microsoft® Excel 5th Edition
Chapter 12 Multiple Regression
Chapter 11 Analysis of Variance
Chapter Topics The Completely Randomized Model: One-Factor Analysis of Variance F-Test for Difference in c Means The Tukey-Kramer Procedure ANOVA Assumptions.
Chapter 3 Analysis of Variance
Statistics for Managers Using Microsoft® Excel 5th Edition
Chapter 17 Analysis of Variance
Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 7 th Edition Chapter 15 Analysis of Variance.
Chapter 11 Analysis of Variance
Copyright ©2011 Pearson Education 11-1 Chapter 11 Analysis of Variance Statistics for Managers using Microsoft Excel 6 th Global Edition.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 10-1 Chapter 10 Analysis of Variance Statistics for Managers Using Microsoft.
Chap 10-1 Analysis of Variance. Chap 10-2 Overview Analysis of Variance (ANOVA) F-test Tukey- Kramer test One-Way ANOVA Two-Way ANOVA Interaction Effects.
Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall 11-1 Chapter 11 Analysis of Variance Statistics for Managers using Microsoft Excel.
Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall 12-1 Business Statistics: A Decision-Making Approach 8 th Edition Chapter 12 Analysis.
1 1 Slide © 2006 Thomson/South-Western Slides Prepared by JOHN S. LOUCKS St. Edward’s University Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
INFERENTIAL STATISTICS: Analysis Of Variance ANOVA
© 2003 Prentice-Hall, Inc.Chap 11-1 Analysis of Variance IE 340/440 PROCESS IMPROVEMENT THROUGH PLANNED EXPERIMENTATION Dr. Xueping Li University of Tennessee.
Chapter 10 Two-Sample Tests and One-Way ANOVA
© 2002 Prentice-Hall, Inc.Chap 9-1 Statistics for Managers Using Microsoft Excel 3 rd Edition Chapter 9 Analysis of Variance.
Chapter 10 Analysis of Variance.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap th Lesson Analysis of Variance.
1 Chapter 13 Analysis of Variance. 2 Chapter Outline  An introduction to experimental design and analysis of variance  Analysis of Variance and the.
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 10-1 Chapter 10 Two-Sample Tests and One-Way ANOVA Business Statistics, A First.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 10-1 Chapter 10 Analysis of Variance Statistics for Managers Using Microsoft.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Lecture 9-1 Analysis of Variance
Previous Lecture: Phylogenetics. Analysis of Variance This Lecture Judy Zhong Ph.D.
Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 8 th Edition Chapter 15 Analysis of Variance.
Business Statistics: A First Course (3rd Edition)
Chapter 4 Analysis of Variance
Econ 3790: Business and Economic Statistics Instructor: Yogesh Uppal
Chap 11-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 11 Analysis of Variance.
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 10-1 Chapter 10 Two-Sample Tests and One-Way ANOVA Business Statistics, A First.
Copyright © 2016, 2013, 2010 Pearson Education, Inc. Chapter 10, Slide 1 Two-Sample Tests and One-Way ANOVA Chapter 10.
Formula for Linear Regression y = bx + a Y variable plotted on vertical axis. X variable plotted on horizontal axis. Slope or the change in y for every.
Chapter 13 Analysis of Variance (ANOVA). ANOVA can be used to test for differences between three or more means. The hypotheses for an ANOVA are always:
Chapter 11 Analysis of Variance
Analysis of Variance . Chapter 12.
Copyright © 2008 by Hawkes Learning Systems/Quant Systems, Inc.
CHAPTER 3 Analysis of Variance (ANOVA) PART 1
Chapter 10 Two-Sample Tests and One-Way ANOVA.
Statistics for Managers Using Microsoft Excel 3rd Edition
ANOVA Econ201 HSTS212.
i) Two way ANOVA without replication
Applied Business Statistics, 7th ed. by Ken Black
Basic Practice of Statistics - 5th Edition
Chapter 10: Analysis of Variance: Comparing More Than Two Means
Chapter 11 Simple Regression
Post Hoc Tests on One-Way ANOVA
Post Hoc Tests on One-Way ANOVA
CHAPTER 12 ANALYSIS OF VARIANCE
Statistical Inference for Managers
Chapter 10 Two-Sample Tests and One-Way ANOVA.
Econ 3790: Business and Economic Statistics
Chapter 11 Hypothesis Tests and Estimation for Population Variances
Chapter 11 Analysis of Variance
Analysis of Variance (ANOVA)
Chapter 9 Analysis of Variance
Chapter 10 Introduction to the Analysis of Variance
Analysis of Variance Objective
Chapter 10 – Part II Analysis of Variance
STATISTICS INFORMED DECISIONS USING DATA
Presentation transcript:

Chapter 15 Analysis of Variance Statistics for Business and Economics 7th Edition Chapter 15 Analysis of Variance Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

One-Way Analysis of Variance 15.2 One-Way Analysis of Variance Evaluate the difference among the means of three or more groups Examples: Average production for 1st, 2nd, and 3rd shifts Expected mileage for five brands of tires Assumptions Populations are normally distributed Populations have equal variances Samples are randomly and independently drawn Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Hypotheses of One-Way ANOVA All population means are equal i.e., no variation in means between groups At least one population mean is different i.e., there is variation between groups Does not mean that all population means are different (some pairs may be the same) Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

One-Way ANOVA All Means are the same: The Null Hypothesis is True (No variation between groups) Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

One-Way ANOVA At least one mean is different: (continued) At least one mean is different: The Null Hypothesis is NOT true (Variation is present between groups) or Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Variability The variability of the data is key factor to test the equality of means In each case below, the means may look different, but a large variation within groups in B makes the evidence that the means are different weak A B A B C Group A B C Group Small variation within groups Large variation within groups Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Partitioning the Variation Total variation can be split into two parts: SST = SSW + SSG SST = Total Sum of Squares Total Variation = the aggregate dispersion of the individual data values across the various groups SSW = Sum of Squares Within Groups Within-Group Variation = dispersion that exists among the data values within a particular group SSG = Sum of Squares Between Groups Between-Group Variation = dispersion between the group sample means Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Partition of Total Variation Total Sum of Squares (SST) Variation due to random sampling (SSW) Variation due to differences between groups (SSG) = + Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Total Sum of Squares SST = SSW + SSG Where: SST = Total sum of squares K = number of groups (levels or treatments) ni = number of observations in group i xij = jth observation from group i x = overall sample mean Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Total Variation (continued) Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Within-Group Variation SST = SSW + SSG Where: SSW = Sum of squares within groups K = number of groups ni = sample size from group i xi = sample mean from group i xij = jth observation in group i Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Within-Group Variation (continued) Summing the variation within each group and then adding over all groups Mean Square Within = SSW/degrees of freedom Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Within-Group Variation (continued) Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Between-Group Variation SST = SSW + SSG Where: SSG = Sum of squares between groups K = number of groups ni = sample size from group i xi = sample mean from group i x = grand mean (mean of all data values) Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Between-Group Variation (continued) Variation Due to Differences Between Groups Mean Square Between Groups = SSG/degrees of freedom Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Between-Group Variation (continued) Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Obtaining the Mean Squares Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall One-Way ANOVA Table Source of Variation MS (Variance) SS df F ratio Between Groups SSG MSG SSG K - 1 MSG = F = K - 1 MSW Within Groups SSW SSW n - K MSW = n - K SST = SSG+SSW Total n - 1 K = number of groups n = sum of the sample sizes from all groups df = degrees of freedom Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

One-Factor ANOVA F Test Statistic H0: μ1= μ2 = … = μK H1: At least two population means are different Test statistic MSG is mean squares between variances MSW is mean squares within variances Degrees of freedom df1 = K – 1 (K = number of groups) df2 = n – K (n = sum of sample sizes from all groups) Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Interpreting the F Statistic The F statistic is the ratio of the between estimate of variance and the within estimate of variance The ratio must always be positive df1 = K -1 will typically be small df2 = n - K will typically be large Decision Rule: Reject H0 if F > FK-1,n-K,  = .05 Do not reject H0 Reject H0 FK-1,n-K, Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

One-Factor ANOVA F Test Example Club 1 Club 2 Club 3 254 234 200 263 218 222 241 235 197 237 227 206 251 216 204 You want to see if three different golf clubs yield different distances. You randomly select five measurements from trials on an automated driving machine for each club. At the .05 significance level, is there a difference in mean distance? Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

One-Factor ANOVA Example: Scatter Diagram Distance 270 260 250 240 230 220 210 200 190 Club 1 Club 2 Club 3 254 234 200 263 218 222 241 235 197 237 227 206 251 216 204 • • • • • • • • • • • • • • • 1 2 3 Club Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

One-Factor ANOVA Example Computations Club 1 Club 2 Club 3 254 234 200 263 218 222 241 235 197 237 227 206 251 216 204 x1 = 249.2 x2 = 226.0 x3 = 205.8 x = 227.0 n1 = 5 n2 = 5 n3 = 5 n = 15 K = 3 SSG = 5 (249.2 – 227)2 + 5 (226 – 227)2 + 5 (205.8 – 227)2 = 4716.4 SSW = (254 – 249.2)2 + (263 – 249.2)2 +…+ (204 – 205.8)2 = 1119.6 MSG = 4716.4 / (3-1) = 2358.2 MSW = 1119.6 / (15-3) = 93.3 Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

One-Factor ANOVA Example Solution Test Statistic: Decision: Conclusion: H0: μ1 = μ2 = μ3 H1: μi not all equal  = .05 df1= 2 df2 = 12 Critical Value: F2,12,.05= 3.89 Reject H0 at  = 0.05  = .05 There is evidence that at least one μi differs from the rest Do not reject H0 Reject H0 F = 25.275 F2,12,.05 = 3.89 Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

ANOVA -- Single Factor: Excel Output EXCEL: data | data analysis | ANOVA: single factor SUMMARY Groups Count Sum Average Variance Club 1 5 1246 249.2 108.2 Club 2 1130 226 77.5 Club 3 1029 205.8 94.2 ANOVA Source of Variation SS df MS F P-value F crit Between Groups 4716.4 2 2358.2 25.275 4.99E-05 3.89 Within 1119.6 12 93.3 Total 5836.0 14   Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Multiple Comparisons Between Subgroup Means To test which population means are significantly different e.g.: μ1 = μ2 ≠ μ3 Done after rejection of equal means in single factor ANOVA design Allows pair-wise comparisons Compare absolute mean differences with critical range    x = 1 2 3 Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Two-Way Analysis of Variance 15.4 Examines the effect of Two factors of interest on the dependent variable Interaction between the different levels of these two factors Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Two-Way ANOVA (continued) Assumptions Populations are normally distributed Populations have equal variances Independent random samples are drawn Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Randomized Block Design Two Factors of interest: A and B K = number of groups of factor A H = number of levels of factor B (sometimes called a blocking variable) Block Group 1 2 … K . H x11 x12 x1H x21 x22 x2H xK1 xK2 xKH Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Partition of Total Variation SST = SSG + SSB + SSE Variation due to differences between groups (SSG) Total Sum of Squares (SST) = + Variation due to differences between blocks (SSB) + Variation due to random sampling (unexplained error) (SSE) The error terms are assumed to be independent, normally distributed, and have the same variance Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Two-Way Mean Squares The mean squares are Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall

Two-Way ANOVA: The F Test Statistic F Test for Groups H0: The K population group means are all the same Reject H0 if F > FK-1,(K-1)(H-1), F Test for Blocks H0: The H population block means are the same Reject H0 if F > FH-1,(K-1)(H-1), Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall