Chap 11-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 11 Analysis of Variance.

Slides:



Advertisements
Similar presentations
Chapter 11 Analysis of Variance
Advertisements

Chapter 12 ANALYSIS OF VARIANCE.
Design of Experiments and Analysis of Variance
Statistics for Managers Using Microsoft® Excel 5th Edition
Chapter 11 Analysis of Variance
Analysis of Variance. Experimental Design u Investigator controls one or more independent variables –Called treatment variables or factors –Contain two.
Statistics for Business and Economics
Chapter Topics The Completely Randomized Model: One-Factor Analysis of Variance F-Test for Difference in c Means The Tukey-Kramer Procedure ANOVA Assumptions.
Chapter 3 Analysis of Variance
Statistics for Managers Using Microsoft® Excel 5th Edition
Chapter 17 Analysis of Variance
One-way Between Groups Analysis of Variance
Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 7 th Edition Chapter 15 Analysis of Variance.
Chapter 11 Analysis of Variance
Copyright ©2011 Pearson Education 11-1 Chapter 11 Analysis of Variance Statistics for Managers using Microsoft Excel 6 th Global Edition.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 10-1 Chapter 10 Analysis of Variance Statistics for Managers Using Microsoft.
Chap 10-1 Analysis of Variance. Chap 10-2 Overview Analysis of Variance (ANOVA) F-test Tukey- Kramer test One-Way ANOVA Two-Way ANOVA Interaction Effects.
Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall 11-1 Chapter 11 Analysis of Variance Statistics for Managers using Microsoft Excel.
Chapter 12: Analysis of Variance
Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall 12-1 Business Statistics: A Decision-Making Approach 8 th Edition Chapter 12 Analysis.
F-Test ( ANOVA ) & Two-Way ANOVA
CHAPTER 3 Analysis of Variance (ANOVA) PART 1
1 1 Slide 統計學 Spring 2004 授課教師:統計系余清祥 日期: 2004 年 3 月 30 日 第八週:變異數分析與實驗設計.
Statistics for Business and Economics Chapter 8 Design of Experiments and Analysis of Variance.
QNT 531 Advanced Problems in Statistics and Research Methods
1 1 Slide © 2005 Thomson/South-Western Chapter 13, Part A Analysis of Variance and Experimental Design n Introduction to Analysis of Variance n Analysis.
INFERENTIAL STATISTICS: Analysis Of Variance ANOVA
© 2003 Prentice-Hall, Inc.Chap 11-1 Analysis of Variance IE 340/440 PROCESS IMPROVEMENT THROUGH PLANNED EXPERIMENTATION Dr. Xueping Li University of Tennessee.
Chapter 10 Two-Sample Tests and One-Way ANOVA
© 2002 Prentice-Hall, Inc.Chap 9-1 Statistics for Managers Using Microsoft Excel 3 rd Edition Chapter 9 Analysis of Variance.
Chapter 11 HYPOTHESIS TESTING USING THE ONE-WAY ANALYSIS OF VARIANCE.
© Copyright McGraw-Hill CHAPTER 12 Analysis of Variance (ANOVA)
Chapter 10 Analysis of Variance.
ANOVA (Analysis of Variance) by Aziza Munir
© 2003 Prentice-Hall, Inc.Chap 11-1 Analysis of Variance & Post-ANOVA ANALYSIS IE 340/440 PROCESS IMPROVEMENT THROUGH PLANNED EXPERIMENTATION Dr. Xueping.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap th Lesson Analysis of Variance.
Business Statistics: Contemporary Decision Making, 3e, by Black. © 2001 South-Western/Thomson Learning 11-1 Business Statistics, 3e by Ken Black Chapter.
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 10-1 Chapter 10 Two-Sample Tests and One-Way ANOVA Business Statistics, A First.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 10-1 Chapter 10 Analysis of Variance Statistics for Managers Using Microsoft.
Chapter 19 Analysis of Variance (ANOVA). ANOVA How to test a null hypothesis that the means of more than two populations are equal. H 0 :  1 =  2 =
Lecture 9-1 Analysis of Variance
Analysis of Variance (One Factor). ANOVA Analysis of Variance Tests whether differences exist among population means categorized by only one factor or.
Previous Lecture: Phylogenetics. Analysis of Variance This Lecture Judy Zhong Ph.D.
Chapter Seventeen. Figure 17.1 Relationship of Hypothesis Testing Related to Differences to the Previous Chapter and the Marketing Research Process Focus.
Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 8 th Edition Chapter 15 Analysis of Variance.
Chapter 11 Analysis of Variance. 11.1: The Completely Randomized Design: One-Way Analysis of Variance vocabulary –completely randomized –groups –factors.
Business Statistics: A First Course (3rd Edition)
Chapter 4 Analysis of Variance
McGraw-Hill, Bluman, 7th ed., Chapter 12
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 10-1 Chapter 10 Two-Sample Tests and One-Way ANOVA Business Statistics, A First.
Copyright © 2016, 2013, 2010 Pearson Education, Inc. Chapter 10, Slide 1 Two-Sample Tests and One-Way ANOVA Chapter 10.
CHAPTER 10 ANOVA - One way ANOVa.
Formula for Linear Regression y = bx + a Y variable plotted on vertical axis. X variable plotted on horizontal axis. Slope or the change in y for every.
ENGR 610 Applied Statistics Fall Week 8 Marshall University CITE Jack Smith.
Aron, Aron, & Coups, Statistics for the Behavioral and Social Sciences: A Brief Course (3e), © 2005 Prentice Hall Chapter 10 Introduction to the Analysis.
Chapter 8 Analysis of METOC Variability. Contents 8.1. One-factor Analysis of Variance (ANOVA) 8.2. Partitioning of METOC Variability 8.3. Mathematical.
Chapter 11 Analysis of Variance
Chapter 10 Two-Sample Tests and One-Way ANOVA.
Statistics for Managers Using Microsoft Excel 3rd Edition
Factorial Experiments
ANOVA Econ201 HSTS212.
Statistics for Business and Economics (13e)
Chapter 10 Two-Sample Tests and One-Way ANOVA.
Chapter 11 Analysis of Variance
Chapter 9 Analysis of Variance
Chapter 15 Analysis of Variance
Chapter 10 – Part II Analysis of Variance
Presentation transcript:

Chap 11-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 11 Analysis of Variance

Chap 11-2 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Chapter Goals After completing this chapter, you should be able to: Recognize situations in which to use analysis of variance Understand different analysis of variance designs Perform a single-factor hypothesis test and interpret results Conduct and interpret post-analysis of variance pairwise comparisons procedures Set up and perform randomized blocks analysis

Chap 11-3 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Chapter Overview Analysis of Variance (ANOVA) F-test Tukey- Kramer test Fisher’s Least Significant Difference test One-Way ANOVA Randomized Complete Block ANOVA

Chap 11-4 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. General ANOVA Setting Investigator controls one or more independent variables Called factors (or treatment variables) Each factor contains two or more levels (or categories/classifications) Observe effects on dependent variable Response to levels of independent variable Experimental design: the plan used to test hypothesis

Chap 11-5 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. One-Way Analysis of Variance Evaluate the difference among the means of three or more populations Examples: Accident rates for 1 st, 2 nd, and 3 rd shift Expected mileage for five brands of tires Assumptions Populations are normally distributed Populations have equal variances Samples are randomly and independently drawn

Chap 11-6 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Completely Randomized Design Experimental units (subjects) are assigned randomly to treatments Only one factor or independent variable With two or more treatment levels Analyzed by One-factor analysis of variance (one-way ANOVA) Called a Balanced Design if all factor levels have equal sample size

Chap 11-7 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Hypotheses of One-Way ANOVA All population means are equal i.e., no treatment effect (no variation in means among groups) At least one population mean is different i.e., there is a treatment effect Does not mean that all population means are different (some pairs may be the same)

Chap 11-8 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. One-Factor ANOVA All Means are the same: The Null Hypothesis is True (No Treatment Effect)

Chap 11-9 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. One-Factor ANOVA At least one mean is different: The Null Hypothesis is NOT true (Treatment Effect is present) or (continued)

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Partitioning the Variation Total variation can be split into two parts: SST = Total Sum of Squares SSB = Sum of Squares Between SSW = Sum of Squares Within SST = SSB + SSW

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Partitioning the Variation Total Variation = the aggregate dispersion of the individual data values across the various factor levels (SST) Within-Sample Variation = dispersion that exists among the data values within a particular factor level (SSW) Between-Sample Variation = dispersion among the factor sample means (SSB) SST = SSB + SSW (continued)

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Partition of Total Variation Variation Due to Factor (SSB) Variation Due to Random Sampling (SSW) Total Variation (SST) Commonly referred to as:  Sum of Squares Within  Sum of Squares Error  Sum of Squares Unexplained  Within Groups Variation Commonly referred to as:  Sum of Squares Between  Sum of Squares Among  Sum of Squares Explained  Among Groups Variation = +

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Total Sum of Squares Where: SST = Total sum of squares k = number of populations (levels or treatments) n i = sample size from population i x ij = j th measurement from population i x = grand mean (mean of all data values) SST = SSB + SSW

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Total Variation (continued)

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Sum of Squares Between Where: SSB = Sum of squares between k = number of populations n i = sample size from population i x i = sample mean from population i x = grand mean (mean of all data values) SST = SSB + SSW

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Between-Group Variation Variation Due to Differences Among Groups Mean Square Between = SSB/degrees of freedom

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Between-Group Variation (continued)

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Sum of Squares Within Where: SSW = Sum of squares within k = number of populations n i = sample size from population i x i = sample mean from population i x ij = j th measurement from population i SST = SSB + SSW

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Within-Group Variation Summing the variation within each group and then adding over all groups Mean Square Within = SSW/degrees of freedom

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Within-Group Variation (continued)

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. One-Way ANOVA Table Source of Variation dfSSMS Between Samples SSBMSB = Within Samples N - kSSWMSW = TotalN - 1 SST = SSB+SSW k - 1 MSB MSW F ratio k = number of populations N = sum of the sample sizes from all populations df = degrees of freedom SSB k - 1 SSW N - k F =

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. One-Factor ANOVA F Test Statistic Test statistic MSB is mean squares between variances MSW is mean squares within variances Degrees of freedom df 1 = k – 1 (k = number of populations) df 2 = N – k (N = sum of sample sizes from all populations) H 0 : μ 1 = μ 2 = … = μ k H A : At least two population means are different

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Interpreting One-Factor ANOVA F Statistic The F statistic is the ratio of the between estimate of variance and the within estimate of variance The ratio must always be positive df 1 = k -1 will typically be small df 2 = N - k will typically be large The ratio should be close to 1 if H 0 : μ 1 = μ 2 = … = μ k is true The ratio will be larger than 1 if H 0 : μ 1 = μ 2 = … = μ k is false

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. One-Factor ANOVA F Test Example You want to see if three different golf clubs yield different distances. You randomly select five measurements from trials on an automated driving machine for each club. At the.05 significance level, is there a difference in mean distance? Club 1 Club 2 Club

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. One-Factor ANOVA Example: Scatter Diagram Distance Club 1 Club 2 Club Club 1 2 3

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. One-Factor ANOVA Example Computations Club 1 Club 2 Club x 1 = x 2 = x 3 = x = n 1 = 5 n 2 = 5 n 3 = 5 N = 15 k = 3 SSB = 5 [ (249.2 – 227) 2 + (226 – 227) 2 + (205.8 – 227) 2 ] = SSW = (254 – 249.2) 2 + (263 – 249.2) 2 +…+ (204 – 205.8) 2 = MSB = / (3-1) = MSW = / (15-3) = 93.3

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. F = One-Factor ANOVA Example Solution H 0 : μ 1 = μ 2 = μ 3 H A : μ i not all equal  =.05 df 1 = 2 df 2 = 12 Test Statistic: Decision: Conclusion: Reject H 0 at  = 0.05 There is evidence that at least one μ i differs from the rest 0  =.05 F.05 = Reject H 0 Do not reject H 0 Critical Value: F  = 3.885

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. SUMMARY GroupsCountSumAverageVariance Club Club Club ANOVA Source of Variation SSdfMSFP-valueF crit Between Groups E Within Groups Total ANOVA -- Single Factor: Excel Output EXCEL: tools | data analysis | ANOVA: single factor

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. The Tukey-Kramer Procedure Tells which population means are significantly different e.g.: μ 1 = μ 2  μ 3 Done after rejection of equal means in ANOVA Allows pair-wise comparisons Compare absolute mean differences with critical range x μ 1 = μ 2 μ 3

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Tukey-Kramer Critical Range where: q  = Value from standardized range table with k and N - k degrees of freedom for the desired level of  MSW = Mean Square Within n i and n j = Sample sizes from populations (levels) i and j

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. The Tukey-Kramer Procedure: Example 1. Compute absolute mean differences: Club 1 Club 2 Club Find the q value from the table in appendix J with k and N - k degrees of freedom for the desired level of 

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. The Tukey-Kramer Procedure: Example 5. All of the absolute mean differences are greater than critical range. Therefore there is a significant difference between each pair of means at 5% level of significance. 3. Compute Critical Range: 4. Compare:

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Tukey-Kramer in PHStat

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Randomized Complete Block ANOVA Like One-Way ANOVA, we test for equal population means (for different factor levels, for example)......but we want to control for possible variation from a second factor (with two or more levels) Used when more than one factor may influence the value of the dependent variable, but only one is of key interest Levels of the secondary factor are called blocks

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Partitioning the Variation Total variation can now be split into three parts: SST = Total sum of squares SSB = Sum of squares between factor levels SSBL = Sum of squares between blocks SSW = Sum of squares within levels SST = SSB + SSBL + SSW

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Sum of Squares for Blocking Where: k = number of levels for this factor b = number of blocks x j = sample mean from the j th block x = grand mean (mean of all data values) SST = SSB + SSBL + SSW

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Partitioning the Variation Total variation can now be split into three parts: SST and SSB are computed as they were in One-Way ANOVA SST = SSB + SSBL + SSW SSW = SST – (SSB + SSBL)

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Mean Squares

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Randomized Block ANOVA Table Source of Variation dfSSMS Between Samples SSBMSB Within Samples (k–1)(b-1)SSWMSW TotalN - 1SST k - 1 MSBL MSW F ratio k = number of populationsN = sum of the sample sizes from all populations b = number of blocksdf = degrees of freedom Between Blocks SSBLb - 1MSBL MSB MSW

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Blocking Test Blocking test: df 1 = b - 1 df 2 = (k – 1)(b – 1) MSBL MSW F = Reject H 0 if F > F 

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Main Factor test: df 1 = k - 1 df 2 = (k – 1)(b – 1) MSB MSW F = Reject H 0 if F > F  Main Factor Test

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Fisher’s Least Significant Difference Test To test which population means are significantly different e.g.: μ 1 = μ 2 ≠ μ 3 Done after rejection of equal means in randomized block ANOVA design Allows pair-wise comparisons Compare absolute mean differences with critical range x  =  123

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Fisher’s Least Significant Difference (LSD) Test where: t  /2 = Upper-tailed value from Student’s t-distribution for  /2 and (k -1)(n - 1) degrees of freedom MSW = Mean square within from ANOVA table b = number of blocks k = number of levels of the main factor

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Fisher’s Least Significant Difference (LSD) Test (continued) If the absolute mean difference is greater than LSD then there is a significant difference between that pair of means at the chosen level of significance. Compare:

Chap A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. Chapter Summary Described one-way analysis of variance The logic of ANOVA ANOVA assumptions F test for difference in k means The Tukey-Kramer procedure for multiple comparisons Described randomized complete block designs F test Fisher’s least significant difference test for multiple comparisons Described two-way analysis of variance Examined effects of multiple factors and interaction