STA291 Statistical Methods Lecture 31. Analyzing a Design in One Factor – The One-Way Analysis of Variance Consider an experiment with a single factor.

Slides:



Advertisements
Similar presentations
BPS - 5th Ed. Chapter 241 One-Way Analysis of Variance: Comparing Several Means.
Advertisements

Copyright © 2009 Pearson Education, Inc. Chapter 29 Multiple Regression.
Copyright © 2010 Pearson Education, Inc. Slide
Inference for Regression
Chapter 14 Comparing two groups Dr Richard Bußmann.
Copyright ©2006 Brooks/Cole, a division of Thomson Learning, Inc. Analysis of Variance Chapter 16.
Confidence Interval and Hypothesis Testing for:
© 2010 Pearson Prentice Hall. All rights reserved Single Factor ANOVA.
Copyright ©2011 Brooks/Cole, Cengage Learning Analysis of Variance Chapter 16 1.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. *Chapter 29 Multiple Regression.
Part I – MULTIVARIATE ANALYSIS
Lecture 19: Tues., Nov. 11th R-squared (8.6.1) Review
Lecture 24: Thurs. Dec. 4 Extra sum of squares F-tests (10.3) R-squared statistic (10.4.1) Residual plots (11.2) Influential observations (11.3,
Copyright © 2006 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Slide Are the Means of Several Groups Equal? Ho:Ha: Consider the following.
8. ANALYSIS OF VARIANCE 8.1 Elements of a Designed Experiment
One-way Between Groups Analysis of Variance
Chapter 11: Inference for Distributions
Inferences About Process Quality
Copyright © 2010 Pearson Education, Inc. Chapter 24 Comparing Means.
Independent Sample T-test Classical design used in psychology/medicine N subjects are randomly assigned to two groups (Control * Treatment). After treatment,
Chapter 12: Analysis of Variance
Copyright © 2009 Pearson Education, Inc. Chapter 28 Analysis of Variance.
F-Test ( ANOVA ) & Two-Way ANOVA
Copyright © 2010, 2007, 2004 Pearson Education, Inc. *Chapter 28 Analysis of Variance.
PS 225 Lecture 15 Analysis of Variance ANOVA Tables.
HAWKES LEARNING SYSTEMS math courseware specialists Copyright © 2010 by Hawkes Learning Systems/Quant Systems, Inc. All rights reserved. Chapter 14 Analysis.
STAT 3130 Statistical Methods I Session 2 One Way Analysis of Variance (ANOVA)
QNT 531 Advanced Problems in Statistics and Research Methods
1-1 Copyright © 2015, 2010, 2007 Pearson Education, Inc. Chapter 23, Slide 1 Chapter 23 Comparing Means.
Inferences for Regression
BPS - 3rd Ed. Chapter 211 Inference for Regression.
Copyright © 2012 Pearson Education. Chapter 21 Design and Analysis of Experiments and Observational Studies.
Inference for Linear Regression Conditions for Regression Inference: Suppose we have n observations on an explanatory variable x and a response variable.
Comparing Two Population Means
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 24 Comparing Means.
 The idea of ANOVA  Comparing several means  The problem of multiple comparisons  The ANOVA F test 1.
t(ea) for Two: Test between the Means of Different Groups When you want to know if there is a ‘difference’ between the two groups in the mean Use “t-test”.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 24 Comparing Means.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Slide
ANOVA (Analysis of Variance) by Aziza Munir
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
INTRODUCTION TO ANALYSIS OF VARIANCE (ANOVA). COURSE CONTENT WHAT IS ANOVA DIFFERENT TYPES OF ANOVA ANOVA THEORY WORKED EXAMPLE IN EXCEL –GENERATING THE.
Analysis of Variance 1 Dr. Mohammed Alahmed Ph.D. in BioStatistics (011)
STA 286 week 131 Inference for the Regression Coefficient Recall, b 0 and b 1 are the estimates of the slope β 1 and intercept β 0 of population regression.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 14 Comparing Groups: Analysis of Variance Methods Section 14.1 One-Way ANOVA: Comparing.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
STA 2023 Module 11 Inferences for Two Population Means.
AP Statistics Chapter 24 Comparing Means.
The Analysis of Variance. One-Way ANOVA  We use ANOVA when we want to look at statistical relationships (difference in means for example) between more.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 14 Comparing Groups: Analysis of Variance Methods Section 14.3 Two-Way ANOVA.
Business Statistics for Managerial Decision Farideh Dehkordi-Vakil.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved Lecture Slides Elementary Statistics Eleventh Edition and the Triola.
Introduction to ANOVA Research Designs for ANOVAs Type I Error and Multiple Hypothesis Tests The Logic of ANOVA ANOVA vocabulary, notation, and formulas.
Analysis of Variance STAT E-150 Statistical Methods.
Comparing Means Chapter 24. Plot the Data The natural display for comparing two groups is boxplots of the data for the two groups, placed side-by-side.
+ Unit 6: Comparing Two Populations or Groups Section 10.2 Comparing Two Means.
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 11 Testing for Differences Differences betweens groups or categories of the independent.
Slide Slide 1 Copyright © 2007 Pearson Education, Inc Publishing as Pearson Addison-Wesley. Lecture Slides Elementary Statistics Tenth Edition and the.
Statistics 24 Comparing Means. Plot the Data The natural display for comparing two groups is boxplots of the data for the two groups, placed side-by-side.
BPS - 5th Ed. Chapter 231 Inference for Regression.
BUS 308 Entire Course (Ash Course) For more course tutorials visit BUS 308 Week 1 Assignment Problems 1.2, 1.17, 3.3 & 3.22 BUS 308.
Oneway ANOVA comparing 3 or more means. Overall Purpose A Oneway ANOVA is used to compare three or more average scores. A Oneway ANOVA is used to compare.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Slide
Chapter 15 Analysis of Variance. The article “Could Mean Platelet Volume be a Predictive Marker for Acute Myocardial Infarction?” (Medical Science Monitor,
Chapter 24 Comparing Means.
Lecture Slides Elementary Statistics Twelfth Edition
Inferences for Regression
Basic Practice of Statistics - 5th Edition
CHAPTER 12 More About Regression
Chapter 24 Comparing Means Copyright © 2009 Pearson Education, Inc.
Presentation transcript:

STA291 Statistical Methods Lecture 31

Analyzing a Design in One Factor – The One-Way Analysis of Variance Consider an experiment with a single factor of k levels. Question of Primary Interest: Is there evidence for differences in effectiveness for the treatments? Let be the mean response for treatment group i. Then, to answer the question, we must test the hypothesis: (no difference in treatments) (at least one treatment has a different result)

What criterion might we use to test the hypothesis? The test statistic compares the variance of the means to what we’d expect that variance to be based on the variance of the individual responses. Analyzing a Design in One Factor – The One-Way Analysis of Variance

The F-statistic compares two measures of variation, called mean squares. The numerator measures the variation between the groups (treatments) and is called the Mean Square due to treatments (MST). The denominator measures the variation within the groups, and is called the Mean Square due to Error (MSE). The F-statistic is their ratio: Every F-distribution has two degrees of freedom, corresponding to the degrees of freedom for the mean square in the numerator and for the mean square (usually the MSE) in the denominator. Analyzing a Design in One Factor – The One-Way Analysis of Variance

1) The Mean Square due to Treatments (between- group variation measure) To quantify these two classes of variation, we introduce two new measures of variability for one- factor experiments with k levels : Analyzing a Design in One Factor – The One-Way Analysis of Variance

2) The Mean Square due to Error (within-group variation measure) Analyzing a Design in One Factor – The One-Way Analysis of Variance

This analysis is called an Analysis of Variance (ANOVA) The null hypothesis is that the means are all equal Usually presented in a table, called the ANOVA table, like this one: Analyzing a Design in One Factor – The One-Way Analysis of Variance

Example: Tom’s Tom-Toms tries to boost catalog sales by offering one of four incentives with each purchase: 1)Free drum sticks 2)Free practice pad 3)Fifty dollars off any purchase 4)No incentive (control group) Analyzing a Design in One Factor – The One-Way Analysis of Variance

Here is a summary of the spending for the month after the start of the experiment. A total of 4000 offers were sent, 1000 per treatment. Analyzing a Design in One Factor – The One-Way Analysis of Variance

Use the summary data to construct an ANOVA table. (This table is most often created using technology.) Since P is so small, we reject the null hypothesis and conclude that the treatment means differ. The incentives appear to alter the spending patterns. Analyzing a Design in One Factor – The One-Way Analysis of Variance

Assumptions and Conditions for ANOVA Independence Assumption The groups must be independent of each other. No test can verify this assumption. You have to think about how the data were collected and check that the Randomization Condition is satisfied.

Equal Variance Assumption ANOVA assumes that the true variances of the treatment groups are equal. We can check the corresponding Similar Variance Condition in various ways: Look at side-by-side boxplots of the groups. Look for differences in spreads. Examine the boxplots for a relationship between the mean values and the spreads. A common pattern is increasing spread with increasing mean. Look at the group residuals plotted against the predicted values (group means). See if larger predicted values lead to larger-magnitude residuals. Assumptions and Conditions for ANOVA

Normal Population Assumption Like Student’s t-tests, the F-test requires that the underlying errors follow a Normal model. As before when we faced this assumption, we’ll check a corresponding Nearly Normal Condition. Examine the boxplots for skewness patterns. Examine a histogram of all the residuals. Example a Normal probability plot. Assumptions and Conditions for ANOVA

Normal Population Assumption For the Tom’s Tom-Toms experiment, the residuals are not Normal. In fact, the distribution exhibits bimodality. Assumptions and Conditions for ANOVA

Normal Population Assumption The bimodality shows up in every treatment! This bimodality came as no surprise to the manager. He responded, “…customers …either order a complete new drum set, or…accessories… or choose not to purchase anything.” Assumptions and Conditions for ANOVA

Normal Population Assumption These data (and the residuals) clearly violate the Nearly Normal Condition. Does that mean that we can’t say anything about the null hypothesis? No. Fortunately, the sample sizes are large, and there are no individual outliers that have undue influence on the means. With sample sizes this large, we can appeal to the Central Limit Theorem and still make inferences about the means. In particular, we are safe in rejecting the null hypothesis. Assumptions and Conditions for ANOVA

Example: A test prep course A tutoring organization says of the 20 students it worked with gained an average of 25 points on a given IQ test when they retook the test after the course. Explain why this does not necessarily prove that the special course caused scores to go up. The students were not randomly assigned. Those who signed up for the course may be a special group whose scores would have improved anyway. Design an experiment to test their claim Give the IQ test to a group of volunteers and then randomly assign them to take the review course or to not take the review course. After a period of time re-administer the test. Assumptions and Conditions for ANOVA

Example: A test prep course A tutoring organization says of the 20 students it worked with gained an average of 25 points on a given IQ test when they retook the test after the course. It is suspected that the students with particularly low grades would benefit more from the course, how would you change your design to account for this suspicion. After the initial test, group the volunteers based on their scores. Randomly assign half of each group to either take the review course or not. Compare the results from the two groups in the block design. Assumptions and Conditions for ANOVA

Multiple Comparisons Knowing that the means differ leads to the question of which ones are different and by how much. Methods that test these issues are called methods for multiple comparisons. Question: Why don’t we simply use a t-test for differences between means to test each pair of group means? Answer: Each t-test is subject to a Type I error, and the chances of committing such an error increase as the number of tested pairs increases.

Let J represent the number of pairs of means. Then, find the confidence interval for each difference using the confidence level instead of If a confidence interval does not contain 0, then a significant difference is indicated. The Bonferroni Method Use the t-test methodology to test differences between the means, but use an inflated value for t* that lessens the accumulated chance of committing a Type I error by keeping the overall Type I error rate at or below This wider margin of error is called the minimum significant difference or MSD. Multiple Comparisons

Watch out for outliers. Watch out for changing variances. Watch for multiple comparisons. Be sure to fit an interaction term when it exists. When the interaction effect is significant, don’t interpret the main effects.

Looking back Understand how to use Analysis of Variance (ANOVA) to analyze designed experiments. o ANOVA tables follow a standard layout; be acquainted with it. o The F-statistic is the test statistic used in ANOVA. F-statistics test hypotheses about the equality of the means of two groups. o The Bonferroni Method is for identifying which treatments are different