STAT 3120 Statistical Methods I Lecture Notes 6 Analysis of Variance (ANOVA)

Slides:



Advertisements
Similar presentations
Experimental Statistics - week 5
Advertisements

Copyright 2004 David J. Lilja1 Comparing Two Alternatives Use confidence intervals for Before-and-after comparisons Noncorresponding measurements.
Analysis of Variance (ANOVA) ANOVA can be used to test for the equality of three or more population means We want to use the sample results to test the.
Design of Experiments and Analysis of Variance
Nonparametric tests and ANOVAs: What you need to know.
© 2010 Pearson Prentice Hall. All rights reserved Single Factor ANOVA.
ANALYSIS OF VARIANCE.
Independent Sample T-test Formula
Chapter Topics The Completely Randomized Model: One-Factor Analysis of Variance F-Test for Difference in c Means The Tukey-Kramer Procedure ANOVA Assumptions.
PSY 307 – Statistics for the Behavioral Sciences
Lecture 9: One Way ANOVA Between Subjects
Lecture 12 One-way Analysis of Variance (Chapter 15.2)
Copyright © 2014 by McGraw-Hill Higher Education. All rights reserved.
Analysis of Variance & Multivariate Analysis of Variance
Statistical Methods in Computer Science Hypothesis Testing II: Single-Factor Experiments Ido Dagan.
Go to Table of ContentTable of Content Analysis of Variance: Randomized Blocks Farrokh Alemi Ph.D. Kashif Haqqi M.D.
Statistical Analysis. Purpose of Statistical Analysis Determines whether the results found in an experiment are meaningful. Answers the question: –Does.
Psy B07 Chapter 1Slide 1 ANALYSIS OF VARIANCE. Psy B07 Chapter 1Slide 2 t-test refresher  In chapter 7 we talked about analyses that could be conducted.
F-Test ( ANOVA ) & Two-Way ANOVA
PS 225 Lecture 15 Analysis of Variance ANOVA Tables.
Selecting the Correct Statistical Test
Chapter 13: Inference in Regression
STAT 3130 Statistical Methods I Session 2 One Way Analysis of Variance (ANOVA)
Fundamentals of Data Analysis Lecture 7 ANOVA. Program for today F Analysis of variance; F One factor design; F Many factors design; F Latin square scheme.
Analysis of Variance ( ANOVA )
© 2002 Prentice-Hall, Inc.Chap 9-1 Statistics for Managers Using Microsoft Excel 3 rd Edition Chapter 9 Analysis of Variance.
ANOVA One Way Analysis of Variance. ANOVA Purpose: To assess whether there are differences between means of multiple groups. ANOVA provides evidence.
t(ea) for Two: Test between the Means of Different Groups When you want to know if there is a ‘difference’ between the two groups in the mean Use “t-test”.
A Repertoire of Hypothesis Tests  z-test – for use with normal distributions and large samples.  t-test – for use with small samples and when the pop.
Analyzing Data: Comparing Means Chapter 8. Are there differences? One of the fundament questions of survey research is if there is a difference among.
Analysis of variance Petter Mostad Comparing more than two groups Up to now we have studied situations with –One observation per object One.
PSY 307 – Statistics for the Behavioral Sciences Chapter 16 – One-Factor Analysis of Variance (ANOVA)
ANOVA (Analysis of Variance) by Aziza Munir
Psychology 301 Chapters & Differences Between Two Means Introduction to Analysis of Variance Multiple Comparisons.
1 Chapter 13 Analysis of Variance. 2 Chapter Outline  An introduction to experimental design and analysis of variance  Analysis of Variance and the.
Testing Hypotheses about Differences among Several Means.
Copyright © 2010, 2007, 2004 Pearson Education, Inc Chapter 12 Analysis of Variance 12.2 One-Way ANOVA.
Chapter 14 – 1 Chapter 14: Analysis of Variance Understanding Analysis of Variance The Structure of Hypothesis Testing with ANOVA Decomposition of SST.
INTRODUCTION TO ANALYSIS OF VARIANCE (ANOVA). COURSE CONTENT WHAT IS ANOVA DIFFERENT TYPES OF ANOVA ANOVA THEORY WORKED EXAMPLE IN EXCEL –GENERATING THE.
PPA 415 – Research Methods in Public Administration Lecture 7 – Analysis of Variance.
Chapter 14 – 1 Chapter 14: Analysis of Variance Understanding Analysis of Variance The Structure of Hypothesis Testing with ANOVA Decomposition of SST.
1 Always be mindful of the kindness and not the faults of others.
CHAPTER 4 Analysis of Variance One-way ANOVA
1 Analysis of Variance & One Factor Designs Y= DEPENDENT VARIABLE (“yield”) (“response variable”) (“quality indicator”) X = INDEPENDENT VARIABLE (A possibly.
Previous Lecture: Phylogenetics. Analysis of Variance This Lecture Judy Zhong Ph.D.
Chapter Seventeen. Figure 17.1 Relationship of Hypothesis Testing Related to Differences to the Previous Chapter and the Marketing Research Process Focus.
1 Overview of Experimental Design. 2 3 Examples of Experimental Designs.
Single-Factor Studies KNNL – Chapter 16. Single-Factor Models Independent Variable can be qualitative or quantitative If Quantitative, we typically assume.
ONE WAY ANALYSIS OF VARIANCE ANOVA o It is used to investigate the effect of one factor which occurs at h levels (≥3). Example: Suppose that we wish to.
Chap 11-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 11 Analysis of Variance.
Regression Analysis. 1. To comprehend the nature of correlation analysis. 2. To understand bivariate regression analysis. 3. To become aware of the coefficient.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
CHAPTER 10 ANOVA - One way ANOVa.
Significance Tests for Regression Analysis. A. Testing the Significance of Regression Models The first important significance test is for the regression.
(c) 2007 IUPUI SPEA K300 (4392) Outline Comparing Group Means Data arrangement Linear Models and Factor Analysis of Variance (ANOVA) Partitioning Variance.
ANOVA Analysis of Variance or The F distribution.
1 ANOVA: ANalysis Of VAriances Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking.
F73DA2 INTRODUCTORY DATA ANALYSIS ANALYSIS OF VARIANCE.
DSCI 346 Yamasaki Lecture 4 ANalysis Of Variance.
Chapter 14 Repeated Measures and Two Factor Analysis of Variance PowerPoint Lecture Slides Essentials of Statistics for the Behavioral Sciences Seventh.
Analyze Of VAriance. Application fields ◦ Comparing means for more than two independent samples = examining relationship between categorical->metric variables.
Data Analysis Module: One Way Analysis of Variance (ANOVA)
Design Lecture: week3 HSTS212.
Analysis of Variance and Covariance
i) Two way ANOVA without replication
CHAPTER 12 ANALYSIS OF VARIANCE
CHAPTER 29: Multiple Regression*
Comparing Three or More Means
Chapter 10 – Part II Analysis of Variance
One-way Analysis of Variance
Presentation transcript:

STAT 3120 Statistical Methods I Lecture Notes 6 Analysis of Variance (ANOVA)

Testing for Relationships Among Variables Dependent Variable Independent (predictor) Variable Hypothesis TestComments Categorical (Qualitative) Chi-SquareTests if variables are statistically independent (i.e. are they related or not?) QuantitativeCategorical (Qualitative) T-TEST ANOVA Non-Parametric Determines if categorical variable (factor) affects dependent variable; typically used for experimental or planned change studies Quantitative Regression Analysis Test establishes a regression model; used to explain, predict or control dependent variable

ANalysis Of VAriance A few points about ANOVA: Used to determine if statistical differences exist among three or more groups; (Question – why not use multiple ttests?) Assumes that the groups are of approximately equal size, have approximately normal distributions and are independent of each other; The test statistic for ANOVA is the F-stat.

ANOVA There are two “templates” to retain in your mind when conducting ANOVA. The first involves the structure of the data: This notation can be found on page 387. DATA MEAN Treatment 1Y11Y12Y13Y14Y1 Treatment 2Y21Y22Y23Y24Y2 Treatment 3Y31Y32Y33Y34Y3 Treatment 4Y41Y42Y43Y44Y4 Treatment 5Y51Y52Y53Y54Y5

ANOVA The second involves the actual computation of the test statistic: This notation can be found on page 389. Source of Variation Sum of Squares DFMean SquaresF Statistic Between Groups SSBt-1 (where t= number of treatments or different groups) s 2 B = SSB/t-1 s 2 B / s 2 W Within Groups SSWn T -ts 2 W = SSW/(n T -t) TotalTSSn T -1

ANOVA Consider an Experiment where 4 groups of 5 subjects are exposed to 4 different advertising strategies, and we measure the level of Retention for the subjects in each group as shown: GroupMEAN Verbal Image Repetition Control

ANOVA If the sample means were identical or very similar, one would not claim that the Ad strategy affects retention. If the sample means are substantially different, one might conclude that the Ad strategy affects retention.

ANOVA According to the null hypothesis, the Ad strategy does not influence retention. According to the alternate hypothesis, the Ad strategy affects retention.

ANOVA If the classification into groups is ignored, one can compute the sum of squares of the observations about the mean of all of the scores. This is called the TOTAL SUM OF SQUARES. That value can be decomposed into two independent sources of variability.

Some of the variability among the observations is a result of differences among people (or things). This is called the WITHIN GROUPS sum of squares. Some of the variability among the observations is a result of differences among the groups. This is called the BETWEEN GROUPS sum of squares. ANOVA

Decomposition of Total Deviation SST = SSW + SSB  i  j (X ij -X) 2 =  i  j (X ij -X j ) 2 + n  j (X j -X) 2 _ _ _ SST = Total Sum of Squares SSW = Sum of Squares Within Groups SSB = Sum of Squares Between Groups X = mean of data for all the sample groups combined X j = mean of the jth sample group X ij = the ith element from the jth group n = number of samples in each group _ _

Computation of Sums of Squares  Total Sum of Squares (SST) –  i  j (X ij -X) 2 = = 474  Within Groups Sum of Squares –  i  j (X ij -X j ) 2 = = 144  Between Groups Sum of Squares –n  j (X j -X) 2 = 5( ) = 330 _ _ _

Decomposition of SST 474 Exp. Factor (330) All Other Variables (144) Between Within Impact of

Degrees of Freedom  Degrees of freedom must be computed for each source of variability.  The degrees of freedom for total is (n T -1) = 19.  The degrees of freedom for between groups is (t-1) = 3  The degrees of freedom for within groups is ( n T - t) = 16.

Analysis of Variance Table SOURCESUM OF SQUARES DEGREES OF FREEDOM MEAN SQUARE F-stat BETWEEN WITHIN TOTAL47419