One-Way Analysis of Variance Comparing means of more than 2 independent samples 1

KNR 445 Statistics ANOVA (1w) Slide 2 Why not multiple t-tests? 1. # comparisons = k(k-1)/2, where k is the # of groups. In other words, when there are many more than 2 groups, the number of comparisons is large 2. In each separate comparison, you only use information within that pair – but information within other pairs may increase power 3. If you do multiple tests, you have multiple answers, not just one 4. With many tests, type 1 error rates increase radically

KNR 445 Statistics ANOVA (1w) Slide 3 ANalysis Of VAriance  1-way ANOVA  Grouping variable = factor = independent variable  The variable will consist of a number of levels  If 1-way ANOVA is being used, the number will be >2.  E.G. What type of program has the greatest impact on aggression?  Violent movies, soap operas, or “infomercials”?  Type of program is the independent variable or factor, while soap operas is one level of the factor, & aggression is the dependent variable 1 2 3

KNR 445 Statistics ANOVA (1w) Slide 4 1-way ANOVA: Hypotheses  Null:  Alternative (experimental):  Note: no directional hypothesis; Null may be false in many different ways 1 2 3

KNR 445 Statistics ANOVA (1w) Slide 5 1-way ANOVA: Logic  Change in test statistic  Recall with t-tests, test statistic is  But with ANOVA, test statistic is 1 2

1-way ANOVA: Logic  Return to our example… KNR 445 Statistics ANOVA (1w) Slide TV MovieSoap OperaInfomercial = 3= 8= 9

1-way ANOVA: Logic  Variance between sampling means  Known as “between group variance”  Think of what could cause these means to differ (vary) from each other  Treatment effect: differences due to the different ways the groups were treated (systematic variation)  Chance: Individual differences, experimental error (unsystematic, unexplained variation) KNR 445 Statistics ANOVA (1w) Slide 7 1 = 3= 8= 9 2

1-way ANOVA: Logic  Variance expected by chance (error)  Known as “within group variance”  Think of what could cause the scores within the groups to differ from each other  Chance: Individual differences, experimental error (unsystematic, unexplained variation) KNR 445 Statistics ANOVA (1w) Slide 8 1 TV MovieSoap OperaInfomercial

1-way ANOVA: Logic  Partitioning the variance KNR 445 Statistics ANOVA (1w) Slide Total variance Within group variance Chance Within group variance Chance Between group variance: Treatment Chance Between group variance: Treatment Chance + =

1-way ANOVA: Logic  The test statistic for the 1-way ANOVA  The F-ratio  If null is true  If null is false KNR 445 Statistics ANOVA (1w) Slide

1-way ANOVA: Logic  More on the F-statistic  F is a statistic that represents ratio of two variance estimates  Denominator of F is called “error term”  When no treatment effect, F  1  If treatment effect, observed F will be > 1  How large does F have to be to conclude there is a treatment effect (to reject H 0 )?  Compare observed F to critical values based on sampling distribution of F  A family of distributions, each with a pair of degrees of freedom KNR 445 Statistics ANOVA (1w) Slide 11 1

 As with t-distribution, a family of curves  Shape of distribution changes with df  If null is true, F≈1  “p” largest at 1  “p” tapers as F > 1  F-values always positive (variance can’t be negative) KNR 445 Statistics ANOVA (1w) Slide 12 The F-distribution F.05 = 5.14 F values Probability Region of rejection

Hypothesis Testing with ANOVA 1. Research question  Does the type of programming affect levels of aggression? 2. Statistical hypotheses  H 0 :  1 =  2 =... =  K  H 1 : At least 2 means are significantly different 3. Decision rule (critical value) 4. Compute observed F-ratio from data 5. Make decision to reject or fail to reject H 0 6. If H 0 rejected, conduct multiple comparisons as needed KNR 445 Statistics ANOVA (1w) Slide 13 1

Computing ANOVA  For those interested (?!) we’ll cover the steps and do an example (not necessary if you understand the concept…but it may help)  If you’re really confident, skip to slide 21  Steps to completion 1. Compute SS (sums of squares) 2. Compute df 3. Compute MS (mean squares) 4. Compute F KNR 445 Statistics ANOVA (1w) Slide

Computing ANOVA  Vocabulary/Symbols:  k = Number of groups  n j = Sample size of the j th group (n 1, n 2,…n j,…n k )  N = Total sample size  = Mean of the j th group  = Grand (overall) mean  SS (Sum of squares) = Sum of squared deviations around a mean KNR 445 Statistics ANOVA (1w) Slide 15 1

Computing ANOVA  Step 1: Compute Sums of Squares (SS)  Need total, group, and error sums of squares  These are combined with appropriate df to give variance calculations, & then generate F-ratio KNR 445 Statistics ANOVA (1w) Slide

Computing ANOVA  Step 1: Compute Sums of Squares (SS)  Total sum of squares (looks a little daunting, but it’s really not) KNR 445 Statistics ANOVA (1w) Slide This is just the sum of the squared deviations of each observation from the overall mean 2. The second part of the formula is the one we’ll use in the calculations, as it’s easier to work with. The first one is easier to conceptualize

Computing ANOVA  Step 1: Compute Sums of Squares (SS)  Group sum of squares KNR 445 Statistics ANOVA (1w) Slide This is the sum of the squared deviations of each group mean from the overall mean (multiplied by each sample’s size)

Computing ANOVA  Step 1: Compute Sums of Squares (SS)  Error sum of squares  Total variance is composed of SS group & SS error  SS total = SS group + SS error  Rearrange this formula to get:  SS error = SS total – SS group KNR 445 Statistics ANOVA (1w) Slide To calculate, take the sum of squares of each observation within a group from its group mean, for all groups 3

Computing ANOVA  Step 2: Compute degrees of freedom  (Used to adjust SS to variance estimates)  df group :  df total :  df error (or “what’s left over”): KNR 445 Statistics ANOVA (1w) Slide

Computing ANOVA  Step 3: Compute Mean Squares (MS) & F- ratio  Mean Square = variance KNR 445 Statistics ANOVA (1w) Slide

Computing ANOVA  The ANOVA summary table (may help you understand where it comes from in SPSS)  all the processes are alluded to above KNR 445 Statistics ANOVA (1w) Slide 22 1 Source Sum of Squares DFMSFsig. Between Groups SS group df group SS gp /df gp =MS B MS B /MS W p-value Within Groups SS error df error Ss e /df e =MS W TotalSS total df total