(c) 2007 IUPUI SPEA K300 (4392) Outline Comparing Group Means Data arrangement Linear Models and Factor Analysis of Variance (ANOVA) Partitioning Variance.

Slides:



Advertisements
Similar presentations
Test of (µ 1 – µ 2 ),  1 =  2, Populations Normal Test Statistic and df = n 1 + n 2 – 2 2– )1– 2 ( 2 1 )1– 1 ( 2 where ] 2 – 1 [–
Advertisements

Topic 12: Multiple Linear Regression
Copyright 2004 David J. Lilja1 Comparing Two Alternatives Use confidence intervals for Before-and-after comparisons Noncorresponding measurements.
Chapter 14, part D Statistical Significance. IV. Model Assumptions The error term is a normally distributed random variable and The variance of  is constant.
Analysis of Variance (ANOVA) ANOVA can be used to test for the equality of three or more population means We want to use the sample results to test the.
Design of Experiments and Analysis of Variance
(c) 2007 IUPUI SPEA K300 (4392) Outline Least Squares Methods Estimation: Least Squares Interpretation of estimators Properties of OLS estimators Variance.
© 2010 Pearson Prentice Hall. All rights reserved Single Factor ANOVA.
One-Way Between Subjects ANOVA. Overview Purpose How is the Variance Analyzed? Assumptions Effect Size.
1 1 Slide © 2009, Econ-2030 Applied Statistics-Dr Tadesse Chapter 10: Comparisons Involving Means n Introduction to Analysis of Variance n Analysis of.
Statistics for Managers Using Microsoft® Excel 5th Edition
Independent Sample T-test Formula
1 Multifactor ANOVA. 2 What We Will Learn Two-factor ANOVA K ij =1 Two-factor ANOVA K ij =1 –Interaction –Tukey’s with multiple comparisons –Concept of.
UNDERSTANDING RESEARCH RESULTS: STATISTICAL INFERENCE.
Analysis of Variance: Inferences about 2 or More Means
Lecture 12 One-way Analysis of Variance (Chapter 15.2)
Analysis of Variance & Multivariate Analysis of Variance
Chap 10-1 Analysis of Variance. Chap 10-2 Overview Analysis of Variance (ANOVA) F-test Tukey- Kramer test One-Way ANOVA Two-Way ANOVA Interaction Effects.
6.1 - One Sample One Sample  Mean μ, Variance σ 2, Proportion π Two Samples Two Samples  Means, Variances, Proportions μ 1 vs. μ 2.
Chapter 12: Analysis of Variance
T-test Mechanics. Z-score If we know the population mean and standard deviation, for any value of X we can compute a z-score Z-score tells us how far.
1 One Way Analysis of Variance – Designed experiments usually involve comparisons among more than two means. – The use of Z or t tests with more than two.
1 1 Slide © 2006 Thomson/South-Western Slides Prepared by JOHN S. LOUCKS St. Edward’s University Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
1 Tests with two+ groups We have examined tests of means for a single group, and for a difference if we have a matched sample (as in husbands and wives)
1 1 Slide © 2005 Thomson/South-Western Chapter 13, Part A Analysis of Variance and Experimental Design n Introduction to Analysis of Variance n Analysis.
INFERENTIAL STATISTICS: Analysis Of Variance ANOVA
One-Way Analysis of Variance Comparing means of more than 2 independent samples 1.
Chapter 11 HYPOTHESIS TESTING USING THE ONE-WAY ANALYSIS OF VARIANCE.
 The idea of ANOVA  Comparing several means  The problem of multiple comparisons  The ANOVA F test 1.
t(ea) for Two: Test between the Means of Different Groups When you want to know if there is a ‘difference’ between the two groups in the mean Use “t-test”.
Chapter 10 Analysis of Variance.
ANOVA (Analysis of Variance) by Aziza Munir
Multiple regression - Inference for multiple regression - A case study IPS chapters 11.1 and 11.2 © 2006 W.H. Freeman and Company.
1 Chapter 13 Analysis of Variance. 2 Chapter Outline  An introduction to experimental design and analysis of variance  Analysis of Variance and the.
Testing Hypotheses about Differences among Several Means.
Chapter 14 – 1 Chapter 14: Analysis of Variance Understanding Analysis of Variance The Structure of Hypothesis Testing with ANOVA Decomposition of SST.
Chapter 11 Linear Regression Straight Lines, Least-Squares and More Chapter 11A Can you pick out the straight lines and find the least-square?
Multiple Regression I 4/9/12 Transformations The model Individual coefficients R 2 ANOVA for regression Residual standard error Section 9.4, 9.5 Professor.
Chapter 19 Analysis of Variance (ANOVA). ANOVA How to test a null hypothesis that the means of more than two populations are equal. H 0 :  1 =  2 =
Comparing Three or More Means ANOVA (One-Way Analysis of Variance)
One-Way ANOVA ANOVA = Analysis of Variance This is a technique used to analyze the results of an experiment when you have more than two groups.
Simple Linear Regression ANOVA for regression (10.2)
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Statistical Testing of Differences CHAPTER fifteen.
ANOVA: Analysis of Variance.
Chapter 14 – 1 Chapter 14: Analysis of Variance Understanding Analysis of Variance The Structure of Hypothesis Testing with ANOVA Decomposition of SST.
Lecture 9-1 Analysis of Variance
Analysis of Variance (One Factor). ANOVA Analysis of Variance Tests whether differences exist among population means categorized by only one factor or.
Previous Lecture: Phylogenetics. Analysis of Variance This Lecture Judy Zhong Ph.D.
STA 286 week 131 Inference for the Regression Coefficient Recall, b 0 and b 1 are the estimates of the slope β 1 and intercept β 0 of population regression.
CPE 619 One Factor Experiments Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama in.
Inferential Statistics 4 Maarten Buis 18/01/2006.
Chapter 4 Analysis of Variance
Econ 3790: Business and Economic Statistics Instructor: Yogesh Uppal
Econ 3790: Business and Economic Statistics Instructor: Yogesh Uppal
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
Significance Tests for Regression Analysis. A. Testing the Significance of Regression Models The first important significance test is for the regression.
1/54 Statistics Analysis of Variance. 2/54 Statistics in practice Introduction to Analysis of Variance Analysis of Variance: Testing for the Equality.
1 Lecture 15 One Way Analysis of Variance  Designed experiments usually involve comparisons among more than two means.  The use of Z or t tests with.
 List the characteristics of the F distribution.  Conduct a test of hypothesis to determine whether the variances of two populations are equal.  Discuss.
DSCI 346 Yamasaki Lecture 4 ANalysis Of Variance.
Six Easy Steps for an ANOVA 1) State the hypothesis 2) Find the F-critical value 3) Calculate the F-value 4) Decision 5) Create the summary table 6) Put.
Chapter 13 Analysis of Variance (ANOVA). ANOVA can be used to test for differences between three or more means. The hypotheses for an ANOVA are always:
Statistics Analysis of Variance.
Post Hoc Tests on One-Way ANOVA
Post Hoc Tests on One-Way ANOVA
Econ 3790: Business and Economic Statistics
One way ANALYSIS OF VARIANCE (ANOVA)
Chapter 15 Analysis of Variance
Chapter 10 – Part II Analysis of Variance
Presentation transcript:

(c) 2007 IUPUI SPEA K300 (4392) Outline Comparing Group Means Data arrangement Linear Models and Factor Analysis of Variance (ANOVA) Partitioning Variance F-test (Computation) T-test and ANOVA Conclusion

(c) 2007 IUPUI SPEA K300 (4392) Comparing group means Compares the means of independent variables x1 and x2 (independent sample t-test) Compares two group means of a variable x; examines how group makes difference in x. Data arrangements: SPSS requires the second arrangement for independent sample t-test

(c) 2007 IUPUI SPEA K300 (4392) Data Arrangement xgroup x1x

(c) 2007 IUPUI SPEA K300 (4392) Linear Model and Factor Examines how group makes difference in the variable x. X = µ + g i + e i µ is the overall mean, g i is group i’s mean difference from the overall mean G is called factor (categorical independent variable) that makes difference in the left-hand side variable (dependent variable) x.

(c) 2007 IUPUI SPEA K300 (4392) Comparing More Variables What if you need to compare x1, x2, and x3? Or compares means of three groups? Compares x1 and x2, x1 and x3, and x2 and x3? How about comparing 4 and 5 groups? Any way to make comparison easy? ANOVA is the answer

(c) 2007 IUPUI SPEA K300 (4392) T-test and ANOVA 1 T-test directly compares means of two variables (groups) ANOVA (Analysis of Variance) partitions overall variance and examines the impact of factors on mean difference So, t-test is a special case of ANOVA that considers only TWO GROUPS

(c) 2007 IUPUI SPEA K300 (4392) Data Arrangement: x ij An observation of i group and jth data point x ij xgroup x 11 x 12 x 13 x 14 x 15 x 21 x 22 x 23 x 24 x x1x2 x 11 x 12 x 13 x 14 x 15 x 21 x 22 x 23 x 24 x 25

(c) 2007 IUPUI SPEA K300 (4392) Partitioning of Variance 1 Overall mean x ** ; group i mean x i* Sum of squares between group (treatment) Sum of squares within group SST = SSM (between) + SSE (within)

(c) 2007 IUPUI SPEA K300 (4392) Partitioning of Variance 2: µ=7.7 Treatmentx(x-xbar)^2xibar(xibar-xbar)^2(x-xibar)^ Total

(c) 2007 IUPUI SPEA K300 (4392) ANOVA: F test 1 H 0 : all group have the same mean Ratio of MSM to MSE Degrees of freedom 1 is t-1 (t is the number of groups) Degrees of freedom 2 is N-t (N is the number of overall observation) SourcesSum of SquaresDFMean SquaresF Model (treatment)SSMt-1MSM=SSM/(t-1)MSM/MSE Error (residual)SSEN-tMSE=SSE/(N-t) TotalSSTN-1

(c) 2007 IUPUI SPEA K300 (4392) ANOVA: F test 2 T=3 (three groups); N=15 (5 in each group) SST=264.9= SSM=160.1, MSM=80.1=160/(3-1) SSE=104.8, MSE=8.7=104.8/(15-3) F=9.2=80.1/8.7 (CV=5.10 p.639) df1=2=3-1, df2=12=15-3 SourcesSum of SquaresDFMean SquaresF Model (treatment) Error (residual) Total

(c) 2007 IUPUI SPEA K300 (4392) ANOVA: F-test 3 If F score is larger than the critical value or the p-value is smaller than the significance level, reject the null hypothesis Rejection of H 0 is interpreted as there is at least one group that has a mean different from other group means. Rejection of H 0 does not, however, say which groups have different means.

(c) 2007 IUPUI SPEA K300 (4392) ANOVA: Short Cuts Compute sum of observations (overall and individual groups) or overall mean x ** Compute variances of groups (s i ) 2

(c) 2007 IUPUI SPEA K300 (4392) Independent sample t-test X1bar=$26,800, s1=$600, n1=10 X2bar=$25,400, s2=$450, n2=8 Since 5.47>2.58 and p-value <.01, reject the H 0 at the.01 level.

(c) 2007 IUPUI SPEA K300 (4392) ANOVA for two group means sum1=268,000=26,800*10, s1=$600, n1=10 sum2=203,200=24,400*8, s2=$450, n2=8 Overall sum=471,200=268, ,200, N=18 SST=SSM+SSE=13,368,611=8,711,111+4,657,500 F=MSM/MSE= ; sqrt( )=5.4704=t

(c) 2007 IUPUI SPEA K300 (4392) T-test versus ANOVA T-test examines mean difference using t distribution (mean difference/standard deviation) ANOVA examines the mean difference by partitioning variance components of between and within group (F-test) T-test is a special case of ANOVA T score is the square root of F score when df 1 is 1 (comparing two groups)

(c) 2007 IUPUI SPEA K300 (4392) Summary of Comparing Means