Major Points An example Sampling distribution Hypothesis testing

Slides:



Advertisements
Similar presentations
Introduction to Hypothesis Testing
Advertisements

Power and Effect Size Cal State Northridge  320 Andrew Ainsworth PhD.
Anthony Greene1 Simple Hypothesis Testing Detecting Statistical Differences In The Simplest Case:  and  are both known I The Logic of Hypothesis Testing:
Chapter 9 Hypothesis Testing Understandable Statistics Ninth Edition
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
Chapter 10.  Real life problems are usually different than just estimation of population statistics.  We try on the basis of experimental evidence Whether.
Copyright © 2011 by Pearson Education, Inc. All rights reserved Statistics for the Behavioral and Social Sciences: A Brief Course Fifth Edition Arthur.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 9 Hypothesis Testing Developing Null and Alternative Hypotheses Developing Null and.
Hypothesis testing Week 10 Lecture 2.
Section 7.1 Hypothesis Testing: Hypothesis: Null Hypothesis (H 0 ): Alternative Hypothesis (H 1 ): a statistical analysis used to decide which of two competing.
Fundamentals of Hypothesis Testing. Identify the Population Assume the population mean TV sets is 3. (Null Hypothesis) REJECT Compute the Sample Mean.
Behavioural Science II Week 1, Semester 2, 2002
Cal State Northridge  320 Ainsworth Sampling Distributions and Hypothesis Testing.
Major Points An exampleAn example Sampling distributionSampling distribution Hypothesis testingHypothesis testing  The null hypothesis  Test statistics.
8-2 Basics of Hypothesis Testing
Chapter 9 Hypothesis Testing.
PY 427 Statistics 1Fall 2006 Kin Ching Kong, Ph.D Lecture 6 Chicago School of Professional Psychology.
PSY 307 – Statistics for the Behavioral Sciences
Major Points Formal Tests of Mean Differences Review of Concepts: Means, Standard Deviations, Standard Errors, Type I errors New Concepts: One and Two.
Fundamental Statistics for the Behavioral Sciences, 5th edition David C. Howell Chapter 8 Sampling Distributions and Hypothesis Testing © 2003 Brooks/Cole.
Statistical hypothesis testing – Inferential statistics I.
AM Recitation 2/10/11.
Overview of Statistical Hypothesis Testing: The z-Test
STATISTICS ELEMENTARY MARIO F. TRIOLA Chapter 7 Hypothesis Testing
Copyright © 2010, 2007, 2004 Pearson Education, Inc Lecture Slides Elementary Statistics Eleventh Edition and the Triola Statistics Series by.
Lecture Slides Elementary Statistics Twelfth Edition
Overview Definition Hypothesis
© 2008 McGraw-Hill Higher Education The Statistical Imagination Chapter 9. Hypothesis Testing I: The Six Steps of Statistical Inference.
Presented by Mohammad Adil Khan
Descriptive statistics Inferential statistics
Introduction to Biostatistics and Bioinformatics
Tuesday, September 10, 2013 Introduction to hypothesis testing.
Sampling Distributions and Hypothesis Testing. 2 Major Points An example An example Sampling distribution Sampling distribution Hypothesis testing Hypothesis.
Section 9.1 Introduction to Statistical Tests 9.1 / 1 Hypothesis testing is used to make decisions concerning the value of a parameter.
Chapter 8 Introduction to Hypothesis Testing
The Probability of a Type II Error and the Power of the Test
1 Today Null and alternative hypotheses 1- and 2-tailed tests Regions of rejection Sampling distributions The Central Limit Theorem Standard errors z-tests.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Inferential Statistics.
Chapter 8 Introduction to Hypothesis Testing
Hypothesis testing Chapter 9. Introduction to Statistical Tests.
LECTURE 19 THURSDAY, 14 April STA 291 Spring
Psy B07 Chapter 4Slide 1 SAMPLING DISTRIBUTIONS AND HYPOTHESIS TESTING.
1 Lecture note 4 Hypothesis Testing Significant Difference ©
Inference and Inferential Statistics Methods of Educational Research EDU 660.
1 ConceptsDescriptionHypothesis TheoryLawsModel organizesurprise validate formalize The Scientific Method.
Hypothesis Testing State the hypotheses. Formulate an analysis plan. Analyze sample data. Interpret the results.
Lecture 16 Section 8.1 Objectives: Testing Statistical Hypotheses − Stating hypotheses statements − Type I and II errors − Conducting a hypothesis test.
Statistical Inference Statistical Inference involves estimating a population parameter (mean) from a sample that is taken from the population. Inference.
Copyright © 2010, 2007, 2004 Pearson Education, Inc Section 8-2 Basics of Hypothesis Testing.
Correct decisions –The null hypothesis is true and it is accepted –The null hypothesis is false and it is rejected Incorrect decisions –Type I Error The.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 8 Hypothesis Testing.
Statistical Inference for the Mean Objectives: (Chapter 9, DeCoursey) -To understand the terms: Null Hypothesis, Rejection Region, and Type I and II errors.
Slide Slide 1 Copyright © 2007 Pearson Education, Inc Publishing as Pearson Addison-Wesley. Overview.
Chap 8-1 Fundamentals of Hypothesis Testing: One-Sample Tests.
26134 Business Statistics Tutorial 11: Hypothesis Testing Introduction: Key concepts in this tutorial are listed below 1. Difference.
Logic and Vocabulary of Hypothesis Tests Chapter 13.
Welcome to MM570 Psychological Statistics
1 URBDP 591 A Lecture 12: Statistical Inference Objectives Sampling Distribution Principles of Hypothesis Testing Statistical Significance.
© Copyright McGraw-Hill 2004
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
Education 793 Class Notes Inference and Hypothesis Testing Using the Normal Distribution 8 October 2003.
Psych 230 Psychological Measurement and Statistics Pedro Wolf October 21, 2009.
Hypothesis Testing Steps for the Rejection Region Method State H 1 and State H 0 State the Test Statistic and its sampling distribution (normal or t) Determine.
Chapter 9: Hypothesis Tests for One Population Mean 9.2 Terms, Errors, and Hypotheses.
Hypothesis Testing and Statistical Significance
Chapter 9 Hypothesis Testing Understanding Basic Statistics Fifth Edition By Brase and Brase Prepared by Jon Booze.
Learning Objectives Describe the hypothesis testing process Distinguish the types of hypotheses Explain hypothesis testing errors Solve hypothesis testing.
Sampling Distributions and Hypothesis Testing
Hypothesis Testing: Hypotheses
Hypothesis Testing.
Presentation transcript:

Major Points An example Sampling distribution Hypothesis testing The null hypothesis Test statistics and their distributions The normal distribution and testing Important concepts

Distribution of M&M’s in the population Yellow 20% Brown 30% Orange 10% Blue 10% Red 20% Green 10% Original Distribution

Testing one sample against population There are normally 5.65 red M&M’s in bag (a population parameter) Mean number of red M&M’s in a halloween candy bag = 4.56 (a sample statistic) Are there sufficiently more red M&M’s to conclude significant differences / the two numbers come from different populations. I have provided a simplified version of the study because it is much easier to begin by comparing a sample mean with a population mean. You will probably need to explain why I did this. You can come back and work with the two-sample example later.

Understanding the theoretical and statistical question Theoretical Question Did M&M use a different proportion of red ones for Halloween? Statistical Question: Is the difference between 5.65 and 4.25 large enough to conclude that it is a real (significant) difference? Would we expect a similar kind of difference with a repeat of this experiment? Or... Is the difference due to “sampling error?”

Sampling Error Often differences are due to sampling error Sampling Error does not imply doing a mistake Sampling Error simply refers to the normal variability that we would expect to find from one sample to another, or one study to another

How could we assess Sampling Error? Take many bags of regular M&M candy. Record the number of red M&M’s. Plot the distribution and record its mean and standard deviation. This distribution is a “Sampling Distribution” of the Mean

Sampling Distribution Means of various samples of Brown M&M’s 7.25 7.00 6.75 6.50 6.25 6.00 5.75 5.50 5.25 5.00 4.75 4.50 4.25 4.00 3.75 Sampling Distribution Number of Red M&M’s in the population Frequency 1400 1200 1000 800 600 400 200 Std. Dev = .45 Mean = 5.65 Distribution ranges between 3.76 and 7.25 Mean is 5.65 SD is .45 Mean of 4.00 is not likely, mean of 5 is likely We can calculate these prob1abilities. Right now lets focus on the logic of the analysis. We can calculate how likely it is to get a score as low as 4.25 by chance. Convert score to z score (z distribution has a mean of 0 and standard deviation of 1) =score-mean/standard deviation Look up Table E10, smaller portion 4.25=-3.1=.0006 5.60 = -.11= .45 7.5=3.5=.0002

What is Sampling Distribution The distribution of a statistic over repeated sampling from a specified population. Can be computed for many different statistics

Distribution ranges between 3.76 and 7.25 Mean is 5.65, SD is .45 Mean Number Aggressive Associates 7.25 7.00 6.75 6.50 6.25 6.00 5.75 5.50 5.25 5.00 4.75 4.50 4.25 4.00 3.75 Number of Red M&M’s Frequency 1400 1200 1000 800 600 400 200 Std. Dev = .45 Mean = 5.65 N = 10000.00 Distribution ranges between 3.76 and 7.25 Mean is 5.65, SD is .45 Mean of 4.00 is not likely, mean of 5 is more likely

How likely is it to get score as low as 4.25 by chance. Convert score to z score (z distribution has a mean of 0 and standard deviation of 1) score - mean / standard deviation Look up Table E10, smaller portion Score Z Score Probability 4.25 -3.1 .0006 5.60 -.11 .45 7.5 3.5 .0002

Hypothesis Testing A formal way of testing if we should accept results as being significantly different or not Start with hypothesis that halloween M&M’s are from normal distribution The null hypothesis Find parameters of normal distribution Compare halloween candy to normal distribution

The Null Hypothesis (H0) Is the hypothesis postulating that there is no difference, that two things are from the same distribution. The hypothesis that Halloween candy came from a population of normal M&M’s The hypothesis we usually want to reject. Alternative Hypothesis: Halloween and Regular M&M’s are from different distributions

It is easier to prove Alternative Hypothesis than Null Hypothesis Hypothesis: All crows are black Sample: 3000 crows Results: all are black Conclusion: Are all crows black?

Observation: One white crow Conclusion: Statement :Every crow is black” is false It is easier to prove alternative hypothesis (all crows are not black) than null hypothesis (all crows are black)

Another example of Null & Alternative Hypothesis Hypothesis: Shopping on Amazon.com is different than on BN.com Study: 100 usability tests comparing the two shopping process on both Results: Both sites performed similarly Conclusion: ?

Observation: On Test No:101 Amazon did better Conclusion: Amazon.com and BN are different.

Steps in Hypothesis Testing Define the null hypothesis. Decide what you would expect to find if the null hypothesis were true. Look at what you actually found. Reject the null if what you found is not what you expected.

Important Concepts Concepts critical to hypothesis testing Decision Type I error Type II error Critical values One- and two-tailed tests

Decisions When we test a hypothesis we draw a conclusion; either correct or incorrect. Type I error Reject the null hypothesis when it is actually correct. Type II error Retain the null hypothesis when it is actually false.

Possible Scenarios

M&M candy example

Type I Errors Assume Halloween and Regular candies are same (null hypothesis is true) Assume our results show that they are not same (we reject null hypothesis) This is a Type I error Probability set at alpha ()  usually at .05 Therefore, probability of Type I error = .05

Type II Errors Assume Halloween and Regular Candies are different (alternative hypothesis is true) Assume that we conclude they are the same (we accept null hypothesis) This is also an error Probability denoted beta () We can’t set beta easily. We’ll talk about this issue later. Power = (1 - ) = probability of correctly rejecting false null hypothesis.

Critical Values These represent the point at which we decide to reject null hypothesis. e.g. We might decide to reject null when (p|null) < .05. Our test statistic has some value with p = .05 We reject when we exceed that value. That value is the critical value.

One- and Two-Tailed Tests Two-tailed test rejects null when obtained value too extreme in either direction Decide on this before collecting data. One-tailed test rejects null if obtained value is too low (or too high) We only set aside one direction for rejection.

One- & Two-Tailed Example One-tailed test Reject null if number of red in Halloween candies is higher Two-tailed test Reject null if number of red in Halloween candies is different (whether higher or lower)

Designing an Experiment: Feature Based Product Advisors Identify some good online product advisors Feature Based Filtering: CNET Digital Camera Advisor Basic Sony Decision Guide Dealtime Feature Based Choice Multi-Dimension (including features) based filtration Sony Advanced Decision Guide Review Based Choosing Epinions CNET Computers / Cameras / both; Sample Size; Experimental Questions