One Tailed and Two Tailed tests One tailed tests: Based on a uni-directional hypothesis Example: Effect of training on problems using PowerPoint Population.

Slides:



Advertisements
Similar presentations
Statistics for the Social Sciences Psychology 340 Fall 2006 Using t-tests.
Advertisements

Fundamental Statistics for the Behavioral Sciences, 5th edition David C. Howell Chapter 12 Hypothesis Tests: One Sample Mean © 2003 Brooks/Cole Publishing.
Sampling Distributions, Hypothesis Testing and One-sample Tests.
Comparing One Sample to its Population
Ethan Cooper (Lead Tutor)
Review: What influences confidence intervals?
Chapter 8 Hypothesis Testing I. Significant Differences  Hypothesis testing is designed to detect significant differences: differences that did not occur.
Chapter 11 – Student’s t Tests Continuation of hypothesis testing. When population standard deviation is unknown, one can not use normal distribution.
Cal State Northridge  320 Andrew Ainsworth PhD Hypothesis Tests: One Sample Mean.
Fundamentals of Hypothesis Testing. Identify the Population Assume the population mean TV sets is 3. (Null Hypothesis) REJECT Compute the Sample Mean.
Cal State Northridge  320 Ainsworth Sampling Distributions and Hypothesis Testing.
If you think you made a lot of mistakes in the survey project…. Think of how much you accomplished and the mistakes you did not make…
Lecture 13: Review One-Sample z-test and One-Sample t-test 2011, 11, 1.
Intro to Statistics for the Behavioral Sciences PSYC 1900 Lecture 9: Hypothesis Tests for Means: One Sample.
Chapter Goals After completing this chapter, you should be able to:
Hypothesis testing & Inferential Statistics
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 9-1 Introduction to Statistics Chapter 10 Estimation and Hypothesis.
Statistics Review Levels of Measurement.
T-Tests Lecture: Nov. 6, 2002.
 What is t test  Types of t test  TTEST function  T-test ToolPak 2.
Chapter 9 Hypothesis Testing.
Statistical Methods in Computer Science Hypothesis Testing I: Treatment experiment designs Ido Dagan.
Chapter 9 Hypothesis Testing II. Chapter Outline  Introduction  Hypothesis Testing with Sample Means (Large Samples)  Hypothesis Testing with Sample.
Intro to Statistics for the Behavioral Sciences PSYC 1900 Lecture 11: Power.
PSY 307 – Statistics for the Behavioral Sciences
Major Points Formal Tests of Mean Differences Review of Concepts: Means, Standard Deviations, Standard Errors, Type I errors New Concepts: One and Two.
Chapter 9 Hypothesis Testing II. Chapter Outline  Introduction  Hypothesis Testing with Sample Means (Large Samples)  Hypothesis Testing with Sample.
PSY 307 – Statistics for the Behavioral Sciences
Hypothesis Testing and T-Tests. Hypothesis Tests Related to Differences Copyright © 2009 Pearson Education, Inc. Chapter Tests of Differences One.
AM Recitation 2/10/11.
Hypothesis Testing:.
Chapter 13 – 1 Chapter 12: Testing Hypotheses Overview Research and null hypotheses One and two-tailed tests Errors Testing the difference between two.
Week 9 Chapter 9 - Hypothesis Testing II: The Two-Sample Case.
Overview Definition Hypothesis
Hypothesis Testing II The Two-Sample Case.
Copyright © 2012 by Nelson Education Limited. Chapter 8 Hypothesis Testing II: The Two-Sample Case 8-1.
Sampling Distributions and Hypothesis Testing. 2 Major Points An example An example Sampling distribution Sampling distribution Hypothesis testing Hypothesis.
Education 793 Class Notes T-tests 29 October 2003.
1 Level of Significance α is a predetermined value by convention usually 0.05 α = 0.05 corresponds to the 95% confidence level We are accepting the risk.
Sampling Distribution of the Mean Central Limit Theorem Given population with and the sampling distribution will have: A mean A variance Standard Error.
Go to Index Analysis of Means Farrokh Alemi, Ph.D. Kashif Haqqi M.D.
Hypothesis Tests: One Sample Mean
Week 8 Chapter 8 - Hypothesis Testing I: The One-Sample Case.
Chapter 9 Hypothesis Testing and Estimation for Two Population Parameters.
Hypothesis Testing Quantitative Methods in HPELS 440:210.
Chapter 9 Hypothesis Testing II: two samples Test of significance for sample means (large samples) The difference between “statistical significance” and.
Copyright © 2012 by Nelson Education Limited. Chapter 7 Hypothesis Testing I: The One-Sample Case 7-1.
IS 4800 Empirical Research Methods for Information Science Class Notes March 13 and 15, 2012 Instructor: Prof. Carole Hafner, 446 WVH
DIRECTIONAL HYPOTHESIS The 1-tailed test: –Instead of dividing alpha by 2, you are looking for unlikely outcomes on only 1 side of the distribution –No.
Chapter 8 Parameter Estimates and Hypothesis Testing.
Review I A student researcher obtains a random sample of UMD students and finds that 55% report using an illegally obtained stimulant to study in the past.
© Copyright McGraw-Hill 2004
Education 793 Class Notes Inference and Hypothesis Testing Using the Normal Distribution 8 October 2003.
AP Statistics. Chap 13-1 Chapter 13 Estimation and Hypothesis Testing for Two Population Parameters.
Chance Models, Hypothesis Testing, Power Q560: Experimental Methods in Cognitive Science Lecture 6.
1 Testing Statistical Hypothesis The One Sample t-Test Heibatollah Baghi, and Mastee Badii.
Hypothesis test flow chart
Lecture 8 Estimation and Hypothesis Testing for Two Population Parameters.
Chapter 9 Introduction to the t Statistic
Hypothesis Testing – Two Population Variances
Math 4030 – 10b Inferences Concerning Variances: Hypothesis Testing
Estimation & Hypothesis Testing for Two Population Parameters
Math 4030 – 10a Tests for Population Mean(s)
Central Limit Theorem, z-tests, & t-tests
Review: What influences confidence intervals?
Hypothesis Testing.
Reasoning in Psychology Using Statistics
What are their purposes? What kinds?
Reasoning in Psychology Using Statistics
Reasoning in Psychology Using Statistics
Presentation transcript:

One Tailed and Two Tailed tests One tailed tests: Based on a uni-directional hypothesis Example: Effect of training on problems using PowerPoint Population figures for usability of PP are known Hypothesis: Training will decrease number of problems with PP Two tailed tests: Based on a bi-directional hypothesis Hypothesis: Training will change the number of problems with PP

If we know the population mean Mean Usability Index Sampling Distribution Population for usability of Powerpoint Frequency Std. Dev =.45 Mean = 5.65 N = Unidirectional hypothesis:.05 level Bidirectional hypothesis:.05 level Identify region

What does it mean if our significance level is.05?What does it mean if our significance level is.05? XFor a uni-directional hypothesis XFor a bi-directional hypothesis PowerPoint example: UnidirectionalUnidirectional XIf we set significance level at.05 level, 5% of the time we will higher mean by chance5% of the time we will higher mean by chance 95% of the time the higher mean mean will be real95% of the time the higher mean mean will be real BidirectionalBidirectional XIf we set significance level at.05 level 2.5 % of the time we will find higher mean by chance2.5 % of the time we will find higher mean by chance 2.5% of the time we will find lower mean by chance2.5% of the time we will find lower mean by chance 95% of time difference will be real95% of time difference will be real

Changing significance levels What happens if we decrease our significance level from.01 to.05What happens if we decrease our significance level from.01 to.05 XProbability of finding differences that don’t exist goes up (criteria becomes more lenient) What happens if we increase our significance from.01 to.001What happens if we increase our significance from.01 to.001 XProbability of not finding differences that exist goes up (criteria becomes more conservative)

PowerPoint example:PowerPoint example: XIf we set significance level at.05 level, 5% of the time we will find a difference by chance5% of the time we will find a difference by chance 95% of the time the difference will be real95% of the time the difference will be real XIf we set significance level at.01 level 1% of the time we will find a difference by chance1% of the time we will find a difference by chance 99% of time difference will be real99% of time difference will be real For usability, if you are set out to find problems: setting lenient criteria might work better (you will identify more problems)For usability, if you are set out to find problems: setting lenient criteria might work better (you will identify more problems)

Effect of decreasing significance level from.01 to.05Effect of decreasing significance level from.01 to.05 XProbability of finding differences that don’t exist goes up (criteria becomes more lenient) XAlso called Type I error (Alpha) Effect of increasing significance from.01 to.001Effect of increasing significance from.01 to.001 XProbability of not finding differences that exist goes up (criteria becomes more conservative) XAlso called Type II error (Beta)

Degree of Freedom The number of independent pieces of information remaining after estimating one or more parametersThe number of independent pieces of information remaining after estimating one or more parameters Example: List= 1, 2, 3, 4 Average= 2.5Example: List= 1, 2, 3, 4 Average= 2.5 For average to remain the same three of the numbers can be anything you want, fourth is fixedFor average to remain the same three of the numbers can be anything you want, fourth is fixed New List = 1, 5, 2.5, __ Average = 2.5New List = 1, 5, 2.5, __ Average = 2.5

Major Points T tests: are differences significant?T tests: are differences significant? One sample t tests, comparing one mean to populationOne sample t tests, comparing one mean to population Within subjects test: Comparing mean in condition 1 to mean in condition 2Within subjects test: Comparing mean in condition 1 to mean in condition 2 Between Subjects test: Comparing mean in condition 1 to mean in condition 2Between Subjects test: Comparing mean in condition 1 to mean in condition 2

Effect of training on Powerpoint use Does training lead to lesser problems with PP?Does training lead to lesser problems with PP? 9 subjects were trained on the use of PP.9 subjects were trained on the use of PP. Then designed a presentation with PP.Then designed a presentation with PP. XNo of problems they had was DV

Powerpoint study data Mean = 23.89Mean = SD = 4.20SD = 4.20

Results of Powerpoint study. ResultsResults XMean number of problems = Assume we know that without training the mean would be 30, but not the standard deviationAssume we know that without training the mean would be 30, but not the standard deviation Population mean = 30 Is enough larger than 30 to conclude that video affected results?Is enough larger than 30 to conclude that video affected results?

Sampling Distribution of the Mean We need to know what kinds of sample means to expect if training has no effect.We need to know what kinds of sample means to expect if training has no effect.  i. e. What kinds of means if  = XThis is the sampling distribution of the mean.

Sampling Distribution of the Mean--cont. The sampling distribution of the mean depends onThe sampling distribution of the mean depends on XMean of sampled population XSt. dev. of sampled population XSize of sample

Cont.

Sampling Distribution of the mean--cont. Shape of the sampled populationShape of the sampled population XApproaches normal XRate of approach depends on sample size XAlso depends on the shape of the population distribution

Implications of the Central Limit Theorem Given a population with mean =  and standard deviation = , the sampling distribution of the mean (the distribution of sample means) has a mean = , and a standard deviation =  /  n.Given a population with mean =  and standard deviation = , the sampling distribution of the mean (the distribution of sample means) has a mean = , and a standard deviation =  /  n. The distribution approaches normal as n, the sample size, increases.The distribution approaches normal as n, the sample size, increases.

Demonstration Let population be very skewedLet population be very skewed Draw samples of 3 and calculate meansDraw samples of 3 and calculate means Draw samples of 10 and calculate meansDraw samples of 10 and calculate means Plot meansPlot means Note changes in means, standard deviations, and shapesNote changes in means, standard deviations, and shapes Cont.

Parent Population Cont.

Sampling Distribution n = 3 Cont.

Sampling Distribution n = 10 Cont.

Demonstration--cont. Means have stayed at 3.00 throughout-- except for minor sampling errorMeans have stayed at 3.00 throughout-- except for minor sampling error Standard deviations have decreased appropriatelyStandard deviations have decreased appropriately Shapes have become more normal--see superimposed normal distribution for referenceShapes have become more normal--see superimposed normal distribution for reference

One sample t test cont. Assume mean of population known, but standard deviation (SD) not knownAssume mean of population known, but standard deviation (SD) not known Substitute sample SD for population SD (standard error)Substitute sample SD for population SD (standard error) Gives you the t statisticsGives you the t statistics Compare t to tabled values which show critical values of tCompare t to tabled values which show critical values of t

t Test for One Mean Get mean difference between sample and population meanGet mean difference between sample and population mean Use sample SD as variance metric = 4.40Use sample SD as variance metric = 4.40

Degrees of Freedom Skewness of sampling distribution of variance decreases as n increasesSkewness of sampling distribution of variance decreases as n increases t will differ from z less as sample size increasest will differ from z less as sample size increases Therefore need to adjust t accordinglyTherefore need to adjust t accordingly df = n - 1df = n - 1 t based on dft based on df

Looking up critical t (Table E.6)

Conclusions Critical t= n = 9, t.05 = 2.62 (two tail significance)Critical t= n = 9, t.05 = 2.62 (two tail significance) If t > 2.62, reject H 0If t > 2.62, reject H 0 Conclude that training leads to less problemsConclude that training leads to less problems

Factors Affecting t Difference between sample and population meansDifference between sample and population means Magnitude of sample varianceMagnitude of sample variance Sample sizeSample size

Factors Affecting Decision Significance level Significance level  One-tailed versus two-tailed testOne-tailed versus two-tailed test