Hypothesis Testing Is It Significant?.

Slides:



Advertisements
Similar presentations
“Students” t-test.
Advertisements

Hypothesis testing Another judgment method of sampling data.
Statistics 101 Class 8. Overview Hypothesis Testing Hypothesis Testing Stating the Research Question Stating the Research Question –Null Hypothesis –Alternative.
Statistical Techniques I EXST7005 Lets go Power and Types of Errors.
HYPOTHESIS TESTING Four Steps Statistical Significance Outcomes Sampling Distributions.
Chapter Seventeen HYPOTHESIS TESTING
Evaluating Hypotheses Chapter 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics.
Cal State Northridge  320 Ainsworth Sampling Distributions and Hypothesis Testing.
Chapter 9 Hypothesis Testing.
PY 427 Statistics 1Fall 2006 Kin Ching Kong, Ph.D Lecture 6 Chicago School of Professional Psychology.
PSY 307 – Statistics for the Behavioral Sciences
Hypothesis Testing Is It Significant?. Questions What is a statistical hypothesis? What is the null hypothesis? Why is it important for statistical tests?
Testing Hypotheses I Lesson 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics n Inferential Statistics.
1 © Lecture note 3 Hypothesis Testing MAKE HYPOTHESIS ©
Presented by Mohammad Adil Khan
Introduction to Hypothesis Testing for μ Research Problem: Infant Touch Intervention Designed to increase child growth/weight Weight at age 2: Known population:
1/2555 สมศักดิ์ ศิวดำรงพงศ์
4-1 Statistical Inference The field of statistical inference consists of those methods used to make decisions or draw conclusions about a population.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Inferential Statistics.
Hypothesis Testing Quantitative Methods in HPELS 440:210.
The Argument for Using Statistics Weighing the Evidence Statistical Inference: An Overview Applying Statistical Inference: An Example Going Beyond Testing.
10.2 Tests of Significance Use confidence intervals when the goal is to estimate the population parameter If the goal is to.
Hypothesis testing and Decision Making Formal aspects of hypothesis testing.
Chapter 20 Testing Hypothesis about proportions
Chap 8-1 Fundamentals of Hypothesis Testing: One-Sample Tests.
Ex St 801 Statistical Methods Inference about a Single Population Mean.
Math 4030 – 9a Introduction to Hypothesis Testing
Testing the Differences between Means Statistics for Political Science Levin and Fox Chapter Seven 1.
Inen 460 Lecture 2. Estimation (ch. 6,7) and Hypothesis Testing (ch.8) Two Important Aspects of Statistical Inference Point Estimation – Estimate an unknown.
Introduction Suppose that a pharmaceutical company is concerned that the mean potency  of an antibiotic meet the minimum government potency standards.
Introduction to hypothesis testing Hypothesis testing is about making decisions Is a hypothesis true or false? Ex. Are women paid less, on average, than.
STEP BY STEP Critical Value Approach to Hypothesis Testing 1- State H o and H 1 2- Choose level of significance, α Choose the sample size, n 3- Determine.
Statistical Techniques
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
Descriptive and Inferential Statistics Descriptive statistics The science of describing distributions of samples or populations Inferential statistics.
One Sample Inf-1 In statistical testing, we use deductive reasoning to specify what should happen if the conjecture or null hypothesis is true. A study.
Chapter 13 Understanding research results: statistical inference.
C HAPTER 2  Hypothesis Testing -Test for one means - Test for two means -Test for one and two proportions.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Prof. Robert Martin Southeastern Louisiana University.
4-1 Statistical Inference Statistical inference is to make decisions or draw conclusions about a population using the information contained in a sample.
Chapter 9 Introduction to the t Statistic
CHAPTER 9 Testing a Claim
Hypothesis Testing Is It Significant?.
INF397C Introduction to Research in Information Studies Spring, Day 12
Inference and Tests of Hypotheses
Tests of Significance The reasoning of significance tests
Hypothesis Testing: Preliminaries
Understanding Results
Hypothesis Testing and Confidence Intervals (Part 1): Using the Standard Normal Lecture 8 Justin Kern October 10 and 12, 2017.
CHAPTER 9 Testing a Claim
Introduction to Statistics for the Social Sciences SBS200 - Lecture Section 001, Fall 2016 Room 150 Harvill Building 10: :50 Mondays, Wednesdays.
Hypothesis Testing: Hypotheses
CONCEPTS OF HYPOTHESIS TESTING
Introduction to Inference
Unlocking the Mysteries of Hypothesis Testing
Introduction to Inference
AP Statistics: Chapter 21
Review: What influences confidence intervals?
Chapter Nine Part 1 (Sections 9.1 & 9.2) Hypothesis Testing
Interval Estimation and Hypothesis Testing
Confidence Intervals.
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
Testing Hypotheses I Lesson 9.
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
STA 291 Spring 2008 Lecture 17 Dustin Lueker.
Introduction To Hypothesis Testing
Presentation transcript:

Hypothesis Testing Is It Significant?

Questions What is a statistical hypothesis? What is the null hypothesis? Why is it important for statistical tests? Describe the steps in a test of the null hypothesis. What are the four kinds of outcome of a statistical test (compare the sample result to the state in the population)?

More questions What is statistical power? What are the factors that influence the power of a test? Give a concrete example of a study (describe the IV and DV) and state one thing you could do to increase its power.

Decision Making Under Uncertainty You have to make decisions even when you are unsure. School, marriage, therapy, jobs, whatever. Statistics provides an approach to decision making under uncertainty. Sort of decision making by choosing the same way you would bet. Maximize expected utility (subjective value). Comes from agronomy, where they were trying to decide what strain to plant.

Statistics as a Decision Aid Because of uncertainty (have to estimate things), we will be wrong sometimes. The point is to be thoughtful about it; how many errors of what kinds? What are the consequences? Statistics allows us to calculate probabilities and to base our decisions on those. We choose (at least partially) the amount and kind of error. Hypothesis testing done mostly by convention, but there is a logic to it.

Statistical Hypotheses Statements about characteristics of populations, denoted H: H: normal distribution, H: N(28,13) The hypothesis actually tested is called the null hypothesis, H0 E.g., The other hypothesis, assumed true if the null is false, is the alternative hypothesis, H1

Testing Statistical Hypotheses - steps State the null and alternative hypotheses Assume whatever is required to specify the sampling distribution of the statistic if the null is true (e.g., SD, normal distribution, etc.) Find rejection region of sampling distribution –that place which is unlikely if null is true Collect sample data. Find whether statistic falls inside or outside the rejection region. If statistic falls in the rejection region, result is said to be statistically significant.

Testing Statistical Hypotheses – example Suppose Assume and population is normal, so sampling distribution of means is known (to be normal). Rejection region: Region (N=25): We get data Conclusion: reject null. Unlikely Unlikely

Same Example Rejection region in z (unit normal) Sample result (79) just over the line Z =(79-75)/2 Z = 2 2 > 1.96

Review What is a statistical hypothesis? What is the null hypothesis? Why is it important for statistical tests? Describe the steps in a test of the null hypothesis.

Exercise Recall the Davis data (heights and weights of men and women) Suppose that in the population (combined men & women), the mean BMI is 23, the SD is 3 and BMI is normally distributed. Construct a confidence interval and rejection regions using z, the unit normal (draw on paper). What is the probability of our sample mean? Is it statistically significant?

Decisions, Decisions Based on the data we have, we will make a decision, e.g., whether means are different (several means are the same, slope is zero, etc.). In the population, the means are really different or really the same. We will decide if they are the same or different. We will be either correct or mistaken. Fire In the Population Fire Alarm No Yes Silent Working Yikes! Goes off False Alarm Sample decision Same Different Right. Null is right, nuts. Type II error. p(Type II)= Type I error. p(Type I)=  Right! Power=1-

Conventional Rules Set alpha to .05 or .01 (some small value). Alpha sets Type I error rate. Choose rejection region that has a probability of alpha if null is true but some bigger probability if alternative is true. Call the result significant beyond the alpha level (e.g., p < .05) if the statistic falls in the rejection region.

Power (1) Alpha ( ) sets Type I error rate. We say different, but really same. Also have Type II errors. We say same, but really different. Power is 1- or 1-p(Type II). It is desirable to have both a small alpha (few Type I errors) and good power (few Type II errors), but usually is a trade-off. Need a specific H1 to figure power.

Power (2) Suppose: Set alpha at .05 and figure region. Rejection region is set for alpha =.05.

Power (3) If the bound (141.3) was at the mean of the second distribution (142), it would cut off 50 percent and Beta and Power would be .50. In this case, the bound is a bit below the mean. It is z=(141.3-142)/2 = -.35 standard errors down. The shaded area is .36. This means that Beta is .36 and power is .64. 4 Things affect power: H1, the alternative hypothesis. The value and placement of rejection region. Sample size. Population variance.

Power (4) The larger the difference in means, the greater the power. This illustrates the choice of H1.

Power (5) 1 vs. 2 tails – rejection region

Rejection Regions 1-tailed vs. 2-tailed tests. The alternative hypothesis tells the tale (determines the tails). If Nondirectional; 2-tails Directional; 1 tail (need to adjust null for these to be LE or GE). In practice, most tests are two-tailed. When you see a 1-tailed test, it’s usually because it wouldn’t be significant otherwise.

Rejection Regions (2) 1-tailed tests have better power on the hypothesized size. 1-tailed tests have worse power on the non-hypothesized side. When in doubt, use the 2-tailed test.

Power (6) Sample size and population variability both affect the size of the standard error of the mean. Sample size is controlled directly. The standard deviation is influenced by experimental control and reliability of measurement.

Review What are the four kinds of outcome of a statistical test (compare the sample result to the state in the population)? What is statistical power? What are the factors that influence the power of a test? Give a concrete example of a study (describe the IV and DV) and state one thing you could do to increase its power.