Lec 6, Ch.5, pp90-105: Statistics (Objectives) Understand basic principles of statistics through reading these pages, especially… Know well about the normal.

Slides:



Advertisements
Similar presentations
“Students” t-test.
Advertisements

Hypothesis testing Another judgment method of sampling data.
Lecture (11,12) Parameter Estimation of PDF and Fitting a Distribution Function.
Hypothesis Testing Steps in Hypothesis Testing:
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Sampling: Final and Initial Sample Size Determination
Chapter 12 Tests of Hypotheses Means 12.1 Tests of Hypotheses 12.2 Significance of Tests 12.3 Tests concerning Means 12.4 Tests concerning Means(unknown.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 9 Hypothesis Testing Developing Null and Alternative Hypotheses Developing Null and.
Chapter 7: Statistical Applications in Traffic Engineering
Chapter 7(7b): Statistical Applications in Traffic Engineering Chapter objectives: By the end of these chapters the student will be able to (We spend 3.
Business 205. Review Sampling Continuous Random Variables Central Limit Theorem Z-test.
1 MF-852 Financial Econometrics Lecture 4 Probability Distributions and Intro. to Hypothesis Tests Roy J. Epstein Fall 2003.
Sample size computations Petter Mostad
9-1 Hypothesis Testing Statistical Hypotheses Statistical hypothesis testing and confidence interval estimation of parameters are the fundamental.
Hypothesis : Statement about a parameter Hypothesis testing : decision making procedure about the hypothesis Null hypothesis : the main hypothesis H 0.
Inferences About Means of Single Samples Chapter 10 Homework: 1-6.
4-1 Statistical Inference The field of statistical inference consists of those methods used to make decisions or draw conclusions about a population.
Chapter 3 Hypothesis Testing. Curriculum Object Specified the problem based the form of hypothesis Student can arrange for hypothesis step Analyze a problem.
Inference about a Mean Part II
IENG 486 Statistical Quality & Process Control
Inferences About Process Quality
BCOR 1020 Business Statistics Lecture 18 – March 20, 2008.
1 BA 555 Practical Business Analysis Review of Statistics Confidence Interval Estimation Hypothesis Testing Linear Regression Analysis Introduction Case.
Review for Exam 2 Some important themes from Chapters 6-9 Chap. 6. Significance Tests Chap. 7: Comparing Two Groups Chap. 8: Contingency Tables (Categorical.
Normal and Sampling Distributions A normal distribution is uniquely determined by its mean, , and variance,  2 The random variable Z = (X-  /  is.
Chapter 9 Title and Outline 1 9 Tests of Hypotheses for a Single Sample 9-1 Hypothesis Testing Statistical Hypotheses Tests of Statistical.
Aaker, Kumar, Day Ninth Edition Instructor’s Presentation Slides
Overview Definition Hypothesis
Hypothesis testing is used to make decisions concerning the value of a parameter.
1/2555 สมศักดิ์ ศิวดำรงพงศ์
Hypothesis Testing (Statistical Significance). Hypothesis Testing Goal: Make statement(s) regarding unknown population parameter values based on sample.
STAT 5372: Experimental Statistics Wayne Woodward Office: Office: 143 Heroy Phone: Phone: (214) URL: URL: faculty.smu.edu/waynew.
Review for Exam 2 (Ch.6,7,8,12) Ch. 6 Sampling Distribution
The paired sample experiment The paired t test. Frequently one is interested in comparing the effects of two treatments (drugs, etc…) on a response variable.
Chapter 7: Statistical Applications in Traffic Engineering
1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.
Topic 5 Statistical inference: point and interval estimate
9-1 Hypothesis Testing Statistical Hypotheses Definition Statistical hypothesis testing and confidence interval estimation of parameters are.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Week 7 October Three Mini-Lectures QMM 510 Fall 2014.
1 10 Statistical Inference for Two Samples 10-1 Inference on the Difference in Means of Two Normal Distributions, Variances Known Hypothesis tests.
Chapter 9 Tests of Hypothesis Single Sample Tests The Beginnings – concepts and techniques Chapter 9A.
Statistical Hypotheses & Hypothesis Testing. Statistical Hypotheses There are two types of statistical hypotheses. Null Hypothesis The null hypothesis,
4 Hypothesis & Testing. CHAPTER OUTLINE 4-1 STATISTICAL INFERENCE 4-2 POINT ESTIMATION 4-3 HYPOTHESIS TESTING Statistical Hypotheses Testing.
Determination of Sample Size: A Review of Statistical Theory
L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 9 1 MER301:Engineering Reliability LECTURE 9: Chapter 4: Decision Making for a Single.
EMIS 7300 SYSTEMS ANALYSIS METHODS FALL 2005 Dr. John Lipp Copyright © Dr. John Lipp.
1 9 Tests of Hypotheses for a Single Sample. © John Wiley & Sons, Inc. Applied Statistics and Probability for Engineers, by Montgomery and Runger. 9-1.
LECTURE 25 THURSDAY, 19 NOVEMBER STA291 Fall
Chapter 7 Point Estimation of Parameters. Learning Objectives Explain the general concepts of estimating Explain important properties of point estimators.
MeanVariance Sample Population Size n N IME 301. b = is a random value = is probability means For example: IME 301 Also: For example means Then from standard.
Ex St 801 Statistical Methods Inference about a Single Population Mean.
Mystery 1Mystery 2Mystery 3.
© Copyright McGraw-Hill 2004
Formulating the Hypothesis null hypothesis 4 The null hypothesis is a statement about the population value that will be tested. null hypothesis 4 The null.
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
Education 793 Class Notes Inference and Hypothesis Testing Using the Normal Distribution 8 October 2003.
Chapter 12 Tests of Hypotheses Means 12.1 Tests of Hypotheses 12.2 Significance of Tests 12.3 Tests concerning Means 12.4 Tests concerning Means(unknown.
Hypothesis Tests u Structure of hypothesis tests 1. choose the appropriate test »based on: data characteristics, study objectives »parametric or nonparametric.
Hypothesis Testing and Statistical Significance
C HAPTER 2  Hypothesis Testing -Test for one means - Test for two means -Test for one and two proportions.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
STAT 312 Chapter 7 - Statistical Intervals Based on a Single Sample
Hypothesis Testing and Confidence Intervals (Part 1): Using the Standard Normal Lecture 8 Justin Kern October 10 and 12, 2017.
Statistics in Applied Science and Technology
INTRODUCTORY STATISTICS FOR CRIMINAL JUSTICE Test Review: Ch. 7-9
Chapter 9 Hypothesis Testing.
Chapter Nine Part 1 (Sections 9.1 & 9.2) Hypothesis Testing
Confidence Intervals.
Presentation transcript:

Lec 6, Ch.5, pp90-105: Statistics (Objectives) Understand basic principles of statistics through reading these pages, especially… Know well about the normal distribution Know the special characteristics of the Poisson distribution Understand the meaning of correlation and dependence Understand what confidence intervals mean Learn how to estimate sample sizes for data collections Understand the concept of hypothesis testing

What we cover in class today… Anything not covered in class, you learn them from reading pp The normal distribution – how to read the standard normal distribution table Central limit theory (CLT) The Poisson distribution – why it is relevant to traffic engineering Correlation and dependence Confidence bounds and their implications Estimating sample sizes The concept of hypothesis testing

The normal distribution z = (x - µ)/  = (65 – 55)/7 = 1.43 Mean = 55 mph What’s the probability the next value will be less than 65 mph? From the sample normal distribution to the standard normal distribution.

Use of the standard normal distribution table, Tab 5-1 Z = 1.43 Most popular one is 95% within µ ± 1.96 

Central limit theorem (CLT) Definition: The population may have any unknown distribution with a mean µ and a finite variance of  2. Take samples of size n from the population. As the size of n increases, the distribution of sample means will approach a normal distribution with mean µ and a variance of  2 /n. F(x) x µ  X distribution X ~ any (µ,  2 ) approaches µ distribution

The Poisson distribution (“counting distribution” or “Random arrival”) With mean µ = m and variance  2 = m. If the above characteristic is not met, the Poisson does not apply.  The binomial distribution tends to approach the Poisson distribution with parameter m = np. (See Table 4-3)  When time headways are exponentially distributed with mean  = 1/, the number of arrivals in an interval T is Poisson distributed with mean  = m = T.

Correlation and dependence Independent variable x Dependent variable y y = f(x) Linear regression: y = a + bx Non-linear regression: y = ax b (example) Correlation coefficient r (  1, perfect fit) Coefficient of determination r 2 (Tells you how much of variability can be “explained” by the independent variables.)

Confidence bounds and interval Point estimates: A point estimate is a single-values estimate of a population parameter made from a sample. Interval estimates: An interval estimate is a probability statement that a population parameter is between two computed values (bounds). µ X X X – t a s/sqrt(n) X + t a s/sqrt(n) -- -- True population mean Point estimate of X from a sample Two-sided interval estimate

Confidence interval (cont) When n gets larger (n>=30), t  can become z. The probability of any random variable being within 1.96 standard deviations of the mean is 0.95, written as: P[(µ  )  y  (µ  )] = 0.95 Obviously we do not know µ and . Hence we restate this in terms of the distribution of sample means: P[( x E)  y  ( x E)] = 0.95 Where, E = s/SQRT(n) (Review 1, 2, 3, and 4 in page 100.)

Estimating sample sizes For cases in which the distribution of means can be considered normal, the confidence range for 95% confidence is: If this value is called the tolerance (or “precision”), and given the symbol e, then the following equation can be solved for n, the desired sample size: and By replacing 1.96 with z and 3.84 with z 2, we can use this for any level of confidence. (Review 1 and 2 on page 101.)

The concept of hypothesis testing Two distinct choices: Null hypothesis, H 0 Alternative hypothesis: H 1 E.g. Inspect 100,000 vehicles, of which 10,000 vehicles are “unsafe.” This is the fact given to us. H 0 : The vehicle being tested is “safe.” H 1 : The vehicle being tested is “unsafe.” In this inspection, 15% of the unsafe vehicles are determined to be safe  Type II error (bad error) and 5% of the safe vehicles are determined to be unsafe  Type I error (economically bad but safety-wise it is better than Type II error.)

Types of errors Reality Decision Reject H 0 Accept H 0 H 0 is true H 1 is true Type I error Type II error Correct Reject a correct null hypothesis Fail to reject a false null hypothesis We want to minimize especially Type II error. Steps of the Hypothesis Testing  State the hypothesis  Select the significance level  Compute sample statistics and estimate parameters  Compute the test statistic  Determine the acceptance and critical region of the test statistics  Reject or do not reject H 0 P(type I error) =  (level of significance) P(type II error ) = 

Dependence between , , and sample size n There is a distinct relationship between the two probability values  and  and the sample size n for any hypothesis. The value of any one is found by using the test statistic and set values of the other two.  Given  and n, determine . Usually the  and n values are the most crucial, so they are established and the  value is not controlled.  Given  and , determine n. Set up the test statistic for  and  with H0 value and an H1 value of the parameter and two different n values. The t (or z) statistics is: t or z (Use an example from a stat book)

One-sided and two-sided tests  The significance of the hypothesis test is indicated by , the type I error probability.  = 0.05 is most common: there is a 5% level of significance, which means that on the average a type I error (reject a true H 0 ) will occur 5 in 100 times that H 0 and H 1 are tested. In addition, there is a 95% confidence level that the result is correct.  If H 1 involves a not-equal relation, no direction is given, so the significance area is equally divided between the two tails of the testing distribution.  If it is known that the parameter can go in only one direction, a one-sided test is performed, so the significance area is in one tail of the distribution. One-sided upper Two-sided each 0.05