Chapter 7(7b): Statistical Applications in Traffic Engineering Chapter objectives: By the end of these chapters the student will be able to (We spend 3.

Slides:



Advertisements
Similar presentations
Lecture (11,12) Parameter Estimation of PDF and Fitting a Distribution Function.
Advertisements

1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 9 Hypothesis Testing Developing Null and Alternative Hypotheses Developing Null and.
Significance Testing Chapter 13 Victor Katch Kinesiology.
Chapter 7: Statistical Applications in Traffic Engineering
Fundamentals of Hypothesis Testing. Identify the Population Assume the population mean TV sets is 3. (Null Hypothesis) REJECT Compute the Sample Mean.
Evaluating Hypotheses Chapter 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics.
Sample size computations Petter Mostad
9-1 Hypothesis Testing Statistical Hypotheses Statistical hypothesis testing and confidence interval estimation of parameters are the fundamental.
Hypothesis : Statement about a parameter Hypothesis testing : decision making procedure about the hypothesis Null hypothesis : the main hypothesis H 0.
Evaluating Hypotheses Chapter 9 Homework: 1-9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics ~
Inferences About Means of Single Samples Chapter 10 Homework: 1-6.
Lec 6, Ch.5, pp90-105: Statistics (Objectives) Understand basic principles of statistics through reading these pages, especially… Know well about the normal.
Inference about a Mean Part II
Lec 7, Ch4, pp83-99: Spot Speed Studies (Objectives)
Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 7 th Edition Chapter 9 Hypothesis Testing: Single.
IENG 486 Statistical Quality & Process Control
Inferences About Process Quality
BCOR 1020 Business Statistics
© 1999 Prentice-Hall, Inc. Chap Chapter Topics Hypothesis Testing Methodology Z Test for the Mean (  Known) p-Value Approach to Hypothesis Testing.
Inferential Statistics
Hypothesis Testing and T-Tests. Hypothesis Tests Related to Differences Copyright © 2009 Pearson Education, Inc. Chapter Tests of Differences One.
Chapter 9 Title and Outline 1 9 Tests of Hypotheses for a Single Sample 9-1 Hypothesis Testing Statistical Hypotheses Tests of Statistical.
Statistical Inference for Two Samples
AM Recitation 2/10/11.
Aaker, Kumar, Day Ninth Edition Instructor’s Presentation Slides
Overview of Statistical Hypothesis Testing: The z-Test
Chapter 10 Hypothesis Testing
Overview Definition Hypothesis
Descriptive statistics Inferential statistics
Fundamentals of Hypothesis Testing: One-Sample Tests
1/2555 สมศักดิ์ ศิวดำรงพงศ์
Chapter 9.3 (323) A Test of the Mean of a Normal Distribution: Population Variance Unknown Given a random sample of n observations from a normal population.
The paired sample experiment The paired t test. Frequently one is interested in comparing the effects of two treatments (drugs, etc…) on a response variable.
+ Chapter 9 Summary. + Section 9.1 Significance Tests: The Basics After this section, you should be able to… STATE correct hypotheses for a significance.
Chapter 7: Statistical Applications in Traffic Engineering
1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.
Chapter 9 Hypothesis Testing II: two samples Test of significance for sample means (large samples) The difference between “statistical significance” and.
Copyright © 2012 by Nelson Education Limited. Chapter 7 Hypothesis Testing I: The One-Sample Case 7-1.
Chapter 10 Hypothesis Testing
© 2003 Prentice-Hall, Inc.Chap 7-1 Business Statistics: A First Course (3 rd Edition) Chapter 7 Fundamentals of Hypothesis Testing: One-Sample Tests.
Introduction to Hypothesis Testing: One Population Value Chapter 8 Handout.
9-1 Hypothesis Testing Statistical Hypotheses Definition Statistical hypothesis testing and confidence interval estimation of parameters are.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Week 7 October Three Mini-Lectures QMM 510 Fall 2014.
Biostatistics Class 6 Hypothesis Testing: One-Sample Inference 2/29/2000.
1 10 Statistical Inference for Two Samples 10-1 Inference on the Difference in Means of Two Normal Distributions, Variances Known Hypothesis tests.
Testing of Hypothesis Fundamentals of Hypothesis.
Chapter 9 Tests of Hypothesis Single Sample Tests The Beginnings – concepts and techniques Chapter 9A.
4 Hypothesis & Testing. CHAPTER OUTLINE 4-1 STATISTICAL INFERENCE 4-2 POINT ESTIMATION 4-3 HYPOTHESIS TESTING Statistical Hypotheses Testing.
L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 9 1 MER301:Engineering Reliability LECTURE 9: Chapter 4: Decision Making for a Single.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Fundamentals of Hypothesis Testing: One-Sample Tests Statistics.
Lecture 9 Chap 9-1 Chapter 2b Fundamentals of Hypothesis Testing: One-Sample Tests.
1 9 Tests of Hypotheses for a Single Sample. © John Wiley & Sons, Inc. Applied Statistics and Probability for Engineers, by Montgomery and Runger. 9-1.
Statistical Inference for the Mean Objectives: (Chapter 9, DeCoursey) -To understand the terms: Null Hypothesis, Rejection Region, and Type I and II errors.
Chap 8-1 Fundamentals of Hypothesis Testing: One-Sample Tests.
MeanVariance Sample Population Size n N IME 301. b = is a random value = is probability means For example: IME 301 Also: For example means Then from standard.
Ex St 801 Statistical Methods Inference about a Single Population Mean.
© Copyright McGraw-Hill 2004
Inferences Concerning Variances
What is a Hypothesis? A hypothesis is a claim (assumption) about the population parameter Examples of parameters are population mean or proportion The.
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
Hypothesis Tests u Structure of hypothesis tests 1. choose the appropriate test »based on: data characteristics, study objectives »parametric or nonparametric.
Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 8 th Edition Chapter 9 Hypothesis Testing: Single.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Two-Sample Hypothesis Testing
STAT 312 Chapter 7 - Statistical Intervals Based on a Single Sample
INTRODUCTORY STATISTICS FOR CRIMINAL JUSTICE Test Review: Ch. 7-9
Chapter 9 Hypothesis Testing.
Chapter Nine Part 1 (Sections 9.1 & 9.2) Hypothesis Testing
Presentation transcript:

Chapter 7(7b): Statistical Applications in Traffic Engineering Chapter objectives: By the end of these chapters the student will be able to (We spend 3 lecture periods for this chapter. We do skip simple descriptive stats because they were covered in CE361.): Lecture number Lecture Objectives (after these lectures you will be able to) Lecture 3 (Chap 7a file) Apply the basic principles of statistics contained in section 7.1 to traffic data analyses Explain the characteristics of the normal distribution and read the normal distribution table correctly (section 7.2) and get necessary values from Excel. Explain the meaning of confidence bounds and determine the confidence interval of the mean (section 7.3) Determine sample sizes of traffic data collection (section 7.4) Explain how random variables are added (section 7.5) Explain the implication of the central limit theorem (section 7.5.1) Explain the characteristics of various probabilistic distributions useful for traffic engineering studies and choose a correct distribution for the study(section 7.6) Lecture 4a (Chap 7b file) Explain the special characteristics of the Poisson distribution and its usefulness to traffic engineering studies (section 7-7) Conduct a hypothesis test correctly (two-sided, one-sided, paired test, F-test) (section 7-8) Lecture 4b (Chap 7 file) Conduct a Chi-square test to test hypotheses on an underlying distribution f(x) (section 7-8)

7.7 The Poisson distribution (“counting distribution” or “Random arrival” discrete probability function) With mean µ = m and variance  2 = m. If the above characteristic is not met, the Poisson theoretically does not apply.  The binomial distribution tends to approach the Poisson distribution with parameter m = np. Also, the binomial distribution approaches the normal distribution when np/(1-p)>=9  When time headways are exponentially distributed with mean  = 1/, the number of arrivals in an interval T is Poisson distributed with mean  = m = T. Note that the unit is veh/unit time (arrival rate). (Read the sample problem in page 144, table 7.5)

7.8 Hypothesis testing Two distinct choices: Null hypothesis, H 0 Alternative hypothesis: H 1 E.g. Inspect 100,000 vehicles, of which 10,000 vehicles are “unsafe.” This is the fact given to us. H 0 : The vehicle being tested is “safe.” H 1 : The vehicle being tested is “unsafe.” In this inspection, 15% of the unsafe vehicles are determined to be safe  Type II error (bad error) and 5% of the safe vehicles are determined to be unsafe  Type I error (economically bad but safety-wise it is better than Type II error.)

Types of errors Reality Decision Reject H 0 Accept H 0 H 0 is true H 1 is true Type I error Type II error Correct Reject a correct null hypothesis Fail to reject a false null hypothesis We want to minimize especially Type II error. Steps of the Hypothesis Testing  State the hypothesis  Select the significance level  Compute sample statistics and estimate parameters  Compute the test statistic  Determine the acceptance and critical region of the test statistics  Reject or do not reject H 0 P(type I error) =  (level of significance) P(type II error ) =  (see the binary case in p. 145/146. to get a feel of Type II error.)

Dependence between , , and sample size n There is a distinct relationship between the two probability values  and  and the sample size n for any hypothesis. The value of any one is found by using the test statistic and set values of the other two.  Given  and n, determine . Usually the  and n values are the most crucial, so they are established and the  value is not controlled.  Given  and , determine n. Set up the test statistic for  and  with H 0 value and an H 1 value of the parameter and two different n values. The t (or z) statistics is: t or z Before-and-after tests with two distinct choices Here we are comparing means; hence divide σ by sqrt(n).

7.8.2 Before-and-after tests with generalized alternative hypothesis  The significance of the hypothesis test is indicated by , the type I error probability.  = 0.05 is most common: there is a 5% level of significance, which means that on the average a type I error (reject a true H 0 ) will occur 5 in 100 times that H 0 and H 1 are tested. In addition, there is a 95% confidence level that the result is correct.  If H 1 involves a not-equal relation, no direction is given, so the significance area is equally divided between the two tails of the testing distribution.  If it is known that the parameter can go in only one direction, a one-sided test is performed, so the significance area is in one tail of the distribution. One-sided upper Two-sided each 0.05

Two-sided or one-sided test These tests are done to compare the effectiveness of an improvement to a highway or street by using mean speeds.  If you want to prove that the difference exists between the two data samples, you conduct a two-way test. (There is no change.)  If you are sure that there is no decrease or increase, you conduct a one-sided test. (There was no decrease) Null hypothesis H 0 :  1 =  2 (there is no increase) Alternative H 1 :  1  2 Null hypothesis H 0 :  1 =  2 (there is no change) Alternative H 1 :  1 =  2

Example ExistingAfter improvement Sample size55 Mean60 min55 min Standard Deviation 8 min At significance level  = 0.05 (See Table 7-3.) The decision point (or typically z c :  For two-sided: 1.96*1.53 =  For one-sided: 1.65*1.53 =2.525 |µ 1 - µ 2 | = |60-55| = 5 > z c By either test, H 0 is rejected.

7.8.3 Other useful statistical tests The t-test (for small samples, n<=30) – Table 7.6: The F-test (for small samples) – Table 7.7: In using the t-test we assume that the standard deviations of the two samples are the same. To test this hypothesis we can use the F-test. (By definition the larger s is always on top.) (See the samples in pages 149 and 151.

7.8.3 Other useful statistical tests (cont) The F-Test to test if s 1 =s 2 When the t-test and other similar means tests are conducted, there is an implicit assumption made that s 1 =s 2. The F-test can test this hypothesis. The numerator variance > The denominator variance when you compute a F-value. If F computed ≥ F table (n1-1, n2-1, a), then s1 ≠ s2 at a asignificance level. If F computed < F table (n1-1, n2-1,a), then s1=s2 at a asignificance level. Discuss the problem in p.151.

Paired difference test You perform a paired difference test only when you have a control over the sequence of data collection. e.g. Simulation  You control parameters. You have two different signal timing schemes. Only the timing parameters are changed. Use the same random number seeds. Then you can pair. If you cannot control random number seeds in simulation, you are not able to do a paired test. Table 7-8 shows an example showing the benefits of paired testing  The only thing changed is the method to collect speed data. The same vehicle’s speed was measure by the two methods.

Paired or not-paired example (table 7.8) Method 1Method 2Difference Estimated mean Estimated SD H 0 : No increase in test scores (means one- sided or one-tailed) Not paired:Paired: |56.9 – 61.2| = 4.3 < 4.54 (=1.65*2.74) Hence, H 0 is NOT rejected. 4.3 increase > (=1.65*0.388) Hence, H 0 is clearly rejected.