An Investigation of the Transferability of Trip Generation Models Dr. Jerry Everett, University of Tennessee - CTR Dr. Fred Wegmann, University of Tennessee.

Slides:



Advertisements
Similar presentations
Chi Squared Tests. Introduction Two statistical techniques are presented. Both are used to analyze nominal data. –A goodness-of-fit test for a multinomial.
Advertisements

Estimating the Effects of Treatment on Outcomes with Confidence Sebastian Galiani Washington University in St. Louis.
AP Statistics – Chapter 9 Test Review
Discrete (Categorical) Data Analysis
Analysis of frequency counts with Chi square
1 Chi-Squared Distributions Inference for Categorical Data and Multiple Groups.
BCOR 1020 Business Statistics
Statistics for Managers Using Microsoft Excel, 5e © 2008 Pearson Prentice-Hall, Inc.Chap 9-1 Statistics for Managers Using Microsoft® Excel 5th Edition.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 9-1 Chapter 9 Fundamentals of Hypothesis Testing: One-Sample Tests Basic Business Statistics.
BCOR 1020 Business Statistics Lecture 21 – April 8, 2008.
Chapter 2 Simple Comparative Experiments
Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 7 th Edition Chapter 9 Hypothesis Testing: Single.
UNDERSTANDING RESEARCH RESULTS: STATISTICAL INFERENCE © 2012 The McGraw-Hill Companies, Inc.
Inferences About Process Quality
Chapter 8 Introduction to Hypothesis Testing
BCOR 1020 Business Statistics
Chapter 14 Inferential Data Analysis
McGraw-Hill/Irwin Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. Business Statistics: Communicating with Numbers By Sanjiv Jaggia.
Copyright c 2001 The McGraw-Hill Companies, Inc.1 Chapter 7 Sampling, Significance Levels, and Hypothesis Testing Three scientific traditions critical.
Presentation 12 Chi-Square test.
Chi-Square Test Dr Kishor Bhanushali. Chi-Square Test Chi-square, symbolically written as χ2 (Pronounced as Ki-square), is a statistical measure used.
© 2004 Prentice-Hall, Inc.Chap 12-1 Basic Business Statistics (9 th Edition) Chapter 12 Tests for Two or More Samples with Categorical Data.
HAWKES LEARNING SYSTEMS math courseware specialists Copyright © 2010 by Hawkes Learning Systems/Quant Systems, Inc. All rights reserved. Chapter 14 Analysis.
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 9-1 Chapter 9 Fundamentals of Hypothesis Testing: One-Sample Tests Business Statistics,
Copyright © Cengage Learning. All rights reserved. 13 Linear Correlation and Regression Analysis.
Inference in practice BPS chapter 16 © 2006 W.H. Freeman and Company.
Aim: How do we test a comparison group? Exam Tomorrow.
© 2003 Prentice-Hall, Inc.Chap 11-1 Analysis of Variance IE 340/440 PROCESS IMPROVEMENT THROUGH PLANNED EXPERIMENTATION Dr. Xueping Li University of Tennessee.
+ Chapter 9 Summary. + Section 9.1 Significance Tests: The Basics After this section, you should be able to… STATE correct hypotheses for a significance.
Imagine a a bag that contained 90 white marbles and 10 black marbles. If you drew 10 marbles, how many would you expect to come up white, and how many.
ESTIMATES AND SAMPLE SIZES
Hypothesis Testing. Steps for Hypothesis Testing Fig Draw Marketing Research Conclusion Formulate H 0 and H 1 Select Appropriate Test Choose Level.
Chapter 11: Applications of Chi-Square. Count or Frequency Data Many problems for which the data is categorized and the results shown by way of counts.
Chapter 11: Applications of Chi-Square. Chapter Goals Investigate two tests: multinomial experiment, and the contingency table. Compare experimental results.
Introduction to inference Use and abuse of tests; power and decision IPS chapters 6.3 and 6.4 © 2006 W.H. Freeman and Company.
ANOVA (Analysis of Variance) by Aziza Munir
Experimental Research Methods in Language Learning Chapter 16 Experimental Research Proposals.
Test of Independence. The chi squared test statistic and test procedure can also be used to investigate association between 2 categorical variables in.
Statistical Inference
CHAPTER 5 INTRODUCTORY CHI-SQUARE TEST This chapter introduces a new probability distribution called the chi-square distribution. This chi-square distribution.
Chi-Square Procedures Chi-Square Test for Goodness of Fit, Independence of Variables, and Homogeneity of Proportions.
1 Nonparametric Statistical Techniques Chapter 17.
Chapter Twelve Copyright © 2006 John Wiley & Sons, Inc. Data Processing, Fundamental Data Analysis, and Statistical Testing of Differences.
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Statistical Testing of Differences CHAPTER fifteen.
1 Statistical Significance Testing. 2 The purpose of Statistical Significance Testing The purpose of Statistical Significance Testing is to answer the.
Chapter Seventeen. Figure 17.1 Relationship of Hypothesis Testing Related to Differences to the Previous Chapter and the Marketing Research Process Focus.
CHAPTER INTRODUCTORY CHI-SQUARE TEST Objectives:- Concerning with the methods of analyzing the categorical data In chi-square test, there are 2 methods.
METHODS IN BEHAVIORAL RESEARCH NINTH EDITION PAUL C. COZBY Copyright © 2007 The McGraw-Hill Companies, Inc.
Chap 8-1 Fundamentals of Hypothesis Testing: One-Sample Tests.
4 normal probability plots at once par(mfrow=c(2,2)) for(i in 1:4) { qqnorm(dataframe[,1] [dataframe[,2]==i],ylab=“Data quantiles”) title(paste(“yourchoice”,i,sep=“”))}
Chapter Outline Goodness of Fit test Test of Independence.
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 7 Sampling, Significance Levels, and Hypothesis Testing Three scientific traditions.
Copyright © Cengage Learning. All rights reserved. Chi-Square and F Distributions 10.
Effect on Model Sensitivities of Combining Transferable Data from Separate Home Interview Surveys Presented to the 11 th Conference on Transportation Planning.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 10 Comparing Two Groups Section 10.1 Categorical Response: Comparing Two Proportions.
Finishing up: Statistics & Developmental designs Psych 231: Research Methods in Psychology.
One-Way Analysis of Variance Recapitulation Recapitulation 1. Comparing differences among three or more subsamples requires a different statistical test.
1 Chi-square Test Dr. T. T. Kachwala. Using the Chi-Square Test 2 The following are the two Applications: 1. Chi square as a test of Independence 2.Chi.
CHAPTER INTRODUCTORY CHI-SQUARE TEST Objectives:- Concerning with the methods of analyzing the categorical data In chi-square test, there are 3 methods.
BPS - 5th Ed. Chapter 221 Two Categorical Variables: The Chi-Square Test.
Hypothesis Tests. An Hypothesis is a guess about a situation that can be tested, and the test outcome can be either true or false. –The Null Hypothesis.
Presented to Toll Modeling Panel presented by Krishnan Viswanathan, Cambridge Systematics, Inc.. September 16, 2010 Time of Day in FSUTMS.
Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 8 th Edition Chapter 9 Hypothesis Testing: Single.
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 7 l Hypothesis Tests 7.1 Developing Null and Alternative Hypotheses 7.2 Type I & Type.
Chapter 12 Chi-Square Tests and Nonparametric Tests
5.1 INTRODUCTORY CHI-SQUARE TEST
Chapter 2 Simple Comparative Experiments
Chapter 10 Hypothesis Tests for One and Two Population Variances
UNDERSTANDING RESEARCH RESULTS: STATISTICAL INFERENCE
Hypothesis Tests for a Standard Deviation
Presentation transcript:

An Investigation of the Transferability of Trip Generation Models Dr. Jerry Everett, University of Tennessee - CTR Dr. Fred Wegmann, University of Tennessee - CEE

Why try to Model and Forecast Future Travel? History tells that urban areas change over time The nature, location and magnitude of changes are almost always influenced by transportation The grand assumption is that if we can model existing travel then we can use that as a basis for forecasting future travel

“Inside the Black Box” The Role of Models in Transportation Planning Graphic borrowed from, A Transportation Modeling Primer - By Edward A. Beimborn

Can you Identify this location?

Same location about 45 years later

Motivation for this Research Smaller MPOs lack resources to gather local travel data Data/models are often borrowed or “transferred” from one area to another There is a need for a defensible, repeatable method for making transfer decisions Better models may lead to better decisions

History of Transferability of Trip Generation Models Validity of transferability has been debated since the infancy of travel demand modeling Studied several times using various methods over past 40 years –For example-Nashville and Knoxville were previously found to have similar trip rates. Consensus is maybe - in right circumstances

Phase I: Transferability Research Objective: Compare MPO travel rates within Tennessee Problem: No travel survey data available for small MPO Areas Solution: Conduct surveys for two small MPO areas

Study Areas Madison County, 560 sq. mi. Hamblen and Jefferson Counties, 490 sq. mi.

Survey Procedures RDD sample developed Advance letter mailed Recruited via CATI, hh & person data gathered Information packet and diaries mailed Reminder call prior to travel day Travel activity data retrieved via CATI Data quality checked then incentives mailed if applicable

Survey Diary

Survey Scope JacksonLakeway HHsPersonsDatesHHsPersonsDates Oct June Oct May 2007

Distribution of Trips by Purpose

Results: Average HH Trip Rates JacksonLakeway HBW HBO NHB Total Trips

Statistical Analysis where, X ij is the cell mean of the ith row and the jth column of the trip rate matrix for Area 1. Y ij is the cell mean of the ith row and the jth column of the trip rate matrix for Area 2. S 2 x ij is the cell variance of the ith row and the jth column for Area 1. S 2 y ij is the cell variance of the ith row and the jth column for Area 2. n ij is the number of observations (samples) in the ith row and the jth column for Area 1. m ij is the number of observations (samples) in the ith row and the jth column for Area 2. The null hypothesis is that the matrices’ cell means are not significantly different The test statistic will be compared to Chi Sq for i x j degrees of freedom at 0.05 If Q is larger then the hypothesis can be rejected signifying that the trip rates for the two areas are in fact different

Findings: Phase I Trip production rates for Jackson and Lakeway are not statistically different and thus transferable Most trip rates for Jackson and Lakeway are statistically different from Knoxville and Nashville Streamlined household travel surveys can be conducted for about $75* per complete (*Price did not include full geocoding, analysis and project management)

Phase II: Transferability Research Some remaining questions include: 1) Are differences real: due to HHs characteristics or the urban context? OR due to differences in data collection procedures? 2) Are transfers valid as long as the areas are similarly sized?

Phase II: Research Objective Test which is more appropriate: Transferring from a similarly-sized urban area in a different state/region of the country or Transferring from an urban area of a different size that is located within the same state?

Tennessee Study Areas

Ohio Study Areas

MPO Area Level Results 11 comparisons had zero differences 10 had a difference in one trip category 15 had differences in two trip categories 4 had differences in three trip categories 40 = Total area to area comparisons All 11 with no differences were within-state comparisons and all 11 pairs had data collected from a common survey

Trip Category Level Results

Findings: Phase II Considerable divergence was discovered so transferability can NOT be advanced as statistically valid on a general basis. The results were too mixed to provide clear guidance regarding the selection of an area from which to transfer. Though not statistically tested it is very likely that a large portion of differences found were due to survey procedures rather than actual differences in travel.

Issues with Evaluating Transferability of Trip Generation Definition of eligible HH survey participants varies Elements related to when data are collected vary Survey procedures and quality are often unknown Unusual circumstances may exist but not be documented Trip/activity: purpose definitions and categories vary

Phase III: Transferability Research Objective: Investigate if a meaningful measure of urbanization can be included in trip generation models from different areas to reduce differences between models and thus improve transferability?

Development of Area Types Purpose: Add missing dimension to transferability analysis Measure: Area Type – “Rural”, “Suburban” and “Urban” Approach: Population density based on 1 sq. mi. grids Implementation: HHs were attributed with pop density of grid cell in which they are located. Categorization Algorithm: TransCAD “Optimal Breaks”

Application of Area Type Measure Dayton, OH Mansfield, OH Rural – 826 HHs Suburban – 366 HHs Urban – 112 HHs Rural – 688 HHs Suburban – 898 HHs Urban – 364 HHs

Analysis Including Area Type A sample of 7 pairs of areas where trips rates were found to be different were re-compared These new comparisons were by trip purpose and disaggregated by the area type. The same statistical analysis was used as with previous comparisons

Results When Area Type is Included Note: Each of these comparison failed the prior test when area type was not included

Findings: Phase III A straightforward and meaningful measure of urbanization can be included in trip generation models using area type. Including area type significantly improves the results of the transfers. The procedures, tools and types of data used in this research are readily available to practitioners and are straightforward enough to be implemented by analysts in many small and medium-sized MPOs.

Summary & Conclusions Transferability is not as straightforward as hoped Methods are available to improve transferability results The standardization of survey practices could save costs and improve transferability analysis Additional research is needed on the topic