A learning-based transportation oriented simulation system Theo A. Arentze, Harry J.P. Timmermans.

Slides:



Advertisements
Similar presentations
Trustworthy Service Selection and Composition CHUNG-WEI HANG MUNINDAR P. Singh A. Moini.
Advertisements

GPS and Multi-Week Data Collection of Activity-Travel Patterns Harry Timmermans Eindhoven University of Technology 4/19/2015.
Ai in game programming it university of copenhagen Reinforcement Learning [Outro] Marco Loog.
Dynamic Restarts Optimal Randomized Restart Policies with Observation Henry Kautz, Eric Horvitz, Yongshao Ruan, Carla Gomes and Bart Selman.
Budapest May 27, 2008 Unifying mixed linear models and the MASH algorithm for breakpoint detection and correction Anders Grimvall, Sackmone Sirisack, Agne.
Time of day choice models The “weakest link” in our current methods(?) Change the use of network models… Run static assignments for more periods of the.
A Decision Matrix for Designing Staff Training Ronnie Detrich Wing Institute.
FIN 685: Risk Management Topic 5: Simulation Larry Schrenk, Instructor.
Marakas: Decision Support Systems, 2nd Edition © 2003, Prentice-Hall Chapter Chapter 4: Modeling Decision Processes Decision Support Systems in the.
A Heuristic Bidding Strategy for Multiple Heterogeneous Auctions Patricia Anthony & Nicholas R. Jennings Dept. of Electronics and Computer Science University.
Personal Background  Name: Jianyu (Jack) Zhou  Undergraduate: Geography, Beijing University, P.R. China ( ) Economic geography.  Master’s:
Games as Systems Administrative Stuff Exercise today Meet at Erik Stemme
Basic Data Mining Techniques Chapter Decision Trees.
Reinforcement Learning Introduction Presented by Alp Sardağ.
A Tool for Partitioning and Pipelined Scheduling of Hardware-Software Systems Karam S Chatha and Ranga Vemuri Department of ECECS University of Cincinnati.
Value of Information for Complex Economic Models Jeremy Oakley Department of Probability and Statistics, University of Sheffield. Paper available from.
D Nagesh Kumar, IIScOptimization Methods: M1L4 1 Introduction and Basic Concepts Classical and Advanced Techniques for Optimization.
Ordinal Decision Trees Qinghua Hu Harbin Institute of Technology
Introduction to Activity-Based Modeling
Agent-based Dynamic Activity Planning and Travel Scheduling (ADAPTS) Model  ADAPTS scheduling process model: –Simulation of how activities are planned.
The Context of Forest Management & Economics, Modeling Fundamentals Lecture 1 (03/30/2015)
Limburgs Universitair Centrum, Universitaire Campus, gebouw D, 3590 Diepenbeek, Belgium Activity-based Modelling: An overview (and some things we have.
RESEARCH DESIGN.
Model Task Force Meeting November 29, 2007 Activity-based Modeling from an Academic Perspective Transportation Research Center (TRC) Dept. of Civil & Coastal.
SAN FRANCISCO COUNTY TRANSPORTATION AUTHORITY San Francisco DTA Project: Model Integration Options Greg Erhardt DTA Peer Review Panel Meeting July 25 th,
Problem Statement and Motivation Key Achievements and Future Goals Technical Approach Kouros Mohammadian, PhD and Yongping Zhang (PhD Candidate), CME,
Distributions of Randomized Backtrack Search Key Properties: I Erratic behavior of mean II Distributions have “heavy tails”.
1 A Model of Within-Households Travel Activity Decisions Capturing Interactions Between Household Heads Renni Anggraini, Dr.Theo Arentze, Prof.H.J.P. Timmermans.
Chapter 11: Artificial Intelligence
1 The relative role of spatial, temporal and interpersonal flexibility on the activity scheduling process Sean T. Doherty Wilfrid Laurier University Kouros.
Inductive learning Simplest form: learn a function from examples
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
For Model Users Group June 10, 2011 Kyeil Kim, Ph.D., PTP Atlanta Regional Commission.
Travel Data Simulation and Transferability of Household Travel Survey Data Kouros Mohammadian, PhD and Yongping Zhang (PhD Candidate), CME, UIC Prime Grant.
Human choices relevant to transportation – travel behavior analysis and beyond Cynthia Chen Presentation made to Goodchild’s CEE500 Seminar Course, UW,
Types of Research (Quantitative and Qualitative) RCS /11/05.
Comparing a Household Activity-Based Model with a Person Activity-Based Model 14th TRB Conference on Transportation Planning Applications May 5-9, 2013,
A Data Intensive High Performance Simulation & Visualization Framework for Disease Surveillance Arif Ghafoor, David Ebert, Madiha Sahar Ross Maciejewski,
Euro-Par, A Resource Allocation Approach for Supporting Time-Critical Applications in Grid Environments Qian Zhu and Gagan Agrawal Department of.
Learning Theory Reza Shadmehr & Jörn Diedrichsen Reinforcement Learning 1: Generalized policy iteration.
LANGUAGE MODELS FOR RELEVANCE FEEDBACK Lee Won Hee.
Module networks Sushmita Roy BMI/CS 576 Nov 18 th & 20th, 2014.
Simulation games Christian Märzinger Thomas Pichler 1.
SHRP2 C10A Final Conclusions & Insights TRB Planning Applications Conference May 5, 2013 Columbus, OH Stephen Lawe, Joe Castiglione & John Gliebe Resource.
Presented to Time of Day Subcommittee May 9, 2011 Time of Day Modeling in FSUTMS.
A Method to Model Neighborhood Interactions in Geo-simulation of Urban Dynamics Yaolong Zhao and Yuji Murayama Division of Spatial Information Science,
FORS 8450 Advanced Forest Planning Lecture 5 Relatively Straightforward Stochastic Approach.
Chapter 11 Statistical Techniques. Data Warehouse and Data Mining Chapter 11 2 Chapter Objectives  Understand when linear regression is an appropriate.
1 Components of the Deterministic Portion of the Utility “Deterministic -- Observable -- Systematic” portion of the utility!  Mathematical function of.
Methodological Considerations for Integrating Dynamic Traffic Assignment with Activity-Based Models Ramachandran Balakrishna Daniel Morgan Srinivasan Sundaram.
August 30, 2004STDBM 2004 at Toronto Extracting Mobility Statistics from Indexed Spatio-Temporal Datasets Yoshiharu Ishikawa Yuichi Tsukamoto Hiroyuki.
Learning Simio Chapter 10 Analyzing Input Data
Introduction to Models Lecture 8 February 22, 2005.
Human and Optimal Exploration and Exploitation in Bandit Problems Department of Cognitive Sciences, University of California. A Bayesian analysis of human.
IT Applications for Decision Making. Operations Research Initiated in England during the world war II Make scientifically based decisions regarding the.
Management Strategy Evaluation (MSE) Bob O’Boyle & Tana Worcester Bedford Institute of Oceanography Dartmouth, Nova Scotia, Canada.
Activity Based Modeling: A Brief Introduction Mike Neidhart, PhD, AICP Volusia County MPO Florida Model Task Force Meeting November 29, 2007.
Why use landscape models?  Models allow us to generate and test hypotheses on systems Collect data, construct model based on assumptions, observe behavior.
Generated Trips and their Implications for Transport Modelling using EMME/2 Marwan AL-Azzawi Senior Transport Planner PDC Consultants, UK Also at Napier.
Urban Planning Group Implementation of a Model of Dynamic Activity- Travel Rescheduling Decisions: An Agent-Based Micro-Simulation Framework Theo Arentze,
Psychology 3051 Psychology 305A: Theories of Personality Lecture 1 1.
Optimization Techniques for Natural Resources SEFS 540 / ESRM 490 B Lecture 1 (3/30/2016)
CS646: Software Design and Architectures Introduction and Overview †  Definitions.  The general design process.  A context for design: the waterfall.
University Of Palestine Faculty Of Applied Engineering & Urban Planning Civil Engineering Department PROJECT MANAGEMENT Scheduling Resources and Costs.
1 Design and evaluation methods: Objectives n Design life cycle: HF input and neglect n Levels of system design: Going beyond the interface n Sources of.
A New Approach to Measure Preferences of Users in Built Environments: Integrating Cognitive Mapping and Utility Models Benedict Dellaert Erasmus University.
The costs of organization
Optimization Techniques for Natural Resources SEFS 540 / ESRM 490 B
Announcements Homework 3 due today (grace period through Friday)
Presentation transcript:

A learning-based transportation oriented simulation system Theo A. Arentze, Harry J.P. Timmermans

Abstract Albatross: activity-based model of activity-travel behavior, derived from theories of choice heuristics The model predicts which activities are conducted when, where, for how long, with whom and the transport mode involved Decision tree is proposed as a formalism to model the heuristic choice

Conceptual considerations regarding decision making and choice behavior Postulate: activity participation, allocation and implementation fundamentally take place at the level of household Decisions: –Long term: marital status, number of children, choice of work and workplace, purchase of transport mode –Short term Decisions influence the generation of activity calendars

Constraints Situational constraints: can’t be in two places at the same time Institutional constraints: such as opening hours Household constraints: such as bringing children to school Spatial constraints: e.g. particular activities cannot be performed at particular locations Time constraints: activities require some minimum duration Spatial-temporal: constraints an individual cannot be at a particular location at the right time to conduct a particular activity

Choice behavior Models used to rely on utility-maximization Albatross assumes that choice behavior is based on rules that are formed and continuously adapted through learning while the individual is interacting with the environment (reinforcement learning) or communicating with others (social learning). Exploration vs. exploitation dilemma

Learning theory sum Albatross is based on a learning theory which implies that rules governing choice behavior are: –heuristic –context-dependent –adaptive in nature

The scheduling model Components: 1.a model of the sequential decision making process 2.models to compute dynamic constraints on choice options 3.a set of decision trees representing choice behavior of individuals related to each step in the process model a-priori defined derived from observed choice behavior

Assumptions Skeleton refers to the fixed and given part of the schedule Flexible activities: optional activities added on the skeleton

The process model

The inference system For each decision, the model evaluates dynamic constrains The implementation of situational, household and temporal constraints is straightforward We will look at space–time constraints and choice heuristics determining location choices

Feasible locations (step 6)

Heuristics Having defined the location choice set, the proposed set of heuristics then define alternative ways of trading-off required travel time against attractiveness of locations.

Heuristics

Decision tree induction Condition-action rules: Albatross generates the best tree based on techniques from C4.5 (Quinlann, 1993), CART (Breiman et al., 1984) and CHAID (Kass, 1980)

Deriving decisions Use a probabilistic assignment rule. The probability of selecting the q-th response for each new case assigned to the k-th node is: where f kq is the number of training cases of category q at leaf node k and N k the total number of training cases at that node.

Testing the model

Results of inducing decision trees

Branch of time-of-day tree

Performance of Albatross The eventual goodness-of-fit of the model can be assessed only by a comparison at the level of complete activity patterns Eventual output of Albatross is trip matrices

Number of activities of predicted and observed patterns

Correlation coefficient

Summary Use of decision trees for choice heuristics, resulting in a considerable, but varying improvement over a null model A sample size of 2000 household-days suffices to develop a stable model Transferability of the model to another context than in which it was developed remains to be studied Model can be extended: use models of reinforcement learning (as opposed to supervised learning which are implicitly used by decision trees)