1. Building and Learning Activity-Based Models Erik Sabina Jennifer Malm Jennifer Malm Suzanne Childress John Bowman DeVon Culbertson

2. Erik’s recommendations (and the price you’ll have to pay) Get into the critical path –Though it will put the hurt on schedule Software is the hardest part –Steal someone else’s if you can –Modelers must program WELL! –The custom versus vendor conundrum Estimate a few models –Some basic skills are indispensible –Why let a few consultants have all the fun?

3. Expertise we started with Discrete choice model estimation –Decent theory, limited practice Programming/software development –Very strong in IT, modelers good programmers Math, stats, econ, etc. –Pretty strong across the board Trip-based modeling –Very strong

4. Levels of Knowledge Sensitivities Limitations and approximations Fix/update variables Re-calibrate Re-estimate some components Re-design the theoretical structure Re-design or extend sw structure

5. Model sensitivities What (example) - non-motorized mode choice Blend point-based and skim distances Point locations for households and jobs Intersection, retail, mixed use density How – programmed all utility function variables Why – can’t apply model without it!

6. Limitations and approximations What (examples) - Little: simpler logsums skims Little: Twice O-D, rather than O-D + D-O Big: sequential TOD and mode choice Big: Implicit intra-household interactions How – programmed all utility function variables Why – know what model can/can’t do

7. Fix/update variables What (examples) – Simple: changes to input data/ GISDK Simple once you get used to it - change SQL Server table / variables in C# Pretty hard - understand how component works (older sibling school, logit solver) How – wrote GISDK/ C# model components Why – changes to variables over time are very common

8. Variable example //Additional created in code variable, Older Sibling's school district if (householdID != currentHouseholdID) { currentHouseholdID = householdID; //Clear Sibling's school zone variable foreach (string choice in OlderSiblingSchoolZoneChoice) { this.UtilityFunctionParameters.AlternativeSpecificVariables[choice]["OldSibSchZone"].Value = 0; } OlderSiblingSchoolZoneChoice.Clear(); } else { //take choice and add a 1 to the OldSibSchZone variable in the choosen zone. tempList = choosenAlternative.Split(' '); zoneID = int.Parse(tempList[1]); if (universityStudent != 1) //Doesn't matter where an older sib university student went to school { if (zoneID != 0) { this.UtilityFunctionParameters.AlternativeSpecificVariables[choosenAlternative]["OldSibSchZone"].Value = 1; }

9. Variable changes in Database

10. Recalibrate What (example) - work location choice model calibrated five years ago is not matching new ACS journey to work data. Model has too few people working at home. What knobs can you turn? Some Examples: 1. Change coefficients to variables related to working at home. 2. Trace back issues to the land use or economic forecasts. How – checked model estimation reports, programmed variables and model input code Why – frequent “tweaks” expected!

11. Recalibrate (2) Another example - Observed boardings on light rail are lower than modeled boardings. What knobs can you turn? Possibilities: 1. Mode choice coefficients / alternative specific constants. 2. Too few university students on light rail? Trips too short, so walk/bike mode share too high. Adjust school location choice model: coefficients on the distance to school variables.

12. Re-estimation What (example) – added variables to school location choice: Zone in School District Older Sibling’s School Zone How – estimated several models ourselves: Estimation software syntax Various levels of theoretical knowledge The “expert coach” approach Why – expecting frequent “tweaks” again!

13. Re-estimate: data issues Oops! You need to re-estimate. The colors on the picture signify where education employment was geo-coded but there was no school enrollment geo-coded.

14. Re-estimate High School Location Choice

15. Redesign model What (examples) - Swap out a component Estimate joint models Explicit joint tour formation Daily schedule interaction Activity generation and assignment How – thorough study of your design (among other things!) Why – next round of model upgrades

16. Redesign software What (examples) – Model component design Upgrade key functions (e.g. MakeChoice) Enhance distributability ( modifications to“plumbing” code) How – designed/wrote most code -The “coach” model Why – open source versus vendor again!

17. Redesign Software (example)

18. What we did: estimation Component Name Synthetic Sample GeneratorTour Primary Destination Choice Regular Workplace Location Regular School LocationTour Main Mode Choice Auto Ownership Area TypeTour Time of Day Choice Parking CostIntermediate Stop Generation Daily Activity PatternIntermediate Stop Location Trip Mode Choice Exact Number of ToursTrip Departure Time Work Tour Destination Type

19. What we did: software Wrote our own (bigtime!) That coach model again Had to learn a lot to do it: Logit math OO/C#/.Net programming SQL-Server database Wanted to use industry-standard tools Led by strong IT department

20. Future training Explicit intra-hh interaction –Many flavors Selection of choice set from a larger set “Doubly constrained” location choice –Enforced quota –Shadow price Ties to DTA Enhancements in population synthesis

21. Authors Erik Sabina, esabina@drcog.orgesabina@drcog.org Jennifer Malm, jmalm@drcog.orgjmalm@drcog.org Suzanne Childress, Schildress@drcog.orgSchildress@drcog.org -Denver Regional Council of Governments John Bowman, John_L_Bowman@alum.mit.eduJohn_L_Bowman@alum.mit.edu - Bowman Research and Consulting DeVon Culbertson, DevonCulbertson@yahoo.comDevonCulbertson@yahoo.com - DeVon Culbertson, LLC