1. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 1 Developing a Transportation Data Archive for the Portland Metropolitan Area. Robert L. Bertini Andrew Byrd Thareth Yin ITE Quad Conference April 23, 2004

2. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 2 Introduction. Outline.  Introduction  National ITS Architecture  Portland ADUS  ADUS Architecture  Data Processing and Storage  Data Analysis and Visualization  Trial Uses  Next Steps

3. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 3 “Data are too valuable to only use once.” Introduction. Guiding Principles.

4. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 4 “Management of the transportation system cannot be done without knowledge of its performance.” Introduction. Guiding Principles.

5. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 5 Introduction. National Science Foundation. National Science Foundation CAREER: Mining Archived Intelligent Transportation Systems Data: A Validation Framework for Improved Performance Assessment and Modeling

6. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 6 Introduction. NSF Project Objectives.  Exploit still-untapped ITS data for accurate assessment of system operation.  Develop and test multimodal transportation system performance measures.  Better understanding of fundamental traffic flow phenomena.  Improved traffic flow modeling.  Forecasting future system state so true control measures can be applied and evaluated.  Outreach aimed toward increasing enrollment, quality and diversity in the transportation program.  Attract and retain students from diverse backgrounds and with diverse learning styles to science and engineering.

7. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 7 National ITS Architecture. Overview.

8. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 8 National ITS Architecture. Overview. 1.Travel And Traffic Management 1.1 Pre-trip Travel Information 1.2 En-route Driver Information 1.3 Route Guidance 1.4 Ride Matching & Reservation 1.5 Traveler Services Information 1.6 Traffic Control 1.7 Incident Management 1.8 Travel Demand Management 1.9 Emissions Testing & Mitigation 1.10 Highway Rail Intersection 2.Public Transportation Management 2.1 Public Transportation Management 2.2 En-route Transit Information 2.3 Personalized Public Transit 2.4 Public Travel Security 3. Electronic Payment 3.1 Electronic Payment Services 4. Commercial Vehicle Operations 4.1 Comm. Vehicle Electronic Clearance 4.2 Automated Roadside Safety Inspection 4.3 On-board Safety & Security Monitoring 4.4 Commercial Vehicle Administrative Processes 4.5 Haz. Material Security & Incident Response 4.6 Freight Mobility 5. Emergency Management 5.1 Emergency Notification & Personal Security 5.2 Emergency Vehicle Management 5.3 Disaster Response And Evacuation 6. Advanced Vehicle Safety Systems 6.1 Longitudinal Collision Avoidance 6.2 Lateral Collision Avoidance 6.3 Intersection Collision Avoidance 6.4 Vision Enhancement For Crash Avoidance 6.5 Safety Readiness 6.6 Pre-crash Restraint Deployment 6.7 Automated Vehicle Operation 7. Information Management 7.1 Archived Data Function 8. Maintenance And Construction Management 8.1 Maintenance & Construction Operations

9. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 9 National ITS Architecture. ADUS Is Born.  ITS technologies collect data  Real time control  Incident management  Traffic signal systems  Traveler information  Also useful if saved and accessible  Data already being collected—incentive for storing them for future use.  Difficulty not in collecting data but in gaining access to that data  Archived Data User Service (ADUS)  Managing ITS data beyond ITS  Careful management of data for various stakeholders

10. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 10 National ITS Architecture. ADUS Is Born.  ADUS controls archiving functionality for all ITS data:  Operational Data Control: manage operations data integrity.  Data Import and Verification: acquire historical data.  Automatic Data Historical Archive: permanent data archive.  Data Warehouse Distribution: integrates planning, safety, operations, and research communities into ITS and processes data products for these communities  ITS Community Interface: provides common interface to all ITS users for data products specification and retrieval.

11. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 11 National ITS Architecture. Data Poor to Data Rich.  Traffic Surveillance  Fare/Toll Systems  Incident Management  Traffic Video  Environmental  CVO  Traffic Control  Highway/Rail  Emergency Response ITSDataArchivesITSDataArchives Performance Monitoring National reporting Performance-based planning Evaluations Public Reactions Long Range Planning TRANSIMS IDAS Four step models Transit routes Operations Planning Incident management ER deployment Signal timing Transit service Travel Time Forecasting Customized route planning ATIS Advisories Other Stakeholder Functions Safety Land use Air quality Maintenance management

12. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 12 Portland ADUS. PSU Designated Regional Archive Center.

13. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 13 Portland ADUS. Current Status. ODOT  Freeway loop detector data  Incident data NOAA  Weather data TriMet  Bus poll data  Bus dispatch data City of Portland  Traffic signal count/speed data Washington State DOT

14. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 14 Portland ADUS. Who Can Use ITS Data? Fourteen Stakeholders Identified :  Transportation Planning  Transportation System Monitoring  Air Quality Analysis  MPO/State Freight and Intermodal Planning  Land Use/Growth Management Planning  Transportation Administrators and Policy Analysis  Traffic Management  Transit Management  Construction and Maintenance  Safety Planning and Administration  Commercial Vehicle Operations  Emergency Management  Transportation Research  Private Sector

15. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 15 Portland ADUS. Vision.  75 CCTV Cameras  436 Inductive Loop Detectors  118 Ramp Meters

16. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 16 ADUS Architecture. Implementing A Successful Archive.  Existing Systems  California PeMS  Puget Sound (WSDOT / TRAC)  San Antonio, TX TransGuide  Positive features and lessons learned  Texas DOT and TTI study  Begin with a single data source  Provide data through the web or CD subscription  Save raw data  Make aggregate data available to users  Data quality control measures  Provide documentation!

17. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 17 ADUS Architecture. Fiber Optic Data Connection.

18. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 18 ADUS Architecture. Data Flows.

19. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 19 ADUS Architecture. Database Backend / Web Frontend.  Database backend  SQL relational database  200 MB per day of raw data  75 GB per year  High capacity disk array  5MB compressed for download  Off-site backup server  Daily backups  Uninterruptible power  Web-based interface  Easily accessible  PHP language

20. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 20 Data Processing and Storage. The Web Interface Is Up and Running.  Loop health analysis  Proven techniques prevent propagation of error

21. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 21 Data Processing and Storage. Aggregation Levels.  Raw 20-second loop detector data  Useful for research, traffic flow theory  Huge data sets  Previously difficult to manage and organize  High resolution aggregates  5 and 15 minute aggregates  Flow, speed, and occupancy retained  VMT, VHT, travel time, delay added  Useful for research and planning purposes  Lower resolution aggregates  Hourly or daily  VMT, VHT, travel time, delay  Increased processing speed for long term overviews

22. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 22 Data Analysis and Visualization. Contour Plots.

23. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 23 Data Analysis and Visualization. Time Series Plots.

24. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 24 Trial Uses. Preliminary Performance Analyses.  Metro travel demand modeling  Highway 217  V/C versus travel time function  Used database backend and custom queries  Metro performance measures report

25. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 25 Next Steps. Expanding Archive Functionality.  Tri-Met  Bus and MAX  Location/dispatch  Washington State DOT  City of Portland  Additional performance measures and plots

26. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 26 Acknowledgments.  National Science Foundation  Oregon Department of Transportation  City of Portland  TriMet  Portland State University  Oregon Engineering and Technology Industry Council

27. Portland ADUS Bertini & Byrd PSU ITS Lab 16-Jan-16 Page 27 Feedback. Your Opinions and Suggestions. As potential users, your opinions and input on this project are appreciated. Please let us know what you think about existing or future:  Data sources  Performance measures  Data visualizations and summaries Contact us: bertini@pdx.edu abyrd@cs.pdx.edu http://www.its.pdx.edu