1. TSM&O Performance Measures Plan Project Management Team Meeting #1 February 2016

2. 2 Agenda Introductions & Project Scope/Schedule TSMO Perf. Meas. State of Practice ODOT Internal Perf. Meas. Systems TSMO Framework Interactive Session Wrap-Up

3. 3 Introductions Name, Title 1 Most Valuable Perf. Meas. You Have Now & Why 1 Perf. Meas. You Wish You Had & Why Source: http://firearmshistory.blogspot.com/2012/05/handgun- shooting-positions-shooting.html

4. TSM&O Performance Measures Plan Overview Audience Focus – Actionable & Useful Plan Traffic Incident Management System Management Program Management

5. Operations Performance Measures

6. TSMO Performance Measures Plan External Literature / State of Practice Review Project Steering Meetings (3) & Stakeholder Engagement Meetings (6) TSM&O Performance Measures Plan – TSM&O Framework (see Strawman) – Successes to date, opportunities – Preferred Perf. Meas. – Implementation Plan – Communications Plan Scope / Outcomes 6

7. TSMO Performance Measures Plan Communication Plan 7

8. TSMO Performance Measures Plan Schedule 8

9. Traffic Incident Management Stakeholder Roster Darin Weaver, TIM Coor. Kelle Sossaman, TOC Coor. Lt. Jeff Lewis, OSP Nathaniel Price, FHWA Brent Atkinson, TMOC Jerimiah Griffin, D8 ADM Jim Scholtes, D10 ADM Ty Burns, D12 ADM Tom Davis, R5 Ops Craig Olson, R2 Ops 9

10. System Management Stakeholder Roster Rich Arnold, TPAU Doug Norval, TPAU Joel McCarroll, R4 Traffic Mngr. Dennis Mitchell, R1 Traffic/ITS Angela Kargel, R2 Traffic Mngr. Shyam Sharma, R3 Traffic Mngr. Jeff Wise, R5 Traffic/Roadway Bill Link, TSSU Mngr Mike Kimlinger, Traffic Standards/Asst mngt. Doug Spencer, ITS HQ 10

11. Program Management Stakeholder Roster Matt Badzinski, ITS/TAD Misti Timshell, ITS/TAD Kelle Sossaman, TOC Coor. Arleigh Mooney, CTOC Mngr. Brent Atkinson, TMOC Mngr, Jeremiah Griffin, STOC Julie Scruggs, STOC Nicole Schmunk, NWTOC Chris Wright, Traveler Info/PM Coor. Bill Link, TSSU Mike Kimlinger, Traffic Mngr./Asset Mnt. 11

12. Highlights of External Literature Review TSM&O programs & metrics are in infancy – Exception is TIM – Move from ad-hoc to actionable & automated TSMO education process on-going within other DOTs… is this ITS rebranded? Freeways are ahead of arterials for TSMO Private data sources & social media are increasingly common Key Findings 12

13. Lit Review Strategic vision should drive performance measures – Develop metrics as a system Keep it simple – start with a few useful metrics Useful metrics to wide audiences – Planning, Design, Maintenance, Managers… Use well-defined metrics – Clearance time means??? Recommendations 13

14. Lit Review Data quality is “Achilles Heel”, consider QA/QC program Data fusion & automation is key to usefulness of metrics toward informing actionable items, efficiently Workforce development was a common need identified for effective TSMO program functions Life-Cycle Comprehensive TSMO Asset Management is the goal, most states are only at an inventory stage. Recommendations, continued 14

15. Example TSMO Performance Measure Goals Incident Clearance within 90 minutes (national) 70% of all TSMO maintenance is proactive (Utah DOT) 95% of all Traffic Signal Detection is Operable, even during construction (Utah DOT) Connect 100% of all ITS and Traffic Signals Statewide Via Fiber Communications (Utah DOT) 15

16. Example Performance Measures Goals Reduce traffic-related deaths by one-half by 2030 (Colorado DOT) Reliability – Slow the growth of congestion through targets for Planning Time Index (Colorado DOT) Public Trust – > 80% surveyed that MnDOT is reliable to deliver the transportation system (Minnesota DOT) Snow & Ice Control - >70% bare lanes within target # of hours of a winter weather event (Minnesota DOT) 16

17. Example Performance Measures Keep arterial travel time at or below the rate of traffic volume increase (City of Mesa, AZ) Prioritize signal timing & infrastructure investment based on trends with % arrival on green & split failures (Utah DOT) Percent of Miles Congested; Avg. speed below 50 mph (Arizona DOT) Inventory number of incidents cleared / number of incidents notified to DOT (national) 17

18. Example Performance Measures Variance of zero, actual vs. programmed maintenance activities (FHWA) Time to provide requested service/information (FHWA) Number of staff trained to maintain equipment (FHWA) Annual failure rate by type/location (FHWA) 18

19. ODOT Performance Databases 19

20. TSMO Strategic Framework “Strawman” Input Gathering Session 20

21. TSMO Framework Audiences 21 Executive Leadership Traffic Incident Management (TIM) Leadership Traffic Operations Center (TOC) Management Traffic Signal Operations Regional Electrical Management ITS/TAD Field Maintenance ITS/TAD Central Maintenance Region Operations & Maintenance Teams Transportation Planning & Analysis Unit

22. TSMO Framework Structure Goal of Perf. Meas. – Around Actions for Each Audience Objective of Perf. Meas. Example Perf. Meas. Example Action Items 22

23. Objectives of TSMO Performance Measures Easy to understand & meaningful metrics (“tell a story”) Dashboard Summary Contain a Return on Investment Dimension Generalized 23

24. Executive Leadership TSMO Perf. Meas. Framework Goal of TSMO Perf Measures Inform the status, trends, barriers & opportunities to better: - Allocate resources to Operations Program, - Discern optimal investment level in Operations vs other agency programs, and - Monitor and report on progress towards meeting goals and objectives. 24 Example Performance Measures Example Action Items - Before / After Evaluations - TSMO projects -- Return On Investment. - Traveler satisfaction with ODOT (operations). - Unfunded vs. funded needs identified. - Funding trends for TSMO investments (hard & soft costs). - TSMO asset condition inventory. - Construct meaningful dashboard display of TSMO performance measures. - Automate aggregation of performance measures into executive summary graphics/reports on regular intervals. - Create consistency in financial investment/funding reports (ex. 217 report).

25. TIM Leadership TSMO Perf. Meas. Framework Goal of TSMO Perf Measures Inform the status, trends, barriers & opportunities to better: - Conduct staff scheduling, - Prioritize resources, and - Program enhancement. 25 Example Performance Measures Example Action Items - Percent of lane blocking within 30, 60, 90 minutes (incident response) - Evaluate incidents which take longer than expected (e.g. 90 minutes) - Frequency of secondary incidents. - Responder struck-bys, fatalities. - Responder training & education performance metric. - Urban vs. rural metrics - Regular forum/staff to facilitate post-incident debriefs, lessons learned exchanges. - Modify dispatch incident software and DMV crash reporting to identify secondary incidents and responder struck-bys/fatals. - Develop TIM training program. - Conduct peer reviews to share best practices. - Automate databases to create summary TIM metrics.

26. TOC Management TSMO Perf. Meas. Framework Goal of TSMO Perf Measures Inform the status, trends, barriers & opportunities to better: - Conduct staff scheduling, - Quality assurance, quality control of staff work, - Identification of training needs and staff development opportunities, and - Provide customer service. 26 Example Performance Measures Example Action Items - Incident duration, notification time, dispatch time, responder arrival time, percentage of highway- related notifications received by ODOT. - Work load peak tracking. - TOC staff training & education performance metric. - Incident frequency metrics (count, duration, summary). - Data entry accuracy (error rate) - Automate databases to create summary TOC metrics. - Conduct peer reviews to share best practices. - Optimize staffing and resources based on need. - QA/QC automation.

27. Traffic Signal Operations TSMO Perf. Meas. Framework Goal of TSMO Perf Measures Inform the status, trends, barriers & opportunities to better: - Optimize arterial performance, - Prioritize resources, and - Address signal complaints/problems. 27 Example Performance Measures Example Action Items - Asset management metrics, maintenance time spent per location/device, life-cycle health, replacement cycle. - Uptime of signal, detection, communications. - Arterial travel time, reliability. - Automated Signal Performance Measures (Utah DOT), split failures, % arrival on green, etc. - Data drives resource investment on corridors/intersections, not blanket every 5 years for retiming. - Replace or enhance automated tracking/reporting of desired signal system metrics (central system or UDOT style SPM). - Develop or enhance an asset management system linked to work tickets, committed/planned enhancements. - Upgrade controllers (ATC), sensors, communication, to allow for proactive performance monitoring of signals & arterials.

28. Regional Electrical Mgmt TSMO Perf. Meas. Framework Goal of TSMO Perf Measures Inform the status, trends, barriers & opportunities to better: - Prioritize traffic signal/electrical maintenance work assignments, and - Troubleshooting/analysis of signal operations. 28 Example Performance Measures Example Action Items - Asset management metrics, maintenance time spent per location/device, life-cycle health, replacement cycle. - Training & education metric, workforce development (e.g. networking, IP ethernet understanding). - Workload management/backlog metrics. - Replace or enhance automated tracking/reporting of desired electrical system metrics. - Develop or enhance an asset management system linked to work tickets, committed/planned enhancements. - Assemble a comprehensive workforce development program.

29. ITS/TAD Field Maintenance TSMO Perf. Meas. Framework Goal of TSMO Perf Measures Inform the status, trends, barriers & opportunities to better: - Prioritize ITS maintenance work assignments, and - Troubleshooting/analysis of ITS equipment operation. 29 Example Performance Measures Example Action Items - Asset management metrics, maintenance time spent per location/device, life-cycle health, replacement cycle. - Training & education metric, workforce development (e.g. networking, IP ethernet understanding). - Workload management/backlog metrics. - Response time/metrics to work tickets (IS). - Replace or enhance automated tracking/reporting of desired ITS system metrics. - Develop or enhance an asset management system linked to work tickets, committed/planned enhancements. - Assemble a comprehensive workforce development program.

30. ITS/TAD Central Maintenance TSMO Perf. Meas. Framework Goal of TSMO Perf Measures Inform the status, trends, barriers & opportunities to better: - Prioritization of software/system maintenance work assignments, - Manage, maintain and prioritize server/IT equipment including replacement/troubleshooting, and - Monitor system performance and identify problems. 30 Example Performance Measures Example Action Items - Workload management/backlog metrics. - Response time/metrics to work tickets (IS). - Training & education metrics, workforce development (e.g. ITS devices, systems, industry standards and protocols, programming/software engineering capabilities). - Maintenance time spent per location/device. - Develop or enhance an asset management system linked to work tickets, committed/planned enhancements. - Assemble a comprehensive workforce development program.

31. Reg. Ops & Maintenance Teams Perf. Meas. Framework Goal of TSMO Perf Measures Inform the status, trends, barriers & opportunities to better: - Select and prioritize operations projects, and - Discern operations program effectiveness and resource needs. 31 Example Performance Measures Example Action Items - Incident metrics. - Crew & district performance measures. - Mobility & safety performance metrics for candidate projects (top 10 list). - Benefit per unit cost invested (ROI). - Asset condition inventory. - Develop or enhance an asset management system linked to work tickets, committed/planned enhancements. - Assemble a comprehensive workforce development program. - Optimize STIP funding splits based on need.

32. Trans. Planning & Analysis Unit TSMO Perf. Meas. Framework Goal of TSMO Perf Measures Inform the status, trends, barriers & opportunities to better: - Conduct tradeoff analysis, project effectiveness, system performance trends, and - Tailor analysis procedures, policy, and documentation. 32 Example Performance Measures Example Action Items - Travel time, reliability (mobility) metrics. - Fatal and serious injury metrics (safety). - Data gathering metrics (coverage, frequency, uptime of 3rd party sources). - QA/QC data accuracy metrics. - Integrate statewide speed/travel time probe data source into automated performance measures system. - Increase frequency with which reliability and other planning for operations projects / analysis occurs.

33. TSMO Framework Feedback and Discussion 33

34. TSMO Performance Measures Plan Wrap Up Recap Discussion – Consensus Items – Items to Explore Deeper with Stakeholder Group – Perf. meas. wish list met? Ideas for the Plan & “Actionableness” 34

35. Thank you. 35