Comprehensive Safety Analysis (CSA) 2010 Supplemental Slides to discuss Data Preview with Motor Carriers U.S. Department of Transportation Federal Motor Carrier Safety Administration

CSA 2010 Data Preview https://csa2010.fmcsa.dot.gov

What is the CSA 2010 Data Preview? Website that provides carriers an assessment of their safety performance by Behavior Analysis Safety Improvement Category (BASIC) Inspection data (24 months) Crash data (24 months) Investigation Findings/Serious Violations (12 months) Provides information and best practices for improving carrier safety Allows carriers to assess their BASIC safety performance in order to begin addressing problems today 3 3

Why Provide a Data Preview? Proactively engages industry to improve safety and prepare for CSA 2010 Carriers are given an opportunity to review and update registration data, or request data reviews DataQs: https://dataqs.fmcsa.dot.gov/login.asp Registration Information (MCS-150) updates Advance notice of BASIC assessments prior to public rollout 4 4

Data Preview Access Details Carrier can only access their own results Access via the CSA 2010 website (requires carrier PIN –instructions for obtaining PIN are on the log-in page) Access via FMCSA Portal (CSA 2010 link) CSA 2010 Test Carriers will continue to have access to CSI as well as the Data Preview Public will not have access to Data Preview FMCSA and State Partners have access to every carrier’s Data Preview

What goes into a BASIC assessment? Carriers’ BASIC Assessments are determined by two inputs: Roadside Performance (CSMS results) Violations found during roadside inspections BASIC percentiles exceeding intervention thresholds Investigation Findings (Serious Violations) Non-compliance that’s so severe immediate corrective action is necessary Directly related to carrier’s management and/or operational controls BASIC is considered deficient and displayed accordingly on a carrier’s record for 12 months

Login Page for Motor Carriers Carriers’ must log in with their DOT# and PIN. Links are available through Portal and the CSA 2010 informational website 7 7

Data Preview –Carrier Summary Screen Once a carrier logs in, you will see this summary page. It includes the BASIC assessments (broken down by on-road performance and investigation results), carrier registration information and a summary of inspections and crash activity over the past 24 months. In the next few slides, I will explain each of these areas in greater detail. 8 8

Data Preview –Carrier Summary Screen This is a blown up view of the Carrier Registration Information on the homepage of the Data Preview. (CLICK) You see that the site indicates when a carrier’s VMT data is out of date and encourages them to update that information with FMCSA. This is part of the agency’s effort to increase and validate the VMT data that we have. (CLICK) When a carrier clicks on “Update Carrier Registration Information”, they are given detailed instructions on how to update their MCS-150. 9 9

Data Preview –Carrier Summary Screen Here is a blow up of the Summary section of the homepage laying out counts of Inspections and Crash activity. 10 10

Data Preview –Carrier Summary Screen This is the section that indicates the carriers’ BASIC assessments for each category (CLICK) The first column indicates the percentile calculated by SMS based on data gathered at the roadside during inspections. (CLICK) The second column indicates if a Serious Violation has been discovered during an investigation over the past year (CLICK) As I explained earlier, these two aspects of CSA 2010 combine to determine the overall assessment of whether a carrier is deficient in any of the BASICs. (CLICK) As you can see by the circle that just showed up, this carrier is deficient in the Unsafe Driving BASIC based on the information gathered by roadside inspections. If I click on the Driver Fitness BASIC on this page, we will be brought to more detailed information. 11 11

Data Preview –Detailed On-Road Performance screen Link to DataQs to request a data review Summary of violations discovered and the severity weight assigned to each Access CSA 2010 information to prepare for implementation Link to Information Center with tips and FAQs This is the screen that shows more details regarding violations cited in the Unsafe Driving BASIC for this carrier. (CLICK) As you can see, they are deficient based on On-road Performance (CLICK) At the top of the page, there is a summary list of the violations for this carrier over the past 24 months that resulted in an Unsafe Driving violation, how many times that violation was cited and the severity weight assigned to the violation. (CLICK) At the bottom of the page is detailed information on inspections over the past 24 months that resulted in at least one Unsafe Driving violation. (CLICK) These links provide more resources for the carrier including DataQs, and information center with tips and guidance on how to improve safety. List of violations found during Roadside Inspections 12 12

Data Preview –Carrier Summary Screen If we go back to the summary page that shows all of the BASICs and assessments, we can see that this carrier is deficient in the Controlled Substances/Alcohol BASIC based on Investigation Findings over the past 12 months. (CLICK) The carrier is found deficient based on investigation findings if a serious violation was discovered in that BASIC area. A serious violation is one in which non-compliance is so severe that immediate corrective action is necessary OR the violation directly relates to the carrier’s management and/or operational controls If you click on the Controlled Substances/Alcohol BASIC, we will get more detailed information regarding these investigations and serious violations. 13 13

Data Preview –Detailed Investigation Results List of Serious Violations found during investigations over the past 12 months (CLICK) Again, this page indicates that the carrier is deficient in this BASIC due to investigation findings (CLICK) At the bottom of the page, there is detailed information regarding the type and date of investigation (in this case a compliance review on 4/7/2010) that was conducted and serious violations were cited. 14 14

Frequently Asked Questions (FAQs)

Frequently Asked Questions Question: Under the current SafeStat system our operation looks “good”. How is it possible that the new system finds our operation deficient in one or more BASICs? Answer: There are distinct differences between SafeStat and the new SMS that lead to different results. SMS is organized by 7 specific behavioral areas (BASICs). SafeStat is organized into 4 broad SEAs SMS uses all safety-based inspection violations. SafeStat uses only out-of-service violations and selected moving violations.

Frequently Asked Questions (cont’d) Question: Is FMCSA using Vehicle Miles Travelled (VMT) for normalizing the Crash Indicator and Unsafe Driving BASIC? Answer: Using Power Units (PU) alone can create potential bias against segments of the industry that employ high VMT per PU. At the same, using VMT alone can create similar bias against segments of industry that operate limited VMT due to the nature of their operations (i.e. utility companies) A blended approach that uses PUs but also incorporates VMT for companies that operate greater than average mileage per PU results in a more equitable and more effective system FMCSA is making the VMT field of the MCS-150 form mandatory for all updates of census data by motor carriers in operation over 12 months.

Frequently Asked Questions (cont’d) Question: Some of the speeding violations recorded in the Unsafe Driving BASIC were simply “warnings” in which the driver was not issued a ticket. Why is FMCSA using these “warnings” against our record in the new SMS? Answer: FMCSA and independent analysis demonstrates a strong relationship between future crashes and high scores in the Unsafe Driving area when including all recorded moving violations Roadside inspection software is being modified to require roadside officers to designate the severity of speeding offenses recorded in roadside inspections FMCSA will eventually assign lesser severity weights to the less severe speeding violations in the SMS

Frequently Asked Questions (cont’d) Question: Will motor carriers involved in the OM Test still be able to see their comprehensive data, including percentile rankings, in the Comprehensive Safety Information (CSI) system? Answer: Yes. Test group motor carriers will continue to have access to the comprehensive data provided by CSI.

Frequently Asked Questions (cont’d) Question: Why are non-preventable crashes included in the Crash Indicator calculation? Answer: FMCSA analysis indicates past crashes are a good predictor of future crashes irrespective of accountability. Therefore: Crashes will not be removed based on preventability The Crash Indicator assessment will be excluded from any public websites that may be viewed by the public (including shippers and insurers) Crash accountability would be considered before issuance of adverse safety fitness ratings. Future Approach: FMCSA is evaluating an approach whereby State reported crashes would be assessed for accountability before considered by the SMS methodology

Frequently Asked Questions (cont’d) Question: How often is this data updated? Response: Data is updated monthly. Question: Does a driver’s violation history at a previous employer impact a carrier’s SMS assessments? Response: No. Only violations that the driver received while working for that carrier will impact the carrier’s SMS assessments

Frequently Asked Questions (cont’d) Question: Will the Carrier Safety Measurement System data be available to the public? Response: Yes, beginning in December 2010 via A&I Online Question: Is there any way to request a review of potentially erroneous or improper violations on carrier and/or driver records? Response: Yes, DataQs: https://dataqs.fmcsa.dot.gov/login.asp