1. Comprehensive Safety Analysis (CSA) Supplemental Slides to discuss Data Preview with Motor Carriers
U.S. Department of Transportation
Federal Motor Carrier Safety Administration

2. CSA 2010 Data Preview https://csa2010.fmcsa.dot.gov

3. What is the CSA 2010 Data Preview?
Website that provides carriers an assessment of their safety performance by Behavior Analysis Safety Improvement Category (BASIC)
Inspection data (24 months)
Crash data (24 months)
Investigation Findings/Serious Violations (12 months)
Provides information and best practices for improving carrier safety
Allows carriers to assess their BASIC safety performance in order to begin addressing problems today 3 3

4. Why Provide a Data Preview?
Proactively engages industry to improve safety and prepare for CSA 2010
Carriers are given an opportunity to review and update registration data, or request data reviews
DataQs:
Registration Information (MCS-150) updates
Advance notice of BASIC assessments prior to public rollout 4 4

5. Data Preview Access Details
Carrier can only access their own results
Access via the CSA 2010 website (requires carrier PIN –instructions for obtaining PIN are on the log-in page)
Access via FMCSA Portal (CSA 2010 link)
CSA 2010 Test Carriers will continue to have access to CSI as well as the Data Preview
Public will not have access to Data Preview
FMCSA and State Partners have access to every carrier’s Data Preview

6. What goes into a BASIC assessment?
Carriers’ BASIC Assessments are determined by two inputs:
Roadside Performance (CSMS results)
Violations found during roadside inspections
BASIC percentiles exceeding intervention thresholds
Investigation Findings (Serious Violations)
Non-compliance that’s so severe immediate corrective action is necessary
Directly related to carrier’s management and/or operational controls
BASIC is considered deficient and displayed accordingly on a carrier’s record for 12 months

7. Login Page for Motor Carriers
Carriers’ must log in with their DOT# and PIN. Links are available through Portal and the CSA 2010 informational website 7 7

8. Data Preview –Carrier Summary Screen
Once a carrier logs in, you will see this summary page. It includes the BASIC assessments (broken down by on-road performance and investigation results), carrier registration information and a summary of inspections and crash activity over the past 24 months. In the next few slides, I will explain each of these areas in greater detail. 8 8

9. Data Preview –Carrier Summary Screen
This is a blown up view of the Carrier Registration Information on the homepage of the Data Preview.
(CLICK) You see that the site indicates when a carrier’s VMT data is out of date and encourages them to update that information with FMCSA. This is part of the agency’s effort to increase and validate the VMT data that we have.
(CLICK) When a carrier clicks on “Update Carrier Registration Information”, they are given detailed instructions on how to update their MCS-150. 9 9

10. Data Preview –Carrier Summary Screen
Here is a blow up of the Summary section of the homepage laying out counts of Inspections and Crash activity. 10 10

11. Data Preview –Carrier Summary Screen
This is the section that indicates the carriers’ BASIC assessments for each category
(CLICK) The first column indicates the percentile calculated by SMS based on data gathered at the roadside during inspections.
(CLICK) The second column indicates if a Serious Violation has been discovered during an investigation over the past year
(CLICK) As I explained earlier, these two aspects of CSA 2010 combine to determine the overall assessment of whether a carrier is deficient in any of the BASICs.
(CLICK) As you can see by the circle that just showed up, this carrier is deficient in the Unsafe Driving BASIC based on the information gathered by roadside inspections. If I click on the Driver Fitness BASIC on this page, we will be brought to more detailed information. 11 11

12. Data Preview –Detailed On-Road Performance screen
Link to DataQs to request a data review
Summary of violations discovered and the severity weight assigned to each
Access CSA 2010 information to prepare for implementation
Link to Information Center with tips and FAQs
This is the screen that shows more details regarding violations cited in the Unsafe Driving BASIC for this carrier.
(CLICK) As you can see, they are deficient based on On-road Performance
(CLICK) At the top of the page, there is a summary list of the violations for this carrier over the past 24 months that resulted in an Unsafe Driving violation, how many times that violation was cited and the severity weight assigned to the violation.
(CLICK) At the bottom of the page is detailed information on inspections over the past 24 months that resulted in at least one Unsafe Driving violation.
(CLICK) These links provide more resources for the carrier including DataQs, and information center with tips and guidance on how to improve safety.
List of violations found during Roadside Inspections 12 12

13. Data Preview –Carrier Summary Screen
If we go back to the summary page that shows all of the BASICs and assessments, we can see that this carrier is deficient in the Controlled Substances/Alcohol BASIC based on Investigation Findings over the past 12 months.
(CLICK) The carrier is found deficient based on investigation findings if a serious violation was discovered in that BASIC area. A serious violation is one in which non-compliance is so severe that immediate corrective action is necessary OR the violation directly relates to the carrier’s management and/or operational controls
If you click on the Controlled Substances/Alcohol BASIC, we will get more detailed information regarding these investigations and serious violations. 13 13

14. Data Preview –Detailed Investigation Results
List of Serious Violations found during investigations over the past 12 months
(CLICK) Again, this page indicates that the carrier is deficient in this BASIC due to investigation findings
(CLICK) At the bottom of the page, there is detailed information regarding the type and date of investigation (in this case a compliance review on 4/7/2010) that was conducted and serious violations were cited. 14 14

15. Frequently Asked Questions (FAQs)

16. Frequently Asked Questions
Question: Under the current SafeStat system our operation looks “good”. How is it possible that the new system finds our operation deficient in one or more BASICs?
Answer: There are distinct differences between SafeStat and the new SMS that lead to different results.
SMS is organized by 7 specific behavioral areas (BASICs). SafeStat is organized into 4 broad SEAs
SMS uses all safety-based inspection violations. SafeStat uses only out-of-service violations and selected moving violations.

17. Frequently Asked Questions (cont’d)
Question: Is FMCSA using Vehicle Miles Travelled (VMT) for normalizing the Crash Indicator and Unsafe Driving BASIC?
Answer:
Using Power Units (PU) alone can create potential bias against segments of the industry that employ high VMT per PU. At the same, using VMT alone can create similar bias against segments of industry that operate limited VMT due to the nature of their operations (i.e. utility companies)
A blended approach that uses PUs but also incorporates VMT for companies that operate greater than average mileage per PU results in a more equitable and more effective system
FMCSA is making the VMT field of the MCS-150 form mandatory for all updates of census data by motor carriers in operation over 12 months.

18. Frequently Asked Questions (cont’d)
Question: Some of the speeding violations recorded in the Unsafe Driving BASIC were simply “warnings” in which the driver was not issued a ticket. Why is FMCSA using these “warnings” against our record in the new SMS?
Answer:
FMCSA and independent analysis demonstrates a strong relationship between future crashes and high scores in the Unsafe Driving area when including all recorded moving violations
Roadside inspection software is being modified to require roadside officers to designate the severity of speeding offenses recorded in roadside inspections
FMCSA will eventually assign lesser severity weights to the less severe speeding violations in the SMS

19. Frequently Asked Questions (cont’d)
Question: Will motor carriers involved in the OM Test still be able to see their comprehensive data, including percentile rankings, in the Comprehensive Safety Information (CSI) system?
Answer: Yes. Test group motor carriers will continue to have access to the comprehensive data provided by CSI.

20. Frequently Asked Questions (cont’d)
Question: Why are non-preventable crashes included in the Crash Indicator calculation?
Answer: FMCSA analysis indicates past crashes are a good predictor of future crashes irrespective of accountability. Therefore:
Crashes will not be removed based on preventability
The Crash Indicator assessment will be excluded from any public websites that may be viewed by the public (including shippers and insurers)
Crash accountability would be considered before issuance of adverse safety fitness ratings.
Future Approach: FMCSA is evaluating an approach whereby State reported crashes would be assessed for accountability before considered by the SMS methodology

21. Frequently Asked Questions (cont’d)
Question: How often is this data updated?
Response: Data is updated monthly.
Question: Does a driver’s violation history at a previous employer impact a carrier’s SMS assessments?
Response: No. Only violations that the driver received while working for that carrier will impact the carrier’s SMS assessments

22. Frequently Asked Questions (cont’d)
Question: Will the Carrier Safety Measurement System data be available to the public?
Response: Yes, beginning in December 2010 via A&I Online
Question: Is there any way to request a review of potentially erroneous or improper violations on carrier and/or driver records?
Response: Yes, DataQs: