ABN: Measuring Safety Performance Senior Managers’ Briefing

Contents 1. The importance of good SPIs 2. The benefits of an SPI program 3. Overview of the process 4. Pre-requisites for a successful SPI program

The importance of good SPIs March 2005 Texas City: 15 Fatalities 170 Injuries $60 billion damage August 2005 CSB issues an urgent safety recommendation. An independent panel to assess safety culture and oversight at all BP was convened The findings were published in the Baker Report in 2007

The importance of good SPIs The Baker Report made several findings and a recommendation regarding the use of SPIs: BP erroneously inferred positive results for personal safety to indicate good process safety At Texas City, personal accident rates were decreasing while process incidents were increasing Rec 7: develop, implement, maintain, and review an integrated set of leading and lagging indicators for process safety

The importance of good SPIs Railway companies use SPIs to monitor safety performance. Traditionally, the rail industry has relied heavily on failure and incident data to monitor safety performance. This means that changes can only be made after something has gone wrong. Proactive measures provide the opportunity to take action before things go wrong. The same SPIs may be used year on year without challenge. Assurance that the most appropriate SPIs are being monitored maybe lacking. Good SPIs will measure both activities and outcomes. Good SPIs will match the current key concerns of the business.

Contents 1. The importance of good SPIs 2. The benefits of an SPI program 3. Overview of the process 4. Pre-requisites for a successful SPI program

Part 1: Why use SPIs? Implementing an SPI program can provide several benefits to an organisation, they: Help manage and reduce risk Provide assurance on safety performance Reinforce a positive safety culture Complement (rather than replace) other safety tools and processes Facilitate learning from others Enhance efficiency

Contents 1. The importance of good SPIs 2. The benefits of an SPI program 3. Overview of the process 4. Pre-requisites for a successful SPI program

The guideline document The guideline document explains the SPI basics and describes a process for developing and managing SPIs. Development of the guideline has involved RTOs in the United Kingdom and Australia, however the general principles apply to all. The guideline recognises the importance of considering the whole risk profile whilst trying to adhere to a manageable number of SPIs. It does not prescribe which SPIs should be used but how to identify the most important.

Part 1: What are SPIs? SPIs are measurements that reflect the effectiveness of the risk control arrangements. They are used to determine whether (or not) any trends are appearing in safety performance. There are two key types of SPI: As an industry we are experienced in using outcome indicators, but the use of activity indicators is still novel. Activity Outcome A measure of whether a risk control system is in place A measure of events after they have occurred

Part 1: What are SPIs? SPIs are often referred to as leading and lagging but the distinction is not clear and forms more of a continuum. Leading Lagging Activity Drugs and alcohol testing Results (outcome) Tests passed Precursors (outcome) SPADs Accidents (outcome) Train collisions

What are SPIs? The SPI categories can be mapped onto the Swiss cheese accident causation model

Results (outcome) Accident (outcome) Precursors (outcome) What are SPIs? The SPI categories can be mapped onto the Swiss cheese accident causation model Activity

What are SPIs? SPIs can measure different aspects of safety performance: Overall performance Multi-fatality events High residual risks Targeted improvements

The process The process is split into seven key steps, although some iteration is required. Step 1: Assign roles and responsibilities Step 2: Identify key issues Step 3: Select and define outcome indicators Step 4: Select and define activity indicators Step 5: Collect and analyse data Step 6: Report and act on findings

Activity Results (outcome) Precursors (outcome) Accidents (outcome) Leading Lagging Part 1: the process of measuring SPIs The key to identifying SPIs is to home in on the key areas of ‘criticality’ and ‘vulnerability’

The process The key to identifying SPIs is to home in on the key areas of ‘vulnerability’ and ‘criticality’ What are the issues of concern? What are the critical and vulnerable barriers of defence? What does success look like? What do you need to do to ensure success? Activity Results (outcome) Precursors (outcome) Accidents (outcome)

Contents 1. The importance of good SPIs 2. The benefits of an SPI program 3. Overview of the process 4. Pre-requisites for a successful SPI program

Pre-requisites Senior management commitment A clear scope SPI champion Implementation team (4-8 people relevant to the scope) Staff briefing and updates 3-5 half-day workshops (dependent on size of scope) Agreement of new SPIs Collection and analysis of SPI data

ABN: For information regarding an Australian Standard® developed by RISSB, contact: Rail Industry Safety and Standards Board Suite 4, Level 4, Plaza Offices (East) Terminal Complex, Canberra Airport ACT 2609 Australia PO Box 4271 Kingston ACT 2604 T F E For information regarding the sale and distribution of RISSB Standards, contact: SAI Global Limited Phone: Fax: ISBN: Enter ISBN.