1. ABN: 58 105 001 465 Measuring Safety Performance Senior Managers’ Briefing

2. Contents 1. The importance of good SPIs 2. The benefits of an SPI program 3. Overview of the process 4. Pre-requisites for a successful SPI program

3. The importance of good SPIs March 2005 Texas City: 15 Fatalities 170 Injuries $60 billion damage August 2005 CSB issues an urgent safety recommendation. An independent panel to assess safety culture and oversight at all BP was convened The findings were published in the Baker Report in 2007

4. The importance of good SPIs The Baker Report made several findings and a recommendation regarding the use of SPIs: BP erroneously inferred positive results for personal safety to indicate good process safety At Texas City, personal accident rates were decreasing while process incidents were increasing Rec 7: develop, implement, maintain, and review an integrated set of leading and lagging indicators for process safety

5. The importance of good SPIs Railway companies use SPIs to monitor safety performance. Traditionally, the rail industry has relied heavily on failure and incident data to monitor safety performance. This means that changes can only be made after something has gone wrong. Proactive measures provide the opportunity to take action before things go wrong. The same SPIs may be used year on year without challenge. Assurance that the most appropriate SPIs are being monitored maybe lacking. Good SPIs will measure both activities and outcomes. Good SPIs will match the current key concerns of the business.

6. Contents 1. The importance of good SPIs 2. The benefits of an SPI program 3. Overview of the process 4. Pre-requisites for a successful SPI program

7. Part 1: Why use SPIs? Implementing an SPI program can provide several benefits to an organisation, they: Help manage and reduce risk Provide assurance on safety performance Reinforce a positive safety culture Complement (rather than replace) other safety tools and processes Facilitate learning from others Enhance efficiency

8. Contents 1. The importance of good SPIs 2. The benefits of an SPI program 3. Overview of the process 4. Pre-requisites for a successful SPI program

9. The guideline document The guideline document explains the SPI basics and describes a process for developing and managing SPIs. Development of the guideline has involved RTOs in the United Kingdom and Australia, however the general principles apply to all. The guideline recognises the importance of considering the whole risk profile whilst trying to adhere to a manageable number of SPIs. It does not prescribe which SPIs should be used but how to identify the most important.

10. Part 1: What are SPIs? SPIs are measurements that reflect the effectiveness of the risk control arrangements. They are used to determine whether (or not) any trends are appearing in safety performance. There are two key types of SPI: As an industry we are experienced in using outcome indicators, but the use of activity indicators is still novel. Activity Outcome A measure of whether a risk control system is in place A measure of events after they have occurred

11. Part 1: What are SPIs? SPIs are often referred to as leading and lagging but the distinction is not clear and forms more of a continuum. Leading Lagging Activity Drugs and alcohol testing Results (outcome) Tests passed Precursors (outcome) SPADs Accidents (outcome) Train collisions

12. What are SPIs? The SPI categories can be mapped onto the Swiss cheese accident causation model

13. Results (outcome) Accident (outcome) Precursors (outcome) What are SPIs? The SPI categories can be mapped onto the Swiss cheese accident causation model Activity

14. What are SPIs? SPIs can measure different aspects of safety performance: Overall performance Multi-fatality events High residual risks Targeted improvements

15. The process The process is split into seven key steps, although some iteration is required. Step 1: Assign roles and responsibilities Step 2: Identify key issues Step 3: Select and define outcome indicators Step 4: Select and define activity indicators Step 5: Collect and analyse data Step 6: Report and act on findings

16. Activity Results (outcome) Precursors (outcome) Accidents (outcome) Leading Lagging Part 1: the process of measuring SPIs The key to identifying SPIs is to home in on the key areas of ‘criticality’ and ‘vulnerability’

17. The process The key to identifying SPIs is to home in on the key areas of ‘vulnerability’ and ‘criticality’ What are the issues of concern? What are the critical and vulnerable barriers of defence? What does success look like? What do you need to do to ensure success? Activity Results (outcome) Precursors (outcome) Accidents (outcome)

18. Contents 1. The importance of good SPIs 2. The benefits of an SPI program 3. Overview of the process 4. Pre-requisites for a successful SPI program

19. Pre-requisites Senior management commitment A clear scope SPI champion Implementation team (4-8 people relevant to the scope) Staff briefing and updates 3-5 half-day workshops (dependent on size of scope) Agreement of new SPIs Collection and analysis of SPI data

20. ABN: 58 105 001 465 For information regarding an Australian Standard® developed by RISSB, contact: Rail Industry Safety and Standards Board Suite 4, Level 4, Plaza Offices (East) Terminal Complex, Canberra Airport ACT 2609 Australia PO Box 4271 Kingston ACT 2604 T +61 6270 4523 F +61 6270 4516 E rissb@rissb.com.au For information regarding the sale and distribution of RISSB Standards, contact: SAI Global Limited Phone: 13 12 42 Fax: 1300 65 49 49 Email: sales@saiglobal.com http://infostore.saiglobal.com/store ISBN: Enter ISBN.