1. ICAO State Safety Programme (SSP) Implementation Course
Module N° 5 –
ALoS related to an SSP
Revision N° 5
ICAO State Safety Programme (SSP) Implementation Course
25/02/10

2. SSP – A structured approach
Module 2
Basic safety management concepts
Module 3
ICAO SARPs related to safety management
Module 4
ICAO SSP framework
Module 5
ALoS related to an SSP
Module 6
Prescription / Performance
Module 8
SSP implementation plan
Module 1 Introduction to the SSP implementation course
Module 7
SSP training programme

3. Objective
At the end of this module, participants will be able to describe the concepts and dimensions underlying the acceptable level of safety (ALoS) related to an SSP
If you manage to survive the 5 or 6 slides you will be ok.

4. Contents
Introductory concepts
Acceptable level of safety (ALoS)
ALoS related to an SSP
Summary
Questions and answers
Points to remember

5. Introductory concepts
The development and implementation of ALoS builds upon certain basic concepts of systems theory
There is a hierarchy underlying the progression of these basic concepts towards the development and implementation of ALoS
Understanding of the concepts and hierarchy is an essential foundation for the development and implementation of ALoS and the SSP
ALoS has not to do much with safety in the traditional sense of safety but has much more relations with safety assurance

6. Introductory concepts – The basic theory
Safety – as defined by Doc 9859
Level of safety – degree of safety of a system, representing the quality of the system, safety-wise, expressed through safety indicators
Safety indicators – parameters that characterize and/or typify the level of safety of the system
Value of safety indicators – quantification of a safety indicator
Safety targets – concrete objectives to be achieved
Value of safety targets – quantification of a safety target
Acceptable level of safety – minimum degree of safety that must be assured by a system in actual practice

7. Introductory concepts – Selection of safety indicators
The selection of appropriate safety indicators is an essential foundation for the development and implementation of ALoS
The selection of safety indicators is a function of the detail to which the level of safety of the system is to be represented
Meaningful safety indicators must be representative of the elements that characterise system safety

8. Introductory concepts – The basic theory: examples
Safety indicators
Fatal airline accidents/serious incidents
Runway excursion events/ground collision events
Development/absence of primary aviation legislation
Development/absence of operating regulations
Level of regulatory compliance …
Safety targets
Reduction in fatal airline accident/serious incidents
Maintain the number in runway excursion events/ground
collision events
Improve the actual level of regulatory compliance

9. Introductory concepts – The basic theory: examples
Value of safety indicators
[Rate/number] Fatal airline accidents per [number] operations
[Rate/number] Runway excursion events per [number] operations
[Rate/number] Ground collision events per [number] operations
[Number] inspections to operators completed [timeframe] ...
Value of safety targets
[Reduce / maintain by / maximum] fatal airline accidents per [number] operations
[Reduce / maintain by / maximum] runway excursion events per [number] operations
[Reduce / maintain by / maximum] ground collision events per [number] operations
[Minimum number] of inspections completed [timeframe]…

10. Introductory concepts – A fundamental differentiation
Safety measurement (strategic)
Generally associated to the SSP
Quantification of outcomes of selected high-level or high-consequence events
Accident rates
Serious incident rates
Quantification of selected high-level State functions
Development/absence of primary aviation legislation
Development/absence of operating regulations
Level of regulatory compliance
A measure of achievement of high-level safety objectives of safety interventions and/or mitigations strategies
How far are we from the

11. Introductory concepts – A fundamental differentiation
Safety performance measurement (tactical)
Generally associated to an SMS
Quantification of the outcomes of selected low-level, low- consequence processes
Number of FOD events per number of ramp operations
Number of ground vehicle events in taxiways per number of airport operations …
A measure of the actual performance of safety interventions and/or mitigation strategies, beyond accident rates and regulatory compliance

12. Introductory concepts – A fundamental differentiation
Safety measurement
Not a continuous process
A spot check
Conducted following pre-specified timeframes
Safety performance measurement
Continuous process
Monitoring and measurement of selected operational activities necessary for the provision of services

13. Basic safety management SARPs
The acceptable level of safety (ALoS) to be achieved shall be established by the State
When establishing ALoS, consideration must be given to
the level of safety risk that applies
the safety risk tolerance
the cost/benefits of improvements to the aviation system
the public expectations in civil aviation system

14. Expressing the ALoS
Values of safety indicators and values of safety targets
Initial ALoS – Quantitative action statements on selected high level/high consequence outcomes (safety measurement)
Mature ALoS – Quantitative action statements on selected high level/high consequence events (safety measurement) and low level/low consequence outcomes (safety performance measurement)

15. Values of safety indicators Values of safety targets
Examples of values of safety indicators and safety targets based on safety measurement
Values of safety indicators
[Number] CFIT and approach & landing accidents per [number] departures
[Number] runway excursions per [number] operations
[Number] ground collision accidents per year on a [x-year] rolling average
[Number] of high-severity events captured through the State MOR yearly
[Number] inspections to operators completed quarterly
[Number] AIS facilities with QMS implemented
Electronic filing of differences completed within [number] months/weeks
Values of safety targets
[Reduce by/maximum] CFIT and approach & landing accidents per [number] departures
[Reduce by/maximum] runway excursions per [number] operations
[Reduce by/maximum] ground collision accidents per year on a [x-year] rolling average
[Minimum number] of high-severity events captured through the State MOR yearly
[Minimum number] inspections to operators completed quarterly
[Number] AIS facilities with QMS implemented by [time]
Electronic filing of differences completed within [revised number] months/weeks

16. ALoS – Mature SSP
In the longer-term, once States develop safety data collection and analysis capabilities under the Safety Assurance component of the SSP, ALoS should reflect a combination of
safety measurement
safety performance measurement

17. Examples of values of safety indicators and targets based on safety performance measurement
[Number] level busts per [number] operations
[Number] Cat B and C runway incursions in 5 international [State] airports per [number] operations
[Number] TCAS/airprox events per [number] operations
[Number] non-conforming approaches (NCA) at 5 international [State] airports per [number] operations
[Number] apron FOD events at 5 international [State] airports per [number] operations
Values of safety targets
[Reduce by/maximum] number of level busts per [number] operations by [date]
[Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports by [date]
[Reduce by/maximum] number of TCAS/airprox events per [number] operations by [date]
[Reduce by/maximum] number of non- conforming approaches (NCA) at 5 international [State] airports by [date]
[Reduce by/maximum] the number of apron FOD events at 5 international [State] airports by [date]

18. Delivering ALoS – Safety action plans
Tools and means to deliver the safety targets of an SSP
Regulations
Training
Technology
Technology
Training
Regulations

19. State Civil Aviation Authority
Today
State Civil Aviation Authority
State Civil Aviation
Authority
Safety measurement
Capture
Storage
Service providers
Airport N° 1
Airport N° 2
Airport N° 3
SMS

20. State Safety Programme
Initial ALoS
State Safety Programme
State Civil Aviation
Authority
Safety measurement
Capture
Storage
Process
Analysis
Service providers
Airport N° 1
Airport N° 2
Airport N° 3
SMS
Initial ALoS

21. State Safety Programme Exchange of protected safety data
Initial ALoS
State Safety Programme
State Civil Aviation
Authority
Protected safety data
Capture
Storage
Process
Analysis
Service providers
Airport N° 1
Airport N° 2
Airport N° 3
SMS
Initial ALoS
Exchange of protected safety data
SDCPS

22. State Safety Programme Exchange of protected safety data
Mature ALoS
State Safety Programme
State Civil Aviation
Authority
Protected safety data
Capture
Storage
Process
Analysis
Service providers
Airport N° 1
Airport N° 2
Airport N° 3
SMS
Exchange of protected safety data
Mature ALoS
SDCPS

23. ALoS – Legal considerations
Establishing ALoS related to an SSP
does not replace legal, regulatory, or other already established requirements, but it must support compliance with them
leaves unaffected the obligations of States, and does not relieve States from compliance with SARPs

24. ALoS – Initial (Safety measurement)
Values of safety targets
[Reduce by/maximum] CFIT and approach and landing accidents per [number] departures
[Minimum number] inspections to operators completed quarterly
...
Action
plans
CFIT training package distributed to industry and supported by training courses
Revision and if necessary update of hiring policy. Inspection manual updated
Values of safety indicators
[Number] CFIT and approach and landing accidents per [number] departures
[Number] inspection to operators completed quarterly
State
Shall comply with all applicable international standards

25. ALoS – Mature (Safety performance measurement)
Values of safety targets
[Reduce by/maximum] Unstabilized approaches (NCA) at 5 international airports per [number] arrivals by [date]
[Reduce by/maximum] Cat B and C runway incursions in 5 international [State] airports per [number] by [date] …
Action
plans
Continuous Descend Operations (CDO) procedures implemented – Arrival procedures charts designed for stabilized approaches
Installation of ASDE/X in 5 international [State] airports ….
Values of safety indicators
[Number] non-conforming approaches (NCA) at 5 international airports [State] per [number] operations
[Number] of Cat B and C runway incursions in 5 international airports [State] per [number] operations
State
Shall comply with all applicable international standards

26. Transition from initial to mature ALoS
Initial ALoS
(Safety measurement)
Quantification of outcomes of selected high-level/high- consequence events
Quantification of selected high-level State functions
State safety assurance
Safety oversight
Safety data collection, analysis and exchange
Safety data driven targeting of oversight on areas of greater concern or need
Mature ALoS
(Safety measurement and safety performance measurement)
Quantification of outcomes of selected high-level/high-consequence events
Quantification of selected high-level State functions
Quantification of outcomes of selected low-level/low-consequence events
Timeline

27. STATE Summary SSP (ALoS) Set of activities SMS
ATS Service
provider
Aerodrome
operator
AMO
Aircraft
operator N° 1
SSP
(ALoS)
operator N° 2
Training
organization
SMS
State accepts and oversees individual service providers’ SMS
Safety performance
State agrees and supervises individual service provider’s SMS safety performance

28. ALoS related to an SSP
Questions and answers

29. Questions and answers
Q: Explain the fundamental differentiation between safety measurement and safety performance measurement?
A: ?
Slide number:

30. Questions and answers
Q: What are the tools and means to deliver the safety targets of an SSP?
A: ?
Slide number:

31. Points to remember
The basic systems safety theory
Safety measurement and safety performance measurement
Initial and mature ALoS
ALoS does not replace legal, regulatory, or other already established requirements

32. Module N° 5
ALoS related to an SSP