1. 5th INTERNATIONAL CONFERENCE Nicosia 15-16 May 2014 Safety performance measurement in Air Navigation Services

2. FSF - 15-16 May 2014 – SAF PERF in ANS Would YOU fly if you thought your life was in clear and imminent danger ? Why do we need to measure safety performance ? Safety in aviation is a business need, as much as it is an ideal…

3. FSF - 15-16 May 2014 – SAF PERF in ANS Why do we need to measure safety performance ? SAFETY Regulations Social pressure Business / customers´ pressure Political pressure

4. FSF - 15-16 May 2014 – SAF PERF in ANS Why do we need to measure safety performance ? Global Annual Air Traffic Growth rate: apprx. 5% (2000 – 2015, Source: ICAO) The main purpose of Air Traffic Management (ATM) is to ensure that airplanes depart, fly and land safely, while maintaining the most efficient operational and economic conditions.

5. FSF - 15-16 May 2014 – SAF PERF in ANS European approach to safety performance …Airspace without borders… …Based on operational needs… …cost efficient… …more safe…

6. FSF - 15-16 May 2014 – SAF PERF in ANS European approach to safety performance SES regulates the performance of ANS: Focus is on four domains: Improving safety levels Minimising the impact on environment, Impoving capacity levels, and Improving cost efficiency

7. FSF - 15-16 May 2014 – SAF PERF in ANS Improvements in capacity and safety are usually associated with additional investments… The European Commission acknowledges the interrelation (included in the preample of the regulations) Capacity Safety Costs States try to strike the right balance… ANS performance – Trade offs

8. FSF - 15-16 May 2014 – SAF PERF in ANS How do we measure ANS performance ? Definition of Key Performance Areas (KPAs) Definition of Key Performance indicators (KPIs) Definition of pan-european targets associated with the KPIs Requirement to produce FAB Performance Plans Adoption of the binding targets by Member States and acceptance by EC Requirement to reconcile the FAB targets with the pan-European targets Introduction of reference periods to assess and review results Setting up of alert thresholds and Sanctions if targets are not met

9. FSF - 15-16 May 2014 – SAF PERF in ANS 9 Key Performance Area(s) (KPAs) Key Performance Area(s) (KPAs) Key Performance Indicator(s) (KPIs) Key Performance Indicator(s) (KPIs) Key Performance Targets (measurable !) Key Performance Targets (measurable !) e.g. capacity, cost e.g. delay (mins per flt), unit rate e.g. 1 min, 40 Euros How do we measure ANS performance ?

10. FSF - 15-16 May 2014 – SAF PERF in ANS 1. KPI 1: the effectiveness of safety management as measured by a methodology based on the ATM Safety Maturity Survey Framework. 2.KPI 2: the percentage of application of the severity classification of Risk Analysis Tool (to allow harmonised reporting of severity assessment of Separation Minima Infringements, Runway Incursions and ATM Specific Technical Events). 3.KPI 3: level of the just culture How do we measure ANS performance ?

11. FSF - 15-16 May 2014 – SAF PERF in ANS Additional Performance Indicators (at the moment for monitoring only) How do we measure ANS performance ? Application of automatic data recording for separation minima infringement monitoring Application of automatic data recording for runway incursion monitoring ATM Occurrence Reports – Reporting level The number of separation Minima Infringements The number of Runway Incursions The number of Airspace Infringements

12. FSF - 15-16 May 2014 – SAF PERF in ANS 12 We measure how well we are managing safety… In short… ANS performance – What/How We measure what is actually happening…

13. FSF - 15-16 May 2014 – SAF PERF in ANS 13 DCAC has developed documented process on how and when this is done… ANS performance – What/How …Identified trends lead to corrective measures… …e.g. better management of changes, more elaborate competency checks, awareness activities to airspace users, better coordination with military…

14. FSF - 15-16 May 2014 – SAF PERF in ANS 14 ANS performance – What/How ANS performance now has to be measured also at regional level... Functional Airspace Blocks need to develop processes on how to do this......remains to be seen if safety issues can be resolved through international coopertion...

15. FSF - 15-16 May 2014 – SAF PERF in ANS ANS Safety Performance – Synergies What about other aviation domains ? Airports ? Airlines ?

16. FSF - 15-16 May 2014 – SAF PERF in ANS ANS Safety Performance – Synergies Regulations do not define mandatory KPIs or targets for other domains Airports : (EU) Regulation 139/2014 published on 12/2/2014 …contains essential requirements for aerodromes, including safety management

17. FSF - 15-16 May 2014 – SAF PERF in ANS ANS Safety Performance – Synergies Airports : (EU) Regulation 139/2014 published on 12/2/2014 ADR.OR.D.005 Management system (a) The aerodrome operator shall implement and maintain a management system integrating a safety management system. (b) The management system shall include: (..)……………………… (5) the means to verify the safety performance of the aerodrome operator’s organisation in reference to the safety performance indicators and safety performance targets of the safety management system… Examples of aerodrome Safety KPIs: 1.Events of unauthorized vehicles on the taxiways per 10,000 operations. 2.FOD events on the apron per 10,000 operations.

18. FSF - 15-16 May 2014 – SAF PERF in ANS ANS Safety Performance – Synergies ANS Aerodromes Cooperation ESSENTIAL ! 1.ATS provider Aerodrome Operator What are the right things to monitor ? Can data (monitoring results) be exchanged? 1.ATS provider Aerodrome Operator What are the right things to monitor ? Can data (monitoring results) be exchanged? 2. ATS oversight Aerodrome Oversight Can performance monitoring processes be harmonised ? Can the relevant sections share resources (expertise) ? Is there need for additional regulation / guidance to operators ? 2. ATS oversight Aerodrome Oversight Can performance monitoring processes be harmonised ? Can the relevant sections share resources (expertise) ? Is there need for additional regulation / guidance to operators ?

19. FSF - 15-16 May 2014 – SAF PERF in ANS ANS Safety Performance – Synergies What about other aviation domains ? Should mandatory safety performance targets be set or harmonised accross all the aviation domains ?

20. FSF - 15-16 May 2014 – SAF PERF in ANS Thank you… Petros Stratis Department of Civil Aviation of Cyprus - NSA BLUE MED FAB Safety WG Leader pstratis@dca.mcw.gov.cy