Safety / Performance Criteria Agreeing on Assumptions Narrator BEIJING, CHINA; 30 JUN-11 JUL 2014

Objective This module provides an overview of Performance and Safety Criteria as well as Project Assumptions Narrator

Why? Why set performance criteria Measurement Determine success Evaluate safety

Assessment Qualitative Assessment Expert judgement used to assess the design based on ICAO SARPs (Standards and Recommended Practices) and Procedures Quantitative Assessment Quantified results produced in the form of numerical data e.g. capacity increased by 20% Both Qualitative and Quantitative assessment are crucial to safety and performance assessment

Evaluating Safety References: ICAO Doc 9859, AN/474, Safety Management Manual (SMM) ICAO Doc 9689, Manual on Airspace Planning Methodology for the Determination of Separation Minima ICAO Circular 319-AN/181, A Unified Framework for Collision Risk Modelling in Support of the Manual on Airspace Planning Methodology for the Determination of Separation Minima (Doc 9689) ICAO Doc 9613, Performance-Based Navigation Manual ICAO Doc 8168, Procedures for Air Navigation Services, Volume I, Flight Procedures ICAO Doc 9905, RNP AR Procedure Design Manual ICAO Doc 4444, Procedures for Air Navigation Services, Air Traffic Management. direct the participants to ICAO Doc 9689 (Manual on Airspace Planning Methodology for the Determination of Separation Minima), Chap 6, for further information on methods of evaluating safety (Method 1 and Method 2).

SAFETY MANAGEMENT SYSTEM (SMS) Ref: ICAO 9859, 2.2

SAFETY THEORY Various defences are built into the aviation system to protect against fluctuations in human performance or decisions at all levels of the system. Organizational & Structural Pressure defensive layers

SAFETY MANAGEMENT SYSTEM (SMS) Traditional Approach: Data collection and analysis efforts are limited to data collected through investigation of accidents and serious incidents. New Approach: Adds routine collection and analysis of data using proactive as well as reactive methodologies to monitor known safety risks and detect emerging safety issues. These enhancements formulated the rationale for moving towards a safety management approach. Ref: ICAO 9859, 5.1

SAFETY MANAGEMENT SYSTEM (SMS) A SMS is a system to assure the safe operation of aircraft through effective management of safety risk. This system is designed to continuously improve safety by identifying hazards, collecting and analysing data and continuously assessing safety risks. The SMS seeks to proactively contain or mitigate risks before they result in aviation accidents and incidents. Ref: ICAO 9859, 5.1

SAFETY MANAGEMENT SYSTEM (SMS) A SMS is not static but is designed for continuous improvement. a) Develop forms for internal evaluations. b) Define an internal audit process. c) Define an external audit process. d) Define a schedule for evaluation of facilities, equipment, documentation and procedures to be completed through audits and surveys. e) Develop documentation relevant to operational safety assurance. Ref: ICAO 9859

SAFETY MANAGEMENT SYSTEM (SMS) The four components of a SMS are: a) safety policy and objectives; b) safety risk management; c) safety assurance; and d) safety promotion Ref: ICAO 9859, 5.3

Safety Risk Management Ref: ICAO 9859

Safety Management Identify Hazards Evaluate Hazards

Safety Management Mitigate vs Eliminate Hazards

Evaluating Safety Ref: ICAO 9859 direct the participants to ICAO Doc 9689 (Manual on Airspace Planning Methodology for the Determination of Separation Minima), Chap 6, for further information on methods of evaluating safety (Method 1 and Method 2). Ref: ICAO 9859

Risk Assessment Ref: ICAO 9859 direct the participants to ICAO Doc 9689 (Manual on Airspace Planning Methodology for the Determination of Separation Minima), Chap 6, for further information on methods of evaluating safety (Method 1 and Method 2). Ref: ICAO 9859

Risk Management Ref: ICAO 9859 direct the participants to ICAO Doc 9689 (Manual on Airspace Planning Methodology for the Determination of Separation Minima), Chap 6, for further information on methods of evaluating safety (Method 1 and Method 2). Ref: ICAO 9859

ASSUMPTIONS

Assumptions What unnecessary assumptions can you eliminate? Columbus challenged the Spanish courtiers to stand an egg on its end. They tried but failed. He then hard-boiled one and squashed it down. “That’s not fair,” they protested, “you broke the rules.” “Don’t be silly,” he replied, “you just assumed more than you needed to.” What unnecessary assumptions can you eliminate?

Assumptions

Assumptions

Assumptions PBN

A few examples …. Changing a radar Blocked military airspace – that wasn’t Changing planned runway orientation Change to the number of runways available

Questions???