Background of the Trial Back in 2012 …  Aviation Community debate on rwy condition assessment  Need for update of national rules on rwy condition assessment (request coming from airport operators)  Ongoing amendment of ICAO Annexes 14 and 15  Publication of ICAO Circular Assessment, Measurement and Reporting of Runway Surface Condition  Preliminary outcomes from TALPA ARC work 2 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

ENAC’s Commitment In order to address the rwy condition assessment issue, in 2012 ENAC Airport & Air Space Regulation Department undertook the amendment of  National Regulation on Aerodrome Design and Operation in order to keep pace with Annex14 and  ENAC Circular APT10 in order to provide guidance on rwy condition assessment, and launched a Trial to evaluate the possibility of assessing runway surface conditions by using the TALPA ARC Matrix. 3 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Why use TALPA ARC Matrix Adopting the ESF concept for the purpose of rwy condition reporting - in lieu of direct reporting of Mu values and braking actions - immediately raised a question: how to assess ESF ? In this respect the Matrix seemed to provide a valuable tool: the Rwy Condition Code (RCC) - based upon all the information available - seemed to translate into practice the Estimated Surface Friction concept (ICAO Circular 329). Moreover, the RCC scale appeared comparable to the ESF coding 4 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Scope of the Trial  To evaluate the suitability and usability of TALPA ARC Matrix as a tool helping operators assess runway conditions  To check the level of consistency of assessments carried out by ground staff, crosschecking them against Braking Action PIREPs  To develop a practical and reliable methodology for assessing the Estimated Surface Friction 5 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Organizations involved in the Trial The Trial was carried out thanks to the cooperation of those Stakeholders who - on a voluntary basis - accepted ENAC’s invitation to participate: Airport Operators Air Operators ANSP (ENAV) Airport Operators Air Operators ANSP (ENAV) 6 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Trial time-frame The Trial was started in 2012 as 1-year project; after its 1 st year, thanks to positive feedback from aerodrome operators, it was continued year after year and it is still ongoing. 2012/13 - Trial Report published on ENAC websiteTrial Report published on ENAC website 2013/14 - No data available (3 days of snowfall) 2014/15 - Data collected, to be published 2015/16 - Still ongoing, no data collected so far 7 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Participating Airports  Bergamo (LIME)  Bologna (LIPE)  Rome Fiumicino (LIRF)  Milan Malpensa (LIMC)  Milan Linate (LIML)  Turin (LIMF)  Treviso (LIPH)  Venice (LIPZ)  Verona (LIPX)          8 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Aerodrome Operator’s responsibilities For the purposes of the trial, Aerodrome Operators were required to assess* rwy condition by means of TALPA Matrix,  surveying the percentage of rwy covered by contamination, the type and depth of contaminant (each rwy third) and the OAT,  measuring the friction coefficient by means of CFMEs and  collecting Braking Action Reports from ATS in order to determine the initial Rwy Condition Code (RCC), consider downgrading and assign the final RCC. (All data to be submitted to ENAC using the relevant forms). * Assessment to be repeated every 30’ and in case of significant changes of wheater conditions Aerodrome Operator’s responsibilities For the purposes of the trial, Aerodrome Operators were required to assess* rwy condition by means of TALPA Matrix,  surveying the percentage of rwy covered by contamination, the type and depth of contaminant (each rwy third) and the OAT,  measuring the friction coefficient by means of CFMEs and  collecting Braking Action Reports from ATS in order to determine the initial Rwy Condition Code (RCC), consider downgrading and assign the final RCC. (All data to be submitted to ENAC using the relevant forms). * Assessment to be repeated every 30’ and in case of significant changes of wheater conditions 9 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Role of ATS Providers The ATS Provider was required to provide Aerodrome Operators with all the available PIREPs of Braking Action (BA), in order to allow for downgrade of preliminary RCC, if necessary (reports within 30’ before the ground staff’s survey*) subsequent crosscheck of final RCC (reports within 60’ after the ground staff’s survey*) * provided that contamination and weather conditions had not significantly changed 10 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Role of Air Operators During the 1st year, 2 air operators (the most representative airlines in the major airports) participated directly in the trial. They were required to provide as many PIREPs as possible in order to enable Airports to downgrade/crosscheck RCCs; the number of reports directly provided was relatively small. It was therefore decided to let Airports put in place their own strategies to encourage reporting (e.g.: Notams, Safety Committees, etc.) and collect reports through ATS. 11 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Preliminary activities  Issuance of ENAC Notice /12, launching the trial and providing guidance on the assessment methodology  Drafting of Forms to be used for the purpose of trial  Arrangement of Meetings with the Operators  Stakeholders’ Conferences  Issuance of specific Notams to inform pilots about the ongoing trial (Aerodrome Operators) 12 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial S

Documents and forms provided 1 - TALPA ARC Matrix and Recommendations * 2 - Rwy Condition Report - RCR (RCC Assessment Form) 3 - Istructions for filling in the Runway Condition Report 4 - Synoptic Table (for RCC / BA recording purposes) 5 - Pilot Braking Action Survey Form (first year only) 6 - ENAC Circular APT-10 (draft) * Aerodrome Operators were provided with the final version of the Matrix; however, the “upgrade” option was not taken into account. 13 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Rwy Condition Report Form 8. Date9. Time 1. Airport id 2. Runway 3. Runway third 4. Friction coefficient 5. Braking Action 6. Corrected RCC 7. Remarks field 14 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial 10. OAT 12. Active precipit. 11. Report n.

Synoptic Table 1. Ref. to RCR 2. Date (dd/md/yy) 3. Rwy (e.g.: 36) 4. Corrected RCC 5. BA Reports following RCC TIME (hh:mm) A B C AIRCRAFT TYPE 5a. BA / Rwy Thirds 15 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Data collection and analysis All data collected by Aerodrome Operators were submitted to ENAC for further analysis at the end of each winter season.  Preliminary check of data was carried out, in order to discard  incomplete Reports and  reports containing mistakes or inconsistent RCCs  Detailed analysis was then performed, consisting in  crosschecking RCCs against the corresponding BA Reports*  statistical analysis of collected data * RCCs having one or more corresponding braking actions only 16 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Metodological remarks In order to check the reliability of the proposed method, each Rwy Condition Code assigned (rwy third) was crosschecked against the subsequent Braking Action (BA) Reports, if any. BA Reports were considered suitable for RCC crosscheck if collected within 1 hour after assignation of RCC, provided that weather conditions and contamination had not changed. RCCs assigned for the purposes of trial were not disseminated. 17 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

The evaluation was based on the following considerations: RCC = BA Reports - ground staff’s assessment matched PIREPs (e.g.: 3 - Medium) RCC < BA Reports - ground staff’s assessment was underestimated as compared to BA Reports RCC > BA Reports - ground staff’s assessment was overestimated as compared to BA Reports RCCs having no corresponding Braking Action Report were not taken into account for the purpose of this analysis. RCCBAR 6DRY 5G 4G/M 3M 2M/P 1P 0NIL 18 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Winter Season 2012/13 - Example 1: Malpensa Airport (LIMC) Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial Total snowfall days 15 Number of RCCs assigned 116 Number of BA reports suitable for crosscheck 29 RCCs crosschecked against at least 1 BA Report 22

Winter Season 2012/13 - Example 2: Bologna Airport (LIPE) 20 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial Total snowfall days 7 Number of RCCs assigned 29 Number of BA reports suitable for crosscheck 46 RCCs crosschecked against at least 1 BA Report 20

21 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial W.S. 2012/13 - Crosscheck of RCC against BA (All Airports) Number of reporting Airports 5/7 Number of RCCs assigned 195 Number of BA reports suitable for crosscheck 109 RCCs crosschecked against at least 1 BA Report 66

RCC crosscheck: Data Summary (W.S. 2012/13)  76,56% of RCCs matching Braking Action Reports or slightly underestimated (1 grade)  7,54% of RCCs significantly underestimated (lower than expected) in comparison to Braking Action Reports  7,95% of RCCs slightly overestimated (higher than expected) in comparison to Braking Action Reports  7,95% of RCCs significantly overestimated (higher than expected) in comparison to Braking Action Reports 22 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

23 W.S. 2014/15 - Crosscheck of RCC against BA - All Airports (provisional data) 23 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial Number of reporting Airports 4/8 Number of RCCs assigned 77 Number of BA reports suitable for crosscheck 81/136 RCCs crosschecked against at least 1 BA Report 44/77

Conclusions  Application of the method - assessments were carried out in line with the proposed methodology with very few (initial) exceptions regarding the downgrade mechanism.  Usability of the Matrix - positive feedback was obtained from aerodrome operators; some issues about snow depth measurement and about somehow conservative results.  Consistency of assessments - encouraging results were obtained from RCC crosscheck against Braking Actions, but further work is needed due to limited amount of data collected. 24 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Approach to downgrade mechanism  Downgrade mainly based on BA Reports and less on CFME measurements  Simultaneous use of multiple d/g criteria rarely observed  Very limited use of RCC downgrade in case of temperatures near/above freezing  Different approach to downgrade observed Downgraded RCCs proved more reliable especially when downgrade was based on multiple criteria 25 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Downgrade based on temperatures near/above freezing The choice not to downgrade RCC in case of temperatures near/above freezing might have determined - under certain circumstances - a slight overestimation of rwy conditions. On the other hand, where RCCs were systematically downgraded in presence of temperatures near or above freezing, assessments have proven slightly conservative. 26 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Potential consequences arising from overestimation of RCC It can be assumed that: - a slight overestimation of RCC should not raise particular issues, provided that extent, type and depth of contaminant have been disseminated to aircrews, - a significant overestimation of RCC (> 1) might result in misleading information to pilots increasing the risk of runway excursions 27 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Potential consequences arising from underestimate of RCC An underestimation of RCC in comparison to the actual rwy condition (on the side of safety) should not raise safety issues; however  while a slight underestimation of RCC can be still considered acceptable under an operational point of view  a significant underestimation of RCC could be extremely penalizing under an operational point of view, potentially leading to traffic disruption or runway closure. 28 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Final considerations Though useful for helping aerodrome operators understand and practise the new assessment methodology, the trial should be regarded as the first stage of a wider project. In fact the amount of data collected is too limited, under a statistical point of view, to enable a validation, because of:  small number of airports involved  small number of braking action reports provided  lack of significant weather / contamination conditions 29 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial

Future developments  Need for further experimentation on TALPA ARC Matrix  Need for data sharing between Authorities  Ongoing research on Runway Surface Condition Sensors  Upcoming amendments to ICAO Annex 14 and PANS- Aerodromes relating to the use of an enhanced global reporting format - ICAO State Letter AN 4/ /30 30 Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016 ENAC Runway Surface Condition Assessment Trial For further information visit ENAC website (see Information Notice NI 2014_008 and Trial Report 2012/13)Information Notice NI 2014_008Trial Report 2012/13)

ENAC Runway Surface Condition Assessment Trial Symposium on "Assessment and Reporting of Runway Surface Conditions” - DGAC - Paris, 31 March -1 April 2016