1 Mexico Regional AMDAR Workshop November 2011 Data Quality Monitoring and Control (QM / QC) Axel Hoff Convenor of WMO AMDAR Panel‘s Science and Technical Sub-Group Deutscher Wetterdienst (DWD) German Meteorological Service Division: Measurement Technology, TI 22 Frankfurter Strasse Offenbach am Main Germany

2 Mexico Regional AMDAR Workshop November 2011 Which features of the AMDAR data have to be monitored and controlled ? – Quality Data transmission (format, validity,...) Physical features (bias, RMSE,...) – Amount Statistics about frequency in space and time Targeting, optimisation – Timeliness Transmission delays

3 Mexico Regional AMDAR Workshop November 2011 Interested Party ParameterAirlinesAMDAR ATM__ Navigation Data  Position (Precision) ± 30 m XX  Groundspeed Vector ± 2 m/s X  True Heading (Precision) ± 0.1 ° X Air Data  Primary Air Data -Static Pressure ± 1 hPa XX -Total Pressure ± 1 hPa X -Temperature ± 1 K XX -Humidity ± 1 % RHin future ? X  Secondary Air Data -True Airspeed ± 2 m/s X -Wind vector ± 2.5 m/s XX What are the quality requirements ? RVSM AMDAR is the freeloader of the air traffic’s requests

4 Mexico Regional AMDAR Workshop November 2011 What does AMDAR’s Quality Management consist of ? – Real-Time Quality Control At the measurement stage on board At the code conversion for GTS At the assimilation stage for numerical forecast – Quality Evaluation for long-term behaviour Systematic biases Trends and drift effects

5 Mexico Regional AMDAR Workshop November 2011 AMDAR Data Management

6 Mexico Regional AMDAR Workshop November 2011 Observing Platform (Aircraft) –Data sampling –Online calculation of the final parameters –Basic QC (plausibility checks) –Transmission to ground Where do we find QM / QC in AMDAR ?

7 Mexico Regional AMDAR Workshop November 2011 Communication Service Provider (e.g. ARINC or SITA) –Relay observations to ground network (downlink) (airline or Data Reception and Switching Centre) –Transmit uplink commands to aircraft Where do we find QM / QC in AMDAR ?

8 Mexico Regional AMDAR Workshop November 2011 Data Reception and Switching Centre (DRSC) –Real-time QC –Passing the data via GTS to all participating institutions –Reporting to System Manager and QEv Centre Where do we find QM / QC in AMDAR ?

9 Mexico Regional AMDAR Workshop November 2011 Real-Time QC: –Check for transmission errors –Check for duplicates –Range check Values to be within plausible limits –Position and time check in time series from single aircraft –Check against reject list of QEv Centre

10 Mexico Regional AMDAR Workshop November 2011 Data Assimilation and Numerical Modelling Centre –Assimilation of the AMDAR data –Identify outliers, sensor biases, RMS errors by checking against the model’s “first guess” fields Where do we find QM / QC in AMDAR ?

11 Mexico Regional AMDAR Workshop November 2011 Quality Evaluation Centre –Near-real-time checks –Update reject lists –Reporting to System Manager and/or DRSC Where do we find QM / QC in AMDAR ?

12 Mexico Regional AMDAR Workshop November 2011 Near-Real-Time Check: –If not already done in real-time checks Transmission errors Duplicates Range (values to be within plausible limits) Consistency in position and time in time series from single aircraft –Timeliness –Identify observing platforms appearing with biases, drifts, scattering phenomena

13 Mexico Regional AMDAR Workshop November 2011 System Manager –Manage programme (incl. status reports, etc.) –Manage data optimization and targeting –Initiate QC actions (notify airline of bad data) –Coordination with other AMDAR programmes in the neighbourhood and worldwide Where do we find QM / QC in AMDAR ?

14 Mexico Regional AMDAR Workshop November 2011 Airlines –Implement and operate AMDAR functionality modules (on-board software, humidity sensor, ground software) –Support up-link control for external commands –Forward measurement data reports to DRSC –System repair on aircraft reporting erroneous data Where do we find QM / QC in AMDAR ?

15 Mexico Regional AMDAR Workshop November 2011 External AMDAR Programme –Insert data on GTS –Disseminate QM reports and statistics Where do we find QM / QC in AMDAR ?

16 Mexico Regional AMDAR Workshop November 2011 Monitoring Centres –Publish quality statistics –Provide regular platform reject lists Where do we find QM / QC in AMDAR ?

17 Mexico Regional AMDAR Workshop November 2011 AMDAR Panel Technical Coordinator –Coordinate AMDAR management and development within WMO AMDAR Panel –Coordinate quality reporting activity Where do we find QM / QC in AMDAR ?

18 Mexico Regional AMDAR Workshop November 2011 Data Archiving Centre –Access all AMDAR GTS data from the DRSC –Eliminate duplicates –Flag data having quality deficits –Archive data in databases –Publish data catalogues Where do we find QM / QC in AMDAR ?

19 Mexico Regional AMDAR Workshop November 2011 QC Forum –Provide network for interchange and discussion of data management issues, problems, reports, actions, and initiatives Where do we find QM / QC in AMDAR ?

20 Mexico Regional AMDAR Workshop November 2011 Exemplary Results from NOAA Observations compared to GSI background (num. model)

21 Mexico Regional AMDAR Workshop November 2011 Exemplary Results from NOAA Observations compared to GSI background (num. model)

22 Mexico Regional AMDAR Workshop November 2011 amounts and timeliness, daily trend timeliness, distribution for all E-AMDAR aircraft Exemplary Results from E-AMDAR Amounts and Timeliness

23 Mexico Regional AMDAR Workshop November 2011 Exemplary Results from E-AMDAR Observation minus first guess of HIRLAM distribution for all E-AMDAR aircraft Daily trend Temperature Bias

24 Mexico Regional AMDAR Workshop November 2011 Exemplary Results from E-AMDAR Mean daily biases in temperature and wind

25 Mexico Regional AMDAR Workshop November 2011 Exemplary Results from DWD Profiles of bias and RMSE in temperature and humidity

26 Mexico Regional AMDAR Workshop November 2011 Exemplary Results from E-AMDAR Identification of outlying aircraft and single events

27 Mexico Regional AMDAR Workshop November 2011 AMDAR’s quality control gives vital feedback for both –Meteorological Services to sort out erroneous data sources learn for assimilation strategies –Airlines to identify aircraft with problems in pressure measurement (  altitude’s accuracy) temperature measurement (  engines) true airspeed / wind (  range calculation)

28 Mexico Regional AMDAR Workshop November 2011 Questions ?