Session C1.3 NWP BASED MONITORING CAPABILTIES – EUMETNET 2 nd WIGOS Workshop on Data Quality Monitoring and Incident Management Geneva, Switzerland, 15 th - 17 th December 2014 EUMETNET QM and Operations Manager Tanja Kleinert

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Content Background information on EUMETNET Observations Programme EUCOS Quality Monitoring –Quality Monitoring Portals –Quarterly QM Reports –Fault reporting –Monitoring migration to BUFR Benefits for EUMETNET Members Lessons learnt

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Content Background information on EUMETNET Observations Programme EUCOS Quality Monitoring –Quality Monitoring Portals –Quarterly QM Reports –Fault reporting –Monitoring migration to BUFR Benefits for EUMETNET Members Lessons learnt

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Austria Belgium Croatia Cyprus Czech Rep. Denmark Estonia Finland France Germany Greece Hungary Iceland Ireland Italy 31 EUMETNET Members The National Met Services of: Latvia Luxemburg Montenegro Netherlands Malta Norway Poland Portugal Slovakia Serbia Slovenia Spain Sweden The FYROM Switzerland United Kingdom

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Observations Programme Management Tasks: Coordinating the evolution of the ground based EUMETNET Composite Observing System (EUCOS), Monitoring the EUCOS performance, Supporting Members’ observation activities where possible and Organising a studies programme. Observations PROGRAMME E-AMDAR E-ASAP E-GVAP E-PROFILE Territorial Segment (upper air and SYNOP stations) Quality Monitoring Studies Programme Possible future activities e.g. observation targeting Programme Components Fully integrated programmes Collaborative components Managed by Obs PMT Evolving needs E-SURFMAR OPERA

GIE/EIG EUMETNET, Registered Number RPM Bruxelles EUCOS area (10N-90N, 70W-40E)

GIE/EIG EUMETNET, Registered Number RPM Bruxelles The current EUCOS networks 92 selected European radiosonde stations 305 selected European synoptic weather stations All AMDAR measurements from European commercial aircraft (daily appr. 700 aircraft) All European ships of the Automated Shipboard Aerological Programme (currently 18 ASAP ships) 4 selected moored buoys and all European drifting buoys, all European Voluntary Observing Ships 29 selected European wind profilers and 119 weather radars delivering vertical wind profiles 139 selected European weather radars (OPERA) Selected European GNSS sites/ Analysing Centres

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Content Background information on EUMETNET Observations Programme EUCOS Quality Monitoring –Quality Monitoring Portals –Quarterly QM Reports –Fault reporting –Monitoring migration to BUFR Benefits for EUMETNET Members Lessons learnt

GIE/EIG EUMETNET, Registered Number RPM Bruxelles EUCOS Quality Monitoring One of the major tasks of the EUCOS Programme Management Team is to monitor the observations of all EUCOS networks regarding the agreed performance standards; EUCOS has set up a web based EUCOS Quality Monitoring Portal (QMP) for all EUCOS networks as well as a WMO QMP for RBSN surface land stations and radiosonde stations of RA VI and GCOS stations globally;

GIE/EIG EUMETNET, Registered Number RPM Bruxelles WMO Quality Monitoring Portal Offers selection of RA VI or GCOS network monitoring (new) –RA VI = RBSN surface land stations (883) and radiosonde stations (141) in RA VI Europe –GCOS = GSN surface land stations (955) and GUAN radiosonde stations (166) worldwide Station lists are uploaded to the portal rather than collecting all available data  chance to identify silent stations Selection of a particular country New: Selection of either TAC or BUFR data monitoring

GIE/EIG EUMETNET, Registered Number RPM Bruxelles The EUCOS/WMO QMP Provides quality monitoring information for several stations or a particular station on the basis of observations archived in DWD’s database: –on observation totals/data availability and –Timeliness –Achieving geopotential heights 100/50 hPa (radiosonde stations/ASAP) The statistics are provided as tables on a daily and monthly basis; storage of the information for 12 months; Color-coding if agreed EUCOS targets are exceeded (deactivated for WMO QMP). Providing monthly observation totals and average timeliness and percentage achieving EUCOS targets (only EUCOS QMP)

GIE/EIG EUMETNET, Registered Number RPM Bruxelles The EUCOS/WMO QMP

GIE/EIG EUMETNET, Registered Number RPM Bruxelles The EUCOS/WMO QMP Provides accuracy monitoring information for particular stations on the basis of obs minus background of ECMWFs´ first guess Parameters depending on the network (temperature, wind, humidity, pressure,…) The statistics are provided as tables/time-series plots on a daily and monthly basis; Storage of the information for 12 months. Color-coding if agreed EUCOS targets are exceeded.

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Radiosonde (and ASAP units in EUCOS QMP) Additional information for radiosonde stations in TAC and BUFR, e.g. 5-days statistics on availability of TEMP parts and achieved burst heights BUFR FM35

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Radiosonde (and ASAP units in EUCOS QMP) Additional information for radiosonde stations in TAC and BUFR, e.g. Weekly statistics of radiosonde ascents displaying sounding plots

GIE/EIG EUMETNET, Registered Number RPM Bruxelles EUCOS QMP: Radiosonde and ASAP units Additional information for radiosonde stations in TAC and BUFR, e.g. Station or routing maps E-ASAP routes 01/01/15 till 14/12/15 (BUFR data) Radiosonde station map 14/12/15 displaying data availability and timeliness of latest soundings

GIE/EIG EUMETNET, Registered Number RPM Bruxelles E-AMDAR Portal AMDAR coverage maps Raw data information (for E-AMDAR Team only) profile data (list of airports and profiles diagrams) Observation totals per airline and aircraft type Accuracy monitoring on the basis of ECMWF model outputs

GIE/EIG EUMETNET, Registered Number RPM Bruxelles E-AMDAR Portal Since summer 2015 monitoring of AMDAR humidity data End of November 2015: 8 aircraft equipped with WVSS-II

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Content Background information on EUMETNET Observations Programme EUCOS Quality Monitoring –Quality Monitoring Portals –Quarterly QM Reports –Fault reporting –Monitoring migration to BUFR Benefits for EUMETNET Members Lessons learnt

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Monitoring: EUCOS network performance Q3 2015

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Monitoring: EUCOS network performance Q3 2015

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Monitoring: EUCOS network performance Q3 2015

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Quarterly QM Reports Per network a summary table of all countries with national data availability, timeliness and accuracy figures are presented Color coded whether EUCOS targets have been achieved or not

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Quarterly QM Reports Table with national data availability, timeliness and accuracy figures Highlighting Ongoing issues Problems resolved New issues

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Content Background information on EUMETNET Observations Programme EUCOS Quality Monitoring –Quality Monitoring Portals –Quarterly QM Reports –Fault reporting –Monitoring migration to BUFR Benefits for EUMETNET Members Lessons learnt

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Fault reporting Obs PMT contacts NMHSes or Operational Service Managers in case of missing or erroneous data (on the basis of EUCOS QMP) via Fault reports are raised either via or Word document

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Fault reporting Raised fault reports, status update, closure of faults are documented in a fault log chaser (EUMETNET Portal) Not all Members answer to these s Automated fault reporting is envisaged for the future

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Content Background information on EUMETNET Observations Programme EUCOS Quality Monitoring –Quality Monitoring Portals –Quarterly QM Reports –Fault reporting –Monitoring migration to BUFR Benefits for EUMETNET Members Lessons learnt

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Monitoring Migration to BUFR Obs PMT monitors the migration to BUFR since years Within the EUCOS networks the migration to BUFR is completed for E-AMDAR, E-ASAP, E-PROFILE, E-SURFMAR drifting and moored buoys Still in progress: surface land station network (3 EUCOS stations still producing FM12 only), upper-air network (4 EUCOS radiosonde still producing FM35 only), E-SURFMAR VOS National monitoring of BUFR distribution via GTS not operational yet!  Members do not realize outages EUCOS/WMO QMP helps to identify data outages or problems with data provision

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Some issues with BUFR data (I) Metadata information (e.g. station position, station height, barometer height) are important for (NWP) users but are not provided by all members or are erroneous: harmonization of BUFR and WMO flatfile required → work in progress Rhodes, Greece16110 Trieste, Italy

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Some issues with BUFR data (II) Differences in temperature values of BUFR and ASCII coded FM35- TEMP radiosonde data due to rounding procedures in TEMP Erroneous observation values in BUFR e.g. –temperature values > 100°C –wind directions > 360° –pressure values > 1100 hPa No negative pressure tendency reported in BUFR Suspicious 24h precipitation amounts (999.8mm) Several parameters cannot be reported in BUFR (fresh snow depth) Many issues with radiosonde BUFR data: –Avoiding the distribution of 4 BUFR bulletins (= 4 TEMP parts) –Significant levels are calculated differently than 2s interval levels –Reporting empty levels up to 10 hPa –Sending only one BUFR message (complete sounding) –Radiosonde meta data information should be harmonized

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Lessons learnt from recent switches to BUFR Provide additional new BUFR data on ftp server in parallel to operational data transmission via GTS for users to allow them to test and check new formats Time line: at least 4-6 weeks up to 2 months Inform data users about parallel data provision and ask for feedback concerning format and content Be prepared to potentially transmit old and new data via GTS in parallel for a while → ON REQUEST ONLY Inform all WMO Members about cessation of TAC data at least 2 months in advance only if –BUFR data are compliant with WMO templates –and if BUFR data can be read and processed by users/Global Lead Centres Recommendation: to provide all BUFR templates (e.g. AMDAR WIGOS BUFR template, wind profiler) on WMO website, e.g.

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Content Background information on EUMETNET Observations Programme EUCOS Quality Monitoring –Quality Monitoring Portals –Quarterly QM Reports –Fault reports –Monitoring migration to BUFR Benefits for EUMETNET Members Lessons learnt

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Benefits for EUMETNET Members EUMETNET Members can monitor the performance of their national stations by using the EUCOS QMP themselves and are also informed in any case of failures by the Obs Programme Management Team. EUMETNET Members are welcomed to add additional stations to the EUCOS QMP besides the defined EUCOS stations to monitor all national stations. The EUCOS QMP helps to identify any data transmission problems via GTS as the QM information bases on observations archived in DWDs and ECMWFs database. The EUCOS QMP offers a download functionality for further processing of the monitoring data on national level. EUMETNET Members are provided with –Fault reports in cases of outages or whenever EUCOS targets are exceeded and –Quarterly and annual network performance summaries A survey on the usage of this tool gave very positive feedback.

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Content Background information on EUMETNET Observations Programme EUCOS Quality Monitoring –Quality Monitoring Portal –Quarterly QM Reports –Fault recognition and escalation –Monitoring migration to BUFR Benefits for EUMETNET Members Lessons learnt

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Lessons learnt Solving problems by individual Members is slow, only few reactions to quarterly monitoring reports but situation improving due to continuous promotion of EUCOS QMP and QM reports at EUMETNET meetings; Usually sending of individual s to known points of contact helps accelerating the fault correction procedure Obs PMT asked for GTS contact points of all EUMETNET Members to report about issues Very important to report BUFR issues and to get in touch with NMHSes directly  still a lot of work to do until all Members will provide correct BUFR data

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Questions and comments?

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Contact Details Stefan Klink EUMETNET Observations Programme Manager GIE/EIG EUMETNET GIE EUMETNET Secretariat c/o L’Institut Royal Météorologique de Belgique Avenue Circulaire Bruxelles, Belgique Tel: +32 (0) Fax: +32 (0) Web: EUMETNET Observations Programme Manager Deutscher Wetterdienst Frankfurter Str Offenbach, Germany Tel: Fax: Web:

GIE/EIG EUMETNET, Registered Number RPM Bruxelles In the former EUCOS programme phase members rarely replied to fault reports raised by the EUCOS PMT (within fault reports were raised; majority concerning E-AMDAR; in 2013 – Jan 2014 already 70 fault reports raised) For the new phase it was proposed to improve this procedure by implementing an automated fault reporting Improved fault reporting requires fault recognition and escalation procedures which shall clearly define –guidelines for fault reporting of all potential faults/issues –whom to contact on operator side –time periods before escalating the issue to next level –when to contact Heads of Obs/STAC/EUMETNET ED to accelerate the work to solve the issue Motivation

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Fault recognition and escalation procedures will be set up for all Observations related operational services/projects High-level flow process chart has been presented to STAC6  each Member shall decide when they want to be informed (immediately/escalation step 1 or 2) First coordinated drafts available for E-AMDAR, E-ASAP, surface land stations, radiosonde stations and OPERA Work in progress to draft E-SURFMAR, E-GVAP and E-PROFILE fault recognition and escalation procedures Will be distributed to STAC/Heads of Observations for approval after final acceptance by OSMs/PM Current status and way forward

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Example E-ASAP: potential problems

GIE/EIG EUMETNET, Registered Number RPM Bruxelles E-ASAP: Potential problems continued

GIE/EIG EUMETNET, Registered Number RPM Bruxelles E-ASAP: Fault recognition step Contact operators on working level (national ASAP manager  operator on ship; communications operator)

GIE/EIG EUMETNET, Registered Number RPM Bruxelles E-ASAP: Fault escalation step 1 and 2

GIE/EIG EUMETNET, Registered Number RPM Bruxelles Required input from operators/member NMHSes To be able to solve problems as quickly as possible it is essential to have operator contact points available for all operational services Member NMHSes will be contacted to provide a list of contact points –Up to now only contact to persons are available (problem: person might not be available at weekends) –In future contact details of operator IT service desks are required –Most important in case of required 24/7 responses Each Member shall provide input to the procedures when Heads of Observations want to be copied into the fault reporting (at fault recognition or escalation step 1 or 2)