Data services: Archiving of UERRA data in MARS and dissemination Richard Mládek, Manuel Fuentes, Shahram Najm, Sebastien Villaume, Enrico Fucile (ECMWF) 1

UERRA GA Toulouse2 Highlights of the previous year EURO4M sample datasets archived UERRA list of parameters delivered WMO compliant GRIB2 definitions prepared => UERRA common data format Where needed new WMO GRIB2 proposals for UERRA submitted and accepted! 1 st UERRA sample archived in MARS!

UERRA GA Toulouse3 EURO4M testbed Archive some data from EURO4M before UERRA samples are available Solution chosen: Original model data in GRIB1 (no common definitions of the parameters) for period If possible provide 15 selected surface parameters only By the end of 2015 two year sample data was archived from 4 centres Data is varying among centres (different parameters, starting times, levels..) => potential complications for users Data is available only to authorized users via standard MARS retrieval tools

UERRA GA Toulouse4 EURO4M testbed EURO4M domain

UERRA GA Toulouse5 EURO4M testbed ml..model levels pl..pressure levels sfc..surface level Centre UM/4DVAR (MO)HIRLAM (SMHI) MESCAN (MF)COSMO (DWD) Domain size (projection) 480*384 (rot.latlon) 326*341 (rot.latlon) 1080*1000 (Lamb.conf) 848*824 (rot.latlon) Typesfcan / fc an Times3, 9, 15, 21h0, 6, 12, 18h 0, 1, h Steps(fc only)0, 1, h6, 12…36h6h Levelsml(71) / pl(20) / sfcsfc Parameter #7(ml)/5(pl)/51(sfc)5(an) /15(fc)3(an) / 4(fc)16 (fluxes are not accumulated!) ml..model levels pl..pressure levels sfc..surface level an..analysis fc..forecast rot.latlon..Rotated Latitude/Longitude grid Lamb.conf..Lambert Conformal

UERRA GA Toulouse6 EURO4M parameters(fc) Centre UM/4DVAR (MO) HIRLAM (SMHI)MESCAN (MF) Parameters type=fc level=sfc o 1.5m specific humidity o 1.5m temperature over land o 10 metre wind gust in the last 24 hours o 10m U wind over land o 10m V wind over land o Clear-sky (II) down surface sw flux o Clear-sky (II) up surface sw flux o Convective precipitation (water) o Convective rainfall rate o Convective snow o Convective snowfall rate o Fraction of sea- ice in sea o High cloud cover o Land-sea mask o Large scale rainfall rate o Large scale precipitation o Large scale snow o Large scale snowfall rate o Latent heat flux o Long wave radiation flux o Low cloud cover o Maximum temperature at 1.5m since previous post- processing o Mean sea level pressure o Medium cloud cover o Minimum temperature at 1.5m since previous post- processing o Net long-wave radiation flux (surface) o Net short-wave radiation flux (surface) o Orography o Precipitation rate o Relative humidity at 1.5m o Sensible heat flux o Short wave radiation flux at surface o Short wave radiation flux at top of atmosphere o Soil temperature layer 1 o Soil temperature layer 2 o Soil temperature layer 3 o Soil temperature layer 4 o Surface pressure o Temperature o Total Cloud Cover o Total Precipitation o Total cloud amount - random overlap o Total cloud amount in lw radiation o Total column water vapour o Very low cloud amount o Visibility at 1.5m o Volumetric soil water layer 1 o Volumetric soil water layer 2 o Volumetric soil water layer 3 o Volumetric soil water layer 4 o 10 metre U wind component o 10 metre V wind component o 2 metre temperature o Convective precipitation (water) o Convective snow o Global radiation flux o Large scale precipitation o Large scale snow o Long wave radiation flux o Net long-wave radiation flux (surface) o Net short-wave radiation flux (surface) o Relative humidity o Snow depth, cold snow o Total Cloud Cover o Total precipitation o 10 metre U wind component o 10 metre V wind component o Surface solar radiation downwards o Surface thermal radiation downwards

UERRA GA Toulouse7 EURO4M parameters(an) Centre HIRLAM (SMHI)MESCAN (MF) COSMO (DWD) Parameters type=an level=sfc o 10 metre U wind component o 10 metre V wind component o 2 metre temperature o Relative humidity o Total Cloud Cover o 2 metre temperature o Relative humidity o Total precipitation o 10 metre U wind component o 10 metre V wind component o 2 metre temperature o 2m Relative Humidity o Convective rain rate o Convective snowfall rate water equivalent o Downward direct short wave radiation flux at surface (mean over forecast time) Initialisation o Geometric Height of the earth surface above sea level o Large scale rain rate o Large scale snowfall rate water equivalent o Max 2m Temperature (i) Initialisation o Min 2m Temperature (i) Initialisation o Net short wave radiation flux (at the surface) o Snow depth o Total Cloud Cover o Total Precipitation

UERRA GA Toulouse8 UERRA datasets 8 datasets coming from 5 models and 4 centres The different models have slightly different domains Each model will stick to its own domain for the project

UERRA GA Toulouse9 Complete UERRA test sample data At this stage it is of the highest importance to get full data sample from each of 8 expected UERRA datasets containing all available agreed parameters in GRIB2 format. The exact encoding rules for GRIB2 files preparation have been mostly provided and the rest will follow soon. The information gathered by checking the content of the complete data samples from each dataset will allow to finish MARS and GRIB-API design and development. Only then any production archiving can start. The checking tool will be provided by ECMWF. Each UERRA file must be checked before archiving to achieve full compliance with agreed data format. The workflow how to archive the full UERRA data in MARS in the future will be investigated to be prepared for smooth transition from test to production archiving.

UERRA GA Toulouse10 Example of archiving workflow For each reanalysis cycle produced: 1) extract UERRA variables 2) encode/convert to UERRA-compliant GRIB2 format 3) run check tool 4) transfer to ECMWF computers (if not already there) 5) archive in MARS by providing the exact request check what was archived (all as intended, no more fields, no less fields, no gaps..)

UERRA GA Toulouse11 UERRA parameters The final list of parameters: 8 parameters on 3 types of vertical levels (model, pressure and height) 43 surface parameters (3 static fields) Some open topics (skin versus surface temperature; any additional products (e.g.probabilistic) planned?) Technical development: Pending GRIB-API & MARS development (addition of new parameters ; new height level type ; new parameters defined since the previous post- processing with varying length of time range ; new soil level etc.) WMO proposals related to GRIB2 encoding of UERRA parameters – all accepted in December 2015 and will appear in the new WMO GRIB2 tables version 17 in May 2016 (but might be used immediately). 1 st UERRA sample archived in MARS!

UERRA GA Toulouse12 UERRA parameters (vertical levels)

UERRA GA Toulouse13 UERRA parameters (surface)

UERRA GA Toulouse14 UERRA parameters encoding GRIB2 encoding rules mostly defined Examples of correctly encoded GRIB2 data for each type of UERRA parameter will be available

UERRA GA Toulouse15 UERRA WMO proposals New type of vertical level : Soil level [numeric] (in GRIB Code table 4.5) Description: This level represents a soil model level. The aim of this type of the level is to encode a field referred to a soil level that has variable depth across the model domain. The non-constant depth is then encoded as a parameter "soil depth" discipline 2, category 3 and parameter number 27. Note: The soil level represents a model level for which the depth is not constant across the model domain. The depth in metres of the level is provided by another GRIB message with the parameter "soil depth" with discipline 2, category 3 and parameter number 27.

UERRA GA Toulouse16 UERRA WMO proposals 6 new parameters: (Product discipline 0 - Meteorological products, parameter category 4: short- wave radiation) 1. Downward short-wave radiation flux, clear sky [Wm -2 ] 2. Upward short-wave radiation flux, clear sky [Wm -2 ] (Product discipline 0 - Meteorological products, parameter category 5: long- wave radiation ) 3. Downward long-wave radiation flux, clear sky [Wm -2 ] (Product discipline 2 - Land surface products, parameter category 3: soil products) 4. Soil heat flux [Wm -2 ] 5. Soil depth [m] description : soil depth, positive downward. It is meant to be used together with the type of level "soil level" to encode the depth of the level at each grid point.

UERRA GA Toulouse17 UERRA WMO proposals Product discipline 1 - Hydrological products, parameter category 0: hydrology basic products 6. Percolation rate [kgm -2 s -1 ] Description: The newly proposed percolation is the downward movement of water under hydrostatic pressure in the saturated zone.This water might still end up in rivers and lakes as discharge but it is a slower process than water runoff or drainage. Such defined percolation is an input for hydrological models together with e.g. water runoff. Real-life example : The newly proposed percolation rate is the parameter K3 in the SURFEX 3-layers scheme (right picture ISBA 3-L; it is called gravitational drainage there).

UERRA GA Toulouse18 UERRA sample in MARS Based on UERRA files from HIRLAM converted from GRIB1 to GRIB2 by GRIB-API tools Only one test field (temperature) for 3 types of levels (model, pressure and surface) Archived in the temporary version of MARS (reachable via web or standard ECMWF MARS access tools) Next step => archive full HIRLAM based UERRA sample

UERRA GA Toulouse19 1 st UERRA sample data in MARS UERRA dataset

UERRA GA Toulouse20 Summary Done: EURO4M datasets archived UERRA list of parameters defined New WMO GRIB2 proposals for UERRA accepted In progress: Work on GRIB2 common definitions for UERRA parameters and related MARS and GRIB-API amendments Preparing and archiving one full UERRA test sample (based on HIRLAM GRIB1 data converted to GRIB2 by GRIB-API) Gathering UERRA full data samples (in GRIB2) representing each expected UERRA dataset (top priority)

UERRA GA Toulouse21 Links Progress status: UERRA parameters: WMO proposals: eters eters

UERRA GA Toulouse22 Thank you.