SEE-GRID-SCI REFS application: NOA The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no PSC03, January 2009, Bucharest Kotroni V. Floros V., Lagouvardos K. National Observatory of Athens

PSC03, January 2009, Bucharest2 Objectives Technical objectives Develop two operational regional ensemble model chains based on BOLAM and MM5, using initial and boundary conditions from the global ensemble model members from NCEP-USA. Develop with SEWA and the Hydrometeorological Institute of Montenegro the postprocessing that will gather all ensemble members and produce a super-ensemble.

PSC03, January 2009, Bucharest3 REFS – Progress Developped a glite UI where we installed MPICH-1.2.7, PGI-5.2, and GANGA 5. Compiled BOLAM and MM5 model on the UI. Developped the scripting for the model workflow:  Downloading the initial and boundary conditions from NCEP  Decoding these data and preprocess them (create the initial and boundary conditions for the models)  Model run

PSC03, January 2009, Bucharest4 REFS – Progress Developped the REFS execution workflow for Bolam and MM5 models Local Job management: managed by a Python module that uses GANGA to submit a set of jobs to the grid. Prepares a compound grid job comprised of a number of subjobs, one for each ensemble member that should run. (a) prepares the ensemble members, (b) submits the jobs to the grid and (c) periodically monitors the execution until all members complete either successfully or unsuccessfully. Execution on the grid: When the job arrives on the WN it executes a script. LILO (lead-in lead-out) script is responsible (a) to prepare the environment for the model, (b) retrieve the model binaries, (c) unpack them, (d) set the appropriate environment variables, (e) execute the model workflow and (f) finally store the results on the LFC.

PSC03, January 2009, Bucharest5 REFS – Progress This procedure has been developped for both Bolam and MM5 models. Use of the SEE-GRID-SCI infrastructure and namely the hellasgrid sites for the moment Systematic testing of the response of the SEE-GRID VO infrastructure on daily requests of the whole workflow of BOLAM model regional ensemble prediction system.  IF THE INITIAL AND BOUNDARY CONDITIONS ARE COMPLETELY FTP’ED FROM NCEP-USA ALL 10 ENSEMBLE MEMBERS FINISH SUCCESSFULLY testing of the response of the SEE-GRID VO infrastructure on daily requests of the whole workflow of MM5 model regional ensemble prediction system.  IF THE INITIAL AND BOUNDARY CONDITIONS ARE COMPLETELY FTP’ED FROM NCEP-USA IT IS QUITE RARE THAT ALL 10 ENSEMBLE MEMBERS FINISH SUCCESSFULLY

PSC03, January 2009, Bucharest6 REFS – Progress A user manual “Regional Ensemble Forecast System (REFS) Users Manual” has been prepared and distributed to the partners for commenting 2 days ago. A proposal for Meteo applications storage and file schema has been also prepared and discussed during the 1 st EVO meeting (with contribution by B. Marovic). On 12/1/09 the LFC space for REFS applications has been prepared and the update scripts that generate the daily output folders has been activated. These scripts run by a cron job at the UI at NOA

PSC03, January 2009, Bucharest7 REFS – Progress PROPOSAL FOR METEO APPLICATIONS STORAGE SCHEME The LFC will be used for storing : Various data files produced by the models:  raw output (output produced daily by each ensemble member of a model),  post-processed output and  intermediate results from failed model executions. Software packages. Packages containing  the model binary executables,  additional required scripts and auxiliary data. These are fetched from the LFC to the WN before the model execution.

PSC03, January 2009, Bucharest8 REFS – Progress /grid /meteo.see-grid-sci.eu /REFS /data / /rawoutput / - -RAW- -.tgz /failed / - -FAIL- -.tgz /artifacts / - -.tgz /shared /software/ / - Example: Output produced by the 7th member of MM5 ensemble forecasting run on 27th November 2008: NOA-MM5-RAW tgz. The file is stored under directory: /grid/meteo.see-grid-sci.eu/REFS/data/SEEurope/rawdata/

PSC03, January 2009, Bucharest9 REFS – Problems (1) IF THE INITIAL AND BOUNDARY CONDITIONS FOR MM5 ARE COMPLETELY FTP’ED FROM NCEP-USA IT IS QUITE RARE THAT ALL 10 ENSEMBLE MEMBERS FINISH SUCCESSFULLY So we are working on different compilations of the MPI and consequently of MM5 in order to resolve the problem. (2) THE NOMADS SERVERS FROM WHERE WE FTP THE INITIAL AND BOUNDARY CONDITIONS ARE NOT VERY STABLE. SOMETIMES THE DATA ARE NOT AVAILABLE. A high availability server has been created in NCEP that provides the needed data but in a new format (GRIB2 instead of GRIB1) so some rescripting is needed.

PSC03, January 2009, Bucharest10 Activities and Time-Plan Up to M12:  improve the scripts for BOLAM and MM5  use the new GRIB2 initial data from NCEP  systematically check the pre-operational runs of these two models on the GRID  start working on the post-processing of all four model outputs towards the super-ensemble