Www.see-grid-sci.eu SEE-GRID-SCI Applications of the Meteorology VO in the frame of SEE-GRID-SCI project The SEE-GRID-SCI initiative is co-funded by the.

Slides:



Advertisements
Similar presentations
Weather Research & Forecasting: A General Overview
Advertisements

© Crown copyright Met Office Met Office Unified Model I/O Server Paul Selwood.
Report of the Q2 Short Range QPF Discussion Group Jon Ahlquist Curtis Marshall John McGinley - lead Dan Petersen D. J. Seo Jean Vieux.
Page 1© Crown copyright 2006ESWWIII, Royal Library of Belgium, Brussels, Nov 15 th 2006 Forecasting uncertainty: the ensemble solution Mike Keil, Ken Mylne,
Predictability and Chaos EPS and Probability Forecasting.
Fire Growth Modelling at Multiple Scales
Cracow Grid Workshop November 5-6 Support System of Virtual Organization for Flood Forecasting L. Hluchy, J. Astalos, V.D. Tran, M. Dobrucky and G.T. Nguyen.
Uncertainty and Climate Change Dealing with uncertainty in climate change impacts Daniel J. Vimont Atmospheric and Oceanic Sciences Department Center for.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.
EG1204: Earth Systems: an introduction Meteorology and Climate Lecture 7 Climate: prediction & change.
Ensemble Post-Processing and it’s Potential Benefits for the Operational Forecaster Michael Erickson and Brian A. Colle School of Marine and Atmospheric.
Chapter 13 – Weather Analysis and Forecasting. The National Weather Service The National Weather Service (NWS) is responsible for forecasts several times.
SRNWP workshop - Bologne Short range ensemble forecasting at Météo-France status and plans J. Nicolau, Météo-France.
SICSA student induction day, 2009Slide 1 Social Simulation Tutorial Session 6: Introduction to grids and cloud computing International Symposium on Grid.
NUMERICAL WEATHER PREDICTION K. Lagouvardos-V. Kotroni Institute of Environmental Research National Observatory of Athens NUMERICAL WEATHER PREDICTION.
National Weather Service National Weather Service Central Computer System Backup System Brig. Gen. David L. Johnson, USAF (Ret.) National Oceanic and Atmospheric.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Nov. 18, EGEE and gLite are registered trademarks EGEE-III, Regional, and National.
The National Environmental Agency of Georgia L. Megrelidze, N. Kutaladze, Kh. Kokosadze NWP Local Area Models’ Failure in Simulation of Eastern Invasion.
ESA DA Projects Progress Meeting 2University of Reading Advanced Data Assimilation Methods WP2.1 Perform (ensemble) experiments to quantify model errors.
SEE-GRID-SCI The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no.
Name, Surname, Position Logo(s) Weather monitoring and forecasting over eastern Attica (Greece) in the frame of FLIRE project Vassiliki Kotroni (1), Konstantinos.
INFSO-RI Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
SEE-GRID-SCI Regional Grid Infrastructure: Resource for e-Science Regional eInfrastructure development and results IT’10, Zabljak,
What are the main differences and commonalities between the IS and DA systems? How information is transferred between tasks: (i) IS it may be often achieved.
Fly - Fight - Win 16 th Weather Squadron Evan Kuchera Fine Scale Models and Ensemble 16WS/WXN Template: 28 Feb 06 Air Force Weather Ensembles.
SEE-GRID-SCI SEE-GRID-SCI ES VOs The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.
SEE-GRID-2 The SEE-GRID-2 initiative is co-funded by the European Commission under the FP6 Research Infrastructures contract no
Celeste Saulo and Juan Ruiz CIMA (CONICET/UBA) – DCAO (FCEN –UBA)
The New Zealand Institute for Plant & Food Research Limited Use of Cloud computing in impact assessment of climate change Kwang Soo Kim and Doug MacKenzie.
ARGONNE NATIONAL LABORATORY Climate Modeling on the Jazz Linux Cluster at ANL John Taylor Mathematics and Computer Science & Environmental Research Divisions.
Kelvin K. Droegemeier and Yunheng Wang Center for Analysis and Prediction of Storms and School of Meteorology University of Oklahoma 19 th Conference on.
Geosciences - Observations (Bob Wilhelmson) The geosciences in NSF’s world consists of atmospheric science, ocean science, and earth science Many of the.
ENSEMBLES RT4/RT5 Joint Meeting Paris, February 2005 Overview of the WP5.3 Activities Partners: ECMWF, METO/HC, MeteoSchweiz, KNMI, IfM, CNRM, UREAD/CGAM,
IDC HPC USER FORUM Weather & Climate PANEL September 2009 Broomfield, CO Panel questions: 1 response per question Limit length to 1 slide.
3 rd Annual WRF Users Workshop Promote closer ties between research and operations Develop an advanced mesoscale forecast and assimilation system   Design.
SEE-GRID-SCI The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no.
The NOAA Operational Model Archive and Distribution System NOMADS The NOAA Operational Model Archive and Distribution System NOMADS Dave Clark for Glenn.
SEE-GRID-SCI SEE-GRID-SCI ES VOs The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures.
ATmospheric, Meteorological, and Environmental Technologies RAMS Parallel Processing Techniques.
Introduction Application of parallel programming to the KAMM model
SEE-GRID-SCI WRF – ARW application: Overview The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research.
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
Welcome to the PRECIS training workshop
Montserrat Fuentes Statistics Department NCSU Research directions in climate change SAMSI workshop, September 14, 2009.
Example of prediction quality for the first (10 min) and last (3 h) prediction horizon element for the same sequence of WF Danilo power production events.
Weather Research and Forecast implementation on Grid Computing Chaker El Amrani Department of Computer Engineering Faculty of Science and Technology, Tangier.
OPTIMIZATION OF DIESEL INJECTION USING GRID COMPUTING Miguel Caballer Universidad Politécnica de Valencia.
SEE-GRID-SCI REFS application: NOA The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures.
Proposed THORPEX/HEPEX Hydrologic Ensemble Project (THEPS) Presentation for 3 rd THORPEX Science Symposium September 14-18, 2009 Prepared by John Schaake,
Support to MPI and interactivity on gLite infrastructures EGEE’07 Budapest, 4th Oct 2007.
SEE-GRID-SCI Vangelis Floros, Vasso Kotroni, Kostas Lagouvardos – NOA, Athens, GREECE Goran Pejanovic, Luka Ilic, Momcilo Zivkovic.
Support to scientific research on seasonal-to-decadal climate and air quality modelling Pierre-Antoine Bretonnière Francesco Benincasa IC3-BSC - Spain.
DET Module 1 Ensemble Configuration Linda Wharton 1, Paula McCaslin 1, Tara Jensen 2 1 NOAA/GSD, Boulder, CO 2 NCAR/RAL, Boulder, CO 3/8/2016.
SEE-GRID-SCI Meteo-VO: Overview The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures.
SEE-GRID-SCI Antun Balaz Scientific Computing Laboratory Institute of Physics Belgrade SEE-GRID eInfrastructure.
Activities and Perspectives at Armenian Grid site The 6th International Conference "Distributed Computing and Grid- technologies in Science and Education"
Figures from “The ECMWF Ensemble Prediction System”
7. Air Quality Modeling Laboratory: individual processes Field: system observations Numerical Models: Enable description of complex, interacting, often.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
Improving Numerical Weather Prediction Using Analog Ensemble Presentation by: Mehdi Shahriari Advisor: Guido Cervone.
SEE-GRID-SCI WRF-ARW model: Grid usage The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures.
OPERATING SYSTEMS CS 3502 Fall 2017
High-resolution operational NWP for forecasting meteotsunamis
Porting MM5 and BOLAM codes to the GRID
CompChem VO: User experience using MPI
Update on the Status of Numerical Weather Prediction
Conference: Data and Life Sci +DC
Peter May and Beth Ebert CAWCR Bureau of Meteorology Australia
Presentation transcript:

SEE-GRID-SCI Applications of the Meteorology VO in the frame of SEE-GRID-SCI project The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no Vassiliki KOTRONI National Observatory of Athens Athens, Greece

Meteorology VO - Applications Regional scale Multi-model, Multi-analysis ensemble forecasting system - REFS  Greece:National Observatory of Athens (NOA).  Serbia: South Environment and Weather Agency of Serbia  Montenegro: Hydrometeorological Institute of Montenegro Interaction of airflow with complex terrain WRF-ARW  Croatia: Ruđer Bošković’ Institute of Zagreb, Department of Geophysics - ‘Andrija Mohorovičić’ Geophysical Institute of the University of Zagreb, Faculty of Graphical Art of the University of Zagreb  Bosnia and Herzegovina: Federal Hydro-Meteorological Institute  Bosnia and Herzegovina: Republic Hydrometeorological Institute  Georgia: GRENA

Meteorology VO Applications - Why using the GRID Advances in numerical weather prediction (NWP) and related applications have been always very closely related with advances in computing sciences as NWP requires numerical calculations that are also parallelizable. The computer resources needed for NWP applications are important both in terms of CPU usage and disk storage. Although many institutions are working/ have experience on NWP, they may not have access to the necessary computer resources The porting of any NWP application to the grid is a natural choice.

Regional scale ensemble forecasting system - Introduction Application problem description Lorenz in 1963 discovered that the atmosphere, like any dynamical system with instabilities has : “a finite limit of predictability even if the model is perfect and even if the initial conditions are known almost perfectly”. In addition it is known that neither the models nor the initial conditions are perfect Problem: deterministic forecasts have limited predictability that relates to the chaotic behaviour of the atmosphere Solution: base the final forecast not only on the predictions of one model (deterministic forecast) but on an ensemble of weather model outputs

MULTI-ANALYSIS ENSEMBLE: based on perturbing the initial conditions provided to individual models, in order to generate inter- forecast variability depending on a realistic spectrum of initial errors 1 forecast model “driven” by various initial conditions MULTI-MODEL ENSEMBLE: based on the use of multiple models that run with the same initial conditions, sampling thus the uncertainty in the models Many forecast models “driven” by the same initial conditions Regional scale ensemble forecasting system - Introduction

In the frame of SEEGRID project the regional infrastructure in the area of South Eastern Europe will provide the environment for the development and deployment of a Regional scale Multi-model, Multi-analysis ensemble forecasting system. This system will comprise the use of four different weather prediction models (multi-model system).  BOLAM, MM5, NCEP/Eta, and NCEP/WRF-NMM  The models will run for the same region many times, each initialized with various initial conditions (multi- analysis) Production of a multitude of forecasts Regional scale ensemble forecasting system - Description

BOLAM serial code: 10 ensemble members over Europe with 10 different initial conditions (multi-analysis) need of 10 available CPUs around noon local time for about 1 hour (clock-time) depending on the Worker Nodes performance. MM5, WRF/NMM, NCEP/Eta paralellized codes using MPI: 10 ensemble members over Europe for each model need to run 10 MPI jobs for 2-3 hours with at least 10 CPUs per job every day about noon time Regional scale ensemble forecasting system - Description

GRID DATA Download (Initial Conditions) Pre- Processing Model Run (BOLAM MM5 WRF/NMM NCEP/Eta) Post Processing Probabilistic Forecast HTTP UI N.O.M.A.D.S NCEP-GFS (USA) UI Every day, about noon time, a cron application will be activated that initiates the submission of 15 jobs (one per ensemble member) to the grid. The jobs pass through the WMS and arrive in the assigned WN. Upon arrival the local workflow executes. Initial coniditions are downloaded from the National Center for Environmental Prediction (NCEP-GFS). On a daily basis the global ensemble members from NCEP-GFS are made available on an ftp server. These fields will be fetched and used as input to the regional ensemble prediction system. Initial conditions are pre-processed and prepared for the model execution Output data will pass through a final post-processing step where specific fields will be isolated and prepared for the probabilistic forecast evaluation. Output from each job will be collected from the WNs (all jobs completed) and passed to the final step that will run locally in the UI and will produce the final probabilistic forecast Regional scale ensemble forecasting system - Workflow

Regional scale ensemble forecasting system – Challenges Grid Response times for -Resource allocation -Job Scheduling and execution Proper MPICH support (for the parallelised codes: MM5, WRF/NMM, NCEP/Eta) Resource availability -10 CPUs for BOLAM, shouldn’t be a challenge, but

Resource availability -3*~10*10 CPUs for the other 3 models execution maybe difficult to allocate within the required time limits -MM5 sensitive to memory leaks - 2GB+ free memory required from WNs -Should be also the case for NCEP/Eta and WRF/NMM - Storage Requirements -~650MB disk space in WNs for initial+output data -Typically small size of output files (~1-2 MB) -may require storage for archiving Regional scale ensemble forecasting system – Challenges

Regional scale ensemble forecasting system – target community The final product of the application aims at assessing the probability of a particular weather event to occur and to provide this information  to the authorities,  the general public, etc, in order to help them make the necessary decisions based on this probabilistic information. The target community is the general public, the Civil Protection and the Administrations of the Electric Power Distribution and other relevant end-users.

PRECIPITATION FORECASTS: BOLAM 10 members

Example of probabilistic forecasts From the multitude of model outputs probabilistic forecasts can be issued like: Probability of more than: -1mm of rain - 5 mm of rain -10 mm of rain Probability of exceedance of a temperature threshold Probability of exceedance of a wind speed threshold

WRF-ARW application – Introduction Application problem description  Atmospheric processes over complex terrain bear numerous difficulties in both numerical weather prediction and research  The purpose of the application is to study the interaction of airflow with the complex terrain, using high resolution simulations with WRF (Weather Research & Forecasting) model  All involved countries (CRO, BiH and Georgia) are characterised by large areas with terrain obstacles.

In the frame of SEE-GRID-SCI project the WRF – ARW will be ported to the GRID  The WRF system is a public domain weather model and is freely available for community use. It is designed to be a flexible, state-of-the-art atmospheric simulation system that is portable and efficient on available parallel computing platforms. WRF is suitable for use in a broad range of applications across scales ranging from meters to thousands of kilometers. Leading partner: RBI – Rudjer Boskovic Institute WRF-ARW application – Introduction

WRF – ARW expected results Expected results and their consequences  Estimating the effect of improved resolution on the numerical weather prediction quality and improving the forecasting skill  Get faster and more reliable weather forecasting model  Operational weather forecast at high resolution for BiH  Expanding user community that will be able to investigate advances of the model on the grid infrastructure. Possible scientific – societal impact  Better prognostic and research model for futher scientific applicance  the social impact for community includes the improved weather forecast over the region of interest

METEOROLOGY VO APPLICATIONS – Time Plan Up to June2009: For the REFS application the pilot version of each regional ensemble forecast system will have been ported to the GRID WRF –ARW model will have been also ported to the GRID