Grid resources for NWP models at national level in Korea Korean Meteorological Administration Super Computer Center Korea Meteorological Administration APAN

Contents  What the operational weather forecasting is  Why the operational centers need Grid Technology.  What Grid activities are in the Meteorological field.  What we have and will do with IT infrastructure. Korean Meteorological Administration APAN

What the operational weather forecasting is… Korean Meteorological Administration APAN

observation Technology for the weather forecasting collectionDiss. Anal.& WF Numerical Weather Prediction

Infrastructure for Earth System Infrastructure for Earth System Korean Meteorological Administration APAN

Nature

Korean Meteorological Administration DATA PRODUCERS Global Observing System GOS DATA CONVEYORS Global Telecommunication System GTS DATA USERS Global Data Processing System GDPS World Meteorological Organization (187members) APAN

Current GTS will be replaced with FWIS until 2010 Korean Meteorological Administration APAN

연구배경 Global Scale Study => climatology with Atmos., Ocean, land surface, etc Global Scale Study => climatology with Atmos., Ocean, land surface, etc Global Observation and sharing information Global Observation and sharing information Co-work with international society is important Co-work with international society is important Some Characteristics of Earth Science global science with huge observation data and high performance computing Dynamic Equation Set Dynamic Equation Set Numerical Representation Numerical Representation Super Computing Super Computing Korean Meteorological Administration APAN

Why we need Grid Korean Meteorological Administration APAN

Archived data volume and the Moore law Source: CAS2k3, MetroFrance Korean Meteorological Administration APAN

Source:CAS2K3 DKRZ Daily transfer volume Korean Meteorological Administration APAN

APAN Source:CAS2K3 DKRZ

Data Size in Operational Center ( DWD ) Korean Meteorological Administration APAN

Forget Modeling: How About Case Study Research?  Exhaustive study of one or more selected observed weather events, sometimes involving the use of models and always involving lots of data!  We spend 70% of our time dealing with data logistics, i.e., searching, formatting, acquiring, reading, reducing, merging onto common grids and projections, visualizing, etc… - Radar, satellite, surface nets, GPS, upper-air balloon, commercial aircraft, wind profiler, etc…  And only ~30% of our time is spent actually studying the event! Source: LEAD, Prof. Kelvin Korean Meteorological Administration APAN

WGNE Table of Operational NWP Centres (November 2002; ref. Kamal Puri) Source : CAS2k3 M.Naughton BOM Korean Meteorological Administration APAN

What Grid activities are in the Meteorological field Korean Meteorological Administration APAN

The Grid and Meteorology: Opportunities  Inter-personal collaboration - E.g., Access Grid, CHEF  On-demand access to simulation models - E.g., Espresso  Access to, and integration of, data sources - E.g., Earth System Grid  Dynamic, virtual computing resources - “Metacomputing”  Integration of all of the above - Collaborative, computationally intensive analysis of large quantities of online data Source : Ian Foster, 16 th APAN Meeting Korean Meteorological Administration APAN

European Grid Korean Meteorological Administration Computational grid example APAN

Korean Meteorological Administration Computational grid example(cont.) APAN

Korean Meteorological Administration APAN

Earth System Grid Korean Meteorological Administration Data grid example APAN

Korean Meteorological Administration APAN

APAN LEAD Concept

Korean Meteorological Administration APAN LEAD Data Cloud

What we have Korean Meteorological Administration APAN

High Speed Network - KOREN Korean Meteorological Administration APAN

High Speed Network - KREONET Korean Meteorological Administration APAN

High Speed Network – International Link Korean Meteorological Administration APAN

APAN KMA Intra Network

Filer2 Filer1 Backup System Front- End System Gigabit Switch2 Gigabit Switch1 SX-5/16A SX-5/12A XYLAN F/W KOREN KMA Backbone Fast.E MRI Giga.E Giga.E G-NEt KMA HPC and Network KREONET Korean Meteorological Administration APAN

What we will do Korean Meteorological Administration APAN

 NEXT KMA HPC System 54 times faster than the current system Initial stage : 6 times 4Q 2004 Final stage : 54 times 4Q 2005 More than 80M$ for next 5 years  Plan for the National Data Center : from 2004 To collect Obs. Data To collect Obs. Data To disseminate Weather Information and Product To disseminate Weather Information and Product  Digital Weather Forecast Fine Mesh Weather Grid Information Fine Mesh Weather Grid Information Real time Dissemination Real time Dissemination Korean Meteorological Administration APAN

KMA Met Satellite at 2008 KMA Met Satellite at 2008 Representative of Group on Earth Observation Representative of Group on Earth Observation V-GISC V-GISC Future WMO Information System Future WMO Information System E-Science for Earth System E-Science for Earth System APEC Climate Network APEC Climate Network Korean Meteorological Administration APAN

Test for the collaboration in the field of Met. with High Speed Network Test for the collaboration in the field of Met. with High Speed Network target Data Grid For sharing Huge data Computationalgrid Access Grid VirtualLab Virtual Storage for Huge Met. Data User Interface based on 3D, VR Parallel Development of modules Computational grid Re-locatable and adoptive grid model Access grid for parallel development of model codes Korean Meteorological Administration APAN

연구 방법 Computational grid for Meteo. Application(Distributed Computing)  Using High Speed Network ( KOREN, KREONET )  Real Time Allocation of computing resource and data resource, sharing model codes  re-locatable grid with friendly UI for high resolution model Model 모듈 4 Group A Module 1 Group C Module 3 Group B Module 2 Group D Module 4 Data Res. Computing Res. Computing Res. Data Res. user 모듈 1 module2 Module 1 Module 3 Module 4 Korean Meteorological Administration APAN

연구 방법 System development for the sharing huge Met. data  Development of User Interface  virtual storage based on Grid Technology  technique development for Remote Display based on 3D,VR Storage A Storage B Storage C Grid FTP Grid FTP Grid FTP Virtual Storage Request Manager Data Catalog Manager Replica Catalog Manager User Display Korean Meteorological Administration APAN

연구 배경 conference Off-Line Media Group A Module1 Module2 Module3 … meeting Phone/Fax Group B Module1 Module2 Module3 … Group C Module1 Module2 Module3 … Group D Module1 Module2 Module3 … One-Side Media Current research status – individual off-line Korean Meteorological Administration APAN

Display system 3D, VR 연구 방법 Access Grid for Collaboration  Access grid for parallel- development  Parallel computing based on high performance computing Discussion Forum Video Conference Exchange E-Message Co-operational Project Local A Local B Local C Access Grid Computing Grid Data Grid Korean Meteorological Administration APAN

For the High quality weather information - More regional and global Observation Data - More regional and global Observation Data - Data assimilation - Data assimilation - High Performance Computing - High Performance Computing - Ensemble Prediction for regional and global scale - Ensemble Prediction for regional and global scale - Enhance the research activity - Enhance the research activity - Training and Education - Training and Education Korean Meteorological Administration APAN

Thank you!! Korean Meteorological Administration APAN

Data Exchange with National Information Center for Earthquakes and Disasters, National Research Institute for Earth Science and Disaster Prevention

Earthquake and Zunami Korean Meteorological Administration APAN