GRID technology by SZTAKI MTA SZTAKI Laboratory of Parallel and Distributed Systems

Collaborative Grid systems Goal: Solving very complex problems that require the collaboration of –various fields of science –various (even geographically distributed) institutions Demo example: –Nowcast: weather forecast for ultra-short time period (30 min) –Collaborative partners: OMSZ (Országos Meterológiai Szolgálat) MTA SZTAKI

 Goal: Analysis of all the available meteorology information  producing parameters on a regular mesh (10km- >1km)  ultra-short forecast  Application: Forecasting dangerous weather situations (storms, fog, etc.)  METEOROLOGY INFORMATION: surface level measurements, high-altitude measurements, radar, satellite, lightning, results of previous computed models, etc.  BASIC PARAMETERS: pressure, temperature, humidity, wind  DERIVED PARAMETERS: type of clouds, visibility, etc. MEANDER Nowcast Program Package

Structure of MEANDER First guess data ALADIN SYNOP data SateliteRadar CANARI Delta analysis Basic fields: pressure, temperature, humidity, wind. Derived fields: Type of clouds, visibility, etc. GRID Rada r to grid Satelit e to grid Current time Type of clouds Overcast Visibilit y Rainfall state Visualization For meteorologist s:HAWK For users: GIF Lightning decode

SZTAKI Grid Solution: TotalGrid The TotalGrid system integrates the different software layers of a Grid (see next slide) and provides for companies –exploitation of free cycles of desktop machines in a Grid environment after the working hours –achieving supercomputer capacity using the actual desktops of the company without further investments –Development and test of Grid programs

Layers of TotalGrid Internet PVM v. MPI Condor v. SGE PERL-GRID P-GRADE

P-GRADE version of MEANDER

netCDF output 34 Mbit Shared PERL-GRID CONDOR-PVM job 11/5 Mbit Dedicated P-GRADE PERL-GRID job HAWK netCDF output Live demo of MEANDER based on TotalGrid ftp.met.hu netCDF 512 kbit Shared netCDF input Parallel execution

Results of the delta method Temperature fields at 850 hPa pressure Wind velocity and direction on the 3D mesh of the MEANDER system

GRM TRACE 34 Mbit Shared PERL-GRID CONDOR-PVM job 11/5 Mbit Dedicated P-GRADE PERL-GRID job On-line Performance Visualization in TotalGrid ftp.met.hu netCDF 512 kbit Shared netCDF input Parallel execution and GRM GRM TRACE

PROVE visualization of the delta method

Thank you for your attention ! ? Further information: