International Data Acquisition for Disaster Prevention and Data Access Technology Hyunseung Choo Sungkyunkwan University

■Introduction ■Earth System weather prediction, earthquakes, and environments ■From Networking to Grid Computing ET over Grid ■The Proposal Importance Current status Proposed approach Final goals Members and organizations ■Conclusion Contents

■Observations ■Data Collection ■Data Analysis ■Weather Forecasting Technology for the Weather Forecasting

Global Infrastructure for Earth System Nature

■ Exponential Growth of Network Technology Network vs. Computer Performance  Computer speed doubles every 18 months  Network speed doubles every 9 months  Difference = order of magnitude per 5 years 1986 to 2000  Computers: x 500  Networks: x 340, to 2010  Computers: x 60  Networks: x 4000 From Networking to Grid Computing (1/2)

■Definition of GRID Research infrastructure for dynamic collecting and sharing research resources connected by high-speed networks GRID Problem solving Experts Scientific Research Instrument Large Scale Data Supercomputer From Networking to Grid Computing (2/2)

Grid Based Resource Integration ■Challenge to huge problems that require massive capability over limited resources at multiple sites Grid Computing  Networking of locally distributed high performance (HP) resources  HP computers, storages, experimental facilities, etc.  IT infrastructure to group systems as a single system  Classified into Access Grid, Computational Grid and Data Grid ■Core applications based on Grid “ IT + Application ” : Environment Technology (ET), Bio Technology (BT), Nano Technology (NT), Space Technology (ST), Cultural Technology (CT), etc. ■Investigated HPCN since late 1980 in US, JP, EU Concentrate to Grid Technology since 2000

Pan-Korean Distributed HPC Resources Daejeon Kwangju Pusan Chuncheon Incheon Suwon Chonan Chongju Jeonju Chang- won Ulsan Pohang Seoul Daegu Cheju Computers Supercomputers Experimental Facilities High Speed Networks Databases Mass Storage Visualization Environment Access Grid System

Importance of R&D Project ■KOREN based distributed Grid Computing environments Overcome limitations of the meteorology area through Grid  Limitations on computing, networking and data storing Solve earlier problems based on disaster prevention data Data format for providers ⇒ Data format for consumers Offer common collaborative environments to weather experts Substitute clusters for supercomputers ■Disaster prevention system by forecasting natural disasters RT data transmission, high-speed producing and processing Parallel technology for numerical models on natural disasters  Low-cost RT disaster prediction Severe weather prediction, environments, East Sea earthquake tsunami (a tidal wave)  Currently depend on GTS in the Japan Meteorological Administration

Final Goals on R&D Project ■ KOREN based Grid system for international disaster prevention ■ KOREN/APII based international joint production of disaster related prevention data ■ development of high speed data access and process system model ■ parallelization of current SWs and sharing international disaster prevention resources KMA SKKU SWU PKNU UCLA (US) Nagoya U. (JP) NIED (JP)

Key Elements on R&D Project ■Current year Sharing data for weather prediction with Japan (APII, Nagoya Univ.) Sharing East Sea seismological information (National Research Institute for Earth Science and Disaster Prevention of Japan) Numerical models for disaster preventions in Grid environments Access Grid for multicasting based on KOREN ■Current year + 1 Sharing and verifying weather data (UCLA) RT transmission of disaster prevention data Development of applications for disaster preventions (MPICH-G2) ■Current year + 2 Use of Data Grid for massive data transmission Use of international core technology for disaster preventions (KOREN, APII)

Data for Disaster Preventions ■International data collection for weather prediction, climates, earthquakes and environments for disaster predictions RT and distributed collection of weather prediction, climates, earthquakes and environments over the entire earth  Access Grid Collaborating organizations for international data sharing  Based on APII-testbed ■Disaster prediction modeling based on the data collection RT locating/allocating distributed computational resources  Computational Grid Data acquisition for analyzing and forecasting global weather prediction ■RT delivery systems for disaster predictions information KOREN + Grid technology => constructing IT infrastructure

Members and Organizations Collaborative working environment for producing disaster prevention data (PKNU(KR), Nagoya Univ.(JP)) Production of data for weather prediction by using Grid (PKNU(KR), UCLA(US)) Seismological observation network between Korea and Japan (KMA(KR), NIED(JP)) KOREN APII-Testbed Communication infrastructure for disaster prevention (SKKU(KR), SWU(KR)) Protocols for monitoring seismic activity Virtual collaboration environment KOREN & APII-Testbed Based Virtual Collaboration Environment For Disaster Preventions

Approaches (2003) PKNU (KR) UCLA (US) Nagoya Univ. (JP) NIED (JP) KMA (KR) SKKU (KR) SWU (KR) RT data exchange for weather prediction Analysis & sharing of massive seismological & meteorological data Policies for sharing data among parties - Data authorization - International cooperation - Collecting individual opinions Production of data for severe weather prediction based on AG Access Grid (AG) -AG environments throughout six parties -Securing AG technique for KOREN Access Grid Demo 1 st Report Weekly Seminar Invited Talks 2 nd Year KOREN/APII-Testbed Based Virtual Collaboration Environments

Approaches ( ) KOREN, APII-Testbed based data production for international environments, earthquakes and severe weather prediction, distributed data access techniques and its applications Combining AG + MPICH-G2 + DG Constructing IT Infrastructure International Conference Final Reports Results from 2004 Weekly Seminar Invited Talks KOREN, APII-Testbed based international environments, earthquake and severe weather prediction data MPICH-G2 - Applications in Grid environments AG based environments, earthquake and severe weather prediction data Data Grid (DG) -Integrated management -Management of distributed data International Conference 2 nd Reports Results from 2003 Weekly Seminar Invited Talks PKNU (KR) UCLA (US) Nagoya Univ. (JP) NIED (JP) KMA (KR) SKKU (KR) SWU (KR) From 1 st Year Current year +1 Current year +2

Research Goal (2003) ■Access Grid connecting KMA, SKKU, SWU and PKNU by KOREN ■Seismological observation network between Korea and Japan by APII-testbed Extended TCP/UDP protocols for high-speed communications ■Data production line for disaster preventions based on MPICH-G2/GQ ■Problem detections and solutions on operations for collaborative working environment based on KOREN/APII- testbed ■Proceeding to the next year Tuning among participating organizations

Example: Organization for Access Grid

Example: Applications in Access Grid ■Establishment of collaborative working environments among parties including universities, laboratories and offices

Restrictions in R&D Project ■Lack of techniques to establish efficient collaborative working environments Sharing computational resources through high speed networks  supercomputers, cluster systems, massive storages Policies through the tuning of management strategies ■Lack of human resources in Grid environments Need re-education programs Invited talks and international technical forums

Improving National Security by establishing international networks for disaster preventions Radical pervasive effect through a technology transfer Create applications using KOREN and APII-testbed → Unification Effect on various areas Applications and Effects “ET over IT” Construction of co-work environments based on KOREN and APII-testbed “α over IT”

Conclusion ■Production and practical use of data for disaster preventions in temporally and spatially distributed computing environments combining KOREN with Grid computing technology ■Raising human resources for Grid technology Producing detailed user guide books/manuals and sharing knowledge through them ■The synergy effect caused by clustering supercomputers through KOREN ■Efficient use of world best IT infrastructure