International Workshop APAN 24, Current State of Grid Computing Researches and Applications in Vietnam Nguyen Thanh Thuy 1, Nguyen Kim Khanh 1, Nguyen Thanh Thuy 1, Nguyen Kim Khanh 1, Tran Ba Thai 2 1 Hanoi University of Technology 2 Institute of Information Technology On behalf of the members of the VNGrid Project
2 Outline Researches on grid computing in Vietnam Researches on grid computing in Vietnam –Centers for High Performance Computing –Research activities Towards a grid infrastructure for Vietnam Towards a grid infrastructure for Vietnam –VNGrid project –The aims –Planed activities Initial results: Initial results: –a data grid for meteorology Conclusion Conclusion
3 Grid computing in Vietnam Initial step Initial step –since a few last years –several HPC centers in Hanoi and HCM City Hanoi University of Technology Hanoi University of Technology Institute of Information Technology, HCM City Institute of Information Technology, HCM City Vietnam National University, Hanoi Vietnam National University, Hanoi Vietnamese Institute of Mathematics Vietnamese Institute of Mathematics HCM City University of Technology HCM City University of Technology Centers for HPC
4 Milestones First center for HPC at HUT 300 GFlops computing center at VNU (max) Other HPC centers are founded First national conference on HPC and grid computing in HCM city BK Grid Group at HUT BioGrid Group at IOIT-HCM TEIN2-VN Project (Trans-Eurasia Information Network) VNGrid Project
5 Encountered Issues Encountered Issues Not yet HPC centers of Tera Flops Not yet HPC centers of Tera Flops Not yet a common infrastructure to connect HPC centers Not yet a common infrastructure to connect HPC centers Grid computing rests in academic researches. Not yet large scale applications. Grid computing rests in academic researches. Not yet large scale applications.
6 Activities done Building grid portals Building grid portals –BKGrid (HUT) –Grid iPortal (VNU-HCM) Experimenting with applications on Experimenting with applications on –Meteorology (HUT, VNU-Hanoi) –Bioinformatics (IOIT-HCM) Participating in international grids Participating in international grids –Pragma (IOIT-HCM) –APGrid (Vietnamese Institute of Mathematics)
7 VNGrid Project Financed by Ministry of Science and Technology of Vietnam A two year project, to be finished in October partners in the project – –HUT – –IOIT in Hanoi – –IOIT in HCM City – –VNU in Hanoi – –Vietnam Military Technical Academy (VMTA)
8 The aims of VNGrid (1) Building a cyber-infrastructure to connect five partners in VN-Grid Building a cyber-infrastructure to connect five partners in VN-Grid Deploying advanced grid technologies to improve the performance Deploying advanced grid technologies to improve the performance –Resource monitoring and discovering –Scheduling and brokering hard to reach the objective!
9 The aims of VNGrid (2) Experimenting grid-based applications on Experimenting grid-based applications on – –Bioinformatics, – –Meteorology, – –Virtual Reality, – –Cryptography. Being connected to other grid systems in the region and over the world
10 Planned activities Selecting the common technology solution for the whole VNGrid – –suitable for the infrastructure in Vietnam – –Via TEIN2 Establishing necessary security policy Developing and deploying some grid applications Building a VNGrid Portal Connecting VNGrid to PRAGMA and some others
11 Attended results Establishing VNGrid for Grid RD and application community in Vietnam Establishing VNGrid for Grid RD and application community in Vietnam Assembling separated HPC centers in Vietnam Assembling separated HPC centers in Vietnam Reinforcing researches on grid computing in Vietnam Reinforcing researches on grid computing in Vietnam Towards applying GC in industrial domains Towards applying GC in industrial domains Opening a new opportunity for collaboration with partners outside Vietnam: HPC, storage and content resources!!! Opening a new opportunity for collaboration with partners outside Vietnam: HPC, storage and content resources!!!
12 Apllication 1: Bioinformatics Deploying grid technologies for Gene Mapping (IOIT-HCM) – –Use Haplotype Pattern Mining (HPM), and Density Based Spatial Clustering of Application with Noise (DBSCAN) to specify the locations of genetic diseases Performing Blast and gene prediction in Grid computing environment using iGridPortal (HCM City College of Natural Sciences)
13 Apllication 2: Meteorological Forecast Using agent technologies to deploy grid services Using agent technologies to deploy grid services –An agent has responsible for calling appropriate services following user requirements Globus Toolkit GRAMMDS 3Grid FTP Cluster PBS Cluster PBS BKGrid Portal Security Service Information Service Weka Resource Broker Agent HPC Service Fedora Core 1
14 Application 2: BKGrid and Meteorological Forecast (cont) Applying the HPC and Grid Computing for climate forecast (HUT, VNU-Hanoi) – –Deploying the MM5 model Vietnamese Institute of Mathematics Exploiting resources on APGrid to run a model for climate forecast (Vietnamese Institute of Mathematics)
15 Intial results: data grid for meteorology at HUT Weather forecasting plays an important role in the society Weather forecasting plays an important role in the society –for agriculture, commerce, catastrophe preventing, etc. There are different institutions in Vietnam working on the meteorology problems but the cooperation is not easy for There are different institutions in Vietnam working on the meteorology problems but the cooperation is not easy for –sharing local observation data –sharing hardware and software resources on computing weather forecast data
16 A data grid portal for meteorology Building a data grid for sharing meteorological datasets is a suitable solution in Vietnam for: Building a data grid for sharing meteorological datasets is a suitable solution in Vietnam for: –Exploiting resources from different HPC centers –Providing a central and easy access point to all meteorological data via a grid portal –Offering a reliable mean for storing and sharing meteorological data for research purpose –Public access to climate forecast website
17 System architecture
18 Weather forecast modeling Model used for weather forecasting: MM5. Model used for weather forecasting: MM5. It can be run on a cluster for the high performance It can be run on a cluster for the high performance
19 Deployment of MM5 model MM5 model already deployed automatically in a cluster with 3 datasets each day MM5 model already deployed automatically in a cluster with 3 datasets each day –Downloading periodically global meteorology data from the AVN site –Combining with local observation data on modeling –Configuring easily the modeling process via a configuration file –Fault tolerance implemented to make the service more reliable
20 Data grid services Data grid as a virtual container for storing data and easy access later Data grid as a virtual container for storing data and easy access later Basic services provided: Basic services provided: –Replicating data in several nodes –Searching data based on metadata –Transferring data between nodes
21 Prototype
22 Conclusion Grid Computing brings chances to developing countries as Vietnam. We need: Grid Computing brings chances to developing countries as Vietnam. We need: –Computing Resources and HPC –Storage Resources and Data in applications, –QoS networking service. –Grid tools –Collaboration Shortage of resources and only initial steps done, more co-operations needed!
23 Conclusion We would like to join grid computing communities in We would like to join grid computing communities in –APAN –TEIN
International Workshop APAN 24, Thank you very much for your attention!