Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006.

Slides:



Advertisements
Similar presentations
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Advertisements

Prof. Natalia Kussul, PhD. Andrey Shelestov, Lobunets A., Korbakov M., Kravchenko A.
Cloud computing in spatial data processing for the Integrated Geographically Distributed Information System of Earth Remote Sensing (IGDIS ERS) Open Joint-Stock.
HIRLAM Use of the Hirlam NWP Model at Met Éireann (Irish Meteorological Service) (James Hamilton -- Met Éireann)
Information Technology Center Introduction to High Performance Computing at KFUPM.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Institute for High Energy Physics ( ) NEC’2007 Varna, Bulgaria, September Activities of IHEP in LCG/EGEE.
Cracow Grid Workshop November 5-6 Support System of Virtual Organization for Flood Forecasting L. Hluchy, J. Astalos, V.D. Tran, M. Dobrucky and G.T. Nguyen.
Microsoft Clustering Sean Roberts, Jean Pierre SLAC.
An Introduction to Princeton’s New Computing Resources: IBM Blue Gene, SGI Altix, and Dell Beowulf Cluster PICASso Mini-Course October 18, 2006 Curt Hillegas.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
International Workshop APAN 24, Current State of Grid Computing Researches and Applications in Vietnam Nguyen Thanh Thuy 1, Nguyen Kim Khanh 1,
High Performance Computing (HPC) at Center for Information Communication and Technology in UTM.
Bondyakov A.S. Institute of Physics of ANAS, Azerbaijan JINR, Dubna.
Implementing Failover Clustering with Hyper-V
1 Int System Introduction to Systems and Networking Department Faculty of Computer Science and Engineering Ho Chi Minh City University of Technology.
E-Infrastructure for Science in Georgia Prof. Ramaz Kvatadze Georgian Research and Educational Networking Association – GRENA
05/18/03Maurizio Davini Hepix2003 Department of Physics University of Pisa Site Report Maurizio Davini Department of Physics and INFN Pisa.
Operational computing environment at EARS Jure Jerman Meteorological Office Environmental Agency of Slovenia (EARS)
and beyond Office of Vice President for Information Technology.
1 Application of multiprocessor and GRID technology in medical image processing IKTA /2002.
1 UK NeSC Meeting, November 18 th, 2004 Terry Sloan EPCC, The University of Edinburgh INWA : using OGSA-DAI in a commercial environment.
DoSon Grid Computing School, Current State of Grid Computing Researches and Applications in Vietnam Vu Duc Thi 1, Nguyen Thanh Thuy 2, Tran Van.
OGCE Workflow Suite GopiKandaswamy Suresh Marru SrinathPerera ChathuraHerath Marlon Pierce TeraGrid 2008.
UTA Site Report Jae Yu UTA Site Report 4 th DOSAR Workshop Iowa State University Apr. 5 – 6, 2007 Jae Yu Univ. of Texas, Arlington.
Introduction to the HPCC Dirk Colbry Research Specialist Institute for Cyber Enabled Research.
The Mauna Kea Weather Center: the need for custom forecasts Steven Businger, Tiziana Cherubini and R. Lyman.
MURI Hardware Resources Ray Garcia Erik Olson Space Science and Engineering Center at the University of WI - Madison.
Research, E-infrastructure and Future Internet in Armenia Yuri Shoukourian National Academy of Sciences of RA INET Armenia conference 8-9 October 2013,
Hanoi, Vietnam, May 2007 ESA CAT-1 inter-Grid testbed Nataliia Kussul, Andrii Shelestov Space Research Institute NASU-NSAU, Ukraine.
VAN HOAI TRAN FACULTY OF COMPUTER SCIENCE & ENGINEERING HCMC UNIVERSITY OF TECHNOLOGY AAOS 2008 Open Grid Computing Architecture.
Batch Scheduling at LeSC with Sun Grid Engine David McBride Systems Programmer London e-Science Centre Department of Computing, Imperial College.
HPC system for Meteorological research at HUS Meeting the challenges Nguyen Trung Kien Hanoi University of Science Melbourne, December 11 th, 2012 High.
Laboratório de Instrumentação e Física Experimental de Partículas GRID Activities at LIP Jorge Gomes - (LIP Computer Centre)
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
The II SAS Testbed Site Jan Astalos - Institute of Informatics Slovak Academy of Sciences.
ARGONNE NATIONAL LABORATORY Climate Modeling on the Jazz Linux Cluster at ANL John Taylor Mathematics and Computer Science & Environmental Research Divisions.
CCS Overview Rene Salmon Center for Computational Science.
Global Observing System Simulation Experiments (Global OSSEs) How It Works Nature Run 13-month uninterrupted forecast produces alternative atmosphere.
NSAU Flood Model Use in Sensor Web: Lessons Learned Sergii Skakun Space Research Institute NASU-NSAU, Ukraine CEOS WGISS-27 May 11-15, 2009 Toulouse, France.
On High Performance Computing and Grid Activities at Vilnius Gediminas Technical University (VGTU) dr. Vadimas Starikovičius VGTU, Parallel Computing Laboratory.
GO-ESSP Workshop, LLNL, Livermore, CA, Jun 19-21, 2006, Center for ATmosphere sciences and Earthquake Researches Construction of e-science Environment.
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
EVGM081 Multi-Site Virtual Cluster: A User-Oriented, Distributed Deployment and Management Mechanism for Grid Computing Environments Takahiro Hirofuchi,
GridLab Resource Management System (GRMS) Jarek Nabrzyski GridLab Project Coordinator Poznań Supercomputing and.
Grid Interest Group Activities WGISS-28, September 30, 2009 Pretoria, South Africa.
December 26, 2015 RHIC/USATLAS Grid Computing Facility Overview Dantong Yu Brookhaven National Lab.
Amagees Tech Corp value added services Data Management and Infrastructure.
Final Implementation of a High Performance Computing Cluster at Florida Tech P. FORD, X. FAVE, K. GNANVO, R. HOCH, M. HOHLMANN, D. MITRA Physics and Space.
Grid Remote Execution of Large Climate Models (NERC Cluster Grid) Dan Bretherton, Jon Blower and Keith Haines Reading e-Science Centre
Ole’ Miss DOSAR Grid Michael D. Joy Institutional Analysis Center.
Ukrainian Academic Grid Initiative (UAGI) Status and outlook G. Zinovjev Bogolyubov Institute for Theoretical Physics Kiev, Ukraine.
China Grid Activities update Li Guoqing NRSCC, China 13,Sept, 2005 Present for WGISS-20, Kiev.
Operational and Application Experiences with the Infiniband Environment Sharon Brunett Caltech May 1, 2007.
INRNE's participation in LCG Elena Puncheva Preslav Konstantinov IT Department.
1 WRF Configuration for Ukraine  Input & boundary conditions from NCEP GFS model  3 day forecasts every 6 hours  10 km horizontal grid, 200x200 gridpoints.
Central Operations Ben Kyger Acting Director / NCEP CIO.
Instituto de Biocomputación y Física de Sistemas Complejos Cloud resources and BIFI activities in JRA2 Reunión JRU Española.
The use of the SCMS-EMI as scientific gateway in BCC of NGI_UA Authors: Andrii Golovynskyi, Andrii Malenko, Valentyna Cherepynets V. Glushkov Institute.
Activities and Perspectives at Armenian Grid site The 6th International Conference "Distributed Computing and Grid- technologies in Science and Education"
ChinaGrid: National Education and Research Infrastructure Hai Jin Huazhong University of Science and Technology
Grid Activities in the Philippines Rey Vincent P. Babilonia Advanced Science and Technology Institute Department of Science and Technology PHILIPPINES.
NIIF HPC services for research and education
INFN Computing Outlook The Bologna Initiative
Grid infrastructure development: current state
Sensor Web & Grid Technical Issues
WORKFLOW PETRI NETS USED IN MODELING OF PARALLEL ARCHITECTURES
Thales Alenia Space Competence Center Software Solutions
Presentation transcript:

Budapest 2006 Grid Activities in Ukraine Nataliya Kussul Space Research Institute NASU-NSAU, Ukraine WGISS 21, Budapest 2006

Budapest 2006 Main issues: Infrastructure –Hardware resources –Technologies Applications –Numerical Weather Prediction –Meteosat Data Processing Services Cloud Mask Cloud Motion Fractal Feature Extraction Current State of Grid Projects involved Prospects

Budapest 2006 Current Infrastructure

Budapest 2006 Hardware resources Cluster SKIT-1 –24x2 Intel Xeon (2.6 GHz) –Infiniband interconnect Cluster SKIT-2 –32x2 Intel Itanium II (1.4 GHz) –SCI interconnect Development cluster –2x2 AMD Opteron (2.2 GHz) –Gigabit Ethernet interconnect

Budapest 2006 Hardware resources LustreFS NAS: 14TB storage iSCSI SAN: 2TB storage Gigabit Ethernet inter-cluster connection A number of UNIX-based workstations Condor pool of MS Windows workstations

Budapest 2006 SKIT-1 SKIT-2Development cluster

Budapest 2006 Cluster load reports WRF model load profile

Budapest 2006 Technologies Globus Toolkit v4 – Grid middleware Karajan – workflow description language UNM MapServer – OGC-compliant software for geospatial data presentation Torque – local cluster scheduler OpenMPI & Scaly – MPI standard implementations Ganglia – monitoring tool Ruby – scripting language

Budapest 2006 Applications Meteosat cloud mask extraction Cloud motion estimation Fractal features extraction Numerical Weather Prediction (WRF model)

Budapest 2006 WRF run subsystem (1) Configured for territory of Ukraine Input & boundary condition from GFS 3 day forecasts every 6 hours 10 km horizontal grid, 200x200 gridpoints 31 vertical levels One run takes 3.5 hours on 2x2 Opteron system

Budapest 2006 WRF run subsystem (2)

Budapest 2006 WRF run subsystem (2)

Budapest 2006 WRF visualization UMN MapServer based Available at

Budapest 2006 Meteosat visualization UMN MapServer based Available at

Budapest 2006 Cloud motion estimation –useful as the source data for Numerical Weather Prediction models –temporary interpolation/extrapolation of image sequences for now casting –based on adapted optical flow techniques

Budapest 2006 Fractal features extraction –Based on modeling of Meteosat images by Generalized Brownian Motion processes –Useful for detecting turbulent areas

Budapest 2006 Current state At the moment Grid middleware is being deployed on SKITs frontend node. SKITs are using proprietary local scheduler An adapter between Globus GRAM and scheduler should be developed

Budapest 2006 Projects involved (1) “Cosmogis” project supported by Ukrainan National Space Agency STCU project “Grid technologies for environmental monitoring using satellite data” (started on December, 2005) Innovative project of National Academy of Science of Ukraine ”Development of pilot project of Ukrainian GEOSS/GMES segment” (2006)

Budapest 2006 Projects involved (2) INTAS-CNES-NSAU call –Project “Data Fusion Grid Infrastructure” is under preparation - Practical way to initiate cooperative activity of agencies on Grid creation We are looking for partners!

Budapest 2006 Plans: Technology To develop Grid-enabled archive for geospatial data based on OGSA-DAI To establish data assimilation of MSG and ATOVS data into modeling process To use Grid infrastructure to perform a model automatic adaptation experiment To work out patterns for inter-domain security policy

Budapest 2006 Plans: organizational To connect to European academic network GEANT To connect to Ukrainian academic network URAN To become a regional center of GEOSS/GMES To participate in the development of WAG To include Ukrainian databases into ECHO system

Budapest 2006 Thank you!