A Catch-All Science Gateway Portal for Malaysia Research Communities The International Workshop on Science Gateways 2013, 3-5 June 2013 Elizabeth Pek Iee.

Slides:



Advertisements
Similar presentations
PRAGMA BioSciences Portal Raj Chhabra Susumu Date Junya Seo Yohei Sawai.
Advertisements

March 6 th, 2009 OGF 25 Unicore 6 and IPv6 readiness and IPv6 readiness
SALSA HPC Group School of Informatics and Computing Indiana University.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
High Performance Computing (HPC) at Center for Information Communication and Technology in UTM.
Jefferson Ridgeway 2, Ifeanyi Rowland Onyenweaku 3, Gregor von Laszewski 1*, Fugang Wang 1 1* Indiana University, Bloomington, IN 47408, U.S.A.,
EXTENDING SCIENTIFIC WORKFLOW SYSTEMS TO SUPPORT MAPREDUCE BASED APPLICATIONS IN THE CLOUD Shashank Gugnani Tamas Kiss.
Seamless Medical Image Processing on the Grid on the Example of Segmentation and Partition of the Airspaces Andrzej Rutkowski 1, Michał Chlebiej 1, Marcelina.
Grid Computing, B. Wilkinson, a.1 Grid Portals.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI WS-PGRADE/gUSE Supporting e-Science communities in Europe Zoltan Farkas.
Connecting Workflow-Oriented Science Gateways to Multi-Cloud Systems Zoltán Farkas, Péter Kacsuk, Ákos Hajnal MTA SZTAKI.
Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
1 port BOSS on Wenjing Wu (IHEP-CC)
Co-ordination & Harmonisation of Advanced e-Infrastructures Research Infrastructures – Grant Agreement n Regional progress report: Mediterranean.
A Cloud is a type of parallel and distributed system consisting of a collection of inter- connected and virtualized computers that are dynamically provisioned.
Holding slide prior to starting show. A Grid-based Problem Solving Environment for GECEM Maria Lin and David Walker Cardiff University Yu Chen and Jason.
Computing for ILC experiment Computing Research Center, KEK Hiroyuki Matsunaga.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker Platform integration into WS-PGRADE/gUSE Zoltán Farkas MTA.
SCI-BS is supported by the FP7 Capacities Programme under contract nr RI Build and Test Portal SCI-BUS - agINFRA OSD Eva Takacs 4D Soft Kft. Budapest,
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
1 Developing domain specific gateways based on the WS- PGRADE/gUSE framework Peter Kacsuk MTA SZTAKI Start date: Duration:
Enabling Grids for E-sciencE ENEA and the EGEE project gLite and interoperability Andrea Santoro, Carlo Sciò Enea Frascati, 22 November.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
Protein Molecule Simulation on the Grid G-USE in ProSim Project Tamas Kiss Joint EGGE and EDGeS Summer School.
Wenjing Wu Andrej Filipčič David Cameron Eric Lancon Claire Adam Bourdarios & others.
Wenjing Wu Computer Center, Institute of High Energy Physics Chinese Academy of Sciences, Beijing BOINC workshop 2013.
Sharing Workflows through Coarse-Grained Workflow Interoperability : Sharing Workflows through Coarse-Grained Workflow Interoperability G. Terstyanszky,
A portal interface to my Grid workflow technology Stefan Rennick Egglestone University of Nottingham
DataNet – Flexible Metadata Overlay over File Resources Daniel Harężlak 1, Marek Kasztelnik 1, Maciej Pawlik 1, Bartosz Wilk 1, Marian Bubak 1,2 1 ACC.
CERN IT Department CH-1211 Genève 23 Switzerland t Monitoring: Tracking your tasks with Task Monitoring PAT eLearning – Module 11 Edward.
Convert generic gUSE Portal into a science gateway Akos Balasko 02/07/
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos
A scalable and flexible platform to run various types of resource intensive applications on clouds ISWG June 2015 Budapest, Hungary Tamas Kiss,
Lightweight construction of rich scientific applications Daniel Harężlak(1), Marek Kasztelnik(1), Maciej Pawlik(1), Bartosz Wilk(1) and Marian Bubak(1,
Cloud-access Author: Riccardo Bruno. cloud-access flow web portal A user accesses through any device to a portal requesting access to an interactive application.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Scientific Gateway for Academic Grid Malaysia Group Name: ZenFone Munirah binti Kassim Ana Farhanah binti Omar Siti Syahirah binti.
Convert generic gUSE Portal into a science gateway Akos Balasko.
The GridPP DIRAC project DIRAC for non-LHC communities.
SHIWA and Coarse-grained Workflow Interoperability Gabor Terstyanszky, University of Westminster Summer School Budapest July 2012 SHIWA is supported.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI Science Gateways and Clouds Dr. Wibke Sudholt CloudBroker GmbH Technoparkstrasse.
1 SCI-BUS: building e-Science gateways in Europe: building e-Science gateways in Europe Peter Kacsuk and Zoltan Farkas MTA SZTAKI.
1 P-GRADE Portal hands-on Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
Introduction to the program of the summer school Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities Programme under contract.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI MTA SZTAKI background for the DARIAH CC Zoltan Farkas MTA SZTAKI LPDS,
The GridPP DIRAC project DIRAC for non-LHC communities.
Breaking the frontiers of the Grid R. Graciani EGI TF 2012.
Usage of WS-PGRADE and gUSE in European and national projects Peter Kacsuk 03/27/
EGEE-II INFSO-RI Enabling Grids for E-sciencE Overview of gLite, the EGEE middleware Mike Mineter Training Outreach Education National.
Consorzio COMETA - Progetto PI2S2 UNIONE EUROPEA Grid2Win : gLite for Microsoft Windows Elisa Ingrà - INFN.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI Introduction to Science Gateway Sustainability Dr. Wibke Sudholt CloudBroker.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI SCI-BUS and the CloudBroker Platform: Extending Science Gateways to Clouds.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing cloud resources through the WS-PGRADE/gUSE and CloudBroker integrated.
SCI-BUS Sílvia Delgado Olabarriaga e-BioScience Group Bioinformatics Laboratory Dept of Epidemiology, Biostatistics and Bioinformatics.
Antonio Fuentes RedIRIS Barcelona, 15 Abril 2008 The GENIUS Grid portal.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Convert generic gUSE Portal into a science gateway Akos Balasko.
SCI-BS is supported by the FP7 Capacities Programme under contract nr RI Quality assurance in SCI-BUS project by applying agile testing practices.
Exposing WS-PGRADE/gUSE for large user communities Peter Kacsuk, Zoltan Farkas, Krisztian Karoczkai, Istvan Marton, Akos Hajnal,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Overview for ENVRI Gergely Sipos, Malgorzata Krakowian EGI.eu
GridMaGrid Users & Applications Conclusions 16/ Grid activities in Morocco Abderrahman El Kharrim CNRST - MaGrid Team Morocco Grid Workshop - Rabat,
Accessing the VI-SEEM infrastructure
Grid Computing: Running your Jobs around the World
WIMEA – ICT: Science Gateway for Weather Information Management in East Africa to interact with ICT Tool WRF MAKWEBA, Damas – DSM Institute of Technology.
Interoperability & Standards
EGEE Middleware: gLite Information Systems (IS)
Presentation transcript:

A Catch-All Science Gateway Portal for Malaysia Research Communities The International Workshop on Science Gateways 2013, 3-5 June 2013 Elizabeth Pek Iee 1, Mohammad Yaser Shafazand 2 and Muhammad Farhan Sjaugi 3 1 NVG Scientific Sdn Bhd, 2 Universiti Putra Malaysia, 3 Academic Grid Malaysia

NovaGlobal Pte Ltd Professional Linux & Windows HPC Services HPC & Cloud Infrastructures & Services Applications Portal & Automated Workflows Computational Science – Compute Generated Imagery (CGI), Materials Science & Bioscience, Numerical Weather Prediction (NWP) Outline Introduction Problems Solution Methodology Screen Shot &Fact Sheet Summary Acknowledgement Demo

NovaGlobal Pte Ltd Professional Linux & Windows HPC Services HPC & Cloud Infrastructures & Services Applications Portal & Automated Workflows Computational Science – Compute Generated Imagery (CGI), Materials Science & Bioscience, Numerical Weather Prediction (NWP) Introduction In Malaysia, the National Grid Initiative/Infrastructure is called Academic Grid Malaysia. The Academic Grid Malaysia is an open access distributed computing infrastructure Open to any Malaysian Academia from institutions and organizations that are recognized by respective ministries to be involved/ associated in/with Distributed-, Grid-, Cloud- and Emerging Computing Applications/Projects The Academic Grid Malaysia provides opportunities to the user communities to run their existing applications more quickly and efficiently, and also to create ambitious new applications, without investing in extra hardware, and software resources.

NovaGlobal Pte Ltd Professional Linux & Windows HPC Services HPC & Cloud Infrastructures & Services Applications Portal & Automated Workflows Computational Science – Compute Generated Imagery (CGI), Materials Science & Bioscience, Numerical Weather Prediction (NWP) Problems However, converting existing applications into Grid applications, and also creating new applications, currently requires significant Grid knowledge, which many users do not have. Most of the user communities that have used Grid are accessing the resources via Linux command line. However some of the users are not familiar with Linux command line, moreover it becomes “extra” work for them after their actual research work. This is one of the reasons of low Distributed Computing Infrastructure (DCI) adoption among research communities in Malaysia.

NovaGlobal Pte Ltd Professional Linux & Windows HPC Services HPC & Cloud Infrastructures & Services Applications Portal & Automated Workflows Computational Science – Compute Generated Imagery (CGI), Materials Science & Bioscience, Numerical Weather Prediction (NWP) Solution In order to solve the problems, we developed a catch-all science gateway portal as the “medium” to access the Academic Grid Malaysia infrastructure. Catch-all here means the portal is not specifically developed/designed for a specific science application. The portal is generic and is able to host many science applications. By providing science gateway portal, it is hoped that user communities no longer face problems and there is a common set standard in accessing the DCI (i.e. NGI Malaysia).

NovaGlobal Pte Ltd Professional Linux & Windows HPC Services HPC & Cloud Infrastructures & Services Applications Portal & Automated Workflows Computational Science – Compute Generated Imagery (CGI), Materials Science & Bioscience, Numerical Weather Prediction (NWP) User community and scientific area targeted by the Science Gateway There are three major user communities that are targeted by the science gateway: –Life science is still one of the main research focus in Malaysia, hence many researchers are doing research on that particular field (i.e. Computational Biology and Chemistry). However, most of them are still using their own personal workstation to do simulation that could take days to complete. Some of the reason why they have yet to adopt the DCI approach is because it requires resources which at this point of time they do not have. –Creative industry (i.e. Multimedia) is one of the area that is actively supported by the government of Malaysia. Hence many academic institution offers programs in this field of study. However, some activities require decent hardware for rendering and not all academic institution can afford this requirement. –Engineering domain generally has adequate resources in running their simulation/application in High Performance Computing. However, most of the users rely on commercial/licensed Engineering software which is costly and has some limitation in the number of users and hardware (i.e. servers).

NovaGlobal Pte Ltd Professional Linux & Windows HPC Services HPC & Cloud Infrastructures & Services Applications Portal & Automated Workflows Computational Science – Compute Generated Imagery (CGI), Materials Science & Bioscience, Numerical Weather Prediction (NWP) Methodology Long before the science gateway for Academic Grid Malaysia is available, NVG Scientific have developed a portal consisting of Bioinformatics application portlets that is currently hosted at the National University of Singapore. However the portal is not suitable to be implemented at the Academic Grid Malaysia infrastructure because most of the portlets was hardcoded to work with the LSF software. Instead, we took the design of each portlet and re-write it according to WS-PGRADE/gUSE+ASM framework.

NovaGlobal Pte Ltd Professional Linux & Windows HPC Services HPC & Cloud Infrastructures & Services Applications Portal & Automated Workflows Computational Science – Compute Generated Imagery (CGI), Materials Science & Bioscience, Numerical Weather Prediction (NWP) Methodology The segregation of the presentation and workflow layer in WS-PGRADE/gUSE framework gives us some benefit: 1.The web programmer can focus on developing/coding the portlet 2.The workflow designer can focus on developing/creating the application workflow that is the actual “workhorse” of the portlet. The workflow shall be tested and validated by the workflow designers and the end-users (volunteer) from each user communities before the web programmer “glues” the presentation layer and the workflow together. After the web programmer glued the presentation layer and the workflow together, the portlet goes to the second validation test before it is released to the public

NovaGlobal Pte Ltd Professional Linux & Windows HPC Services HPC & Cloud Infrastructures & Services Applications Portal & Automated Workflows Computational Science – Compute Generated Imagery (CGI), Materials Science & Bioscience, Numerical Weather Prediction (NWP) How does it works? 9 Computing Element Storage Element Site X Information System Submit job query Retrieve output Workload Management System Academic Grid SCIBUS PORTAL publish state File and Replica Catalog MyProxy + VOMS query create credential process Retrieve status & output Logging and bookkeeping Job status Logging query

NovaGlobal Pte Ltd Screenshot

NovaGlobal Pte Ltd Professional Linux & Windows HPC Services HPC & Cloud Infrastructures & Services Applications Portal & Automated Workflows Computational Science – Compute Generated Imagery (CGI), Materials Science & Bioscience, Numerical Weather Prediction (NWP) Fact Sheet Portal homepage : Portal Framework : WS-PGRADE/gUSE version Programming API : ASM 3.4 Operating System : Scientific Linux 6.2 Grid Middleware : EMI Middleware UI version 2.0 Applications: Autodock4, AMBER, NWChem, GROMACS, FastDNAml, Phase, Clustalw-MPI, BLAST*, Muscle, OpenFOAM,Blender*, Multidendrograms, PROSPECT, NAMD*, Glimmer* * Will be released soon.

NovaGlobal Pte Ltd Professional Linux & Windows HPC Services HPC & Cloud Infrastructures & Services Applications Portal & Automated Workflows Computational Science – Compute Generated Imagery (CGI), Materials Science & Bioscience, Numerical Weather Prediction (NWP) Summary The NGI Malaysia provide opportunities to the user communities to run their existing applications more quickly and efficiently, and also to create ambitious new applications, without investing in extra hardware, and software resources. Most of the user communities that have used Grid are accessing the resources via Linux command line. However this becomes a problem since not all of the users has Linux skills. This is one of the reasons for low Distributed Computing Infrastructure (DCI) adoption among research communities in Malaysia. By providing them a science gateway, it is hoped that user communities no longer face any problem in accessing the DCI (i.e. Academic Grid Malaysia) and also increase the adoption of the DCI technology among research communities in Malaysia

NovaGlobal Pte Ltd Professional Linux & Windows HPC Services HPC & Cloud Infrastructures & Services Applications Portal & Automated Workflows Computational Science – Compute Generated Imagery (CGI), Materials Science & Bioscience, Numerical Weather Prediction (NWP) Acknowledgement Herewith we would like to thank you: –SCI-BUS project for providing us research grant to develop the Science Gateway for Research Communities in Malaysia. SCI- BUS is supported by the EU FP7 Capacities Programme under contract n°RI NVG Scientific Sdn Bhd has been appointed as one of SCI-BUS subcontractor. –Centre for Information and Communication Technology – Universiti Teknologi Malaysia for providing us resource to access to the Malaysia Research and Education Network.

NovaGlobal Pte Ltd Professional Linux & Windows HPC Services HPC & Cloud Infrastructures & Services Applications Portal & Automated Workflows Computational Science – Compute Generated Imagery (CGI), Materials Science & Bioscience, Numerical Weather Prediction (NWP) Demo Login to : Username: Password: 45scibus123