Usage of WS-PGRADE and gUSE in European and national projects Peter Kacsuk 03/27/2012 1.

Slides:



Advertisements
Similar presentations
Enabling the execution of various workflows (Kepler, Taverna, Triana, P-GRADE) on EGEE Tamas Kukla, Tamas Kiss, Gabor Terstyanszky.
Advertisements

Running Workflows on Clouds and Grids Gabor Terstyanszky, University of Westminster T. Fahringer, P. Kacsuk, J. Montagnat, I. Taylor e-Science Workshop,
1 P-GRADE Portal and GEMLCA Legacy Code Architecture Peter Kacsuk MTA SZTAKI
1 Introduction to SCI-BUS and WS-PGRADE/gUSE Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities Programme under contract.
P. Kacsuk (MTA SZTAKI) – project co-ordinator on behalf of the SCI-BUS consortium SCIence gateway Based User Support (SCI-BUS)
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI Science Gateways for improving the uptake of Grid and Cloud Computing.
© 2006 Open Grid Forum The Astro Community and DCIs in Europe and the role of Astro-CG C. Vuerli - INAF.
P-GRADE and WS-PGRADE portals supporting desktop grids and clouds Peter Kacsuk MTA SZTAKI
WS-PGRADE: Supporting parameter sweep applications in workflows Péter Kacsuk, Krisztián Karóczkai, Gábor Hermann, Gergely Sipos, and József Kovács MTA.
EXTENDING SCIENTIFIC WORKFLOW SYSTEMS TO SUPPORT MAPREDUCE BASED APPLICATIONS IN THE CLOUD Shashank Gugnani Tamas Kiss.
Workflows Information Flows Prof. Silvia Olabarriaga Dr. Gabriele Pierantoni.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI WS-PGRADE/gUSE Supporting e-Science communities in Europe Zoltan Farkas.
Connecting Workflow-Oriented Science Gateways to Multi-Cloud Systems Zoltán Farkas, Péter Kacsuk, Ákos Hajnal MTA SZTAKI.
Using the WS-PGRADE Portal in the ProSim Project Protein Molecule Simulation on the Grid Tamas Kiss, Gabor Testyanszky, Noam.
ER-flow C. Vuerli Contributions by G. Terstyanszky, K. Varga.
Workflow sharing and integration services by the ER-flow project on behalf of the ER-flow consortium EGI Community Forum, Manchester,
1 Developing domain specific gateways based on the WS- PGRADE/gUSE framework Peter Kacsuk MTA SZTAKI Start date: Duration:
Sharing, integrating and executing different workflows in heterogeneous multi-cloud systems Peter Kacsuk MTA SZTAKI SCI-BUS is supported.
07/06/11 New Features of WS-PGRADE (and gUSE) 2010 Q Q2 Miklós Kozlovszky MTA SZTAKI LPDS.
From P-GRADE to SCI-BUS Peter Kacsuk, Zoltan Farkas and Miklos Kozlovszky MTA SZTAKI - Computer and Automation Research Institute of the Hungarian Academy.
Protein Molecule Simulation on the Grid G-USE in ProSim Project Tamas Kiss Joint EGGE and EDGeS Summer School.
Sharing Workflows through Coarse-Grained Workflow Interoperability : Sharing Workflows through Coarse-Grained Workflow Interoperability G. Terstyanszky,
Introduction to SHIWA Technology Peter Kacsuk MTA SZTAKI and Univ.of Westminster
1 Introduction to SCI-BUS and WS-PGRADE/gUSE Peter Kacsuk MTA SZTAKI Start date: Duration: 36 months SCI-BUS is supported.
STAR net, Resources and VOs C. Vuerli, A. Costa, U. Becciani, P. Massimino, G. Castelli.
Introduction to WS-PGRADE and gUSE Tutorial Akos Balasko 04/17/
WS-PGRADE portal and its usage in the CancerGrid project M. Kozlovszky, P. Kacsuk Computer and Automation Research Institute of the Hungarian Academy of.
1 Advanced features of the P-GRADE portal Peter Kacsuk, Gergely Sipos Peter Kacsuk, Gergely Sipos MTA.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
Convert generic gUSE Portal into a science gateway Akos Balasko 02/07/
How to Read gUSE Documents Orange Docs Series for General Pruposes RELEASE ISSUE POLICY LICENSE HOW TO READ GUSE DOCUMENTS GUSE IN A NUTSHELL by Tibor.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Services for advanced workflow programming.
Scientific Gateway for Academic Grid Malaysia Group Name: ZenFone Munirah binti Kassim Ana Farhanah binti Omar Siti Syahirah binti.
Convert generic gUSE Portal into a science gateway Akos Balasko.
SHIWA and Coarse-grained Workflow Interoperability Gabor Terstyanszky, University of Westminster Summer School Budapest July 2012 SHIWA is supported.
Building an European Research Community through Interoperable Workflows and Data ER-flow project Gabor Terstyanszky, University of Westminster, UK EGI.
SHIWA: Is the Workflow Interoperability a Myth or Reality PUCOWO, June 2011, London Gabor Terstyanszky, Tamas Kiss, Tamas Kukla University of Westminster.
Application Specific Module Tutorial Zoltán Farkas, Ákos Balaskó 03/27/
1 SCI-BUS: building e-Science gateways in Europe: building e-Science gateways in Europe Peter Kacsuk and Zoltan Farkas MTA SZTAKI.
1 Porting applications to the NGS, using the P-GRADE portal and GEMLCA Peter Kacsuk MTA SZTAKI Hungarian Academy of Sciences Centre for.
1 SCI-BUS use case Peter Kacsuk, Sandor Acs, Mark Gergely MTA SZTAKI Start date: Duration: 36 months SCI-BUS is supported.
1 Further information and next steps Further information and next steps Gergely Sipos MTA SZTAKI
1 WS-PGRADE/gUSE generic DCI gateway framework for EGI user communities Zoltan Farkas and Peter Kacsuk MTA SZTAKI SCI-BUS is supported.
Introduction to the program of the summer school Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities Programme under contract.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI MTA SZTAKI background for the DARIAH CC Zoltan Farkas MTA SZTAKI LPDS,
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Introduction to SHIWA project EGI User Forum, Vilnius Peter Kacsuk MTA SZTAKI
Supporting Big Data Processing via Science Gateways EGI CF 2015, November, Bari, Italy Dr Tamas Kiss, CloudSME Project Director University of Westminster,
Porting workflows for the Heliophysics Community Dr. Gabriele Pierantoni Trinity College Dublin.
SHIWA Simulation Platform (SSP) Gabor Terstyanszky, University of Westminster EGI Community Forum Munnich March 2012 SHIWA is supported by the FP7.
1 Globe adapted from wikipedia/commons/f/fa/ Globe.svg IDGF-SP International Desktop Grid Federation - Support Project SZTAKI.
New developments of gUSE & WS-PGRADE to support e-science gateways Peter Kacsuk and Miklos Kozlovszky MTA SZTAKI - Computer and Automation Research Institute.
SHIWA project presentation Project 1 st Review Meeting, Brussels 09/11/2011 Peter Kacsuk MTA SZTAKI
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI SCI-BUS and the CloudBroker Platform: Extending Science Gateways to Clouds.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing cloud resources through the WS-PGRADE/gUSE and CloudBroker integrated.
SCI-BUS project Pre-kick-off meeting University of Westminster Centre for Parallel Computing Tamas Kiss, Stephen Winter, Gabor.
Converting P-GRADE Grid Portal into E-Science Gateways A. Balasko, M. Kozlovszky, K. Varga, A. Schnautigel, K. Karóckai, I. Márton, T. Strodl, P. Kacsuk.
Convert generic gUSE Portal into a science gateway Akos Balasko.
Convert generic gUSE Portal into a science gateway Akos Balasko.
1 SCI-BUS: building e-Science gateways in Europe: building e-Science gateways in Europe Peter Kacsuk MTA SZTAKI Start date:
Exposing WS-PGRADE/gUSE for large user communities Peter Kacsuk, Zoltan Farkas, Krisztian Karoczkai, Istvan Marton, Akos Hajnal,
Building an European Research Community through Interoperable Workflows and Data ER-flow Prof. Gabor Terstyanszky, University of Westminster, UK Heildelberg,
Building an European Research Community through Interoperable Workflow and Data Gabor Terstyanszky University of Westminster.
1 SCI-BUS gateway technology for a large variety of user communities Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities.
SHIWA SIMULATION PLATFORM = SSP Gabor Terstyanszky, University of Westminster e-Science Workflows Workshop Budapest 09 nd February 2012 SHIWA is supported.
Workflows in Computational Chemistry Prof
WS-PGRADE for Molecular Sciences and XSEDE
Peter Kacsuk MTA SZTAKI
Introduction to the SHIWA Simulation Platform EGI User Forum,
Presentation transcript:

Usage of WS-PGRADE and gUSE in European and national projects Peter Kacsuk 03/27/2012 1

Downloads statistics at sourceforge 10/18/2011 WS-PGRADE Tutorial

3 WS-PGRADE in European and national projects CancerGrid (EU FP6) ProSim (UK) EDGI (EU FP7) MosGrid (D-Grid) Swiss Proteomics Portal HP-SEE (EU FP7) SHIWA (EU FP7) SCI-BUS (EU FP7)

4 The CancerGrid portal for anti-cancer drug research Workflow development & configuration Algorithms configuration Workflow execution Molecule database browser Integrated components of CancerGrid portal Structure viewer

5 ProSim workflow in g-USE UK project for Protein Molecule Simulation on the Grid a combination of GEMLCA and standard g-USE jobs Executed on 5 different sites of the UK NGS Parameter sweeps in phases 3 and 4 Status: actively used in production Phase 1 Phase 2

6 MosGrid Science Gateway for Molecular Simulations Requirement: Workflow enabled grid portal for UNICORE based on Liferay Solution: Adaptation of WS-PGRADE from GridSphere to Liferay Development of UNICORE Submitter Support for SAML Development of ASM support Status: It’s been in production since May 2011 See details: A Science Gateway for Molecular Simulations

7 Swiss Proteomics Portal 19/05/10 Step 1 Step 2 Result PS1&mzXM L_1 Result PS3&mzXM L_1 Result PS2&mzXM L_1 Result PS4&mzXM L_1 Result PS6&mzXM L_1 Result PS5&mzXM L_1 PS1 ParamA = A2 ParamB = B3 ParamC = C1 TPP Workflow Parameter Sets Data Set parameters.proper ties ParamA = A1; A2 ParamB = B1; B2; B3 ParamC = C1 combine INPUT file_list.txt mzXML_1 mzXML_2 mzXML_3 mzXML_2 mzXML_1 PS2 ParamA = A2 ParamB = B2 ParamC = C1 PS3 ParamA = A2 ParamB = B1 ParamC = C1 PS4 ParamA = A1 ParamB = B3 ParamC = C1 PS5 ParamA = A1 ParamB = B2 ParamC = C1 PS6 ParamA = A1 ParamB = B1 ParamC = C1 OUTPUT Result PS3&mzXM L_2 Result PS2&mzXM L_2 Result PS4&mzXM L_2 Result PS6&mzXM L_2 Result PS5&mzXM L_2 Result PS1&mzXM L_2 Result PS1 Result PS3 Result PS2 Result PS4 Result PS6 Result PS5 Result PS1&mzXM L_1 Result PS3&mzXM L_1 Result PS2&mzXM L_1 Result PS4&mzXM L_1 Result PS6&mzXM L_1 Result PS5&mzXM L_1 Status: Production since Dec 2010 in ETH Zürich See details: Proteomics portal: an e- Science Gateway for Swiss Bioinformatics

8 EDGI portal for local DG: Environmental Risks of Veterinary Medicines Establish whether currently available bioinformatics databases are a potential tool to predict the effects of pharmaceutical compounds on aquatic organisms Wmin Local DG with ~1600 PCs

9 Creating multi-workflow applications and executing them in the multi- middleware SHIWA VO SHIWA Simulation Platform v2 (WS-PGRADE) SHIWA RepositorySHIWA Portal WF1 e-scientist SHIWA Science Gateway invoke WE GEMLCA Service WFn WE1WEp search WF GEMLCA Repository edit WF WE + WF WF1WFm GEMLCA with GIB s1 s2 s3 s5 s2 s4 WF list PGRADE Workflow engine PGRADE Workflow editor gLite DCI MOTEUR WE GWES WE Globus DCI pre-deployed- WEs MOTEUR WE Kepler WE Taverna WE Triana WE local cluster ASKALON WE SHIWA VO ASKALON WE GEMLCA admin

10 SHIWA RepositorySHIWA Portal WF1 SHIWA Science Gateway GEMLCA Service WFn WE1WEp GEMLCA Repository WE + WF WF1WFm GEMLCA with GIB WF list WS- PGRADE Workflow engine WS-PGRADE Workflow editor edit WF s2 search WF s1 s5 s4 gLite DCI MOTEUR WE GWES WE Globus DCI pre-deployed- WEs MOTEUR WE Kepler WE Taverna WE Triana WE local cluster ASKALON WE SHIWA VO ASKALON WE researcher invoke WE s6 GEMLCA admin SHIWA Proxy Server Proxy Server s3 s6 submit WE SHIWA Simulation Platform v2 (WS-PGRADE)

LINGA Prototype Challenge 17/09/11 Meta- Workflow Sub-Workflows Management

12 Main objectives of SCI-BUS 1.Create a generic-purpose gateway technology 2.Elaborate an application-specific gateway building technology and customisation methodology 3.Establish production gateway services both for NGIs (horizontal user communities) and various science communities (vertical user communities) 4.Provide seamless access to major computing, data and networking DCIs and services including supercomputers, clusters, grids and clouds 5.Create and maintain a Liferay portlet repository that enables the quick creation of user specific customised gateways 6.Provide gateway development and application development support 7.Develop business models to guarantee the sustainability of the gateway services and to enable the commercial exploitation

14 Re-usability and adaptability to different communities and needs Create 11 gateways in the 1st project year for the following user communities: 1.International seismology community 2.Helio-physics communityc 3.Swiss systems biology community of the SystemsX.ch project 4.German MoSGrid computational chemistry and bioinformatics community 5.Biomedical researchers community of the Academic Medical Centre of the University of Amsterdam 6.Astrophysics community 7.PireGrid SMEs community 8.Business process modelling community 9.Blender rendering community 10.Citizen web-2 community 11.Public application developer community (based on ETICS-2 results) Create another 16 user community gateways (including 6 subcontractors)

15 Portal Access Portal related information If you are a portal user: access to multi-grid environment WS-PGRADE/gUSE portal If you want to set up your own gateway: download the portal from sourceforge If you are a WF user or developer: SHIWA Simulation platform

16 Invitation to related events IWSG-Life (International Workshop on Science Gateways for Life Sciences), Amsterdam, May, SCI-BUS, SHIWA, EDGI Joint Summer School 2012: on workflows and gateways for grids and clouds Budapest, 2-6 July

17 Thank you for your attention! Questions?