ER-flow Purpose of the meeting C. Vuerli Contributions by G. Terstyanszky.

Slides:



Advertisements
Similar presentations
Running Workflows on Clouds and Grids Gabor Terstyanszky, University of Westminster T. Fahringer, P. Kacsuk, J. Montagnat, I. Taylor e-Science Workshop,
Advertisements

1 Introduction to SCI-BUS and WS-PGRADE/gUSE Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities Programme under contract.
P. Kacsuk (MTA SZTAKI) – project co-ordinator on behalf of the SCI-BUS consortium SCIence gateway Based User Support (SCI-BUS)
© 2006 Open Grid Forum The Astro Community and DCIs in Europe and the role of Astro-CG C. Vuerli - INAF.
SCD in Horizon 2020 Ian Collier RAL Tier 1 GridPP 33, Ambleside, August 22 nd 2014.
Workflows Information Flows Prof. Silvia Olabarriaga Dr. Gabriele Pierantoni.
Virtual Collaborative Social Living Community for Elderly Kick Off Event WP 7 Plan 1 st period Inova+
Bioinformatics Grid Application for Life Science. COMMUNICATION NETWORK DEVELOPMENT SPECIFIC SUPPORT ACTION BIOINFOGRID Luciano Milanesi CNR-ITB.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI WS-PGRADE/gUSE Supporting e-Science communities in Europe Zoltan Farkas.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Co-funded.
ER-flow C. Vuerli Contributions by G. Terstyanszky, K. Varga.
Workflow sharing and integration services by the ER-flow project on behalf of the ER-flow consortium EGI Community Forum, Manchester,
SEE-GRID-2 The SEE-GRID-2 initiative is co-funded by the European Commission under the FP6 Research Infrastructures contract no
Sharing, integrating and executing different workflows in heterogeneous multi-cloud systems Peter Kacsuk MTA SZTAKI SCI-BUS is supported.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Lessons learnt from the EGEE Application Porting Support activity Gergely Sipos Coordinator.
From P-GRADE to SCI-BUS Peter Kacsuk, Zoltan Farkas and Miklos Kozlovszky MTA SZTAKI - Computer and Automation Research Institute of the Hungarian Academy.
Sharing Workflows through Coarse-Grained Workflow Interoperability : Sharing Workflows through Coarse-Grained Workflow Interoperability G. Terstyanszky,
Introduction to SHIWA Technology Peter Kacsuk MTA SZTAKI and Univ.of Westminster
1 Introduction to SCI-BUS and WS-PGRADE/gUSE Peter Kacsuk MTA SZTAKI Start date: Duration: 36 months SCI-BUS is supported.
ESIP Federation Air Quality Cluster Partner Agencies.
INFSO-RI Enabling Grids for E-sciencE Plan until the end of the project and beyond, sustainability plans Dieter Kranzlmüller Deputy.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Training services offered by SZTAKI for EGEE and EGI Gergely Sipos MTA SZTAKI (Hungarian.
The Astronomy challenge: How can workflow preservation help? Susana Sánchez, Jose Enrique Ruíz, Lourdes Verdes-Montenegro, Julian Garrido, Juan de Dios.
Cooperative experiments in VL-e: from scientific workflows to knowledge sharing Z.Zhao (1) V. Guevara( 1) A. Wibisono(1) A. Belloum(1) M. Bubak(1,2) B.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures Grant Agreement n
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE’09 SSC Workshop SAFE Project Proposal.
18/03/2013, Villigen Development plan in WP19 MTA SZTAKI Robert Lovas MTA SZTAKI Laboratory of Parallel and Distributed Systems.
1 RI WP4 version: 3.0 Introduction Author: Robert Lovas, Ad Emmen DEGISCO Desktop Grids for International Scientific Collaboration
EGEE is a project funded by the European Union under contract IST Generic Applications in EGEE-NA4 Roberto Barbera NA4 Generic Applications.
SHIWA and Coarse-grained Workflow Interoperability Gabor Terstyanszky, University of Westminster Summer School Budapest July 2012 SHIWA is supported.
Building an European Research Community through Interoperable Workflows and Data ER-flow project Gabor Terstyanszky, University of Westminster, UK EGI.
INFSO-RI Enabling Grids for E-sciencE The EGEE Project Owen Appleton EGEE Dissemination Officer CERN, Switzerland Danish Grid Forum.
VLDATA Common solution for the (very-)large data challenge EINFRA-1, focus on topics (4) & (5)
SHIWA: Is the Workflow Interoperability a Myth or Reality PUCOWO, June 2011, London Gabor Terstyanszky, Tamas Kiss, Tamas Kukla University of Westminster.
1 SCI-BUS: building e-Science gateways in Europe: building e-Science gateways in Europe Peter Kacsuk and Zoltan Farkas MTA SZTAKI.
1 SCI-BUS use case Peter Kacsuk, Sandor Acs, Mark Gergely MTA SZTAKI Start date: Duration: 36 months SCI-BUS is supported.
Introduction to the program of the summer school Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities Programme under contract.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI MTA SZTAKI background for the DARIAH CC Zoltan Farkas MTA SZTAKI LPDS,
1 st EGI CMMST VT meeting 19 February 2013 A. Laganà (UNIPG, Italy)
1 Web: SGI - Science Gateways Initiative Delivering Science Gateway infrastructure components and solutions Stephen.
Introduction to SHIWA project EGI User Forum, Vilnius Peter Kacsuk MTA SZTAKI
Porting workflows for the Heliophysics Community Dr. Gabriele Pierantoni Trinity College Dublin.
SHIWA Simulation Platform (SSP) Gabor Terstyanszky, University of Westminster EGI Community Forum Munnich March 2012 SHIWA is supported by the FP7.
Usage of WS-PGRADE and gUSE in European and national projects Peter Kacsuk 03/27/
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Application Porting Support Gergely Sipos,
SAFE SSCs for A&A, Fusion and ES Coordinator: Claudio Vuerli, INAF, Italy.
SHIWA project presentation Project 1 st Review Meeting, Brussels 09/11/2011 Peter Kacsuk MTA SZTAKI
Using SHIWA Workflow Interoperability Tools for Neuroimaging Data Analysis Applications Vladimir Korkhov 1, Dagmar Krefting 2, Tamas Kukla 3, Gabor Terstyanszky.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Collaboration.
1 SCI-BUS: building e-Science gateways in Europe: building e-Science gateways in Europe Peter Kacsuk MTA SZTAKI Start date:
Exposing WS-PGRADE/gUSE for large user communities Peter Kacsuk, Zoltan Farkas, Krisztian Karoczkai, Istvan Marton, Akos Hajnal,
Building an European Research Community through Interoperable Workflows and Data ER-flow Prof. Gabor Terstyanszky, University of Westminster, UK Heildelberg,
HELIOGATE – A USER EXPERIENCE PERSPECTIVE G.Pierantoni, E. Carley, B. Bentley S. Olabarriaga E. Sciacca, G. Taffoni, G. Castelli, U. Becciani.
Building an European Research Community through Interoperable Workflow and Data Gabor Terstyanszky University of Westminster.
1 The Life-Science Grid Community Tristan Glatard 1 1 Creatis, CNRS, INSERM, Université de Lyon, France The Spanish Network for e-Science 2/12/2010.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Application Porting Support SSC and proposal Gergely Sipos
1 SCI-BUS gateway technology for a large variety of user communities Peter Kacsuk MTA SZTAKI SCI-BUS is supported by the FP7 Capacities.
SHIWA SIMULATION PLATFORM = SSP Gabor Terstyanszky, University of Westminster e-Science Workflows Workshop Budapest 09 nd February 2012 SHIWA is supported.
EDGI European Desktop Grid Initiative
Coarse Grained Interoperability scenarios
RDA US Science workshop Arlington VA, Aug 2014 Cees de Laat with many slides from Ed Seidel/Rob Pennington.
NA3 Activities (until April 2005)
Workflows in Computational Chemistry Prof
Peter Kacsuk MTA SZTAKI
TAPAS in the EGI “ecosystem”
EGI Webinar - Introduction -
Conference: Data and Life Sci +DC
DEGISCO project - Desktop Grids for application developers and users
Introduction to the SHIWA Simulation Platform EGI User Forum,
Presentation transcript:

ER-flow Purpose of the meeting C. Vuerli Contributions by G. Terstyanszky

University of WestminsterUoWUnited Kingdom Magyar Tudomanyos Akademia Szamitastechnikai es Automatizalasi Kutato Intezete MTA-SZTAKIHungary Centre National de la Recherche ScientifiqueCNRSFrance Stichting European Grid InitiativeEGI.euThe Netherlands Academic Medical Center of the University of Amsterdam AMCThe Netherlands Technische Universität DresdenTUDGermany Ludwig-Maximilians-Universität MünchenLMUGermany University College LondonUCLUnited KIngdom Trinity College DublinTCDIreland Istituto Nazionale di AstrofisicaINAFItaly Partners: Technology providers: CNRS, EGI.eu, MTA-SZTAKI, UoW Research Communities: Astro-PhysicsINAF Computational ChemistryLMU + TUD Helio-PhysicsTCD + UCL Life ScienceAMC Duration: September 2012 – August 2014 ER-flow Project

Project Aim and Services Aim: To provide a simulation platform for research communities to enable seamless execution of workflows of different workflow systems through workflow interoperability To investigate data interoperability issues in the workflow domain and propose solutions Services: To support the whole workflow lifecycle: editing, uploading, browsing downloading and executing workflows To provide coarse-grained workflow interoperability solution To provide GUIs to manage workflows Key actors: Researchers Workflow engine developers Workflow developers

Objective No. 1: To further build a European community of workflow developers and users involving a wide range of research communities which already use workflow systems and which are new to this technology. Objective No. 2: To migrate workflow based scientific applications of the supported research communities to the European Grid Infrastructure through the SHIWA Simulation Platform and to use these applications both for production runs and to promote e-Science workflow solutions for research communities. Objective No. 3: To disseminate the workflow interoperability solution of the SHIWA project among the selected research communities and identify further research communities that need the simulation platform to run their experiments. Objective No. 4: To define requirements of the supported research communities on interoperability of the scientific data in the workflow domain and to identify existing and missing protocols and standards needed to support this interoperability. Objective No. 5: To write a study on the interoperability of the scientific data in the workflow domain, make recommendations on how to achieve data and workflow interoperability with existing protocols and standard, and identify research, development and standardisation issues required to be solved in order to achieve workflow interoperability in data-intensive research. Project Objectives

No.descriptionM12M24milestonesWP 01new research communities of SSP 24M2.2/M2.3WP2 02number of researchers using SSP M5.2/M5.3WP5 Objective No. 1: To further build a European community of workflow developers and users involving a wide range of research communities which already use workflow systems and which are new to this technology. Objectives and Indicators Questions: -Which communities are we addressing? -How will we reach 250 users? Which communities will they represent? -Will they workflow developers or researchers with basic IT knowledge?

Objective No. 2: To migrate workflow based scientific applications of the supported research communities to the European Grid Infrastructure through the SHIWA Simulation Platform and to use these applications both for production runs and to promote e-Science workflow solutions for research communities. No.descriptionM12M24milestonesWP 03Astro-Physics workflows614M5.2/M5.3WP5 04Computational Chemistry workflows 1020M5.2/M5.3WP5 05Helio-Physics workflows614M5.2/M5.3WP5 06Life Science workflows1020M5.2/M5.3WP5 07number of executed workflows M5.2/M5.3WP5 Objectives and Indicators Questions: -Do we have these workflows? If we don’t have them how will we identify and find them? Will they non-native or meta-workflows? -Do we have “real” users who will run 3000 times workflows available in the repository?

Objective No. 3: To disseminate the workflow interoperability solution of the SHIWA project among the selected research communities and identify further research communities that need the simulation platform to run their experiments. No.descriptionM12M24milestonesWP 08dissemination & training events for supported communities 48M2.2/M2.3WP2 09dissemination & training events for new communities 24M2.2/M2.3WP2 10European dissemination & training events 24M2.2/M2.3WP2 11users of the User Forum200400M2.2/M2.3WP2 12publications on research achievements 48M5.2/M5.3WP5 Objectives and Indicators Questions: -What kind of dissemination and training events will we run? How will identify the dissemination and training events? Who will run these events? -How will we run the User Forum? How will we attract users to the forum?

Objective No. 4: To define requirements of the supported research communities on interoperability of the scientific data in the workflow domain and to identify existing and missing protocols and standards needed to support this interoperability. No.descriptionM12M24milestonesWP 13requirements specification for data interoperability 22M3.1/M5.1WP2 WP5 Objectives and Indicators Questions: -What kind of data interoperability issues will we target? -How will we identify these requirements? Who identify these requirements?

Objective No. 5: To write a study on the interoperability of the scientific data in the workflow domain, make recommendations on how to achieve data and workflow interoperability with existing protocols and standard, and identify research, development and standardisation issues required to be solved in order to achieve workflow interoperability in data-intensive research. No.descriptionM12M24milestonesWP 14recommendations on data interoperability 01M4.2WP4 15publications on data interoperability 04M4.2WP4 Objectives and Indicators

Work Packages and Efforts No.titlem/mWP leader startingending WP1Project Management6UoW0124 WP2Knowledge Transfer29SZTAKI0124 WP3Infrastructure & Technical Support 20UoW0124 WP4Data Interoperability in Workflow Domain 30CNRS0124 WP5Application Support76AMC0124

partnerswp1wp2wp3wp4wp5 UoW MTA-SZTAKI8424 CNRS15151 EGI.eu624 AMC3319 partnerswp1wp2wp3wp4wp5 TUD29 LMU48 UCL215 TCD18 INAF3215 Partners and Efforts

User Communities and Simulation Platform Research communities supported by the project –Astro-Physics –Computational Chemistry –Helio-Physics –Life Science Further research communities –At least four further research communities will be supported –Candidate communities: Hydrometeorology Seismology –Further communities considered

Why the meeting at IAA On September 1 st 2013 ER-flow enters in its second year. We collected six astro applications during the first year –Port on SSP will be completed by the end of the 1 st year of ER-flow (31 August 2013) We committed ourselves to port at least eight new astro applications during the second year

Why the meeting at IAA New collected applications should be structured in a way that: –It should be possible for them to identify a number of basic constituting workflows which could be used as building blocks for other applications or meta-workflows –Already existing workflows for them should have been created by using workflow systems other than WS-PGRADE/gUSE

Why the meeting at IAA First exchange of ideas with Susana at –EGI User Forum in Munich (March 2012) –SHIWA Summer School in Budapest (July 2012) IAA is in the right position to contribute with: –New applications and possibly workflows built with workflow systems other than WS-PGRADE/gUSE –Its experience gained in workflow-oriented projects like Wf4ever and others IAA contributions to ER-flow of two types: –Scientific (new applications) by researchers –Technological (workflow systems, portals, science gateways, etc.) by workflow developers

Objectives Make aware all scientists at IAA of the new opportunities offered by workflows and the related technologies for their everyday activity and meet all those interested to port their applications and (non native WS-PGRADE) workflows on SSP Go in deep on all correlated technological aspects with AMIGA group: –Tight collaboration between ER-flow and the AMIGA group on technological aspects like DCIs, workflow systems, workflows sharing, data sharing, portals, science gateways and federations thereof (STAR net ), etc.