1. SHIWA project presentation Project 1 st Review Meeting, Brussels 09/11/2011 Peter Kacsuk MTA SZTAKI kacsuk@sztaki.hu

2. 2 Contract n°: 261585 Project type: I3 Start date: 01/07/2010 Duration: 24 months Total budget: 2,101,980 € Funding from the EC: 1,800,000 € Total funded effort in person-months: 231 Web site: www.shiwa-workflow.eu Contact person: Prof. Peter Kacsuk, email: Kacsuk@sztaki.hu The Project

3. 3 Project Partners MTA SZTAKI, Hungary UIBK, Austria C-UB, Germany CNRS, France UOW, United Kingdom CU, United Kingdom AMC, Netherlands

4. 4 Motivations 1 In many cases large simulations are organized as scientific workflows that run on DCIs However, there are too many different WF formalism WF languages WF engines If a community selected a WF system it is locked into this system: They can not share their WFs with other communities (even in the same scientific field) They can not utilize WFs developed by other communities

5. 5 Motivations 2 A WF system/engine is typically connected to one particular DCI As a result if a community selected a WF system it is locked into this DCI Porting the WF to another DCI requires large effort Parallel execution of the same WF in several DCIs is usually not possible

6. WF Ecosystem 6

7. Project objectives 1 Enable user communities to share their WFs –Publish the developed WFs –Access and re-use the published WFs –Build so-called meta-workflows from the published WFs Toolset: –SHIWA Simulation Platform WF Repository SHIWA Portal SHIWA Desktop 7

8. Project objectives 2 Enable the execution of a WF on several different DCIs –Enable the porting of a WF from one DCI to another one –Enable the simultaneous execution of a WF on several DCIs Toolset: –IWIR –DCI Bridge 8

9. SHIWA Workflow Interoperability – EGI UF11 9 Method Leverage existing workflow-based solutions –Workflow systems used as interfaces to DCIs Coarse-Grained (CGI) and Fine-Grained Interoperability (FGI) approaches Workflow system Foreach d in D { A(d); } Foreach d in D { A(d); } Workflow language Front-end Core engine Back-end DCI Distributed data Application services Computing resources invocatio n data transfers

10. Master workflow system Foreach d in D { A(d); } Foreach d in D { A(d); } Workflow language Front-end Core engine Back-end DCI 1 Distributed data Application services Computing resources invocations data transfers Embedded workflow system Workflow language Front-end Core engine Back-end DCI 2 Distributed data Application services Computing resources CGI

11. Target workflow system Foreach d in D { A(d); } Foreach d in D { A(d); } Front-end Core engine Back-end Target DCI Distributed data Application services Computing resources invocations data transfers Source workflow system 1 Workflow language Front-endExport Core engine Source workflow system 2 Front-endExport Core engine IWIR representation Export IWIR Exportation and integration through IWIR Source DCI Distributed data Application services Comp. res. Services adaptation FGI

12. SHIWA Simulation Platform 12

13. 13 SHIWA Simulation Platform SHIWA RepositorySHIWA Portal WE developer MOTEUR WE WF1 Kepler WE Taverna WE Triana WE WF developer e-scientist GEMLCA admin Workflow engine Workflow editor create LCID & upload WE SHIWA Simulation Platform invoke WE GEMLCA +GIB create LCID & upload WF gLite DCI Globus DCI WE Server DCIs WFn WE1WFp search and remember WF GEMLCA Repository edit WF WE + WF WE+WF LCID WF1WFm GEMLCA submitter s1 s2 s4 s5 s3 s4 WF list WF + metadata

14. LINGA Prototype Challenge 17/09/11 Meta- Workflow Sub-Workflows Management

15. Collaboration 1 VRC Integration –development of workflow technology to serve new communities of EGI –SHIWA will provide information and support channel to the EGI user communities training material availability monitoring for SHIWA Repository 15

16. Collaboration 2 Joint dissemination –Advertise the start of the collaboration in each Party’s website with a dedicated static page and article or press release. –Organise joint topical workshop on e-Science Workflows –Organie joint activity at EGI Community Forum 2012. 16

17. Thank you.