1. Enabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework Marco Fargetta (INFN), Riccardo Bruno (INFN), Roberto Barbera (UniCT, INFN), Marcin Plociennik (PSNC), Sandro Fiore (CMCC), Michal Owsiak (PSNC), Tomasz Zok (PSNC), Daniel Figat (PSNC), Giacinto Donvito (INFN), Marco Antonio Tangaro (CNR), Federico Zambelli (CNR, University of Milano), Dean N. Williams (LLNL), Valentine Anantharaj (ORNL), Giovanni Aloisio (CMCC), Emidio Giorgio (INFN), Lionel Schwarz (IN2P3), Germán Moltó (UPV) and Bas Wegh (KIT) RIA-653549 DI4R. 29 September 2016. Krakow, Poland

2. INDIGO DataCloud Project 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 2 Develop an open source Cloud platform for computing and data (“DataCloud”) for scientists seeking to easily exploit distributed Cloud/Grid compute and data resources 11.1M€, 30 months, to 09/2017 26 partners in 11 European countries INDIGO = Integrating Distributed data Infrastructures for Global ExplOitation http://cordis.europa.eu/project/rcn/194882_en.html For more information, attend the INDIGO sessions this afternoon

3. General Architecture 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 3 IAAS PAAS SAAS

4. Service Catalogue INDIGO Software is modular Communities can deploy all or just a sub-set of provided services A service catalogue is available https://www.indigo-datacloud.eu/service-component FutureGateway service is responsible for the high level user interaction It is not limited to INDIGO-powered IaaS and PaaS infrastructures. Legacy ones are also supported. 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 4

5. The FutureGateway (FG) A set of components to build User Interfaces The core is a RESTful API service Manage applications and resources on behalf of the user Other components are currently provided as plug-ins for the Liferay portal framework Components for other portal frameworks could be made available Modular architecture to support different back-end infrastructures (Cloud, Grid, local HPC sites) Based on JSAGA Adaptors 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 5

6. The FG API service Responsible for task management A task can be any activity to be executed on a remote infrastructure Three resources are defined: Task The interaction requested by the user Application The activity to be performed on the remote infrastructure Infrastructure The distributed computing system where tasks can be executed 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 6

7. Analyses Wait further input (if needed) Task Submit Monitoring Remote Task Output Access information Resource FG Process Task User inputApplicationsInfrastructures 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 7 User Portal Admin

8. Current Implementation 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 8 JSAGA Adaptors Grid and Cloud Engine (GridEngine) TOSCA 1 st EI (SimpleTosca) TOSCA 2 nd EI (ToscaIDC) Other Interfaces … (…) JSAGA SSH EMI/gLit e rOCCITOSCA Distributed Computing Infrastructures TOSCA Orchestrator Mid Layer Components DB Interface APIServer DB (fgapiserver) Queue table (as_queue) APIServer (APIServerDaemon) APIServer frontend (fgAPIServer) Executor Interfaces Graphic User Interfaces (Web, Mobile and Desktop applications) REST APIs – APIServer specs. V1.0 rOCCI CLIEMI/gLite APIs ganymed-ssh-2

9. FutureGateway Release FG release shipped with INDIGO middleware Current release: INDIGO MidnightBlue http://repo.indigo-datacloud.eu/ FG source code available on GitHub under Apache 2.0 licence Under the indigo-dc organisation https://github.com/indigo-dc FG REST API specification publicly available http://docs.fgapis.apiary.io/# 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 9

10. Integration: Climate Model Intercomparison ENES Application deployed in a Liferay portal Communication with API Service in the browser 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 10 LiferayAPI Service INDIGO PaaS Web page title http://www.url.com

11. Integration: Molecular Dynamics Very similar to the previous but on different platform No Liferay based portal Submission to WP4 IaaS 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 11

12. Integration example: Kepler FG API service connected with a desktop application Kepler workflow https://kepler-project.org/ Authentication managed by the user User provides a valid token before task execution Can be retrieved either from IAM or from a portal connected to the API service 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 12

13. Integration example: Mobile Applications FG API Service integration with mobile application is under development Mobile toolkit will provide similar functionalities available in web portals 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 13

14. Conclusions Separation of User Interface from task management simplifies the integration with different platforms Web portals based on different technologies/frameworks Desktop applications Mobile Apps Integration with INDIGO PaaS Orchestrator as well as with other legacy infrastructures Next release aims at simplifying the architecture of the API Server Gather all the current tools implementing the APIs in a single service 29 September 2016. Krakow, PolandEnabling scientific applications on hybrid e-Infrastructures: the FutureGateway framework 14