Www.eudat.eu EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No. 654065 EUDAT EGI interoperability.

Slides:



Advertisements
Similar presentations
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI AAI in EGI Status and Evolution Peter Solagna Senior Operations Manager
Advertisements

The Internet2 NET+ Services Program Jerry Grochow Interim Vice President CSG January, 2012.
EGI-Engage EGI-Engage Engaging the EGI Community towards an Open Science Commons Project Overview 9/14/2015 EGI-Engage: a project.
Advanced Computing Services for Research Organisations Bob Jones Head of openlab IT dept CERN This document produced by Members of the Helix Nebula consortium.
European Grid Initiative Federated Cloud update Peter solagna Pre-GDB Workshop 10/11/
EMI AAI Strategy & Plans John White / Helsinki Institute of Physics Federated Identity Systems for Scientific Collaborations Workshop , CERN,
Authentication and Authorisation for Research and Collaboration Licia Florio (GÉANT) Christos Kanellopoulos (GRNET) Service orientation.
A public-private partnership building a multidisciplinary cloud platform for data intensive science Bob Jones Head of openlab IT dept CERN This document.
Authentication and Authorisation for Research and Collaboration Pilots on the Integrated R&E AAI Paul van Dijk, Activity Lead Pilots.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Processing services.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No The pan-European.
Authentication and Authorisation for Research and Collaboration Peter Solagna Milano, AARC General meeting Current status and plans.
JRA1.4 Models for implementing Attribute Providers and Token Translation Services Andrea Biancini.
Authentication and Authorisation for Research and Collaboration Christos Kanellopoulos
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No B 2 DROP User.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No B2ACCESS LSDMA.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Evolution of AAI for e- infrastructures Peter Solagna Senior Operations Manager.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT collaborative.
Networks ∙ Services ∙ People Thomas Bärecke Journée Fédération, Paris Collaboration européenne GÉANT SA5 03/07/2015 SA5 T5 team
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Data Preservation.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Store and Share.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EPOS and EUDAT.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT Aalto Data.
Get Data to Computation eudat.eu/b2stage B2STAGE How to shift large amounts of data Version 4 February 2016 This work is licensed under the.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No The use of the.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No West-Life.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Public access.
Store and exchange data with colleagues and team Synchronize multiple versions of data Ensure automatic desktop synchronization of large files B2DROP is.
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number Marios Chatziangelou, et al.
EGI-Engage EGI Webinar - Introduction - Gergely Sipos EGI.eu / MTA SZTAKI 6/26/
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Collaboration.
European Grid Initiative The EGI Federated Cloud as Educational and Training Infrastructure for Data Science Tiziana Ferrari/ EGI.eu.
Authentication and Authorisation for Research and Collaboration Peter Solagna, Nicolas EGI AAI integration experiences AARC Project.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Support to scientific.
Authentication and Authorisation for Research and Collaboration AARC/CORBEL Workshop for Life Sciences AAI AARC Draft Blueprint.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI A pan-European Research Infrastructure supporting the digital European Research.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT Services.
EGI-InSPIRE EGI-InSPIRE RI EGI strategy towards the Open Science Commons Tiziana Ferrari EGI-InSPIRE Director at EGI.eu.
EGI-InSPIRE RI EGI-InSPIRE RI EGI-InSPIRE Software provisioning and HTC Solution Peter Solagna Senior Operations Manager.
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number Federated Cloud Update.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No TURBASE-DNS: A.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Herbadrop.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Enriching Europeana.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Aalto Data Repository.
Authentication and Authorisation for Research and Collaboration Licia Florio IGTF Meeting The AARC Project Amsterdam, 8 September.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EGI - EUDAT interoperability.
Security in the wider world David Kelsey (STFC-RAL) GridPP37 – Ambleside 2 Sep 2016.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No LTER- Europe &
Accessing the VI-SEEM infrastructure
PIDs in EUDAT Webinar, 15 Februari 2013
AAI for a Collaborative Data Infrastructure
Alessandro Spinuso, Andreas Rietbrock, Andrè Gemuend,
ICOS on-demand atmospheric transport computation A use case for interoperability of EGI and EUDAT services Ute Karstens, André Bjärby, Oleg Mirzov, Roger.
KER - Open Data Platform
EMI Interoperability Activities
Ideas for an ICOS Competence Centre Implementation of an on-demand computation service Ute Karstens, André Bjärby, Oleg Mirzov, Roger Groth, Mitch Selander,
EGI/EUDAT/INDIGO-DataCloud Joint project proposal for EINFRA-12 A
EGI-Engage Engaging the EGI Community towards an Open Science Commons
Solutions for federated services management EGI
DATA SPHINX & EUDAT Collaboration
Thursday pilot session: 7-minutes
EGI Webinar - Introduction -
Common Authentication and Authorisation Service for Life Science Research Mikael Linden, ELIXIR Finland.
An EUDAT-based FAIR Data Approach for Data Interoperability
European Research Data Services, Expertise & Technology Solutions
Break out group coordinator:
Joining the EOSC Ecosystem
Stakeholders R. Dimper 15 January 2019
Expand portfolio of EGI services
EOSC-hub Contribution to the EOSC WGs
Presentation transcript:

EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT EGI interoperability use case Giuseppe Fiameni, Diego Scardaci (EGI), Peter Gille EGI Conference Lisbon

Goal Enable researchers seamlessly access e- Infrastructures services pairing data and high- throughput computing resources together Communities ELIXIR, EISCAT-3D, BBMRI, ICOS EPOS, ENVRI+ … Timeframe March 2014 – February 2016 Collaboration

Definition: Permit a user of both e-infrastructures to instantiate a VM on the EGI Cloud Federation for the execution of a computational job consuming data stored onto EUDAT resources Assumptions: a)the user holds a valid and trusted security token (X.509 certificate) b)he/she has been granted to access EGI resources c)he/she has already deposited data within the EUDAT infrastructure Use Case “alpha”

1.The user authenticates to the EGI infrastructure 2.The EGI infra instantiates the environment and performs preliminary configuration (account, network, firewall, tools, libraries, compilers, applications,...)  contextualization 3.The virtual environment is started up  user’s credentials are copied into the VM 4.The VE stages data from EUDAT to a local storage area for performance and locality reasons, using authentication obtained in step 1  data staging via GridFTP or HTTP (CDMI)  data discoverability via B2FIND More detailed flow

5.The user launches the computational job 6.Any intermediate result is shared with the public via the EUDAT B2DROP service  either results or inputs 7.Final results are ingested back onto EUDAT for being preserved in the long term (B2SAFE)  registered via PID More detailed flow (cont.)

Authentication/Authorization: Credentials federation Support for eduGAIN  EUDAT and EGI both member of the AARC project  Iota profile? Authorization? Data access PID management  Handling of data via PID Data staging performance POSIX access to data via FUSE  AAI Adoption of CDMI (?!) Deposit of intermediate results via B2DROP or similar services AuthN/AuthZ  EUDAT Library Technical Challenges

Spec. Document Set up a Proof of Concept environment Services testbed EGI VM EUDAT B2SAFE instance VM contextualization Define tools and services to be installed on the VM image Streamline authentication process Make the VM obtain proper authentication tokens through the EGI authentication infrastructure using x.509 certificates Data staging/access Evaluate data access and staging from EUDAT resource to the EGI VM  GridFTP, HTTP, FUSE Preliminary plan (Phase 1 – August 2015)

EPOS “The MISFIT application, takes as input the synthetic seismograms generated from HPC simulations for a certain Earth model and earthquake and, after a preprocessing stage, compares them with real observations in order to foster subsequent model updates and improvement (Inversion)” ?? Adoption