Copernicus Data in the EGI infrastructure

Slides:



Advertisements
Similar presentations
EGI-InSPIRE RI EGI-InSPIRE RI EGI-InSPIRE EGI services for the long tail of science Peter Solagna Senior Operations.
Advertisements

RI EGI-InSPIRE RI EGI Future activities Peter Solagna – EGI.eu.
Status: For Information Only ESA UNCLASSIFIED - For Official Use Cloud Processing at ESA [EO Payload Ground Segment] Cristiano Lopes, ESA CEOS WGISS-40.
European Grid Initiative Data Services and Solutions Part 2: Data in the cloud Enol Fernández Data Services.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Running Big Data on the EGI Federated Cloud Javier Lopez Cacheiro, Álvaro.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT EGI interoperability.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Federated Cloud 1 17 Feb 2014 Diego Scardaci, EGI.eu Technical Outreach.
European Life Sciences Infrastructure for Biological Information ELIXIR Cloud Roadmap Chairs: Steven Newhouse, EMBL-EBI & Mirek Ruda,
Instituto de Biocomputación y Física de Sistemas Complejos Cloud resources and BIFI activities in JRA2 Reunión JRU Española.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI User Engagement in EGI (With focus on the cloud) Gergely Sipos, EGI.eu Technical.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Enabling SSO capabilities in the EGI Cloud services Peter Solagna – EGI.eu.
EGI-Engage EGI-Engage WP3 e-Infrastructure Commons Diego Scardaci EGI.eu/INFN 6/18/2016 EGI-Engage – First.
INDIGO Outreach and Exploitation process Peter Solagna, Matthew Viljoen EGI.eu.
EGI-Engage EGI Webinar - Introduction - Gergely Sipos EGI.eu / MTA SZTAKI 6/26/
European Grid Initiative EGI FedCloud User Support coordination meeting Diego Scardaci - EGI.eu/INFN 01/04/2015.
Federated Cloud: Computing UPVLC-I3M Effort allocated: 6 pms. Proposal: Integration of an Infrastructure Broker with self-configuration and auto-scaling.
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number Federated Cloud Update.
ESA UNCLASSIFIED – For Official Use EO Innovation Europe Programmatic Context Users public services Users profit-making services Users geosciences Outreach.
INDICATE Final Conference, Ankara, Turkey – 15 October, INDICATE Final Conference, Ankara, Turkey EGI & eCulture The role of.
Sentinel Data Access for Africa 11 December 2014 Sentinels Data Access for Africa.
1 EGI Federated Cloud Architecture Matteo Turilli Senior Research Associate, OeRC, University of Oxford Chair – EGI Federated Clouds Task Force
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Role and Challenges of the Resource Centre in the EGI Ecosystem Tiziana Ferrari,
EGI-InSPIRE EGI-InSPIRE RI Developing the concept of a service marketplace for EGI Diego Scardaci EGI.eu/INFN.
The EGI Federated Cloud
Onedata Eventually Consistent Virtual Filesystem for Multi-Cloud Infrastructures Michał Orzechowski (CYFRONET AGH)
Jordi Farres HMA-WG Meeting ESRIN, 23 Jan 2013
WLCG IPv6 deployment strategy
The EGI Training Infrastructure
SA1 Operation of EGI technical platforms
ESA EO Federated Identity Management Activities
ONAP/K8S Deployment OOM Team
Diego Scardaci EGI Technical Outreach Expert
Virtualization and Clouds ATLAS position
Strategy and Policy Officer
User Engagement in EGI (With focus on the cloud)
Population Imaging Use Case - EuroBioImaging
ICOS on-demand atmospheric transport computation A use case for interoperability of EGI and EUDAT services Ute Karstens, André Bjärby, Oleg Mirzov, Roger.
WP5 Operations Peter Solagna SA1 work package leader EGI Foundation.
INTAROS WP5 Data integration and management
Exploitation and Sustainability updates
FedCloud Blueprint Update
Christos Kanellopoulos
KER - Open Data Platform
WLCG experiments FedCloud through VAC/VCycle in the EGI
Onedata Eventually Consistent Virtual Filesystem for Multi-Cloud Infrastructures Michał Orzechowski (CYFRONET AGH)
Senior Strategy and Policy Officer
Ideas for an ICOS Competence Centre Implementation of an on-demand computation service Ute Karstens, André Bjärby, Oleg Mirzov, Roger Groth, Mitch Selander,
Cwa.infoaas.eu.
Linked Challenges Virtualisation has a key role to play….
Virtualization in the gLite Grid Middleware software process
An easier path? Customizing a “Global Solution”
Connecting the European Grid Infrastructure to Research Communities
Diego Scardaci (EGI.eu)
Solutions for federated services management EGI
Climate Data Analytics in a Big Data world
Exploitation Platforms and Common Reference Architecture
The EGI Federated Cloud
Case Study: Algae Bloom in a Water Reservoir
EGI Webinar - Introduction -
EGI FedCloud in Digital Humanities
Steven Newhouse, EGI.eu EGI-InSPIRE Project Director
ELIXIR Competence Center
Cloud computing mechanisms
Australia’s Regional Copernicus Data Access/Analysis Hub
EGI FedCloud User Support coordination meeting
Technical Outreach Expert
Core Activities re-assessment
EGI Pay-for-Use Brief Summary
Photon & Neutron working meeting
Presentation transcript:

Copernicus Data in the EGI infrastructure Diego Scardaci Senior User Community Support and Outreach officer

Aims of the pilot Provide access to the Copernicus Data within the EGI infrastructure Mechanisms to automatically download data for a given area in a certain time window Validate the access through standard EO interfaces (e.g. DHUS) Local and remote access Validate the access through the EGI Data Hub (OneData) Compare the performance

Partners involved Terradue CESNET Cyfronet EGI.eu Geohazard and Hydrology TEPs service provider Service provider for other EO exploitation platforms CESNET EGI FedCloud Service Provider Collaborative Ground segment node for the Czech Repubblic Cyfronet EGI DataHub service provider OneData technology provider EGI.eu Coordination and technical support

Test cases Access Copernicus Data from VMs running in EGI FedCloud: VMs and data in the same provider and data access via DHUS interface VMs and data in the same provider and data access via the EGI DataHub VMs and data in the different providers and data access via DHUS interface VMs and data in the different providers and data access via the EGI DataHub

Use case VITO Sentinel’s Biopar application embedded in the ESA Geohazard Exploitation platform (GEP) Copernicus data from Belgium and Mali Time window of 1 month (most recent data) Cloud resources Master node: 2 CPUs, 8 GB RAM, 100 GB disk N Slave nodes: 2 CPUs, 8 GB RAM, 200 GB disk GEP is already using EGI FedCloud resources for its production operation

Actions and Roles CESNET Make Copernicus data of Belgium and Mali available (1 month time window) DHUS EGI DataHub (OneData provider registered in the DataHub) Provide Cloud resources to Terradue to run the VMs (FedCloud or Geohazard VO ?)

Actions and Roles Terradue: Configure/Modify the SW to access data from EGI HTTP and POSIX ? Deploy VMs @ CESNET Deploy VMs @ 2nd FedCloud provider Run the pilot Collect performance measurements

Actions and Roles CYFRONET EGI.eu Support CESNET on the deployment and configuration of the OneProvider instance EGI.eu Coordinate the pilot activity Look for the second provider

Pilot expected outcomes Validate the usage of the EGI DataHub for a real use case Performance comparison between the DataHub and DHUS interfaces to access EO data Performance measurements in case of remote access to data within the EGI Federation Possible future collaboration with GEANT Exploit the pilot outcomes in NextGEOSS and others EO cases

Timeline To be discussed today