EUDAT’s engagement with the Earth Sciences

Slides:



Advertisements
Similar presentations
Project number: Data and Data Requirements Wouter Los University of Amsterdam.
Advertisements

Data Archiving and Networked Services DANS is an institute of KNAW en NWO and the Peter Doorn Data Archiving and Networked Services EUDAT Conference Trust.
Christoph Waldmann Hank Loescher University of Bremen/MARUM NEON, USA Connecting Research Infrastructures in the Environmental Field Across the Atlantic.
Data discovery and data processing for environmental research infrastructures Roberto Cossu ENVRI WP4 leader ESA.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No The pan-European.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT The European.
EUDAT: Data sharing and management in a collaborative data infrastructure Rob Baxter, EPCC, University of Edinburgh.
Aalto Data Repository Keijo Heljanko and Mikko Hakala
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT- Towards.
Store and Share Research Data b2share.eudat.eu B2SHARE How to share and store research data using EUDAT’s B2SHARE This work is licensed under.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT User Forum.
NFFA-EUROPE: Information and Data Management Repository Platform for nanoscience in Europe LOGO of your Pilot – organisation / initiative Stefano Cozzini.
Support to scientific research on seasonal-to-decadal climate and air quality modelling Pierre-Antoine Bretonnière Francesco Benincasa IC3-BSC - Spain.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT Working.
Jost von Hardenberg ISAC-CNR, Torino, Italy with Paolo Davini, Susanna Corti, and many others EUDAT User Forum, Rome,Italy 3-4 February, 2016.
B2 Nordic – call for pilot. Introduction B2 Nordic: initiative proposed to NeIC Uptake of the EUDAT B2 service suite in the Nordics. 2.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EPOS and EUDAT.
ICOS To collect high-quality observational data relevant to the greenhouse gas budget of Europe To make the ICOS data freely available to all interested.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT Aalto Data.
RI EGI-InSPIRE RI Earth science e-infrastructures workshop Diego Scardaci, EGI.eu Technical Outreach Expert.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No The use of the.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No West-Life.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Public access.
Store and exchange data with colleagues and team Synchronize multiple versions of data Ensure automatic desktop synchronization of large files B2DROP is.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Support to scientific.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT Services.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No TURBASE-DNS: A.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Herbadrop.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Enriching Europeana.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Aalto Data Repository.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No LTER- Europe &
1 This slide indicated the continuous cycle of creating raw data or derived data based on collections of existing data. Identify components that could.
Intentions and Goals Comparison of core documents from DFIG and Publishing Workflow IG show that there is much overlap despite different starting points.
PIDs in EUDAT Webinar, 15 Februari 2013
Towards a pan-European Collaborative Data Infrastructure
This work is licensed under the Creative Commons CC-BY 4.0 licence.
The EUDAT Services Suite
Services for EOSC management
Tokamak data mirror for JET and MAST Moving towards an open data repository for European nuclear fusion research.
EUDAT: collaborative pan-European infrastructure providing research data services, training and consultancy This work is licensed.
AAI for a Collaborative Data Infrastructure
Alessandro Spinuso, Andreas Rietbrock, Andrè Gemuend,
ICOS on-demand atmospheric transport computation A use case for interoperability of EGI and EUDAT services Ute Karstens, André Bjärby, Oleg Mirzov, Roger.
Data Ingestion in ENES and collaboration with RDA
Engaging with Users Daan Broeder Meertens Institute & CLARIN ERIC
Ideas for an ICOS Competence Centre Implementation of an on-demand computation service Ute Karstens, André Bjärby, Oleg Mirzov, Roger Groth, Mitch Selander,
EGI/EUDAT/INDIGO-DataCloud Joint project proposal for EINFRA-12 A
Data Services at CSC ©2016 OKM ATT initiative Licensed under Creative Commons BY 4.0.
Mark van de Sanden Giovanni Morelli
EOSChub / OpenAIRE-Advance
Data Access and Re-use Carl Johan Håkansson EUDAT Service Area Manager
EUDAT Collaborative Data Infrastructure
Climate Data Analytics in a Big Data world
Workshop Data curation and the EUDAT Collaborative Data Infrastructure
DATA SPHINX & EUDAT Collaboration
INFRAEOSC 5c call Proposal summary
EUDAT B2FIND A Cross-Discipline Metadata Service and Discovery Portal
EOSC services architecture
NFFA Europe.
An EUDAT-based FAIR Data Approach for Data Interoperability
European Research Data Services, Expertise & Technology Solutions
EUDAT Site and Service Registry
DATATURB Direct simulation data of turbulent flows
Bird of Feather Session
JADDS- Jülich Atmospheric Data Distribution Service
RDA uptake activities and plans: ESGF
EOSC-hub T6.1 Meeting 08 February 2018 Amsterdam Science Park
Joining the EOSC Ecosystem
Expand portfolio of EGI services
EOSC-hub Contribution to the EOSC WGs
Presentation transcript:

EUDAT’s engagement with the Earth Sciences Daan Broeder Giuseppe Fiamini Damien Lecarpentier EUDAT is an initiative of European big generic data and computing centers together with community organizations to come to a infrastructure for efficiently supporting research communities with generic data management services. This initiative is supported by EC funded projects, the latest one EUDAT2020

EUDAT2020 - 35 Partners EUDAT2020 is a project of some 20ME with 35 consortium partners

Collaborative Data Infrastructure (CDI) A collaboration between Service Providers and Research Communities EUDAT generic data service provider storage, workflows, processing, archive A Partnership Agreement specifying the mutual obligations between the EUDAT centres Community Repositories (thematic data centres) A collaboration between Service Providers and Research Communities A Partnership Agreement specifying the mutual obligations between the EUDAT centres a portfolio of data management services A data and service model that ensures the CDI’s interoperability, extensibility and stability Looking to the future we have the CDI partnership agreement and a secretariat as a basis for future coordination. a portfolio of data management services A data and service model that ensures the CDI’s interoperability, extensibility and stability

B2 Service Suite B2ACCESS B2HANDLE Integration / Usability /

EUDAT services are based on user community requirements EUDAT engages with a large variety of communities in different ways, ranging from interviewing for requirements to service provisioning

Engagement with Communities EUDAT has 7 core-communities, part of the EUDAT2020 project Invite collaborations with new communities & projects call for Data Pilots resulting in further engagement with 24 Pilots EUDAT working groups Working with EUDAT and community experts on specific data management topics Semantics, Sensitive Data, New Database Technologies, … Intensive RDA involvement: PracticalPolicies, PIT, DTR, DataFabric, … Collaboration with communities in new proposals such as the recently approved SeaDataCloud project Add the collaboration in new proposals

ENES – European Network for Earth System Modeling The climate and earth system modeling community is represented in EUDAT by DKRZ as community data center DKRZ works on a B2SHARE instance for DKRZ/ENES as a long tail data archive and publishing platform. special requirements: completeness, quality checks choice for Handle or DOI as PIDs B2FIND as one of the channels for publishing ENES metadata B2STAGE moving data to HPC centers

EPOS – European Plate Observatory System EUDAT collaborates with the seismology community within EPOS represented by three thematic data centers: INGV, KNMI and GFZ EUDAT provides data preservation and replication with B2SAFE B2STAGE moving data to HPC facilities Requirements for: handling of metadata throughout the CDI, access to replica data handling of dynamic data

ICOS – Integrated Carbon Observation System ICOS is a Pan-European Infrastructure for studying the greenhouse gas balance EUDAT is providing data management services to the ICOS Carbon Portal, that gathers data from all the ICOS observation stations Use of B2SAFE for persistency and B2STAGE for moving data to HPC facilities Auxiliary services: Semantic annotation (B2NOTE) and data typing (DTR)

Earth Science Data Pilots JADDS – Juelich Atmospheric Data Distribution Service Publishing metadata for atmospheric composition model data-sets in B2FIND Publishing frequent requested data-sets content via B2SHARE PAIRQURS - Public Access to fine grained city air quality data from roving sensors Archive, share and publish observation data via B2SHARE & B2DROP DATA SPHINX – DATA Storage and Preservation of HIgh resolutioN climate model eXperiments Aggregating model simulation output data using B2STAGE in a central repository Publishing the metadata via B2SHARE and B2FIND ClimateModeling – Seasonal-to-decadal climate and air quality modeling Data transfer between institutes with B2STAGE/B2SAFE Data discovery via B2FIND EISCAT – Unified Access to EISCAT radar data The incoherent scatter radars provide information on the ionosphere Using EUDAT services for managing the data that will be produced by the next generation radars in the EISCAT-3D project JADDS and DATA SPHINX are about aggregating data and publishing PAIRQURS is next to publishing results also using data exchange with B2DROP Notice that JADDS and DATA SPHINX use B2SHARE as a metadata publication platform The European Incoherent Scatter Scientific Association (EISCAT) operates three incoherent scatter radars, instruments probing the Earth's ionosphere, at high latitudes Salient points generalize a bit

EUDAT Service Uptake by Earth Sciences* B2FIND B2SAFE B2STAGE B2SHARE B2DROP B2ACCESS B2HANDLE Data Volume TB Requirements for services within scope of EUDAT (not exhaustive) ENES X 10s Mixed Handle / DOIs support for B2SHARE & B2HANDLE EPOS 100s Metadata in the CDI, access to replica, dynamic-data handling B2HANDLE, B2ACCESS for community services ICOS Metadata in the CDI, B2NOTE for semantic annotation, DTR for explicit Data Typing, B2HANDLE DOI support JADDS 50 PAIRQURS 10 Data SPHINX 150 ClimateModel 300 EISCAT New requirements are explicitly a goal of this Data Pilot Conclusions: DOIs must be offered in combination with standard Handles from B2HANDLE, B2FIND is an accepted interdisciplinary metadata catalogue, descriptive metadata should be present at all levels in the CDI Mention the difference between community storage and storage involved with EUDAT services for the community e.g. EISCAT 3D PBversus 100s TB B2DROP is not explicitly in the UP, but its already used in the communities in an informal way, limit is also 20GB *in different stages of realization

Experiences & Conclusions EUDAT can provide for a large variety of research communities needs EUDAT operates in a landscape of developing research infrastructures of varying maturity these often have ready-developed solutions … or requirements are not yet stable EUDAT has to identify the right components and generic services useful for communities to build their data strategies on allowing alignment of business and organizational models Successful uptake of EUDAT services is necessarily based on strong interaction with research communities DOI use

For more information contact info@eudat.eu or visit