Project number: 283465 Data and Data Requirements Wouter Los University of Amsterdam.

Slides:



Advertisements
Similar presentations
Robert-Jan Smits Director, DG Research, European Commission Towards a European Strategy for Research Infrastructures Opportunities for the Arctic region.
Advertisements

Svalbard Integrated Arctic Earth Observing System (SIOS) SIOS Distributed Data Management System & The Brokering Approach by Bente Lilja Bye SIOS Coordination.
A common global framework for marine data management Helen Glaves.
Roberto Cossu European Space Agency
Data Interoperability and Access Activities Prepared for the Data Archiving and Access Requirements Working Group (DAARWG) Ken McDonald, TPIO/GEO-IDE Jeff.
Beyond a Data Portal: A Collaborative Environment for the Deep Carbon Science Communities Han Wang, Yu Chen, Patrick West, John Erickson, Xiaogang Ma,
Interoperability ERRA System.
Project number: Towards common operations Wouter Los 1 & Sanna Sorvari 2 1 University of Amsterdam 2 Finnish Meteorological Institute.
EGI-Engage EGI-Engage Engaging the EGI Community towards an Open Science Commons Project Overview 9/14/2015 EGI-Engage: a project.
Research Infrastructures in FP7 On behalf of : Anna Maria Johansson, Hervé Péro European Commission, DG RTD/B3 MarineERA workshop Feb
1 Common Challenges Across Scientific Disciplines Laurence Field CERN 18 th November 2013.
Christoph Waldmann Hank Loescher University of Bremen/MARUM NEON, USA Connecting Research Infrastructures in the Environmental Field Across the Atlantic.
ATMOSPHERIC SCIENCE DATA CENTER ‘Best’ Practices for Aggregating Subset Results from Archived Datasets Walter E. Baskin 1, Jennifer Perez 2 (1) Science.
Seismic Hazard Map EPOS European Plate Observing System RESEARCH INFRASTRUCTURE AND E-SCIENCE FOR DATA AND OBSERVATORIES ON EARTHQUAKES, VOLCANOES, SURFACE.
Data discovery and data processing for environmental research infrastructures Roberto Cossu ENVRI WP4 leader ESA.
LifeWatch E-Science and Observatory Infrastructure for Biodiversity & Ecosystem Science Olaf Bánki.
Max Craglia (JRC) and Stefano Nativi (CNR) FP7-ENV-2011 Planning Meeting 24 September 2010, GEO Secretariat Outcome of EuroGEOSS Multi-disciplinary Interoperability:
Breakout # 1 – Data Collecting and Making It Available Data definition “ Any information that [environmental] researchers need to accomplish their tasks”
Experiences from the LifeWatch infrastructure for biodiversity and ecosystem research Wouter Los (University of Amsterdam)
EPOS where we are, where we go ! Massimo Cocco INGV Rome September EPOS Meeting.
Building Scientific Workflows for the Fisheries and Aquaculture Management Community based on Virtual Research Environments Pedro Andrade (CERN)
OOI Cyberinfrastructure and Semantics OOI CI Architecture & Design Team UCSD/Calit2 Ocean Observing Systems Semantic Interoperability Workshop, November.
Project number: ENVRI and the Grid Wouter Los 20/02/20161.
Introductory remarks Wouter Los LifeWatch Infrastructure for Biodiversity and Ecosystem Research.
The Global Scene Wouter Los University of Amsterdam The Netherlands.
1 Marine EnviRonment and Security for Europe Area MERSEA FP VI Integrated Project (SPACE) Contribution to GMES, GODAE, INSPIRE SeaSearch – Limassol May.
Using a Simple Knowledge Organization System to facilitate Catalogue and Search for the ESA CCI Open Data Portal EGU, 21 April 2016 Antony Wilson, Victoria.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EPOS and EUDAT.
Defining the e-Infrastructure needs of European Environmental Research Infrastructures Pasquale Pagano Italian National Research Council (ISTI-CNR)
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT Aalto Data.
H2020 ProjectProject Number: ENVRI plus and the OSDC PAOLO LAJ ENVRI plus coordination.
Get Data to Computation eudat.eu/b2stage B2STAGE How to shift large amounts of data Version 4 February 2016 This work is licensed under the.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No The use of the.
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No West-Life.
ENVRIPLUS week, May 2016 Zandvoort Background, ocean observation e-infrastructure  Who is the community/project the use case belongs to?  ENVRIPLUS EU.
Click to edit Master title style Click to edit Master text styles Second level Third level Fourth level Fifth level 1 SI O S Svalbard Integrated Arctic.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Support to scientific.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No TURBASE-DNS: A.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Herbadrop.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Enriching Europeana.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Aalto Data Repository.
CrossCutting topic: Data Quality and European Network of EO Networks
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No LTER- Europe &
PIDs in EUDAT Webinar, 15 Februari 2013
Towards a pan-European Collaborative Data Infrastructure
EUDAT Towards a European Collaborative Data Infrastructure
Tokamak data mirror for JET and MAST Moving towards an open data repository for European nuclear fusion research.
Discovering and accessing data from a distributed network of data centres S. Mazzeo (ESA)
EUDAT’s engagement with the Earth Sciences
Pasquale Pagano CNR – ISTI (Pisa, Italy)
COOPEUS CONNECTING RESEARCH INFRASTRUCTURES
Flanders Marine Institute (VLIZ)
Ideas for an ICOS Competence Centre Implementation of an on-demand computation service Ute Karstens, André Bjärby, Oleg Mirzov, Roger Groth, Mitch Selander,
SIOS (Svalbard Integrated
EGI-Engage Engaging the EGI Community towards an Open Science Commons
EC FP7 - Cooperation Theme 6: Environment (incl. climate change)
DATA SPHINX & EUDAT Collaboration
EOSC services architecture
AGU Fall Meeting, December 17, 2014
NFFA Europe.
LifeWatch Cloud Computing Workshop
An EUDAT-based FAIR Data Approach for Data Interoperability
Common Solutions to Common Problems
European Research Data Services, Expertise & Technology Solutions
Workshop on Gap Analysis and Prioritization
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
Brian Matthews STFC EOSCpilot Brian Matthews STFC
DATATURB Direct simulation data of turbulent flows
Bird of Feather Session
Presentation transcript:

Project number: Data and Data Requirements Wouter Los University of Amsterdam

Project number: Environmental Science oceanic and atmospheric processes long-term development of the climate system Biological processes biodiversity development of the cryosphere and lithosphere Earth as a single complex and coupled system 23/10/12 W. Los - EUDAT2

Project number: ESFRI Environmental Research Infrastructures Tropospheric research aircraft COPAL Upgrade of incoherent SCATter facility EISCAT-3D Multidisciplinary seafloor observatory EMSO Plate observing system EPOS Global ocean observing infrastructure EURO- ARGO Aircraft for global observing system IAGOS Integrated carbon observation system ICOS Biodiversity and ecosystem research infra LIFEWATCH Svalbard arctic Earth observing system SIOS 23/10/2012W. Losi - EUDAT3

Project number: EUDAT4

Project number:

29/03/12Pasquale Pagano - EGI CF Radar interference data Gas (CO2 etc) fluxes ∂ (concentration) Gas (CO2 etc) fluxes ∂ (concentration) Areal and satellite observation Species data, distributions, abundance, biomass, etc. Observations, sensor data, collection data, DNA, etc Marine sensors Currents, salinity, deposition, etc Plate tectonics Seismic data, satellite data, sensors, etc

Project number: Goal Enable multidisciplinary scientists to access and study data from multiple domains for “system level” research by providing solutions and guidelines for the RIs common needs Multiple data producers Multiple data consumers 7 23/10/12 W. Los- EUDAT

Project number: Approach discover data which are heterogeneous in format, content, and metadata description harmonise, integrate and analyse data across domains and RIs Promote Accessibility Preserve Specificity 23/10/12W. Los - EUDAT8

Project number: Data infrastructure requirements Integrated data discovery across various catalogues (Near) real-time data handling Federation over infrastructures/services Persistent identifiers mechanism Metadata definition and assignment Attribution / crediting author/ownership Quality control of data Provenance and preservation Archiving vs. regeneration of data and/or results (processed data) Single sign-on, delegated authorisation Running complex models Data staging or moving computation to data 23/10/12W. Los- EUDAT9

Project number: First steps - priority areas Integrated data discovery across various centres / catalogues (near) Real-time data handling Federation over existing (national or international) infrastructures / services 23/10/12W. Los - EUDAT10

Project number: : Integrated data discovery Integrated data discovery across various centres / catalogues The challenge of being able to easily discover data which are heterogeneous (in format, content, and metadata description) and which are stored at different places ENVRI partners ESA, CNR, UvA and CSC are tackling this Does EUDAT see a role to contribute?

Project number: Geospatial Data Services Geospatial Repositories Data Discovery Data Access Data Process OGC OpenSearch Linked Open Data Catalogue Services OGC WCS THREDDS OGC WPS WPS 52N P1P2P.. WPS Hadoop Hadoop Cluster Data Pub. /Vis. OGC WMS, WFS GeoServer gCube Data staging by courtesy of P. Pagano

Project number: : (Near) Real Time Data Handling (near) Real-time data handling The challenge(s) of being able to handle real-time data Challenges include: collecting, storing and cataloguing data as it arrives in real-time from sensors processing data into derived data products in real-time analysing data in real-time It was suggested that EUDAT might take this up

Project number: : Federation Federation over existing (national and international infrastructures / services The challenge of bringing together existing infrastructure components / services as contributions to the construction of an Research Infrastructure The challenge of bringing about interoperability (syntactic and semantic) between separately owned and operated facilities that each contribute to the Research Infrastructure Is EUDAT also interested?

Project number: Data infrastructure requirements Integrated data discovery across various catalogues (Near) real-time data handling Federation over infrastructures/services Persistent identifiers mechanism Metadata definition and assignment Attribution / crediting author/ownership Quality control of data Provenance and preservation Archiving vs. regeneration of data and/or results (processed data) Single sign-on, delegated authorisation Running complex models Data staging or moving computation to data 23/10/12W. Los- EUDAT15

Project number: Need a Common Data Infrastructure Managing the growing amount of data Improving interoperability between infrastructures and across disciplines Promoting collaboration and clarifying roles and responsibilities 23/10/12W. Los- EUDAT16 EUDAT contributions to the ENVRI consortium is welcome!

Project number: Thank you 23/10/2012 W. Los – EUDAT 17