EGU Conference, Vienna, Austria, 8-13April 2018

Slides:



Advertisements
Similar presentations
Ocean Data Interoperability Platform EU-US-Australia collaborative project Grant Number: Call: FP7-INFRASTRUCTURES INFSO Activity: INFRA :
Advertisements

SIMORC Workshop March 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management.
NODCi - National Infrastructure for access to Oceanographic and Marine Data and Information (RGI-014) By Dick M.A. Schaap – MARIS Amsterdam, April 09.
Status of CDI service (connections, NetCDF introduction, CDI ingestion service and set-up of CDI ingestion pilot) By Dick M.A. Schaap – Technical Coordinator.
Ocean Data Interoperability Platform (ODIP) ODIP Background and Prototype 1 development EGU 2014 – ESSI 2.5 Session – Vienna – Austria – 1 st May 2014.
A Pan-European Infrastructure for Ocean and Marine Data Management Dick M.A. Schaap – MARIS (SeaDataNet technical coordinator)
SDN2 First Training Course, Oostende IODE-PO, 2-6 July 2012 Metadata Directories Management Sissy Iona, HCMR/HNODC.
EDMED and EDIOS Roy Lowry, Karen Vickers (Technical) Lesley Rickards, Liz Bradshaw (Content) British Oceanographic Data Centre.
SeaDataNet, pan-European infrastructure for ocean and marine data management A key component of EMODNet A possible building block for GEOSS By Dick M.A.
Towards a pan-European infrastructure for marine and ocean data management + Importance of standards By Dick M.A. Schaap – Technical Coordinator SeaDataNet.
2 nd Training Workshop 4 – 5 June 2007 Common Data Index - CDI By Dick M.A Schaap Technical Coordinator SeaDataNet.
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S…………… By Dick M.A. Schaap – Technical Coordinator Trieste – Italy, 3 – 5 June 2013, Kick Off Meeting.
Marine Data Management within EMODNet Chemistry project: data aggregation, quality control and products preparation A.S. Iona 1, P. Karagevrekis 1, S.Balopoulou.
Helen Glaves (NERC- BGS), Dick Schaap (MARIS), Robert Arko (LDEO) and Roger Proctor (IMOS)
Training course – Ostende – 2-6 July 2012 Introduction to the 1 st training session of SeaDataNet 2 M. Fichaut, IFREMER, France.
SeaDataNet2 Plenary meeting, 19th-20th September 2012, Rhodes SeaDataNet2 Plenary meeting THE EMODNET CHEMISTRY LOT. FROM THE EXPERIENCE OF THE THREE YEARS.
Needs for Data and Information Managing living and non-living resources, monitoring environmental changes in the sea and protecting the marine environment,
1 The IODE Ocean Data Portal - current status and future Nikolai Mikhailov, Chair of IODE/JCOMM ETDMP National Oceanographic Data Centre, Russia Four Session.
NATO ARW September 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management by Dick M.A. Schaap (MARIS) Technical coordinator.
SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management: Achievements and challenges.
From Emodnet Chemical Pilot to Emodnet Chemistry 2 Matteo Vinci, Istituto Nazionale di Oceanografia e di Geofisica Sperimentale – OGS – NODC group, Dipartimento.
Design central EMODnet portal Objectives, Technical Proposal and Consultation Process.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT,
Lesley Rickards MEDIN Core Team European initiatives and how MEDIN and the data in the framework relates to them.
SeaDataNet – EMODNet – WISE-Marine By Dick M.A. Schaap – MARIS SeaDataNet Technical Coordinator Brussels – Belgium, 14 November 2011, Expert Group on Marine.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Istanbul – Turkey,
IODE Ocean Data Portal – from data access to integration platform Sergey Belov, Tobias Spears, Nikolai Mikhailov International Oceanographic Data and Information.
TTG, March 2014, Barcelona WP3: Capacity building and training.
From Emodnet Chemical Pilot to Emodnet Chemistry 2 Matteo Vinci and Alessandra Giorgetti, – OGS – NODC group, OCE - MODEG meeting, Copenhagen, 4 and 5.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES SeaDataNet annual meeting, Madrid, March 2009 How to prepare data for integration in SeaDataNet.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES Synthesis of the data management activities (NA) S. Iona (HCMR), R. Lowry (BODC), F. Nast (BSH),
Chemical lot - HOW: Infrastructure set up based on SeaDataNet V1 efficient distributed Marine Data Management Infrastructure; Principle of “ADOPTED AND.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S How to make EMODnet Chemistry fit for purpose at system level By Dick M.A. Schaap – Technical.
SeaDataNet Harmonizing and optimizing the metadatabases and controlled vocabularies, incl maintenance & retrieval systems.
Marine Strategy 2012, 14th-16th May 2012, Copenhagen Marine Strategy 2012 THE EMODNET CHEMISTRY LOT. AN OVERVIEW ON THE EXPERIENCE OF THE THREE YEARS PILOT.
EMODNet Chemistry (MARE/2012/10). The portal should collect the following groups of chemicals: - in 3 matrices: water column, biota, sediment. - in all.
Data Product Catalogue for SeaDataNet and Emodnet Chemistry M. Treguer, T. Loubrieu, IFREMER.
EMODNet Physics + My Ocean – SeaDataNet Dick Schaap (MARIS) – Brussels – 1 March 2013.
Helen Glaves 1 and Dick Schaap 2 1 British Geological Survey, United Kingdom 2 MARIS, The Netherlands.
Metadata generation, control and updating Peter Thijsse - MARIS.
Data Product Catalogue for SeaDataNet and Emodnet Chemistry M. Treguer, T. Loubrieu, C. GUYOT, IFREMER.
Metadata V1 By Dick M.A. Schaap – technical coordinator Oostende, June 08.
The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.
Sensor Web Enablement (SWE) developments for fixed monitoring platforms and research vessels By Dick M.A. Schaap – SeaDataNet Technical Coordinator with.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal.
CDI Data Discovery and Access Service Dick Schaap (MARIS) – SeaDataNet Technical Coordinator RDA – Paris - Sept 2015.
MIKADO – Generation of ISO – SeaDataNet metadata files
SeaDataNet tools NEMO, OCTOPUS, MIKADO
Introduction to the 1st training session of SeaDataNet 2
EMODnet Chemistry 3 Upgrading of the portal and its services By
Supported by the European Commission
INTRODUCTION TO GENERATING SERVICES
SEXTANT PRODUCTS CATALOGUE
Data aggregation and products generation in the Mediterranean Sea
ODP Interoperability Package
INTAROS – Integrated Arctic Observation System
By Dick M.A. Schaap – Coordinator
EMODnet – Bathymetry By
EMODnet - Ingestion and safe-keeping of marine data
Flanders Marine Institute (VLIZ)
EMODnet Chemistry initiative
EMODnet Chemistry Background, set-up, achievements and future By
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
Vanessa Tosello (IFREMER), Flavian Gheorghe (MARIS)
IHO-European Union Network Working Group (IENWG)
Design central EMODnet portal Objectives and Technical description Initial draft prepared by the Flanders Marine Institute.
Work Programme 2012 COOPERATION Theme 6 Environment (including climate change) Challenge 6.4 Protecting citizens from environmental hazards European.
EMODNet Physics + My Ocean – SeaDataNet
Upgrading the portal and its services
Presentation transcript:

EGU Conference, Vienna, Austria, 8-13April 2018 The contribution of the SeaDataNet infrastructure in the extreme weather events study Leda Pecci – ENEA (Italy) EGU Conference, Vienna, Austria, 9 April 2019

EGU Conference, Vienna, Austria, 8-13April 2018 SeaDataNet is a comprehensive Pan-European semi-distributed marine data infrastructure, providing access to multidisciplinary, integrated marine and ocean data and products of standardised quality, services, as well as an overview of marine organisations, research and monitoring activities related to the sea. Physical oceanography Chemistry Geophysics Marine Geology Biology Bathymetry Selection of data along tracks Meteorology

EGU Conference, Vienna, Austria, 8-13April 2018 Origin Architecture Data services (visualisation, quality check) Metadata services Data products Vocabulary services Software tools SeaDataNet project activities Challenges for extreme weather events How SeaDataNet supports extreme weather events study The highlights SeaDataNet standards and tools in other EU projects

EGU Conference, Vienna, Austria, 8-13April 2018 Origin EGU Conference, Vienna, Austria, 9 April 2019 SeaDataNet started in 1990s and has been developing over the years thanks to EU funded projects: 90 Metadata directories Medar/MedAtlas 2002-2005 Sea-Search (FP5) 2006-2011 SeaDataNet (FP6) 2011-2015 SeaDataNet II (FP7) 2016-2020 SeaDataCloud (H2020) SeaDataNet was a EU project funded by FP7 (seventh Programme for Research) started in his first phase in 2006 to 2011. SeaDataNet is the result of the joint efforts of several marine institutes around the European and the Mediterranean seas.

EGU Conference, Vienna, Austria, 8-13April 2018 Architecture EGU Conference, Vienna, Austria, 9 April 2019  a single access for a wide range of data of different types Central Portal Data centre NODC User The infrastructure provides a unique point of access to discover and download data residing in remote data centres (or repositories). The CDI service (Common Data Index service) provides a catalogue of global data availability. 1.  The user connects to the portal and sends a data request to the central portal. 2.  The portal first checks if the data is available and whether the user has the necessary permissions. 3.  If so, the portal  forwards the request to the data centre(s) that own the data. 4.  The user will then receive the data directly from each data centre. Data Request Data Downloading NODC (National Oceanographic Data Centre)

EGU Conference, Vienna, Austria, 8-13April 2018 Data services EGU Conference, Vienna, Austria, 9 April 2019 Discovery, visualization, access and download The SeaDataNet portal offers different services: discovery, visualisation, access and data downloading. The data discovery is freely available, without registration and allows to access metadata. The discovery interface allows searching for data and visualising the results through an interactive map and/or by searching for specific properties. How to download the data: Data discovery, data selection, Add to the shopping basket and user registration Data policy: All metadata services are public domain. User registration is required to download data, in order to accept the SeaDataNet license. The major part of data is freely available (85%). The remaining data have access estrictions and the user has to make arrengements with the data producers to negotiate access for downloading. http://www.seadatanet.org

EGU Conference, Vienna, Austria, 8-13April 2018 Data Services EGU Conference, Vienna, Austria, 9 April 2019 Map tools Data discovery interface The discovery interface allows searching for data and visualising the results through an interactive map and/or by searching for specific properties. How to download the data: Data discovery, data selection, Add to the shopping basket and user registration Data policy: All metadata services are public domain. User registration is required to download data, in order to accept the SeaDataNet license. The major part of data is freely available (85%). The remaining data have access restrictions and the user has to make arrengements with the data producers to negotiate access for downloading. Discipline Cruise Parameter Country Instrument Platform ………..

EGU Conference, Vienna, Austria, 8-13April 2018 Metadata Services SDN provides useful information to know which organisations operate in marine environment, what they do and where  chances for future collaborations in research or in the private sector

EGU Conference, Vienna, Austria, 8-13April 2018 Metadata Services EDIOS CDI EDMED CSR EDMO EDMERP Projects Research cruises Observing programmes Data index Data sets Organisations COMPLIANT SeaDataNet portal provides an overview of the Marine organisations in Europe and their involvement in scientific cruises, data collection, marine projects EDMO : European Directory of Marine Organisations ( CSR : Cruise Summary Reports ( EDMED : European Directory of Marine Environmental Datasets ( EDMERP : European Directory of Marine Environmental Research projects EDIOS : European Directory of Ocean Observing Systems () CDI : Common Data Index () All SeaDataNet catalogues have been harmonised and tuned in format, syntax and semantics (common vocabularies). They have a common editor (MIKADO) and online CMS and online query interfaces COMPLIANT

EGU Conference, Vienna, Austria, 8-13April 2018 Data Products EGU Conference, Vienna, Austria, 9 April 2019

EGU Conference, Vienna, Austria, 8-13April 2018 Data Products EGU Conference, Vienna, Austria, 9 April 2019 gridded climatologies (DOI) reports describing products’ characteristics and quality (DOI) Historical data collections of all T and S measurements within SeaDataNet covering all EU sea basins (DOI) Catalogue

EGU Conference, Vienna, Austria, 8-13April 2018 Product Catalogue 12

EGU Conference, Vienna, Austria, 8-13April 2018 Product Catalogue Download Viewing tools Ocean Browser and Oceanotron Metadata record (DOI) 13 13

EGU Conference, Vienna, Austria, 8-13April 2018 Vocabulary services Controlled vocabularies used in all metadatabases and data formats (interoperability) organised with international governance, user interfaces and web services

EGU Conference, Vienna, Austria, 8-13April 2018 Software Tools EGU Conference, Vienna, Austria, 9 April 2019 To create metadata CDI, CSR, EDMO, EDIOS, EDMERP To convert to the internal formats To convert data file To present and analyse data To make available data in data centres NEMO reformat ASCII file of vertical profiles, time series and trajectories to SDN formats file. NEMO generates the coupling table and a CSV file that is a summary of the data that can be used by Mikado to produce a CDI file for metadata. The ODV software is also being used in SeaDataNet for producing generic data products for each of the regional seas for various variables. The DIVA software tool ( Data-Interpolating Variational Analysis ) allows to spatially interpolate (or analyse) those observations on a regular grid in an optimal way. As a part of SeaDataNet, the DIVA method has been integrated into ODV, and the integration greatly facilitates the usage of DIVA.  MIKADO: generator of XML descriptions of SeaDataNet catalogues NEMO: reformatting software to SeaDataNet formats Download Manager: downloading software ODV: Ocean data view adapted to SeaDataNet needs DIVA: for product generation adapted to SeaDataNet needs To generate the spatial objects for CDI files

EGU Conference, Vienna, Austria, 8-13April 2018 SeaDataCloud project activities This project has received funding from the European Union’s Horizon 2020 Research Infrastructures programme, under the grant agreement No 730960”. Upgrading and innovating existing services for users and data providers: Advancing the CDI service by adopting cloud Introducing 'Linked Data principle' to catalogues for semantic web Adding transformation facility for INSPIRE compliance Developing new services for users and data providers: consortium of e-infrastructure service providers SWE Ingestion service for Real Time data streams Brokerage service for mutual exchange with international data networks Virtual Research Environment (VRE) with advanced services: subsetting, online ODV, DIVA, and visualisation Innovation: The infrastructure is going to offer a virtual research environment that includes on line services for analysis, quality control, data sub-setting, visualisation of retrieved datasets, generation and publication of data products.

Challenges for extreme weather events EGU Conference, Vienna, Austria, 9 April 2019 How do oceans drive extreme weather events? To improve the understanding of variability and climate change and the link between the latter and extreme events To improve the knowledge of global climate pattern To predict human influence on climate change Carrying out research in this field of sea sciences can help the humanity. The availability of great amount of high quality ocean data allows hazard vulnerability assessment and gives the possibility to plan the risk mitigation strategies and the adaptation measures. High tide in Venice (01dic2008) Credit: Consorzio Venezia Nuova

EGU Conference, Vienna, Austria, 8-13April 2018 How SeaDataNet supports  extreme weather events study In the SeaDataNet infrastructure are available more than 2 M of data sets comprising bathymetry data as well as temperature, salinity, currents, etc. In situ data is used mainly for validation activity of climate-hazard modelling data and satellite data. Improved models are used to better forecast and to predict areas that are likely to be very high exposure to climate hazards. SDN released qualified temperature and salinity historical data collections in the European regional seas as well as climatological maps. Credit: C. Papucci Rosette sampler

Availability of aggregated dataset 1900-2014 EGU Conference, Vienna, Austria, 9 April 2019 Availability of aggregated dataset 1900-2014

Climatology OceanBrowser EGU Conference, Vienna, Austria, 9 April 2019 OceanBrowser SDN provides temperature and salinity climatologies, based on the aggregated datasets, for all the European sea basins produced using DIVA software

EGU Conference, Vienna, Austria, 8-13April 2018 The highlights EGU Conference, Vienna, Austria, 9 April 2019 Easy to use for end-users and data providers 110 Data centres providing data and metadata More than 2,100,000 ocean data sets available Vocabulary governance and services Standard QA-QC procedures, method for checking possible duplicates Standards and interoperability solutions widely recognized by the international community, beyond European borders. SeaDataNet has participated in the ODIP I and II projects and it collaborates with the existing global infrastructures such as the IOC-IODE – Ocean Data Portal (ODP), GEOSS and the International Council for Science World Data System (ICSUWDS). These strategic collaborations to work towards the common goal of a better interoperability Best practices in data management in collaboration with international infrastructures of U.S., Australia and Canada.

Cooperation and involvement EGU Conference, Vienna, Austria, 8-13April 2018 EGU Conference, Vienna, Austria, 9 April 2019 Cooperation and involvement Copernicus Marine Environmental Monitoring Services (CMEMS): providing long-term archives and standards Marine Strategy Framework Directive (MSFD): providing infrastructure, standards and data collections for several indicators Large ocean monitoring systems (EuroGOOS, AtlantOS, Euro-ARGO, JERICO-Next, EuroFleets, ..): providing standards and validation + long-term archiving services Ocean Data Interoperability Platform (ODIP): exploring and demonstrating common standards and interoperability with leading data management infrastructures in USA and Australia GEOSS - EuroGEOSS: feeding GEOSS portal with SeaDataNet in-situ data collections from large community of European data holders (> 100 data centres; >600 data originators) European Open Science Cloud (EOSC): shaping the pilot Blue Cloud European Marine Observation and Data Network (EMODnet): driving and serving many EMODnet thematic portals Black Sea SCENE involving 6 NODCs and many other data holding institutes from the 6 Black Sea countries, to provide metadata and data access and to strengthen their national NODC networks. EU-funding 3.4 MEuro. Caspinfo involving 12 institutes and private industry from the Caspian Sea region, to provide metadata and data access and to build their capacity for data management and user services. EU-funding 0.8 Meuro Geoo seas involving 24 geological and geophysical data centres from 16 European countries (EuroGeoSurveys), to provide metadata and data access. EU-funding 4.9 MEuro. EuroFleets involving 24 research institutes and data centres from 17 European countries, to optimise the management of research vessels and to streamline the flow of data from the research cruises to the data centre infrastructure. EU-funding 7.2 MEuro. Jerico involving 27 institutes from 17 European countries, to develop better coordination between the coastal observatories responsible for physical and bio-chemistry parameters as well as to develop improved procedures for streamlining the flow of data from the monitoring stations to the data centre infrastructure. EU-funding 6.5 MEuro. Emodnet Chemistry chemistry, hydrography, physics lots. SeaDataNet has qualified itself as leading infrastructure for the EMODNet data management component and is leading several preparatory EMODNet projects

EGU Conference, Vienna, Austria, 8-13April 2018 CDI service driving and serving many portals and communities Black Sea SCENE involving 6 NODCs and many other data holding institutes from the 6 Black Sea countries, to provide metadata and data access and to strengthen their national NODC networks. EU-funding 3.4 MEuro. Caspinfo involving 12 institutes and private industry from the Caspian Sea region, to provide metadata and data access and to build their capacity for data management and user services. EU-funding 0.8 Meuro Geoo seas involving 24 geological and geophysical data centres from 16 European countries (EuroGeoSurveys), to provide metadata and data access. EU-funding 4.9 MEuro. EuroFleets involving 24 research institutes and data centres from 17 European countries, to optimise the management of research vessels and to streamline the flow of data from the research cruises to the data centre infrastructure. EU-funding 7.2 MEuro. Jerico involving 27 institutes from 17 European countries, to develop better coordination between the coastal observatories responsible for physical and bio-chemistry parameters as well as to develop improved procedures for streamlining the flow of data from the monitoring stations to the data centre infrastructure. EU-funding 6.5 MEuro. Emodnet Chemistry chemistry, hydrography, physics lots. SeaDataNet has qualified itself as leading infrastructure for the EMODNet data management component and is leading several preparatory EMODNet projects