SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management: Achievements and challenges.

Slides:



Advertisements
Similar presentations
International Research Cruise Database and Website Status October ‘07.
Advertisements

ECOOP Data Management System (T2.2/WP2) Declan Dunne 13 th February 2008, Athens.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
Ocean Data Interoperability Platform EU-US-Australia collaborative project Grant Number: Call: FP7-INFRASTRUCTURES INFSO Activity: INFRA :
SIMORC Workshop March 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management.
NODCi - National Infrastructure for access to Oceanographic and Marine Data and Information (RGI-014) By Dick M.A. Schaap – MARIS Amsterdam, April 09.
Ocean Data Interoperability Platform (ODIP) ODIP Background and Prototype 1 development EGU 2014 – ESSI 2.5 Session – Vienna – Austria – 1 st May 2014.
A Pan-European Infrastructure for Ocean and Marine Data Management Dick M.A. Schaap – MARIS (SeaDataNet technical coordinator)
SDN2 First Training Course, Oostende IODE-PO, 2-6 July 2012 Metadata Directories Management Sissy Iona, HCMR/HNODC.
EDMED and EDIOS Roy Lowry, Karen Vickers (Technical) Lesley Rickards, Liz Bradshaw (Content) British Oceanographic Data Centre.
SeaDataNet, pan-European infrastructure for ocean and marine data management A key component of EMODNet A possible building block for GEOSS By Dick M.A.
Towards a pan-European infrastructure for marine and ocean data management + Importance of standards By Dick M.A. Schaap – Technical Coordinator SeaDataNet.
A common global framework for marine data management Helen Glaves.
2 nd Training Workshop 4 – 5 June 2007 Common Data Index - CDI By Dick M.A Schaap Technical Coordinator SeaDataNet.
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
CASPINFO To foster co-operation and strengthen data sharing between marine scientists, the oil & gas industry and the government sector.
Helen Glaves (NERC- BGS), Dick Schaap (MARIS), Robert Arko (LDEO) and Roger Proctor (IMOS)
Training course – Ostende – 2-6 July 2012 Introduction to the 1 st training session of SeaDataNet 2 M. Fichaut, IFREMER, France.
SeaDataNet2 Plenary meeting, 19th-20th September 2012, Rhodes SeaDataNet2 Plenary meeting THE EMODNET CHEMISTRY LOT. FROM THE EXPERIENCE OF THE THREE YEARS.
Distributed system development, including standards and interoperability By Dick M.A. Schaap – technical coordinator Bologna, September 08.
1 The IODE Ocean Data Portal - current status and future Nikolai Mikhailov, Chair of IODE/JCOMM ETDMP National Oceanographic Data Centre, Russia Four Session.
NATO ARW September 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management by Dick M.A. Schaap (MARIS) Technical coordinator.
From Emodnet Chemical Pilot to Emodnet Chemistry 2 Matteo Vinci, Istituto Nazionale di Oceanografia e di Geofisica Sperimentale – OGS – NODC group, Dipartimento.
Synthesis of the technical activity and State of development of the on-line system V1 By Dick M.A. Schaap – technical coordinator Madrid, March 09.
Common Data Index CDI V1 How to proceed By Dick M.A. Schaap – technical coordinator Madrid, March 09.
Design central EMODnet portal Objectives, Technical Proposal and Consultation Process.
Lesley Rickards MEDIN Core Team European initiatives and how MEDIN and the data in the framework relates to them.
SeaDataNet – EMODNet – WISE-Marine By Dick M.A. Schaap – MARIS SeaDataNet Technical Coordinator Brussels – Belgium, 14 November 2011, Expert Group on Marine.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Istanbul – Turkey,
IODE Ocean Data Portal – from data access to integration platform Sergey Belov, Tobias Spears, Nikolai Mikhailov International Oceanographic Data and Information.
Opendap dev - meeting, Boulder, Feb 2007 OPeNDAP infrastructure in European Operational Oceanography T Loubrieu (IFREMER) T Jolibois (CLS)
TTG, March 2014, Barcelona WP3: Capacity building and training.
From Emodnet Chemical Pilot to Emodnet Chemistry 2 Matteo Vinci and Alessandra Giorgetti, – OGS – NODC group, OCE - MODEG meeting, Copenhagen, 4 and 5.
MEDIN Work Plan for By March 2011 MEDIN will be 3 years into the original 5 year development plan started in Would normally ask for continued.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES SeaDataNet annual meeting, Madrid, March 2009 How to prepare data for integration in SeaDataNet.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES Synthesis of the data management activities (NA) S. Iona (HCMR), R. Lowry (BODC), F. Nast (BSH),
Chemical lot - HOW: Infrastructure set up based on SeaDataNet V1 efficient distributed Marine Data Management Infrastructure; Principle of “ADOPTED AND.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S How to make EMODnet Chemistry fit for purpose at system level By Dick M.A. Schaap – Technical.
SeaDataNet Harmonizing and optimizing the metadatabases and controlled vocabularies, incl maintenance & retrieval systems.
Marine Strategy 2012, 14th-16th May 2012, Copenhagen Marine Strategy 2012 THE EMODNET CHEMISTRY LOT. AN OVERVIEW ON THE EXPERIENCE OF THE THREE YEARS PILOT.
EMODNet Chemistry (MARE/2012/10). The portal should collect the following groups of chemicals: - in 3 matrices: water column, biota, sediment. - in all.
1 Marine EnviRonment and Security for Europe Area MERSEA FP VI Integrated Project (SPACE) Contribution to GMES, GODAE, INSPIRE SeaSearch – Limassol May.
Download Manager software Training Workshop Ostend, Belgium, 20 th May 2014 D.M.A. Schaap - Technical Coordinator.
EMODNet Physics + My Ocean – SeaDataNet Dick Schaap (MARIS) – Brussels – 1 March 2013.
Helen Glaves 1 and Dick Schaap 2 1 British Geological Survey, United Kingdom 2 MARIS, The Netherlands.
Metadata generation, control and updating Peter Thijsse - MARIS.
3rd Training Workshop June 2008, Ostende Management of CSR Anne Che-Bohnenstengel, BSH  Metadata Formats  Defined Vocabularies  Content Management.
Data Product Catalogue for SeaDataNet and Emodnet Chemistry M. Treguer, T. Loubrieu, C. GUYOT, IFREMER.
Metadata V1 By Dick M.A. Schaap – technical coordinator Oostende, June 08.
Sensor Web Enablement (SWE) developments for fixed monitoring platforms and research vessels By Dick M.A. Schaap – SeaDataNet Technical Coordinator with.
Outcomes from EMODnet/MSFD coordination meetings A. Giorgetti, M. Lipizer, M. Vinci EMODnet Chemistry, 3 rd year meeting, June 8-9, 2016 Helsinki, Finland.
SeaDataNet European Directory of Marine Research Projects - EDMERP By Dick Schaap.
User Registration in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
SeaDataNet JRA2: Technical development of the interoperable system components By Dick Schaap.
Validation of Metadata XML files SeaDataNet Training, June 2008 Presented by with contributions from Karen Vickers (BODC) Presented by Michèle Fichaut.
CDI Data Discovery and Access Service Dick Schaap (MARIS) – SeaDataNet Technical Coordinator RDA – Paris - Sept 2015.
MIKADO – Generation of ISO – SeaDataNet metadata files
SeaDataNet tools NEMO, OCTOPUS, MIKADO
Introduction to the 1st training session of SeaDataNet 2
Supported by the European Commission
SEXTANT PRODUCTS CATALOGUE
Flanders Marine Institute (VLIZ)
Distributed Marine Data System:
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
MIKADO: Generation of CDI ISO19139 XML files
Vanessa Tosello (IFREMER), Flavian Gheorghe (MARIS)
Design central EMODnet portal Objectives and Technical description Initial draft prepared by the Flanders Marine Institute.
EMODNet Physics + My Ocean – SeaDataNet
EGU Conference, Vienna, Austria, 8-13April 2018
Presentation transcript:

SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management: Achievements and challenges

SeaSearch and SeaDataNet Data availability of vital importance for marine research European data set is fragmented Not always quality controlled Not always easily accessible In 35 countries bordering European seas –Thousands scientific laboratories from government organizations and private industry collect data –Data are acquired using various sensors on board of research vessels, AUV, fixed and drifting platforms, airplanes and satellites –Measurements of physical, geophysical, geological, biological and chemical parameters, biological species, etc.

SeaDataNet I partners 49 partners including: Major oceanographic institutes of 35 countries National Oceanographic Data Centres (NODCs) Divisions of major national marine research institutes 3 satellite data centres 3 scientific modelling centres 2 SMEs experts in software development 3 International organisations (IOC, ICES, JRC) I3: Integrated Infrastructure Initiative

SeaDataNet infrastructure

SeaDataNet Metadata Services Give overviews of marine organizations in Europe Their engagement in marine research projects, managing large datasets, and data acquisition by research vessels and monitoring programmes for the European seas and global oceans European Directory of Marine Organisations (EDMO) European Directory of Marine Environmental Data sets (EDMED) European Directory of Marine Environmental Research Projects (EDMERP) Cruise Summary Reports (CSR) European Directory of the initial Ocean-observing Systems (EDIOS)

Interrelationships between the directories, using vocabularies Country Param Platf … … … EDMED EDIOS EDMERP CDI CSR EDMO XML

Common Vocabularies Controlled vocabularies containing keys, terms, abbreviations and essential (but often missing) definitions Lists for platforms, countries, sea areas, etc… International content governance by SeaVox list server Web service On-line user client Export in.csv files

Metadata Services Tiers These directories are compiled from national contributions, collated by SeaDataNet partners for their country. Each of the directories has its own origin; As part of SeaDataNet all directories have been harmonised in use of syntax, semantics and tools.

SeaDataNet User’s portal schema V1 IFREMER Database BODC Database BSH Database ENEA Database Download managers in data centres CSREDIOS EDMED CDI Shopping basket Requests status manager datametadata CSR CDI Project info Metadata & Data catalogues Data request Status of request General request Metadata request Organisation + data source id Data download at BODCat BSHat MARIS + EDMERP services for metadata Data downloading services Visualisation services (WMS) for V2 Entry point for access hits EDMO EDIOSEDMED EDMERPEDMO Software Vocabularies StandardsCross search AAA Registr. My transact. User Register User registration

Software and services MIKADO XML editor for maintenance of entries for the Discovery services XML Validation Web services for validating new metadata entries NEMO, MedSDN2ODV and Med2MedSDN software for converting various data formats to SeaDataNet standard formats

Data products SeaDataNet will provided added-value products to be created by regional centres –Mediterranean Sea –Black Sea –Baltic Sea –Arctic and North Sea –Atlantic and global ocean First products => gridded climatologies –based on already available data-sets (mostly hydrographic data) –updated during the project life To make products comparable, all regional data centers will use a common tool for spatial mapping For this a new version of DIVA (Data Inverse Variational Analysis) was developed (University of Liege)

SeaDataNet offers SeaDataNet partnership is providing data, products and services to all users, SeaDataNet want to involve new data centers or products’ providers Enlarge the SeaDataNet partnership

SeaDataNet serves  In order to make best use of SDN data for science and for society, a robust operational infrastructure, based on European and internationally agreed standards, is required  This has been recognised by many, including the Commission, the ESF Marine Board, EuroGOOS, individual organisations and their research scientists.

SeaDataNet The SeaDataNet architecture has been designed as a multidisciplinary system from the beginning. It is able to support a wide variety of data types and to serve several sector communities. SeaDataNet is also actively sharing its technologies and expertise, spreading and expanding its approach, and building bridges to other well established infrastructures in the marine domain. This has resulted in adoption and an active role for a number of SeaDataNet partners in related data management projects “ MARINE KNOWLEDGE marine data and observation for smart and sustainable growth” states that the creation of marine knowledge begins with observation of the seas and oceans. INSPIRE Directive aims to create a European spatial data infrastructure that delivers integrated spatial information service Marine Strategy Framework Directive (MSFD) will be aided by an overarching European Marine Observation and Data Network (EMODNet)s to end-users.

SeaDataNet 2 European Directory of Marine Organisations (EDMO) (at present > entries) European Directory of Marine Environmental Data (EDMED) ( > entries) European Directory of Marine Environmental Research Projects (EDMERP) (> entries) Cruise Summary Reports (CSR) (> entries) European Directory of the Ocean Observing Systems (EDIOS) (> entries)

SeaDataNet 2: middlewares Discovery services = Metadata directories and User interfaces  Vocabulary services = Common vocabularies and Governance Security services = Authentication, Authorization & Accounting  Delivery services = Requesting and Downloading of data sets  Viewing services = Mapping of metadata Product viewing services = Viewing of generic and standard products in maps Monitoring services = Statistics on system usage and performance and Registration of data requests and transactions  Maintenance services = Entry and updating of metadata by data centres SeaDataNet II will have a dialogue with the related INSPIRE working groups to contribute to the INSPIRE process and to establish common standards. Further work will be dedicated to upgrading the NetCDF (CF) standard in cooperation with UNIDATA (USA) to make it better for SeaDataNet and MyOcean purposes. Establish common SeaDataNet profiles of OGC standards such as SensorML, Observations & Measurements schema, Sensor Observation Service (SOS), Web Feature Service (WFS)

Interoperability Achieving interoperability and exchange with other relevant data management systems in Europe, thereby promoting, fine-tuning and implementing the SeaDataNet standards, also taking into account active tuning and harmonising on an international scale. Achieving for operational oceanography both delayed mode and real-time data provision capacities in close cooperation with MyOcean, EuroGOOS, its Regions (ROOSes), and other oceanographic monitoring agencies and systems.