Ocean Data Interoperability Platform I & II

Slides:



Advertisements
Similar presentations
Cultural Heritage in REGional NETworks REGNET Workplan Adherence.
Advertisements

Rolling Deck to Repository: Transforming the United States Academic Fleet Into an Integrated Global Observing System Suzanne M. Carbotte, Robert Arko,
International Research Cruise Database and Website Status October ‘07.
Ocean Data Interoperability Platform EU-US-Australia collaborative project Grant Number: Call: FP7-INFRASTRUCTURES INFSO Activity: INFRA :
Status of CDI service (connections, NetCDF introduction, CDI ingestion service and set-up of CDI ingestion pilot) By Dick M.A. Schaap – Technical Coordinator.
The Open Archives Initiative Simeon Warner (Cornell University) Symposium on “Scholarly Publishing and Archiving on the Web”, University.
Ocean Data Interoperability Platform (ODIP) ODIP Background and Prototype 1 development EGU 2014 – ESSI 2.5 Session – Vienna – Austria – 1 st May 2014.
A Pan-European Infrastructure for Ocean and Marine Data Management Dick M.A. Schaap – MARIS (SeaDataNet technical coordinator)
EDMED and EDIOS Roy Lowry, Karen Vickers (Technical) Lesley Rickards, Liz Bradshaw (Content) British Oceanographic Data Centre.
SeaDataNet, pan-European infrastructure for ocean and marine data management A key component of EMODNet A possible building block for GEOSS By Dick M.A.
A common global framework for marine data management Helen Glaves.
2 nd Training Workshop 4 – 5 June 2007 Common Data Index - CDI By Dick M.A Schaap Technical Coordinator SeaDataNet.
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
Helen Glaves (NERC- BGS), Dick Schaap (MARIS), Robert Arko (LDEO) and Roger Proctor (IMOS)
Ocean Data Interoperability Platform EU-US-Australia collaborative project Grant Number: Call: FP7-INFRASTRUCTURES INFSO Activity: INFRA :
SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management: Achievements and challenges.
1 INFRA : INFRA : Scientific Information Repository supporting FP7 “The views expressed in this presentation are those of the author.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT,
IIIrd SeaSearch Full Group Meeting Limassol, Cyprus Tuesday May 25-27, 2004 SeaDataNet-Design Study proposal.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Istanbul – Turkey,
IODE Ocean Data Portal – from data access to integration platform Sergey Belov, Tobias Spears, Nikolai Mikhailov International Oceanographic Data and Information.
MEDIN Work Plan for By March 2011 MEDIN will be 3 years into the original 5 year development plan started in Would normally ask for continued.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
ODP Interoperability Package Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT, Buenos Aires, Argentina, 7 – 11 October.
Open Archive Initiative – Protocol for metadata Harvesting (OAI-PMH) Surinder Kumar Technical Director NIC, New Delhi
ENEON first workshop Observing Europe: Networking the Earth Observation Networks in Europe September, Paris IIASA Ian McCallum ENEON first workshop.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S How to make EMODnet Chemistry fit for purpose at system level By Dick M.A. Schaap – Technical.
SeaDataNet Harmonizing and optimizing the metadatabases and controlled vocabularies, incl maintenance & retrieval systems.
NESC Worshop – 07 September 2005 Development of a Marine Metadata Standard Greg Reed Executive Officer Australian Ocean Data Centre Joint Facility.
International Oceanographic Data and Information Exchange - Ocean Data Portal (IODE ODP) Enabling science through seamless and open access to marine data.
EMODNet Physics + My Ocean – SeaDataNet Dick Schaap (MARIS) – Brussels – 1 March 2013.
Helen Glaves 1 and Dick Schaap 2 1 British Geological Survey, United Kingdom 2 MARIS, The Netherlands.
ISWG / SIF / GEOSS OOS - August, 2008 GEOSS Interoperability Steven F. Browdy (ISWG, SIF, SCC)
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
Metadata V1 By Dick M.A. Schaap – technical coordinator Oostende, June 08.
Sensor Web Enablement (SWE) developments for fixed monitoring platforms and research vessels By Dick M.A. Schaap – SeaDataNet Technical Coordinator with.
SeaDataNet European Directory of Marine Research Projects - EDMERP By Dick Schaap.
User Registration in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
Workshop Sensor Web Enablement (SWE) for oceanography - introduction Dick M.A. Schaap – MARIS March 2016.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal.
CDI Data Discovery and Access Service Dick Schaap (MARIS) – SeaDataNet Technical Coordinator RDA – Paris - Sept 2015.
GEOSS Component and Service Registry (CSR)
Supported by the European Commission
Priorities for International Development of e-Infrastructure and Data Management in Global Change Research Presentation by Robert Gurney, University of.
SEXTANT PRODUCTS CATALOGUE
ODP Interoperability Package
Linked Data for Field Deployments
EMODnet - Ingestion and safe-keeping of marine data
OceanDocs Digital Repository of Marine Science Research Outputs
Flanders Marine Institute (VLIZ)
Capacity Building Enhance the coordination of efforts to strengthen individual, institutional and infrastructure capacities, particularly in developing.
Distributed Marine Data System:
Results of IODE Ocean Data Portal project for
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
WGISS Connected Data Assets April 5, 2017 Yonsook Enloe
WGCapD Collaboration with EOPOWER on Resource Facility Nancy D
Topics NOAA support for: CWIC Infrastructure NOAA as a Data Provider
Report on operation of the Partnership Centre for the IODE Ocean Data Portal in Dr Sergey Belov, et al. Partnership Centre for the IODE Ocean.
WGISS Connected Data Assets April 9, 2018 Yonsook Enloe
OneStop: Architecture Review
IODE Ocean Data Portal - nodes – national, regional/specialized and global Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal.
DRIVER Digital Repository Infrastructure Vision for European Research
IODE Ocean Data Portal - technological framework of new IODE system
Workshop on Gap Analysis and Prioritization
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
Support for SOT Activities
EMODNet Physics + My Ocean – SeaDataNet
Institut Français de Recherche pour l'Exploitation de la Mer
EGU Conference, Vienna, Austria, 8-13April 2018
ODIP: an international effort promoting the development a global framework for marine data management to support large-scale ocean research Helen Glaves.
Presentation transcript:

Ocean Data Interoperability Platform I & II Collaborative project between Europe, USA, and Australia FP7 Grant Number: 312492 1 October 2012 – 30 September 2015 FP7 Grant Number: 654310 1 April 2015 – 31 March 2018 By Dick M.A. Schaap – MARIS (NL), technical coordinator

E-infrastructures USA Europe Australia A number of regional initiatives have made significant progress in addressing discovery, access, and long term stewardship of ocean and marine data on a regional basis ODIP is a community lead initiative to overcome barriers by exploring common standards and interoperability solutions for improving exchange between regional infrastructures and towards global infrastructures such as GEOSS, IODE – ODP, POGO, .. These problems have been recognised and are being addressed at the regional level by a number of initiatives e.g. SeaDataNet, Geo-Seas in Europe; R2R, IOOS in the USA; AODN, IMOS in Australia. All of these initiatives have implemented marine data management infrastructures within their own regions. BUT they are implemented according to their own regional requirements and priorities.

Partners Europe: 19 EU-funded partners (9 countries) NERC-BGS/BODC, MARIS, OGS, IFREMER, HCMR, ENEA, ULG, CNR, RBINS, TNO, AWI, BSH, RIHMI-WDC, VLIZ, UniHB, CSIC, 52ONorth, IEEE, SOCIB

Contributors USA Scripps Institution of Oceanography (SIO) Woods Hole Oceanographic Institute (WHOI) Lamont-Doherty Earth Observatory (LDEO), Florida State University (FSU): Center for Ocean-Atmospheric Prediction Studies ESRI NOAA - NCEI US-IOOS UNIDATA MMI

Contributors Australia: University of Tasmania (IMOS) CSIRO Geoscience Australia (GA) NCI ANDS International: UNESCO IOC-IODE POGO ICSU – WDS GEO/GEOSS Canada Ocean Networks Canada

Objectives To provide a coordination platform to facilitate the establishment of interoperability between regional data infrastructures in Europe, USA and Australia and also with global systems e.g. IODE Ocean Data Portal, GEOSS, POGO To demonstrate this co-ordination through the development of several joint prototype projects that allow effective sharing of marine and ocean data To develop these prototype projects by largely leveraging on existing and ongoing regional projects and initiatives To promote and disseminate ODIP approach and results widely for further uptake and feedback

ODIP 1 prototype: Establishing interoperability between the SeaDataNet, IMOS and US NODC data discovery and access services using the GEO-DAB brokerage service and towards interacting with interacting with the IODE-ODP and GEOSS portals Lead by European partners via SeaDataNet

ODIP Prototype 1 - context Marine Data Discovery & Access services: Europe: Common Data Index (CDI) service, operated by SeaDataNet USA: Data Discovery and Access service, operated by US NODC Australia: Data Discovery and Access service, operated by AODN Global Data Discovery & Access services: GEOSS portal IODE Ocean Data Portal (ODP) 8

GEO-DAB Brokerage service implementation The GEO-DAB Brokerage Service at CNR harvests XML entries and converts these following a Generic Brokerage Reference Schema, adopting prevailing vocabs 9

pan-European infrastructure April 2016: 106 data centres connected; > 1.8 million data sets

ODIP 1 prototype: Aggregation of SeaDataNet metadata CDI granules to CDI collections (ISO 19115 – 19139) (1.8 million => 420 collections), conversion to Common Brokerage Model, and harvesting via CS-W and OAI-PMH services

ODIP 1 – SeaDataNet in GEOSS SeaDataNet CDI collections have been populated in GEOSS portal (http://geoportal.org) 12

ODIP 1 – SeaDataNet in ODP RIHMI-WDC, operator of IODE ODP portal, has harvested SeaDataNet CDI collections and included in ODP CSW gave some issues with GeoNetwork; OAI protocol worked with jOAI harvester as also used in WIS 13

Node 2: US NODC Activities extended to include US NODC services: US NODC already provides web services at collections level as CSW, OAI-PMH and OpenSearch endpoints for discovery. All metadata contain at least FTP and HTTP links to the data, and many also have Hyrax, THREDDS Data Server, and Live Access Server links. 1st analysis of definition of US NODC collections => use of ISO19115 – 19139 metadata US NODC has circa 28.000 collection entries which relate to > 1.3 million granule data sets 14

US NODC web page collection Data access URLs 15

Node 3: AODN - Australia Activities extended to include AODN services: AODN makes use of GeoNetWork and already provides web services at collections level as CSW, OAI-PMH and OpenSearch endpoints for discovery. Collections are defined somewhat differently from SeaDataNet and US NODC At present ca. 110 collections, defined by IMOS facilities (similar to data originator), geometric object, timeliness (real-time or delayed mode) 16

AODN - Australia Catalogue with collections 17

GEOSS portal – AODN entries http://www.geoportal.org/ AODN 18

GEOSS portal – US NODC entries http://www.geoportal.org/ US NODC 19

GEOSS portal – SeaDataNet entries http://www.geoportal.org/ SeaDataNet 20

ODP portal http://www.oceandataportal.net/portal/portal/odp2/interoperability US NODC SeaDataNet AODN 21

ODIP 2 prototype: ODIP 2: Establishing interoperability between cruise summary reporting systems in Europe, the USA and Australia and also towards global POGO portal Led by Rolling Deck to Repository (R2R) partners (USA) SeaDataNet Cruise Summary Report (CSR) adopted with ISO19115 – 19139 Schema and supporting Common Vocabularies

ODIP Prototype 2 - Context Europe, USA and Australia administer cruises and related data acquisition activities undertaken by their research vessel fleets: In Europe via SeaDataNet Cruise Summary Reports directory In USA via Rolling Deck to Repository (R2R) project In Australia via Marine National Facility (MNF) All 3 regions are participating in the Partnership for Observation of the Global Oceans (POGO). A POGO portal is maintained for sharing information on planned, current and past cruises to enhance awareness of opportunities, and to improve the cost-effectiveness of cruises. 23

ODIP Prototype 2 - USA The mission of the Rolling Deck to Repository (R2R) project is to provide uniform stewardship of routinely-collected environmental sensor data from the US academic research fleet. It publishes Cruise records in multiple formats. 24

ODIP Prototype 2 – Workplan Publish ISO Cruise Summary Reports at regional nodes: Europe: Cruise Summary Reports (CSR) service, operated by SeaDataNet USA: Rolling deck to Repository (R2R) catalogue, operated by R2R group Australia: Marine National Facility (MNF) service, operated by CSIRO Deploy GeoNetwork catalogs at regional nodes to provide both GUI (Web portal) and API (CSW service) Harvest GeoNetwork nodes into POGO global catalog to provide integrated search 25

ODIP Prototype 2 - development R2R team has prepared and published by its GeoNetwork node an initial set of 130 CSRs for the USA research vessels Kilo Moana and Falkor. These were harvested and successfully integrated by BSH into the POGO CSR Catalog service. 26

ODIP Cross cutting themes Vocabularies Data publishing and citation Persons registration Supporting the prototype projects Partly self-standing Relation with Research Data Alliance and Belmont Forum activities 27

Dissemination of ODIP outcomes Project website Social media International conferences Other related initiatives Ocean Data Portal (ODP) Research Data Alliance Belmont Forum www.odip.org As ODIP is a community orientated project which seeks to engage with the wider marine community the outcomesof the promoted using several apporaches: An ODIP web site has been created where you join the ODIP mailing list and get regular updates on these activities

Thank you!