SIMORC Workshop March 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management.

Slides:



Advertisements
Similar presentations
Koninklijk Nederlands Instituut voor ZeeonderzoekRoyal Netherlands Institute for Sea Research 1 NIOZ is part of the Netherlands Organisation for Scientific.
Advertisements

International Research Cruise Database and Website Status October ‘07.
ECOOP Data Management System (T2.2/WP2) Declan Dunne 13 th February 2008, Athens.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Bologna, September 08.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
Ocean Data Interoperability Platform EU-US-Australia collaborative project Grant Number: Call: FP7-INFRASTRUCTURES INFSO Activity: INFRA :
NODCi - National Infrastructure for access to Oceanographic and Marine Data and Information (RGI-014) By Dick M.A. Schaap – MARIS Amsterdam, April 09.
TMSI/IDM/SISMER Centre de Brest B.P Plouzané France Tél : +33 (0) Fax : +33 (0)
A Pan-European Infrastructure for Ocean and Marine Data Management Dick M.A. Schaap – MARIS (SeaDataNet technical coordinator)
SDN2 First Training Course, Oostende IODE-PO, 2-6 July 2012 Metadata Directories Management Sissy Iona, HCMR/HNODC.
EDMED and EDIOS Roy Lowry, Karen Vickers (Technical) Lesley Rickards, Liz Bradshaw (Content) British Oceanographic Data Centre.
SeaDataNet, pan-European infrastructure for ocean and marine data management A key component of EMODNet A possible building block for GEOSS By Dick M.A.
Towards a pan-European infrastructure for marine and ocean data management + Importance of standards By Dick M.A. Schaap – Technical Coordinator SeaDataNet.
2 nd Training Workshop 4 – 5 June 2007 Common Data Index - CDI By Dick M.A Schaap Technical Coordinator SeaDataNet.
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
Training course – Ostende – 2-6 July 2012 Introduction to the 1 st training session of SeaDataNet 2 M. Fichaut, IFREMER, France.
Spatially enabling Northern Ireland Dr Suzanne McLaughlin DFP Land & Property Services GIS Ireland Conference 11 th October 2012.
SeaDataNet2 Plenary meeting, 19th-20th September 2012, Rhodes SeaDataNet2 Plenary meeting THE EMODNET CHEMISTRY LOT. FROM THE EXPERIENCE OF THE THREE YEARS.
Distributed system development, including standards and interoperability By Dick M.A. Schaap – technical coordinator Bologna, September 08.
Needs for Data and Information Managing living and non-living resources, monitoring environmental changes in the sea and protecting the marine environment,
NATO ARW September 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management by Dick M.A. Schaap (MARIS) Technical coordinator.
SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management: Achievements and challenges.
From Emodnet Chemical Pilot to Emodnet Chemistry 2 Matteo Vinci, Istituto Nazionale di Oceanografia e di Geofisica Sperimentale – OGS – NODC group, Dipartimento.
Synthesis of the technical activity and State of development of the on-line system V1 By Dick M.A. Schaap – technical coordinator Madrid, March 09.
Common Data Index CDI V1 How to proceed By Dick M.A. Schaap – technical coordinator Madrid, March 09.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT,
OBSERVATIONS & PRÉVISIONS CÔTIÈRES SeaDataNet 3 nd Annual Plenary Meeting Madrid – Spain March (14:00) – 27(13:00) SeaDataNet.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES SeaDataNet Pan-European Infrastructure for Ocean and Marine Data Management Gilbert Maudire and the.
IIIrd SeaSearch Full Group Meeting Limassol, Cyprus Tuesday May 25-27, 2004 SeaDataNet-Design Study proposal.
Lesley Rickards MEDIN Core Team European initiatives and how MEDIN and the data in the framework relates to them.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Istanbul – Turkey,
IODE Ocean Data Portal – from data access to integration platform Sergey Belov, Tobias Spears, Nikolai Mikhailov International Oceanographic Data and Information.
Opendap dev - meeting, Boulder, Feb 2007 OPeNDAP infrastructure in European Operational Oceanography T Loubrieu (IFREMER) T Jolibois (CLS)
TTG, March 2014, Barcelona WP3: Capacity building and training.
MEDIN Work Plan for By March 2011 MEDIN will be 3 years into the original 5 year development plan started in Would normally ask for continued.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES SeaDataNet annual meeting, Madrid, March 2009 How to prepare data for integration in SeaDataNet.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES Synthesis of the data management activities (NA) S. Iona (HCMR), R. Lowry (BODC), F. Nast (BSH),
Chemical lot - HOW: Infrastructure set up based on SeaDataNet V1 efficient distributed Marine Data Management Infrastructure; Principle of “ADOPTED AND.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S How to make EMODnet Chemistry fit for purpose at system level By Dick M.A. Schaap – Technical.
Welcome to SeaDataNet Technical Task Team Meeting + a few basic questions that the co-ordinator expects to get a preliminary answer before the Kick-Off.
Network evaluation and data delivery – WP2.1 Giuseppe M.R. Manzella - ENEA Marco Gambetta – INGV Aldo Drago – UoM Declan Dunne - UCC Annual Meeting – Athens.
SeaDataNet Harmonizing and optimizing the metadatabases and controlled vocabularies, incl maintenance & retrieval systems.
Marine Strategy 2012, 14th-16th May 2012, Copenhagen Marine Strategy 2012 THE EMODNET CHEMISTRY LOT. AN OVERVIEW ON THE EXPERIENCE OF THE THREE YEARS PILOT.
EMODNET Preparatory Actions Progress meeting for ur-EMODNET preparatory actions, 24 November 2009 Presentation of Progress Chemical Lot Alessandra Giorgetti.
Data Product Catalogue for SeaDataNet and Emodnet Chemistry M. Treguer, T. Loubrieu, IFREMER.
Download Manager software Training Workshop Ostend, Belgium, 20 th May 2014 D.M.A. Schaap - Technical Coordinator.
EMODNet Physics + My Ocean – SeaDataNet Dick Schaap (MARIS) – Brussels – 1 March 2013.
Helen Glaves 1 and Dick Schaap 2 1 British Geological Survey, United Kingdom 2 MARIS, The Netherlands.
Metadata generation, control and updating Peter Thijsse - MARIS.
3rd Training Workshop June 2008, Ostende Management of CSR Anne Che-Bohnenstengel, BSH  Metadata Formats  Defined Vocabularies  Content Management.
An Introduction to the MEDIN Discovery Metadata Standard MEDIN Workshop BGS, Edinburgh, June 2015.
An Introduction to the MEDIN Discovery Metadata Standard MEDIN Workshop NOC, Liverpool, Sept 2015.
Data Product Catalogue for SeaDataNet and Emodnet Chemistry M. Treguer, T. Loubrieu, C. GUYOT, IFREMER.
Metadata V1 By Dick M.A. Schaap – technical coordinator Oostende, June 08.
The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.
SeaDataNet European Directory of Marine Research Projects - EDMERP By Dick Schaap.
User Registration in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal.
Validation of Metadata XML files SeaDataNet Training, June 2008 Presented by with contributions from Karen Vickers (BODC) Presented by Michèle Fichaut.
CDI Data Discovery and Access Service Dick Schaap (MARIS) – SeaDataNet Technical Coordinator RDA – Paris - Sept 2015.
SeaDataNet Pan-European infrastructure for Ocean & Marine Data management An Integrated research Infrastructure Initiative (I3) SeaDataNet Overview and.
Introduction to the 1st training session of SeaDataNet 2
Supported by the European Commission
SEXTANT PRODUCTS CATALOGUE
Distributed Marine Data System:
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
Vanessa Tosello (IFREMER), Flavian Gheorghe (MARIS)
EMODNet Physics + My Ocean – SeaDataNet
EGU Conference, Vienna, Austria, 8-13April 2018
Presentation transcript:

SIMORC Workshop March 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management

SIMORC Workshop March 2007 Background Data availability of vital importance for marine research European data set is fragmented Not always quality controlled Not always easily accessible In 35 countries bordering European seas more than 600 scientific laboratories from government organizations and private industry collect data use various sensors on board of research vessels, submarines, fixed and drifting platforms, airplanes and satellites measure physical, geophysical, geological, biological and chemical parameters, biological species, etc.

SIMORC Workshop March 2007 What is SeaDataNet? EU Sixth Framework Programme Integrated Infrastructure Initiative (I3) 1 April 2006 to 31 March 2011 Objectives develop an efficient distributed pan-European marine data management Infrastructure for managing large and diverse data sets network existing professional data centres of 35 countries, active in data collection provide integrated databases of standardised quality on-line

SIMORC Workshop March 2007 SeaDataNet partners 49 partners including: Major oceanographic institutes of 35 countries National Oceanographic Data Centres (NODCs) Divisions of major national marine research institutes 3 satellite data centres 3 scientific modelling centres 2 SMEs experts in software development 3 International organisations

SIMORC Workshop March 2007 Building on experience Data management of scientific projects, e.g. MTPII- MATER, CANIGO, OMEX, MERSEA, etc. Leaders of Data Management Concerted Actions MEDAR/MEDATLAS II - Mediterranean Data Archaeology and Rescue, aiming to make available a comprehensive data product of temperature, salinity and bio-chemical data in the Mediterranean and Black Sea through a wide international cooperation, toSEA-SEARCH – The gateway to Oceanographic and Marine Data & Information in Europe, to provide an effective navigation tool to oceanographic and marine data and information sources for European marine waters and to centres in Europe with expertise and skills in oceanographic and marine data & information management. Bringing in new partners – satellite data centres

SIMORC Workshop March 2007 SeaDataNet components

SIMORC Workshop March 2007 Infrastructure, versions & planning Version 0 Continuation and maintenance of existing Sea-Search systems with minor modifications Version 1 All data centres involved in upgraded meta-databases Technical Task Team partners involved in transparent data access, security, monitoring, viewing services = trans-national access Pre-operational by October 2007 and operational by February 2008 Version 2 All data centres involved in trans-national access and access upgraded Operational by 2010

SIMORC Workshop March 2007 SeaDataNet data policy Metadata free and open access, no registration required each data centre should provide the meta-data in standardized format to populate the catalogue services Data and products services the general case if free and open access/mandatory registration a “SeaDataNet role” (partner, academic, commercial etc.) is attributed to each user Each NODC attributes the roles to the users of its of country Out of the partnership, the roles are assigned by SeaDataNet user- desk each data centre node delivers data according to the user’s role and its local regulation each data centre should provide freely the data sets necessary to develop the common products

SIMORC Workshop March 2007 Discovery services Marine environmental data sets (EDMED) Marine environmental research projects (EDMERP) Observing systems (EDIOS) Research Cruise Summary Reports (CSR) Common Data Index (CDI) Directory of marine organisations (EDMO)

SIMORC Workshop March 2007 Cruise Summary Reports Conceived by IOC ICES acted as focal point Currently over than cruises Documenting data collected on scientific research cruises operated by European vessels Cruise track charts included Online entry form Online searchable database

SIMORC Workshop March 2007 European Directory of the Ocean- observing System (EDIOS) Initiative of the European Global Ocean Observing System (EuroGOOS) Regular repeated measurements On-line searchable directory of observing, measuring, and monitoring systems Over 10,000 observation entries Links to on-line real-time and archive data Tool to aid design of observing systems

SIMORC Workshop March 2007 Common Data Index Index to individual data sets Approx entries from 10 partners ISO19115 metadata standard has been adopted On-line searchable directory Direct access to on-line data sets, catalogues or request

SIMORC Workshop March 2007 Technical developments Establishment of common vocabularies Upgrading formats for interrelationships between these directories ISO content model is the basis for the XML formats and exchange schema (XSD) Innovating maintenance modalities: XML exchange formats upgrading XML validation services Online Content Management System (CMS) Introducing Web services Vocabularies and Directory of Marine Organisations (EDMO)

SIMORC Workshop March 2007 SeaDataNet standards Interoperability – key to distributed data management system success Includes establishing common understanding of terms used Achieved through use of controlled vocabularies containing keys, terms, abbreviations and essential (but often missing) definitions Schemes for handling duplicate data Common quality control protocols Ocean Data View software for visualisation

SIMORC Workshop March 2007 SeaDataNet : Delivery Services V1 Primary function Users will be able to download selected data sets CDI User Interface Searching and browsing of metadata of data sets Shopping Basket in combination with AAA services Preparing a user request of multiple data sets, handling validation of users, and routing requests to the data centres

SIMORC Workshop March 2007 Authentication, Authorization and Administration (AAA) Single Sign On system required for access to distributed system User’s authentication information based on personal login / password User must register in order to get login Web form to provide necessary information Online user agreement “SeaDataNet General Licence” After processing, login/password sent by ( check) Users’ directory management (registration processing) Centralised vs Decentralised Choice in V1 for CAS system (= centralised) SeaDataNet Data Policy Authorisation based on “Roles”

SIMORC Workshop March 2007 SeaDataNet : Delivery Services V1 Download manager process of requests by each data centre to deliver one comprehensive data set (one zip file) per data centre Request status manager provide users overview of request status of requests and download functions provide data centres with overview of all requests and data delivery Data delivery formats CF compliant NetCDF format for gridded and multi- dimensional data types (e.g. ADCP) Modified ODV spreadsheet format for other data types (e.g. time-series, profiles)

SIMORC Workshop March 2007 SeaDataNet User’s portal schema V1 IFREMER Database BODC Database BSH Database... Download managers in data centres CSREDIOS EDMED CDI Shopping basket Requests status manager datametadata CSR CDI Project info Metadata & Data catalogues Data request Status of request General request Metadata request Organisation + data source id Data download at BODCat BSHat MARIS + EDMERP services for metadata Data downloading services Visualisation services (WMS) for V2 Entry point for access hits EDMO EDIOSEDMED EDMERPEDMO Software Vocabularies StandardsCross search AAA Registr. My transact. User Register User registration

SIMORC Workshop March 2007 Data products SeaDataNet will provided added-value products to be created by regional centres Mediterranean Sea Black Sea Baltic Sea Arctic and North Sea Atlantic and global ocean First products => gridded climatologies based on already available data-sets (mostly hydrographic data) updated during the project life To make products comparable, all regional data centers will use a common tool for spatial mapping For this a new version of DIVA (Data Inverse Variational Analysis) was developed (University of Liege)

SIMORC Workshop March 2007 SeaDataNet capacity building The training program has two main objectives: to ensure that the data and metadata to be integrated in the SeaDataNet system will be formatted, checked for quality and disseminated according to the common protocols developed during the project to transfer expertise and to train IT experts of the SeaDataNet data centers in the basics, installation and operation of the SeaDataNet technical components

SIMORC Workshop March 2007 SeaDataNet system components Discovery services = Metadata directories Vocabulary services = Common vocabularies Auxiliary tables = Organisations, Research Vessels Security services = Authentication, Authorization & Administration (AAA) Monitoring and statistics = usage & system performance Delivery services = Data access & downloading of data sets (ASCII, NetCDF, …, data virtualisation) Viewing services = GIS, ODV analysis software, Google Earth,.. Product services = Generic and standard products

SIMORC Workshop March 2007 International Conference IMDIS st Announcement Second international conference “International Marine Data Information Systems” (IMDIS) March 31 - April 1, 2008, Athens, Greece Joint organisers: SeaDataNet, Hellenic Centre for Marine Research, IOC/IODE Four sessions: Marine environmental data bases: infrastructures and data access systems Data Services in ocean science: standards and interoperability Visualisation tools Services for Users and Education

SIMORC Workshop March