SeaDataNet Harmonizing and optimizing the metadatabases and controlled vocabularies, incl maintenance & retrieval systems.

Slides:



Advertisements
Similar presentations
OBSERVATIONS & PRÉVISIONS CÔTIÈRES Training Workshop – Ostende – October 2009 REFORMATTING TOOLS Med2MedSDN and NEMO M. Fichaut.
Advertisements

OBSERVATIONS & PRÉVISIONS CÔTIÈRES Metadata and Data Management Activities winthin NA 3-7 S. Iona (HCMR), D. Schaap (MARIS), L. Rickards.
International Research Cruise Database and Website Status October ‘07.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Bologna, September 08.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES 3 rd SeaDataNet training course – Ostende – June 2008 MIKADO tool M. Fichaut, V. Tosello, M.
Ocean Data Interoperability Platform EU-US-Australia collaborative project Grant Number: Call: FP7-INFRASTRUCTURES INFSO Activity: INFRA :
MEDIN Standards M. Charlesworth and the MEDIN Standards Working Group.
Cruise Summary Report Content Management SDN2 1. Training Workshop - Ostend, Belgium.
SIMORC Workshop March 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management.
NODCi - National Infrastructure for access to Oceanographic and Marine Data and Information (RGI-014) By Dick M.A. Schaap – MARIS Amsterdam, April 09.
Status of CDI service (connections, NetCDF introduction, CDI ingestion service and set-up of CDI ingestion pilot) By Dick M.A. Schaap – Technical Coordinator.
Who does what and when? Mary Rowlatt MDR Partners.
Pan-European infrastructure for Ocean & Marine Data management An EU Integrated research Infrastructure Initiative (I3) MIKADO : Java tool for XML Creation.
A Pan-European Infrastructure for Ocean and Marine Data Management Dick M.A. Schaap – MARIS (SeaDataNet technical coordinator)
SDN2 First Training Course, Oostende IODE-PO, 2-6 July 2012 Metadata Directories Management Sissy Iona, HCMR/HNODC.
EDMED and EDIOS Roy Lowry, Karen Vickers (Technical) Lesley Rickards, Liz Bradshaw (Content) British Oceanographic Data Centre.
SeaDataNet, pan-European infrastructure for ocean and marine data management A key component of EMODNet A possible building block for GEOSS By Dick M.A.
2 nd Training Workshop 4 – 5 June 2007 Common Data Index - CDI By Dick M.A Schaap Technical Coordinator SeaDataNet.
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
MEDIN Data Guidelines. Data Guidelines Documents with tables and Excel versions of tables which are organised on a thematic basis which consider the actual.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES 3 rd SeaDataNet training course – Ostende – June 2008 NEMO reformatting tool v1 M. Fichaut.
Controlled Vocabularies (Term Lists). Controlled Vocabs Literally - A list of terms to choose from Aim is to promote the use of common vocabularies so.
Ocean Data Interoperability Platform EU-US-Australia collaborative project Grant Number: Call: FP7-INFRASTRUCTURES INFSO Activity: INFRA :
Training course – Ostende – 2-6 July 2012 Introduction to the 1 st training session of SeaDataNet 2 M. Fichaut, IFREMER, France.
SeaDataNet2 Plenary meeting, 19th-20th September 2012, Rhodes SeaDataNet2 Plenary meeting THE EMODNET CHEMISTRY LOT. FROM THE EXPERIENCE OF THE THREE YEARS.
Distributed system development, including standards and interoperability By Dick M.A. Schaap – technical coordinator Bologna, September 08.
MEDIN Standards Workshop 27 th March 2012 Programme.
NATO ARW September 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management by Dick M.A. Schaap (MARIS) Technical coordinator.
SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management: Achievements and challenges.
Synthesis of the technical activity and State of development of the on-line system V1 By Dick M.A. Schaap – technical coordinator Madrid, March 09.
Common Data Index CDI V1 How to proceed By Dick M.A. Schaap – technical coordinator Madrid, March 09.
MAY SEA-SEARCH MEETING CYPRUS METADATA and XML in compliance with ISO Michèle FICHAUT, IFREMER/SISMER Gilbert MAUDIRE, IFREMER/ISI Mickaël.
SEADATANET Kick-Off Meeting Heraklion, Crete Island louvíou 2006Friedrich Nast1 NA4: Cruise Summary Reports Directory (CSR) From Maintenance of.
IIIrd SeaSearch Full Group Meeting Limassol, Cyprus Tuesday May 25-27, 2004 SeaDataNet-Design Study proposal.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Istanbul – Turkey,
TTG, March 2014, Barcelona WP3: Capacity building and training.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES SeaDataNet annual meeting, Madrid, March 2009 How to prepare data for integration in SeaDataNet.
OBSERVATIONS & PRÉVISIONS CÔTIÈRES Synthesis of the data management activities (NA) S. Iona (HCMR), R. Lowry (BODC), F. Nast (BSH),
Chemical lot - HOW: Infrastructure set up based on SeaDataNet V1 efficient distributed Marine Data Management Infrastructure; Principle of “ADOPTED AND.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S How to make EMODnet Chemistry fit for purpose at system level By Dick M.A. Schaap – Technical.
NCP training session 30 October 2002 Integrated information system on RTD in Europe Gwenda Jeffreys-Jones, DG RTD European Commission.
An introduction to the MEDIN Discovery Metadata Standard.
EMODnet Chemistry 2 Technical progress and new challenges Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Venice,
An introduction to the MEDIN Discovery Metadata Standard.
Download Manager software Training Workshop Ostend, Belgium, 20 th May 2014 D.M.A. Schaap - Technical Coordinator.
Helen Glaves 1 and Dick Schaap 2 1 British Geological Survey, United Kingdom 2 MARIS, The Netherlands.
Metadata generation, control and updating Peter Thijsse - MARIS.
3rd Training Workshop June 2008, Ostende Management of CSR Anne Che-Bohnenstengel, BSH  Metadata Formats  Defined Vocabularies  Content Management.
An Introduction to the MEDIN Discovery Metadata Standard MEDIN Workshop BGS, Edinburgh, June 2015.
An Introduction to the MEDIN Discovery Metadata Standard MEDIN Workshop NOC, Liverpool, Sept 2015.
Metadata V1 By Dick M.A. Schaap – technical coordinator Oostende, June 08.
Sensor Web Enablement (SWE) developments for fixed monitoring platforms and research vessels By Dick M.A. Schaap – SeaDataNet Technical Coordinator with.
SeaDataNet European Directory of Marine Research Projects - EDMERP By Dick Schaap.
User Registration in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
SeaDataNet JRA2: Technical development of the interoperable system components By Dick Schaap.
Validation of Metadata XML files SeaDataNet Training, June 2008 Presented by with contributions from Karen Vickers (BODC) Presented by Michèle Fichaut.
CDI Data Discovery and Access Service Dick Schaap (MARIS) – SeaDataNet Technical Coordinator RDA – Paris - Sept 2015.
Stavroula Balopoulou , Angelo Lykiardopoulos, Sissy Iona HCMR-HNODC
MIKADO – Generation of ISO – SeaDataNet metadata files
Introduction to the 1st training session of SeaDataNet 2
Flanders Marine Institute (VLIZ)
Distributed Marine Data System:
CEOP/IGWCO Joint Meeting, Feb.28  March 4, University of Tokyo, Japan
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
MIKADO: Generation of CDI ISO19139 XML files
Vanessa Tosello (IFREMER), Flavian Gheorghe (MARIS)
Tools for generation of SDN NetCDF (CFPOINT) files
Signposting your information - MEDIN Discovery Metadata
New Round of Regional data collections Deltares
Presentation transcript:

SeaDataNet Harmonizing and optimizing the metadatabases and controlled vocabularies, incl maintenance & retrieval systems

Present metadatabases Meta- directory Content EDMEDDiscovery inventory for data sets CSRInventory of Cruise Summary Reports EDMERPInventory of Institute Research Projects EC ProjectsInventory of EC funded Research Projects EDIOSInventory of Observing stations and associated observing programmes CDIInventory of individual data sets, managed by Data Centres EDMOInventory of data centres, research institutes and data collectors

EDMEDEDMERPCSREDIOSORGCDI BODCMARISBSHBODCMARIS Research Institutes, Data Holding Centres, Monitoring agencies,.. All over EUROPE National collation by NODCs XML Access AsciiOnline Ascii Master CMS Web Map Print Data online Print Data online Cross matrix ICES Java Tools Ascii Present set-up

SeaDataNet objectives Up to date maintenance of each Directory More cohesion between Directories and Vocabularies Provide users with cross searching functionality Discard redundancy to avoid asking for the same info Thereby: Safeguarding backward compatibility to legacy metadata (where required!) Establishing governance arrangements Ensuring continuity while developing

Considerations for maintenance The system must engage all NODCs and for CDI all partners The volume of entries and frequency of updating of each of the directories differs considerably between each directory and per NODC The maintenance of each directory is performed by different classes of staff from institutes The directories make more or less use of vocabularies, which differ for comparable topics For each directory a central coordinator is required to safeguard momentum and quality

Conclusions for maintenance the maintenance system must support a number of modalities to cope with all NODCs AND the different metadirectories in practice one integrated data model is not feasable in practice, but better cohesion between the different formats and schemas (with ISO19115 as basis) each format has to be reconsidered for optimization, better use of controlled and common vocabularies and EDMO for organisations for each metadirectory a central master database must be continued under governance of the object manager (next to and linked to local databases, if available)

Proposed Set-up for maintenance derive a range of controlled vocabularies with technical and content governance updating and maintenance of the metadirectories by: online maintenance by NODCs via CMS (incl master editing options) XML export from local system in a semi-automatic way, with exchange initiated by NODCs at regular intervals XML export from local system in automatic and continuous proces (harvesting system) Note: per metadatabase NODCs can have a different choice!

Actions maintenance system optimize and document each format (tune to use of common controlled vocabularies, ISO19115 schema and GML) define controlled vocabularies and organize technical and content governance (BODC with committee of BODC, IFREMER, BSH, RIKZ,..) each directory coordinator (BODC, BSH, MARIS) modifies its central metadatabase configuration (entry, import and management) to the modified formats, use of controlled vocabularies and support of 3 maintenance modalities. NODCs choose their preferred modality per metadatabase and adapt to the new configuration

Actions maintenance system continue the updating of metadatabases with the present set-up develop the new set-up in parallel, including conversion routine at coordinators (BODC, BSH, MARIS) for conversion from old to new format switch systems as soon as also the new front-end is ready

Considerations for retrieval & presentation Each metadatabase coordinator continues to provide an end user interface and develops in parallel an upgraded version for the new format (thereby considering more geographical functionalities (OGC)) NODCs must have access to the central metadatabases and controlled vocabularies to enable them to develop their own end-user interfaces at local, national, regional and thematic levels Next to the individual SeaDataNet metadatabase end- user interfaces the SeaDataNet portal must provide a cross searching end-user interface over all metadatabases

Proposed use of Web Services Install Web Services for the controlled vocabularies (BODC is volunteering) Install a Web Service for each Directory by BODC, BSH and MARIS to support intermediate users NODCs use these intermediate Web Services to develop their own local, regional, thematic end user interfaces SeaDataNet uses these intermediate Web Services to develop its cross searching end user interface at the SeaDataNet portal

NODCs and institutes CSR EDMO EDMED EDMERP CDI EDIOS Vocab Web Service Web Service Web Service Web Service Web Service Web Service Web Service End-User Interface End-User Interface End-User Interface End-User Interface End-User Interface End-User Interface SeaDataNet Cross search End user interface Local/ National/ Regional End user interfaces Local/ National/ Regional End user interfaces Local/ National/ Regional End user interfaces Local/ National/ Regional End user interfaces Local/ National/ Regional End user interfaces NODCs SeaDataNet End-users

Actions for retrieval and presentation Formulate specifications for the required functionality of the intermediate Web Services Develop Web Services for Controlled Vocabularies (BODC) Develop Web Services for each Directory (BODC, BSH, MARIS) in mutual coordination Formulate specifications for the cross searching SeaDataNet end user interface Upgrade existing end user interfaces for each directory (BODC, BSH, MARIS) ….