A System of Industry Metocean data for the Offshore and Research Communities (SIMORC) by Dick Schaap - MARIS Status March 2007 Supported by the European.

Slides:



Advertisements
Similar presentations
Koninklijk Nederlands Instituut voor ZeeonderzoekRoyal Netherlands Institute for Sea Research 1 NIOZ is part of the Netherlands Organisation for Scientific.
Advertisements

WG 2 (data exchange) During the transitional period and till the Single Authorisation electronic information and communication system is implemented,
World Meteorological Organization Working together in weather, climate and water Pilot Project V Integration of marine meteorological and other appropriate.
International Research Cruise Database and Website Status October ‘07.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Bologna, September 08.
Online data access in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
Luxembourg, Ville Kajala Senior Officer on Transparency Directive Issues Pan-European Access to Financial Information Disclosed by Listed Entities.
SIMORC Workshop March 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management.
NODCi - National Infrastructure for access to Oceanographic and Marine Data and Information (RGI-014) By Dick M.A. Schaap – MARIS Amsterdam, April 09.
1 CES IASSIST 2002, June 2002 University of Connecticut MetaNet: Standardising Statistical Metadata Methodology Karen Brannen University of Edinburgh,
A Pan-European Infrastructure for Ocean and Marine Data Management Dick M.A. Schaap – MARIS (SeaDataNet technical coordinator)
EUROWA Module European Module for Oiled Wildlife Emergency Response Assistance.
EDMED and EDIOS Roy Lowry, Karen Vickers (Technical) Lesley Rickards, Liz Bradshaw (Content) British Oceanographic Data Centre.
SeaDataNet, pan-European infrastructure for ocean and marine data management A key component of EMODNet A possible building block for GEOSS By Dick M.A.
2 nd Training Workshop 4 – 5 June 2007 Common Data Index - CDI By Dick M.A Schaap Technical Coordinator SeaDataNet.
1 ENISA’s contribution to the development of Network and Information Security within the Community By Andrea PIROTTI Executive Director ENISA Cyprus, 28.
United Nations Statistics Division
Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.
MEDIN Data Guidelines. Data Guidelines Documents with tables and Excel versions of tables which are organised on a thematic basis which consider the actual.
CASPINFO To foster co-operation and strengthen data sharing between marine scientists, the oil & gas industry and the government sector.
Business Register Interoperability Throughout Europe Vito Giannella European Business Register eeig.
Controlled Vocabularies (Term Lists). Controlled Vocabs Literally - A list of terms to choose from Aim is to promote the use of common vocabularies so.
Agricultural Market Information System (AMIS): State of Play AMIS First Meeting of the Rapid Response Forum 11 April 2012 Mexico City Abdolreza Abbassian,
NATO ARW September 2007 SeaDataNet A Pan-European Infrastructure for Ocean and Marine Data Management by Dick M.A. Schaap (MARIS) Technical coordinator.
N° 1 The European railway Agency: an engine for the integrated railway area EFRTC, Vilamoura on June 24 TH 2005 Olivier PIRON 24 June 2005.
TENCompetence: The European Network for Competence Development Chris Kew CETIS April
RACS coordination meeting 29 May 2008 Brussels. Review of the functioning of the RACs.
EUM/SIR/VWG/12/0375, v1, 10 July 2012 Coordination Group for Meteorological Satellites - CGMS EUM/SIR/VWG/12/0375, v1, 10 July 2012 Coordination Group.
Common Data Index CDI V1 How to proceed By Dick M.A. Schaap – technical coordinator Madrid, March 09.
Role of the Chair OGP - update by Richard Wylde Geodetic Advisor, ExxonMobil Chair OGP Geomatics Committee User needs on energy and minerals data and services.
1 IDNs go live under.eu Conference for ccTLD registries and registrars of CIS Bled, Slovenia – 7 September 2009 Joke Braeken, Deputy Manager External Relations.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT,
European Cooperation in the field of Scientific and Technical Research COST is supported by the EU RTD Framework Programme ESF provides.
Data Protection Act AS Module Heathcote Ch. 12.
IIIrd SeaSearch Full Group Meeting Limassol, Cyprus Tuesday May 25-27, 2004 SeaDataNet-Design Study proposal.
European Commission DG Enterprise VIRTUAL ENVIRONMENT FOR INNOVATION MANAGEMENT TECHNIQUES VERITE Kick-off meeting Thessaloniki November 2001.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Istanbul – Turkey,
IODE Ocean Data Portal – from data access to integration platform Sergey Belov, Tobias Spears, Nikolai Mikhailov International Oceanographic Data and Information.
MEDIN Work Plan for By March 2011 MEDIN will be 3 years into the original 5 year development plan started in Would normally ask for continued.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
EUM/SAF/VWG/02/0010, Rev. 3, May 2003 Page 1 The SAF Network Concept and Status Juha-Pekka Luntama, EUMETSAT GRAS Mission Scientist
UK Environmental Observation Framework.
Eurostat/UNSD Conference on International Outreach and Coordination in National Accounts for Sustainable Development and Growth 6-8 May, Luxembourg These.
EMIDOI - Electronic Marketplace for Information on Decommissioning of Offshore Installations eContent Concertation Meeting 11 october Frankfurt.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S How to make EMODnet Chemistry fit for purpose at system level By Dick M.A. Schaap – Technical.
SeaDataNet Harmonizing and optimizing the metadatabases and controlled vocabularies, incl maintenance & retrieval systems.
Open Archive Forum Rachel Heery UKOLN, University of Bath UKOLN is funded by Resource: The Council for Museums, Archives.
EDLproject WP3 “Developing the European Digital Library” LIBER – EBLIDA workshop Digitisation of Library Material in Europe Copenhagen, October.
NESC Worshop – 07 September 2005 Development of a Marine Metadata Standard Greg Reed Executive Officer Australian Ocean Data Centre Joint Facility.
Download Manager software Training Workshop Ostend, Belgium, 20 th May 2014 D.M.A. Schaap - Technical Coordinator.
Metadata generation, control and updating Peter Thijsse - MARIS.
Data Coordinating Center University of Washington Department of Biostatistics Elizabeth Brown, ScD Siiri Bennett, MD.
Metadata V1 By Dick M.A. Schaap – technical coordinator Oostende, June 08.
Introduction to BODC and GEOTRACES data office Edward Mawji British Oceanographic Data Centre
SeaDataNet European Directory of Marine Research Projects - EDMERP By Dick Schaap.
User Registration in the SeaDataNet V1 system by Dick M.A. Schaap – technical coordinator Oostende, June 08.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal.
Statistical Business Register Enterprise Groups in Latvia Sarmite Prole Head of Business Register Section Business Statics Department Central Statistical.
Validation of Metadata XML files SeaDataNet Training, June 2008 Presented by with contributions from Karen Vickers (BODC) Presented by Michèle Fichaut.
CDI Data Discovery and Access Service Dick Schaap (MARIS) – SeaDataNet Technical Coordinator RDA – Paris - Sept 2015.
Monitoring Visit to NatRisk Project
Supported by the European Commission
Dick M.A. Schaap - MARIS EMODnet Chemistry 3 – Plenary Trieste – Italy
Progress EMODnet Ingestion
Flanders Marine Institute (VLIZ)
Data Protection Legislation
Distributed Marine Data System:
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
Point 6. Eurostat plans for Time Use Survey data processing and dissemination Working Group on Time Use Surveys 10 April 2013.
WISE and INSPIRE By Albrecht Wirthmann, GISCO, Eurostat
Presentation transcript:

a System of Industry Metocean data for the Offshore and Research Communities (SIMORC) by Dick Schaap - MARIS Status March 2007 Supported by the European Commission as part of the 6th Framework Programme sub-priority – Global Change and Ecosystems EC contract no

A major share of metocean in situ observations for the oceans and seas is collected by research institutions and governmental organizations, operating monitoring stations and performing field surveys. In addition a very substantial volume of metocean in situ data is collected by private industry, in particular by or under contract to major oil & gas companies. However there is not a common awareness of available data sets and no systematic indexing and archival of these data sets within the industry. Furthermore there is only limited reporting and access to these data sets & results of field studies for other parties, in particular the scientific community. The issue

Autumn 2003, Pat Hyder introduced the idea to OGP MetOcean Committee for restricted release of the global commercial ocean data set for research (in particularly to evaluate ocean models) with technical support of the International Pacific Research Centre. The Committee agreed to compile a cross-company inventory and, in principle, to making data available in a restricted manner for future research. Total, BP and Shell agreed to take the proposal forward. Early 2004, Shell discussed the idea with MARIS at Oceanology International and it was agreed that MARIS would compose a partnership and compile a proposal to the EU. This was submitted in Autumn 2004 and successfully evaluated (24 out of 25 points) in January The project was officially launched in June Some history

Create an internet based central index, including a geographical user interface, of metocean data sets, collected globally by OGP members (oil & gas industry) both in the past and ongoing Harmonise the quality and formats of the data sets and store these in a central database, linked to the central index, for unified retrieving and access of the metocean datasets by internet Define a SIMORC Data Protocol with rules agreed by OGP members for access and use of data sets by scientific & educational users, and by other users. Promote and disseminate the SIMORC facility in the oil & gas industry, scientific communities and developing countries to achieve an increasing number of contributing parties and users Objectives

Project, financially supported by the European Commission Limited Interest Project (LIP) of OGP Metocean Committee to enable participation of increasing number of OGP members  OGP – supported by Task group of Shell, Total and BP Amoco  MARIS (coordinator and system development)  BODC (quality control and harmonisation of all datasets)  IOC-IODE (dissemination and education)  LIP signed by: Shell, Total, BP, Chevron, Statoil, and Hydro. Considered by ConocoPhilipps, ExxonMobil, …  Supported by international Advisory Board Partnership & Framework

Metadata format for data sets, based upon Sea-Search / SeaDataNet Common Data Index (CDI) format and XML schema; ISO compliant Metadata format for publications/ analysis reports, based upon Dublin Core model for bibliographic interoperability Formats for delivery of data sets: NetCDF and BODC ASCII Manual with QC & formatting procedures, based upon international practices Formats

Internal metadata and data Flow Data sets Publications QCForma t XML record per Data set file Data set file NetCDF Data set file BODC-Ascii QC Doc page per Data set file at BODC server Meta data record per Publication Publication File (doc / pdf) SIMORC Metadatabase SIMORC Data set Files SIMORC Publication Metadatabase SIMORC Publication Files OGP MemberBODC MARIS Possible other sources

Data delivery and progress Shell June 2006: DVD of data from Shell 1878 data files, waves, currents, met. including wind One format, well documented Ca 600 now included in SIMORC and further work by BODC underway BP May 2006: First batch of data from FugroGEOS ADCPs August 2006: Second batch of data from FugroGEOS ADCPs February 2007: Third batch of data from FugroGEOS Current Meters up to 300 more series to deliver from FugroGEOS Extra from BP Office for e.g. Caspian Sea underway Contact with BP USA for Gulf of Mexico data sets Ca 30 sets now included in SIMORC and further work by BODC underway

Data progress Total October 2005: First data received December 2005: Second data sets received April 2006: Further data from Total (Gulf of Mexico) June 2006: DVDs of data from Total June 2006: Boxes of 5.25 inch floppies January 2007: Aditioanl data sets delivered Many problems to resolve due to lack of documentation; limited transfer to SIMORC database so far Support from Total top management to hire additional staff for one year to support BODC in QC and harmonisation of these data sets Conoco Philips Release of high-quality data set for Ekofisk Field – North Sea from 1980 to present – soon to be transferred to BODC

Searching and browsing in the SIMORC metadatabases of available data sets and related publications is a public internet service Data sets and related publications are managed by SIMORC in a secure domain behind a firewall and measures have been taken to prevent unwanted access Ordering of data sets and delivery by downloading of data sets can only be done by registered users and requires a valid User License Agreement Protocol - Access Principles

Access principles Scientific Users Non-Scientific Users Data sets labelled: LI = Available under licence Direct accessRequest forwarded to owner Data sets labelled: RS = Restricted Request forwarded to owner Users Restriction

Order flow diagram Search in metadatabase Results Order list Submit Order (specify filetype + Publication yes/no) User Check Meta database YES Scientific Shopping Basket NO Info about Conditions, Registration etc Log in Register license scientific institutes Register Other users User Register YES Non-Scientific

Order flow registered scientific users Confirmation mail to user and (split to) owner(s) User to download Data set(s) + Publication(s) Transaction Register Submit extended Order Form with motivation LIRS Owner to consider Requests All activity administered YES Scientific Shopping Basket Check on status LI / RS User notified User Register Order delivered No Yes Data sets Publications

Order flow registered other users Confirmation mail to user and (split to) owner(s) User to download Data set(s) + Publication(s) Transaction Register Submit extended Order Form with motivation LIRS Owner to consider Requests All activity administered YES Non-Scientific Shopping Basket User notified User Register Order delivered No Yes Data sets Publications

SIMORC Metadatabase and User Interface: Searching and browsing of metadata of data sets and related publications, stored in SIMORC SIMORC User Register: Details of users, their organizations and addresses, contract period, Id-Passwords, type of user SIMORC Shopping Basket: Preparing a user request of multiple data sets, handling validation of users, and routing requests to the Transaction Register SIMORC Transaction Register: Processing and administration of all requests and data deliveries (downloads), for users and owners. Master level to oversee all transactions. System Modules

SIMORC Service is operational !

User dialogue User interface for searching data sets

User dialogue Resulting data sets

User dialogue At present ca 650 data sets, more underway

User dialogue Resulting data sets Include in Shopping basket

User dialogue Check shopping basket Submit order

User dialogue Log on required or first registration Submit order

User dialogue Order confirmation after Log on

User dialogue Definitive confirmation and order no.

User dialogue Transaction register for users and data owners

User dialogue User can check status of orderlines and download agreed data sets

User dialogue Data owner can check status of orderlines and agree / deny requests

SIMORC has been integrated in oceanographic data management training courses, organised by IOC-IODE So far more than 15 training courses have been held Overall more than 300 participants from 75 countries have been made aware of SIMORC and have received training in its use SIMORC training curriculum will be included in the IODE OceanTeacher system. These tools are used during the IODE Training Courses and can also be used for self-training and continuous professional development. It was recently agreed that WMO will use the OceanTeacher as a main training tool for Marine Meteorology. Targets are creating wide awareness in scientific communities and developing countries Training

Substantial database of data sets Processes, methods, standards and systems in place and operational to process and include new data sets and to serve users Service includes: Transparant overview of available data sets Delivery of harmonised and documented data sets QC of submitted data Supporting further use and exchange of data sets Present state

Further processing of received data sets for inclusion in SIMORC Service Extension of EC contract requested till December 2007 to allow for spending of remaining budgets on processing of more data sets Strong recommendation to other OGP members => make use of this and supply additional data sets soon!! Promotion of the service to scientific institutes and developing countries => registration of users via Licence Agreements Preparing an LIP arrangement with OGP members for coming 3 years of SIMORC Service operations for further expansion of the SIMORC database with new / fresh data sets from existing suppliers and old data sets from other OGP companies Providing OGP members with manual to use towards subcontractors for standard QC, formating and documentation of new Metocean data sets for a smooth processing. Future

SIMORC Service is operational ! Visit the SIMORC Service at SIMORC Service is operational!!!