Using Ocean Data View for EMODnet Chemistry Reiner Schlitzer

Slides:

Advertisements

Similar presentations

OBSERVATIONS & PRÉVISIONS CÔTIÈRES Training Workshop – Ostende – October 2009 REFORMATTING TOOLS Med2MedSDN and NEMO M. Fichaut.

Advertisements

Reiner Schlitzer & Stephan Heckendorff Alfred Wegener Institute for Polar and Marine Research Multi-file Data Aggregation with Ocean Data View.

WP1 - Data collection and metadata compilation in sea regions Sissy Iona (HCMR/HNODC) EMODNET Chemistry th Steering Committee, 2-3 December 2014,

EDMODnet Chemistry - DIVA Products from the Baltic Region Örjan Bäck, Lotta Fyrberg, Martin Hansson, Magnus Wenzer Swedish Meteorological and Hydrological.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research ODV Gridding Methods.

SDN2 First Training Course, Oostende IODE-PO, 2-6 July 2012 Metadata Directories Management Sissy Iona, HCMR/HNODC.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View - Available Data Collections and Data Model.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View 4 - Data Quality Control.

WP2: Data products generation in Mediterranean Sea EMODNET Chemistry Data Products, Experts Workshop Split (Croatia), June 2014 Sissy Iona, HCMR-HNODC.

Status of upgrading CDI service (user interface, harvesting via GeoNetwork, CDI interoperability options following SeaDataNet D8.7) By Dick M.A. Schaap.

MEDIN Data Guidelines. Data Guidelines Documents with tables and Excel versions of tables which are organised on a thematic basis which consider the actual.

Marine Data Management within EMODNet Chemistry project: data aggregation, quality control and products preparation A.S. Iona 1, P. Karagevrekis 1, S.Balopoulou.

Self Guided Tour for Query V8.4 Basic Features. 2 This Self Guided Tour is meant as a review only for Query V8.4 Basic Features and not as a substitute.

Controlled Vocabularies (Term Lists). Controlled Vocabs Literally - A list of terms to choose from Aim is to promote the use of common vocabularies so.

7 th TTG meeting – Trieste – 3-4 March, 2015 SeaDataNet tools, new developments IFREMER : M. Fichaut, A. Briand, M. Larour, T. Loubrieu, V. Tosello ALTRAN.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View.

QC/QA and Diva Products in Mediterranean Sea EMODNET Chemistry 2 Meeting on ODV QC and Diva Products Ifremer Headquarter, Paris, 3 September 2014 Sissy.

Workshop on QC in Derived Data Products, Las Cruces, NM, 31 January 2007 ClimDB/HydroDB Objectives Don Henshaw Improve access to long-term collections.

Access to CARBOOCEAN and related data. Data is standardized and homogenised (parameters, metadata, etc.) quality checked well documented international.

WMS in a nutshell A “quick & easy” guide to using WMS.

EMODnet Chemistry 2 Service Contract MARE/2012/10 S Progress of the CDI service By Dick M.A. Schaap – Technical Coordinator Istanbul – Turkey,

Emodnet Chemistry Lot Guidelines for data products.

Reiner Schlitzer & Stephan Heckendorff Alfred Wegener Institute for Polar and Marine Research Ocean Data View – New Developments.

ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

OBSERVATIONS & PRÉVISIONS CÔTIÈRES SeaDataNet annual meeting, Madrid, March 2009 How to prepare data for integration in SeaDataNet.

Annual Meeting, June , Istanbul, Turkey WP2: Data aggregation and products generation in the Atlantic Sea: results and criticalities EMODnet.

Chemical lot - HOW: Infrastructure set up based on SeaDataNet V1 efficient distributed Marine Data Management Infrastructure; Principle of “ADOPTED AND.

Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.

EMODNET Preparatory Actions Progress meeting for ur-EMODNET preparatory actions, 24 November 2009 Presentation of Progress Chemical Lot Alessandra Giorgetti.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research ODV – New Developments.

DADDS New Features Tuesday, May 3, 2016Sioux Falls, SD Letecia Reeves, GOES DCS Customer Service Specialist NOAA/NESDIS/OSPO/SPSD.

Ocean Data View Course Objective: Import, quality control and visualize own or external datasets. What you learn: Large publicly available datasets exist.

The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Data Quality Control and Visualization with Ocean Data View 4.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View Achievements and Future Developments.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View and itsRole in SeaDatanet and its Role in SeaDatanet.

DATA AGGREGATION AND PRODUCTS GENERATION

MIKADO – Generation of ISO – SeaDataNet metadata files

SeaDataNet tools NEMO, OCTOPUS, MIKADO

How to include additional information in ODV and CDI formats

NEMO – Reformating tool

GML in CDI and CSR ISO using Ends&Bends

Partner contribution:

Data aggregation and products generation in the Mediterranean Sea

OCTOPUS – SeaDataNet Format conversion tool

WP3: Data aggregation and products generation NE Atlantic Sea

Status of ODV developments

Meeting on ODV QC and DIVA Products

INITIAL WORLD OCEAN DATABASE COLLECTION

WP2 Products in Mediterranean Sea

ISRAMAR Work Flow for SeaDataNet

Tools for generation of SDN NetCDF (CFPOINT) files

Ocean Data View Reiner Schlitzer

Reporting Solutions for Scheduler

Ocean Data View 4 - Data Quality Control Reiner Schlitzer

Ocean Data View 4 - Data Quality Control Reiner Schlitzer

EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner 40: State Oceanographic Institute Alexander Korshenko,

Data aggregation and products generation

EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: BODC Annual Meeting, June ,

ODV Gridding Methods Reiner Schlitzer

Practical work on NetCDF - CFPOINT

Ocean Data View Spreadsheet Format Reiner Schlitzer

EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Latvian Institute of Aquatic Ecology.

Ocean Data View Reiner Schlitzer

EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Institute of Marine Science and Management, Istanbul University.

EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Marine Hydrophysical Institute Annual.

SDN Data access search:

EMODnet Chemistry 3 Generation of data products in the Baltic Sea

Steering Committee Meeting Amsterdam, Dec 2014

Generation of data products in the Mediterranean Sea

Presentation transcript:

Using Ocean Data View for EMODnet Chemistry Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

Upcoming major release ODV 5.0 (summer 2017) Optimized importers (SDN importer 8x faster) Tab-based multi-view capability

Data Processing Pipeline Import - File Aggregation Duplicates checks Export – (Parameter P35 Aggregation, Unit Conversions) Data QC Export of history/provenance records

File Import Metadata enrichment (imports all CDI fields provided via csv files) Imports instrument code and fall-rate information from data files Supports SDN netCDF files in addition to SDN/ODV txt files 64-bit ODV allows import of all SDN data files in one go

Duplicate Checks

P35 Parameter Aggregation Source ODV collection must have been produced via option Import > SDN Formats using ODV 4.6.3 or later Automatically downloads up-to-date versions of P35 vocab and conversion database

Unit Conversion Database

P35 aggregated variables Other source variables not in any P35 variable

QC - Visual Quality Control easy spotting and identification of outliers or offsets painless editing of data value and quality flag logging of all value or flag modifications

QC - Automatic Range Checks full sample set sample sub-set

QC - QF Mass Assignments all samples of many or all stations (initialization) all samples in a window all or some selected samples of current station current sample only

Using Quality Flag Filters Before filtering After filtering

Provenance: Per-Station Data History History information stays with station data when exporting to ODV spreadsheet or ODV collection.

Workshop Topics Import - File Aggregation Duplicates checks Export – (Parameter P35 Aggregation, Unit Conversions) Data QC Export of history/provenance records