Ocean Data View 4 - Data Quality Control Reiner Schlitzer

Slides:

Advertisements

Similar presentations

Reiner Schlitzer & Stephan Heckendorff Alfred Wegener Institute for Polar and Marine Research Multi-file Data Aggregation with Ocean Data View.

Advertisements

CLINIC MANAGEMENT SYSTEM APPOINTMENT SCHEDULING. How will this start? Any schedules already built will not be carried over to the CMS Portal You will.

Refresher Instruction Guide Strategic Planning and Assessment Module

Object Linking and Embedding Objective 6.02 Linking and Embedding.

EDMODnet Chemistry - DIVA Products from the Baltic Region Örjan Bäck, Lotta Fyrberg, Martin Hansson, Magnus Wenzer Swedish Meteorological and Hydrological.

Logging In Go to web site:

TMSI/IDM/SISMER Sept 2000 SISMER SISMER Systèmes d’Informations Scientifiques pour la Mer F-NODC Quality Control Procedure at IFREMER Argo data management.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research ODV Gridding Methods.

Argo Real-time Quality Control Process NOAA/AOML: Y.-H. DANESHZADEH, R. MOLINARI, R. SABINA, C. SCHMID CIMAS/UM: E. FORTEZA, X. XIA, H. YANG.

© Crown copyright Met Office The EN dataset Simon Good and Claire Bartholomew.

Guidelines for QC/QA from EMODNet Chemistry pilot Marina Lipizer, Istituto Nazionale di Oceanografia e di Geofisica Sperimentale–OGS Dipartimento OCE Kick-off.

Argo QC with an emphasis on the North Atlantic Justin Buck British Oceanographic Data Centre Joseph Proudman Building 6 Brownlow Street Liverpool L3 5DA,

Hernan E. Garcia (U.S. NODC, IODE Group of Experts on Biological and Chemical Data Management and Exchange Practices) EDM Workshop 2014, Silver Spring,

QARTOD III Scripps Institution of Oceanography La Jolla, CA Quality Control, Quality Assurance, and Quality Flags Mark Bushnell, NOAA/NOS/CO-OPS November.

EMODnet Chemistry 2 Quality Control inventory Matteo Vinci and Alessandra Giorgetti OGS, Trieste.

First Data Management Training Workshop, February, 2007, Oostende, Belgium 1 Quality control checks description First Data Management Training Workshop.

Quality Control Standards for SeaDataNet Review status at 1 st Annual Meeting (March 2007) Review developments over last year Current status Future work.

IQuOD Data Flow Tim Boyer NODC. Inflow How will IQuOD quality controlled data get into the World Ocean Database?

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View - Available Data Collections and Data Model.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View 4 - Data Quality Control.

OUTLINE OF QUALITY CONTROL DOCUMENT Introduction Why is quality control is needed? Information to accompany data Automatic checks “Scientific” quality.

WP2: Data products generation in Mediterranean Sea EMODNET Chemistry Data Products, Experts Workshop Split (Croatia), June 2014 Sissy Iona, HCMR-HNODC.

Gadgets & More…. “Date Range” Gadgets Allows you to choose a specific date, before or after a date or a range of dates using the Workflows calendar.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View.

QC/QA and Diva Products in Mediterranean Sea EMODNET Chemistry 2 Meeting on ODV QC and Diva Products Ifremer Headquarter, Paris, 3 September 2014 Sissy.

TEAM Basic TotalElectrostatic ManagementAwareness&

Access to CARBOOCEAN and related data. Data is standardized and homogenised (parameters, metadata, etc.) quality checked well documented international.

© Crown copyright Met Office The EN QC system for temperature and salinity profiles Simon Good.

Quality Control for the World Ocean Database GSOP Quality Control Workshop June 12, 2013.

Reiner Schlitzer & Stephan Heckendorff Alfred Wegener Institute for Polar and Marine Research Ocean Data View – New Developments.

ODV for Data Products Reiner Schlitzer, Alfred Wegener Institute, Bremerhaven, Germany.

© Crown copyright Met Office The EN4 dataset of quality controlled ocean temperature and salinity profiles and monthly objective analyses Simon Good.

Compliance Assist Refresher Instruction Guide Adding or Editing Student Learning Outcomes.

Chemical lot - HOW: Infrastructure set up based on SeaDataNet V1 efficient distributed Marine Data Management Infrastructure; Principle of “ADOPTED AND.

The APEX Truncated Negative Pressure Drifts (TNPDs)

SeaDataNet Pan-European infrastructure for Ocean & Marine Data management An Integrated research Infrastructure Initiative (I3) NA2: TA system Monitoring.

Hernan E. Garcia (U.S. NODC, IODE Group of Experts on Biological and Chemical Data Management and Exchange Practices) 2nd IQuOD Workshop 2014, Silver Spring,

HRP Copyright © Leland Stanford Junior University. All rights reserved. Warning: This presentation is protected by copyright law and.

Geneva, April 2007 GTSPP by Bob Keeley (Canada) and Charles Sun (U.S.A)

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research ODV – New Developments.

© Crown copyright Met Office Ensemble of subsurface databases Simon Good, presented by Nick Rayner, ERA-CLIM workshop on observation errors, Vienna, April.

The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.

What is a Wiki and How Do I Use It in my Classroom? Presented by Jasmin Bankes and Becky Bartsch 4 th Grade Classroom Teachers, Central.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Data Quality Control and Visualization with Ocean Data View 4.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View Achievements and Future Developments.

EDMODnet Chemistry, Baltic Sea - Oxygen, Chlorophyll and contaminants - General issues Magnus Wenzer, Lotta Fyrberg, Örjan Bäck Swedish Meteorological.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View and itsRole in SeaDatanet and its Role in SeaDatanet.

SeaDataNet Technical Task Group meeting JRA1 Standards Development Task 1.2 Common Data Management Protocol (for dissemination to all NODCs and JRA3) Data.

SeaDataNet tools NEMO, OCTOPUS, MIKADO

Partner contribution:

Using Ocean Data View for EMODnet Chemistry Reiner Schlitzer

SCAR 2016 Standing Committee on Antarctic Geographic Information

OCTOPUS – SeaDataNet Format conversion tool

Argo Delayed-Mode Salinity Data

WP2 Products in Mediterranean Sea

ISRAMAR Work Flow for SeaDataNet

Creating Marine Data Section Plots in ODV

TBR Institution Guide to Updating and Entering Vendors

FASTER Processing in Skyward

TBR Institution Guide to Updating and Entering Vendors

Ocean Data View Reiner Schlitzer

State Reporting Processing

Ocean Data View 4 - Data Quality Control Reiner Schlitzer

Learning Outcomes Tab (cont’d)

ODV Gridding Methods Reiner Schlitzer

RiskMan Personal Delegates

Monitoring procedures

Ocean Data View Spreadsheet Format Reiner Schlitzer

Ocean Data View Reiner Schlitzer

Generation of data products in the Norwegian and Barents Seas

Presentation transcript:

Ocean Data View 4 - Data Quality Control Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research

Wish: All data are of highest quality. Reality…

Need to quality control data. Flag dubious data. Don‘t delete data! ODV maintains a quality flag value for every data value. Choice between 14 quality flag schemes, including SEADATANET, ODV, ARGO and others

ODV quality flag scheme

SEADATANET quality flag scheme QFSetID= SEADATANETQF Set Description: SEADATANET quality flags Reference: http://vocab.ndg.nerc.ac.uk/term/L201/1/<code> Flag Description ODVGENERICQF GTSPP ARGO SEADATANET ESEAS WOD WODSTATION WOCEBOTTLE WOCECTD WOCESAMPLE QARTOD BODC PANGAEA SMHI no quality control 1 5 Q * blank good value 2 3 probably good value probably bad value 4 7 K ? bad value 8 / B changed value R | value below detection 6 < value in excess > interpolated value T missing value 9 N value phenomenon uncertain A

SEADATANET quality flag scheme QFSetID= SEADATANETQF Set Description: SEADATANET quality flags Reference: http://vocab.ndg.nerc.ac.uk/term/L201/1/<code> Flag Description ODVGENERICQF GTSPP ARGO SEADATANET ESEAS WOD WODSTATION WOCEBOTTLE WOCECTD WOCESAMPLE QARTOD BODC PANGAEA SMHI no quality control 1 5 Q * blank good value 2 3 probably good value probably bad value 4 7 K ? bad value 8 / B changed value R | value below detection 6 < value in excess > interpolated value T missing value 9 N value phenomenon uncertain A

Purpose: Once QC is performed the quality flags can be used to filter the data by quality.

Data Editing and Quality Control easy spotting and identification of outliers or offsets painless editing of data value and quality flag logging of all value or flag modifications automatic range checks and manual or automatic editing

Manual Data Editing and Quality Control

Automatic Range Checks and Outlier Removal

All changes logged in .log file. Note: All changes logged in .log file. Can be viewed Collection>View Log file