IQuOD Data Flow Tim Boyer NODC. Inflow How will IQuOD quality controlled data get into the World Ocean Database?

Slides:

Advertisements

Similar presentations

The Live Access Server (Access to observational data) Jonathan Callahan (University of Washington) Steve Hankin (NOAA/PMEL – PI) Roland Schweitzer, Kevin.

Advertisements

Chapter 10: Designing Databases

1 Building an Ocean Profile-Plankton Database: Progress Since the "International Workshop on Oceanographic Biological and Chemical Data Management" Ocean.

Aquarius Validation Data System John Gunn 6 th Science Meeting Seattle, WA, USA July 2010.

An OPeNDAP server for CORIOLIS data centre Context and functions Architecture and technical description Planned improvements T. Loubrieu, A. Forest (IFREMER)

ICOADS Archive Practices at NCAR JCOMM ETMC-III 9-12 February 2010 Steven Worley.

Global Argo Data Repository Status Report for 2009 Charles Sun US National Oceanographic Data Center 10 th Argo Data Management Team Meeting 30 September.

1 Zdenka Willis Director, National Oceanographic Data Center SEADATANET June 9, 2006.

Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System 1 Zaihua Ji Doug Schuster Steven Worley Computational.

Pan-European infrastructure for Ocean & Marine Data management An EU Integrated research Infrastructure Initiative (I3) MIKADO : Java tool for XML Creation.

First Data Management Training Workshop, February, 2007, Oostende, Belgium 1 Quality control checks description First Data Management Training Workshop.

IQuOD An International Quality Control Effort Tim Boyer EDM workshop September 10, 2014.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View - Available Data Collections and Data Model.

Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.

2 nd Training Workshop 4 – 5 June 2007 Common Data Index - CDI By Dick M.A Schaap Technical Coordinator SeaDataNet.

Tools for accessing distributed in-situ data collections Donald W. Denbo, NOAA/PMEL-JISAO Jason E. Fabritz, NOAA/PMEL-JISAO Bernard J. Kilonsky, Sea Level.

AON Data Questionnaire Results 21 Respondents Last Updated 27 March 2007 First AON PI Meeting Scot Loehrer, Jim Moore.

Observing System Monitoring Center Integrating data and information across observing system networks.

World Ocean Database, World Ocean Atlas, and Regional Climatologies

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View.

John T. Gunn, AVDS Manager Earth & Space Research 1910 Fairview Ave. E., Suite 210 Seattle, WA Ph: ; 1 st Joint GOSUD/SAMOS.

1FileScope  FileScope File Editor Query Tool Report Generator File Conversion Tool Full Screen Support Developers Tool.

Getting Historical Data into the Word Ocean Database Ocean Climate Laboratory Team/NODC.

Technical Working Group, II Teruko Manabe Steven Worley Miroslaw Mietus Shawn Smith Simon Tett Volker Wagner Scott Woodruff David Berry Liz Kent.

SAMOS-GOSUD Meeting. Boulder 2-4 May Potential collaboration between the Coriolis project and the Samos initiative L. Petit de la Villéon. Ifremer-France-

NcBrowse A Graphical netCDF/OPeNDAP Browser Donald Denbo 1 & John Osborne 2 1 UW/JISAO-NOAA/PMEL, 2 OceanAtlas Software

Describe workflows used to maintain and provide the RDA to users – Both are 24x7 operations Transition to the NWSC with zero downtime NWSC is new environment.

1 Dapper and Argo Joe Sirott PMEL/NOAA. 2 What is Dapper? Web server that provides distributed access to in-situ data via OPeNDAP protocol Clients include.

Marine Data Representation systems T. Loubrieu, G. Maudire, S. Pouliquen, T. Carval, IFREMER, E. Charpentier, WMO Scott D. Woodruff, NOAA.

Observing System Monitoring Center (OSMC) Status Update April 2005 Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI)

Quality Control for the World Ocean Database GSOP Quality Control Workshop June 12, 2013.

Where Should the GALION Data Reside? Centrally or Distributed? Introduction to the Discussion Fiebig, M.; Fahre Vik, A. Norwegian Institute for Air Research.

IOOS National Glider Data Assembly Center

Kevin O’Brien University of Washington/JISAO NOAA/PMEL The Observing System Monitoring Center Steve Hankin, PMEL Ted Habermann, NGDC David Neufeld, NGDC.

© Crown copyright Met Office The EN4 dataset of quality controlled ocean temperature and salinity profiles and monthly objective analyses Simon Good.

NOAA/NESDIS/National Oceanographic Data Center Following the Flow of Two Underway Data Streams Within the U. S. National Oceanographic Data Center Steven.

The ATNF Pulsar Data Archive Matthew Whiting (ATNF) Albert Teoh, David Smith, Lucyna Kedziora-Chudczer, Dick Manchester, Vince McIntyre 2nd Gravitational.

Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012.

U.S. National report 2nd International Workshop for GODAR WESTPAC Sydney Levitus Director, WDC for Oceanography- Silver Spring Japan Oceanographic Data.

ECOOP annual meeting Feb 13-14, Objectives & Description. Objectives: Collect meta data and historical data for temperature and salinity measurements.

A Climate Data Portal Focused on realtime and retrospective in situ data Nancy Soreide, Don Denbo, Willa Zhu, NOAA/PMEL Charles Sun, NOAA/NODC Bernie Kilonsky,

Building a Global Ocean Profile Database GSOP Quality Control Workshop June 12, 2013.

National Aeronautics and Space Administration Aquarius Validation Data System Overview and Status Algorithm Workshop March 21-22, 2007 John Gunn Earth.

Russian Federation CDMS1 Integrated Data Management System Alexander Besprozvannykh.

An Introduction to the Argo Data Sytem South Pacific Workshop 11 – 14 October 2005 Mark Ignaszewski FNMOC.

OceanSITES: NCEI is set to automatically archive and this moored buoy time series dataset with regular updates. These data will be part of all future World.

IQuOD Project Proposal To produce and make publically available, the highest-quality standard possible historical subsurface ocean temperature (salinity)

Geneva, April 2007 GTSPP by Bob Keeley (Canada) and Charles Sun (U.S.A)

Distributed Data Servers and Web Interface in the Climate Data Portal Willa H. Zhu Joint Institute for the Study of Ocean and Atmosphere University of.

A Climate Data Portal Focused on realtime and retrospective in situ data Nancy Soreide, Don Denbo, Willa Zhu, PMEL Charles Sun, NODC Bernie Kilonsky, U.

Data Management System to Collect, Quality Control, Distribute, and Archive Near Real-time Marine Data Jeremy J. Rolph, Jacob T. Rettig, Mark A. Bourassa,

SCD Research Data for Ocean Observatories Steering Committee June 18, 2001 Steven Worley Scientific Computing Division Data Support Section.

Training course 2, Ostende, May 2014 IFREMER work-flow for production of CDIs data Michèle Fichaut, IFREMER, SISMER M. Fichaut, IFREMER.

EMODNet Physics + My Ocean – SeaDataNet Dick Schaap (MARIS) – Brussels – 1 March 2013.

GOSUD 5 th meeting Boulder, USA 2-4 May, Status GOSUD Meeting 2-4 May, 2006 Review of progress has been extracted from the Annual Report prepared.

The TIGGE Model Validation Portal: An Improvement in Data Interoperability 1 Thomas Cram Doug Schuster Hannah Wilcox Michael Burek Eric Nienhouse Steven.

Ocean Data View Course Objective: Import, quality control and visualize own or external datasets. What you learn: Large publicly available datasets exist.

ODP V2 Data Provider overview. 22 Scope Data Provider provides access to data and metadata of the local data systems. Data Provider is a wrapper, installed.

Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View and itsRole in SeaDatanet and its Role in SeaDatanet.

SeaDataNet tools NEMO, OCTOPUS, MIKADO

Data Browsing/Mining/Metadata

IOOS National Glider Data Assembly Center

MERRA Data Access and Services

Introduction to Ocean Data View

INITIAL WORLD OCEAN DATABASE COLLECTION

Comparisons of Argo profiles and nearby high resolution CTD stations

Integrating Data and Information Across Observing System

Ocean Data View Reiner Schlitzer

GODAE Quality Control Pilot Project

Ocean Data View Reiner Schlitzer

Presentation transcript:

IQuOD Data Flow Tim Boyer NODC

Inflow How will IQuOD quality controlled data get into the World Ocean Database?

3 Argo/GODAEGTSPP Delayed Mode Data NODC Permanent Archive [non-uniform Format] Near Real-Time Availability World Ocean Database Additional QC Uniform format Buoys PMEL/JAM Data quality information Not Always Publicly Accessible NODC Information Stream

4 IQuOD Manual QC Expert Center NODC Permanent Archive Specific IQuOD subset World Ocean Database IQuOD Automatic QC Uniform format IQuOD Information Stream Data quality information IQuOD Manual QC

5 NODC Permanent Archive World Ocean Database IQuOD Automatic QC Uniform format IQuOD Manual QC Expert Center IQuOD Information Stream IQuOD Manual QC Original Data IQuOD QC Other QC project

Outflow How will IQuOD quality controlled data get out to users?

7 World Ocean Database Internal Storage INSIDE THE DATA Original Profile Data Altered Profile Data (if necessary) QC Flags (orig) QC Flags (WOD) QC Flags (IQuOD) QC Flags (2nd) Generated on the fly

Data Dissemination: Yearly by instrument Geographically by instrument WODselect All updated quarterly Format: Native WOD format (compact ASCII) with conversion routines netCDF -> feeds into NODC Geoportal/THREDDS server Working now on subset dissemination through Geoportal

WODselect download page -For ASCII format, choice of two flags: default is originators flag + WOD flag. -For netCDF format, no restriction on number, form of flags -Can also bundle entire IQuOD QC’ed dataset. -First, only temperature flags (include WOD flags for other variables?) -Not all data IQuOD QC’ed (include automatic IQuoD flags for other temperature data?)

Confluence How will IQuOD quality controlled data be combined with other high value data sources?

11 World Ocean Database Additional QC Uniform format NODC to Public Information Stream (Profile Data) NODC Permanent Archive Public Access Geoportal/THREDDS WODselect

12 Ideal NODC to Public Information Stream (Profile Data) NODC Permanent Archive Public Access Geoportal/THREDDS WOD GTSPP Argo PMEL buoys

13 Ideal NODC to Public Information Stream (in situ Data) NODC Permanent Archive Public Access Geoportal/THREDDS Coastal Buoy Profile Current Thermo salinograph

Consolidated Granule Level GeoPortal Best Copy World Ocean Database GTSPP Argo Individual Accessions Get DataInformation Get Data Information See allInformation

Best Copy: Get Data Virtual download through THREDDS Server tar ball of all data files CF compliant netCDF format Files are not uniform in format Quality control not uniform in execution or as represented by flags

Best Copy Information Description of data which matches request X casts from GTSPP (ocean profile data from 1990 to present Y casts from World Ocean Database (historical ocean profile data from 1772-[WOD most current date] : takes precedence over GTSPP Z cycles from Argo (takes precedence over all others for profiling floats) A daily means from PMEL/NDBC tropical moored buoy arrays (takes precedence over all others for tropical moored buoys) B cruise thermosalinograph records C coastal moored buoy stations

Terminus Questions?