1 NODC Quality Control : Automatic Checks - reveal systematic errors in incoming data and metadata - eliminate most non-representative data from consideration.

Slides:



Advertisements
Similar presentations
Better Data, Better Science! [ Better Science through Better Data Management ] Todd D. OBrien NOAA – NMFS - COPEPOD.
Advertisements

Figure 1: Location map of hydrographic and coastal sampling stations.
American Seas NCOM Assessments and Graphics for JUNE 2010 Frank Bub – NAVOCEANO (16 FEB 11) File: AMSEAS_GOM_NCOM_Evals_all_16FEB11.ppt June coverage –
MAMA Workshop on Marine Data & Information Management Malta, 28 th January 2004 Recent experiences and future plans in oceanographic data management of.
Argo Real-time Quality Control Process NOAA/AOML: Y.-H. DANESHZADEH, R. MOLINARI, R. SABINA, C. SCHMID CIMAS/UM: E. FORTEZA, X. XIA, H. YANG.
NATS 101 Lecture 3 Climate and Weather. Climate and Weather “Climate is what you expect. Weather is what you get.” -Robert A. Heinlein.
2 nd international Conference for GODAR-WESTPAC JODC, Japan Coast Guard, Tokyo 2004.
11 MEDATLAS 2002: database and data management system for the long term monitoring of Mediterranean and Black seas EC-MAST Concerted Action (MAS3-CT /ERBIC20-CT
1 NATS 101 Lecture 3 Climate and Weather. 2 Review and Missed Items Pressure and Height-Exponential Relationship Temperature Profiles and Atmospheric.
Chapter 11: Inference for Distributions
=(S,,0); 4=(S,,4000).
NOAA Climate Obs 4th Annual Review Silver Spring, MD May 10-12, NOAA’s National Climatic Data Center 1.SSTs for Daily SST OI NOAA’s National.
First Data Management Training Workshop, February, 2007, Oostende, Belgium 1 Quality control checks description First Data Management Training Workshop.
Quality Control Standards for SeaDataNet Review status at 1 st Annual Meeting (March 2007) Review developments over last year Current status Future work.
IQuOD An International Quality Control Effort Tim Boyer EDM workshop September 10, 2014.
National Climatic Data Center NCDC "State of the climate" search/2008/ann/bams/.pdf and.ppt.
Zenghong Liu & Jianping Xu State Key Lab of Satellite Ocean Environment Dynamics The Second Institute of Oceanography, SOA GOVST-V , Beijing.
Oceanographers' contribution to climate modelling and prediction: progress to date and a future perspective by Emily F. Shuckburgh Philosophical Transactions.
Our Backyard Waterways: Predicting a Phytoplankton Bloom.
© Crown copyright Met Office The EN QC system for temperature and salinity profiles Simon Good.
Satellite Sea-surface Salinity: Data and Product Biases and Differences Eric Bayler and Li Ren NOAA/NESDIS Center for Satellite Applications and Research.
ISPOL Ocean Turbulence Project Miles McPhee McPhee Research Co. Naches WA USA.
From Ocean Sciences at the Bedford Institute of Oceanography Temperature – Salinity for the Northwest.
XBT Fall Rate Problem A Historical Perspective Bill Emery, Univ. of Colorado Bob Heinmiller (deceased 2005)
Modeling the upper ocean response to Hurricane Igor Zhimin Ma 1, Guoqi Han 2, Brad deYoung 1 1 Memorial University 2 Fisheries and Oceans Canada.
WOCE hydrographic Atlas, 1 As a result of the World Ocean Circulation Experiment (WOCE), a hydrographic survey of the world oceans occurred from
Quality Control for the World Ocean Database GSOP Quality Control Workshop June 12, 2013.
Monitoring Heat Transport Changes using Expendable Bathythermographs Molly Baringer and Silvia Garzoli NOAA, AOML What are time/space scales of climate.
© Crown copyright Met Office The EN4 dataset of quality controlled ocean temperature and salinity profiles and monthly objective analyses Simon Good.
1 1 Morten D. Skogen WP10: Hindcast and scenario studies on coastal- shelf climate and ecosystem variability and change Overview and plans ECOOP annual.
Seasonal Change in the Upper Ocean (The Annual Cycle)
Mean 20 o C isotherm (unit: meter) The thermocline zone is sometimes characterized by the depth at which the temperature gradient is a maximum (the “thermocline.
Typical Distributions of Water Characteristics in the Oceans.
1 Global Ocean Heat Content in light of recently revealed instrumentation problems Syd Levitus, John Antonov, Tim Boyer Ocean Climate Laboratory.
MEDAR 2002 Database and Network The MEDAR Group MEDAR/MEDATLAS II Mediterranean Data Archaeology and Rescue of Temperature, Salinity and Bio-chemical Parameters.
OC3230-Paduan images Copyright © McGraw Hill Chap 7-8: Distributions SPECIAL DATES: MPA meeting…6 Jul R/V Pt Sur Cruise…14 Jul R/V Pt Sur Cruise…25 Jul.
Fig Decadal averages of the seasonal and annual mean anomalies for (a) temperature at Faraday/Vernadsky, (b) temperature at Marambio, and (c) SAM.
CO2 MEASUREMENTS ON THE PIRATA NETWORK
Technical Details of Network Assessment Methodology: Concentration Estimation Uncertainty Area of Station Sampling Zone Population in Station Sampling.
Unit 2 Measuring the Earth Mapping. Size and Shape Almost a perfect sphere- slight flattening in the polar regions and a slight bulging at the equatorial.
1 Detection of discontinuities using an approach based on regression models and application to benchmark temperature by Lucie Vincent Climate Research.
XBT Fall Rate Equation – A Review Pankajakshan and Gopalkrishna, National Institute of Oceanography, Goa, India.
EMODnet Chemistry Partner contribution: RIHMI-WDC 2-nd annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation.
CLIMATE GRAPHS. Temp In °C Precipitation In mm OTTAWA LABELS! CITY AT TOP TEMPERATURE ON LEFT IN °C PRECIPITATION ON RIGHT MONTHS ACROSS THE BOTTOM.
NOAA National Climatic Data Center Dr. Karsten Shein Climatologist NOAA/NESDIS/NCDC 151 Patton Ave. Asheville, NC
Environmental Monitoring in the Black Sea Meeting Name, Dates, Venue Joint Survey Prepared by: Alexander Mikaelyan with contribution of Jaroslav Slobodnik,
CTD Data Processing Current BIO Procedure. Current Processing Software Matlab Migrating to R & Python Code Version Control SVN Migrating to GitHub.
Station lists and bias corrections Jemma Davie, Colin Parrett, Richard Renshaw, Peter Jermey © Crown Copyright 2012 Source: Met Office© Crown copyright.
Fig Wilkins Ice Shelf breakup events of (a) MODIS band 1 image 10 days after the end of the first event; (b) Envisat ASARimage during the second.
Seasonal mean Arctic Ocean climatology calculated from the archived data (ADAM: Arctic ocean Data Archive for Model validation & data assimilation) beta-version.
SeaDataNet Technical Task Group meeting JRA1 Standards Development Task 1.2 Common Data Management Protocol (for dissemination to all NODCs and JRA3) Data.
Estimation of acoustic travel-time systematic variations due to observational height difference across the solar disk. Shukur Kholikov 1 and Aleksander.
PROVIDING DATA SERVICES FOR THE MEDITERRANEAN AND BLACK SEAS
Data aggregation and products generation in the Mediterranean Sea
Spatial Modes of Salinity and Temperature Comparison with PDO index
Argo Delayed-Mode Salinity Data
The β-spiral Determining absolute velocity from density field
Outline RTQC goals to achieve Description of current proposal Tests
Observations of Deep Flow along the Central California Coast
Creating Marine Data Section Plots in ODV
Apr-Jun Jan-Mar Jul-Sep Oct-Dec
Aquarius SSS space/time biases with respect to Argo data
Y. Xue1, C. Wen1, X. Yang2 , D. Behringer1, A. Kumar1,
Mark J. Costello, Chhaya Chaudhary  Current Biology 
The effect of ship Nox deposition on cyanobacteria blooms
NATS 101 Lecture 3 Climate and Weather
What are we seeing in the surface currents?
Eutrophication indicators PSA & EUTRISK
NATS 101 Lecture 3 Climate and Weather
Fig. 1 Environmental conditions and concentrations of floating plastic debris in the Arctic Ocean. Environmental conditions and concentrations of floating.
Presentation transcript:

1 NODC Quality Control : Automatic Checks - reveal systematic errors in incoming data and metadata - eliminate most non-representative data from consideration Eliminates ~6% of temperature data from Consideration (>800,000 profiles) Checks include: Range check Spike check Density inversion Speed check Standard deviation Red – Unflagged Black – Flagged

31 distinct regions with ocean variable ranges at standard depths, includes separate ranges for coastal regions 177,000 temperature profiles affected (1.5%) Min/Max Range Checks

Inversion and Large Gradient Checks For Temperature: Inversion ≤ -0.3°C/meter Gradient ≥ 0.7°C/meter MBT with large inversion °Celsius Depth (meters) Inversions present In 276,000 temperature Profiles (2% of profiles) Large positive gradients Present in 534,000 Temperature profiles (4% of profiles)

Density inversions – when local stability with respects to density less than zero Check applied at observed levels, but not used to exclude data from interpolation to standard levels Check applied at standard levels. Interpolation procedure can introduce inversions. Two or more density inversions at same station and whole temperature and salinity profiles are marked and not used to calculate climatologies. 214,00 temperature and salinity casts not used due to two or more density inversions on standard levels (1.6% of all temperature profiles, 3.7% of all salinity profiles) Density inversion check

Standard Deviation Checks check is on standard levels 5° means and standard deviations used values flagged if they exceed 3 to 5 times standard deviations from mean - 3 times for upper 50 meters for coastal data - 4 times for near coastal and near bottom data - 5 times for all other data profile not used for climatologies if it has 2 or more standard deviation flags separate checks for annual, seasonal, monthly time periods 367,000 temperature profiles flagged with more than 2 annual mean/standard deviation failures (3% of total profiles) - 233,000 salinity profiles flagged (4% of total)

May – August 1976 Cruise of Russian Ship Priboy (Russian Far East Scientific Research Institute)

Blue Dots = Phosphate data from Priboy cruise, 2839 stations. Red Dots = other Phosphate in representative 5° square in North Pacific, 5455 stations Red Solid Line = Mean phospate values at standard depths for same 5° square Red Dotted Line = ±3 to 5 standard deviations for 5° square Green Line= Mean Priboy cruise phosphate with correction applied Estimated fix of data: Correct value = (3.189 X initial value) Problem is due to difference in Molecular weight conventionally Used by Russians, Americans

Flag values: 0-9 Flag value: 2 Flag values: 3-9 Depth: 0-50 m Depth: m Depth: m Years: Month: Jan - Mar Courtesy Igor Smolyar

Region: 73º-75º N, 10º-45º E , Jan-Apr Temperature data 0-20 m All measurements Flagged values: Standard Deviation outliers Fuzzy logic method Temperature (°C) Courtesy Igor Smolyar

# CRUZTRACK REPORT FORM: # Statn Date Time Latitde Longitde Dist / TLS = Speed * UniqStat Access# Ship MP # O 1 2/ 7/ / 7/ / 7/ / 7/ / 7/ / 8/ * Cruise Speed/ Cruise Track Check

“Bullseyes” in December Salinity Climatology at Surface Before cleanup After cleanup Problems along 180 longitude caused by December, 1979 Russian cruise. An archiving error involving a computer at the Russian National Oceanographic Data Center caused decrease In salinity values. We are able to recover original values for these data Thank you – Questions?