Metadata Limitations and the effect on XBT depth adjustment A. Gronell and R. Cowley CSIRO Marine and Atmospheric Research.

Slides:



Advertisements
Similar presentations
FDA/Industry Workshop September, 19, 2003 Johnson & Johnson Pharmaceutical Research and Development L.L.C. 1 Uses and Abuses of (Adaptive) Randomization:
Advertisements

JCOMM SOT-4 April 2007 Revisiting the XBT Fall Rate Equation (Sippican Deep Blue):Implications and Recommendations JCOMM/SOT-4 Derrick Snowden Gustavo.
Computing Science Software Design and Development SOFTWARE DESIGN AND DEVELOPMENT USING PYTHON.
Flexgen Payroll – TCRS/Concord Project Local Government Corporation 2014 Resource.
Understanding Microsoft Excel
5/3/2015J-PARC1 Transverse Matching Using Transverse Profiles and Longitudinal Beam arrival Times.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Top Reasons why users call ECCA. Agenda Reason for the call: What is the question or problem? Reason for the call: What is the question or problem? Answer.
BOAT - Optimistic Decision Tree Construction Gehrke, J. Ganti V., Ramakrishnan R., Loh, W.
Climate case study. Outline The challenge The simulator The data Definitions and conventions Elicitation Expert beliefs about climate parameters Expert.
1 Hash-Based Indexes Yanlei Diao UMass Amherst Feb 22, 2006 Slides Courtesy of R. Ramakrishnan and J. Gehrke.
1 Hash-Based Indexes Chapter Introduction  Hash-based indexes are best for equality selections. Cannot support range searches.  Static and dynamic.
QBM117 Business Statistics Statistical Inference Sampling Distribution of the Sample Mean 1.
1 How to use Memshare in Shipbuilding – Quality Control.
Some Introductory Programming 1. Structured Query Language - used for queries. - a standard database product. 2. Visual Basic for Applications - use of.
TRENDS IN MARINE WINDS ADJUSTED FOR CHANGES IN OBSERVATION METHOD, Bridget R. Thomas 1, Elizabeth C. Kent 2, Val R. Swail 3 and David I. Berry.
Benchmark database inhomogeneous data, surrogate data and synthetic data Victor Venema.
STAT 3130 Statistical Methods II Missing Data and Imputation.
Working with Numbers in Alice - Converting to integers and to strings - Rounding numbers. - Truncating Numbers Samantha Huerta under the direction of Professor.
 On Wednesday, June 4, 2014, we will upgrade both version 10.2 and version 10.3 during the same time period. After the upgrade has finished, we will.
© GCSE Computing Candidates should be able to:  explain the representation of an image as a series of pixels represented in binary  explain the need.
Encoding, Validation and Verification Chapter 1. Introduction This presentation covers the following: – Data encoding – Data validation – Data verification.
Confidence Intervals for the Mean (σ known) (Large Samples)
Making a Playable DVD movie using your digital photos And adding music to the movie.
Section 8.1 Estimating  When  is Known In this section, we develop techniques for estimating the population mean μ using sample data. We assume that.
A lesson approach © 2011 The McGraw-Hill Companies, Inc. All rights reserved. a lesson approach Microsoft® Excel 2010 © 2011 The McGraw-Hill Companies,
Editing RT QC flag in delayed mode ? Virginie Thierry DMQC 4 Toulouse, 28 septembre 2009.
TQ3 / Passport Data Collection and Transfer This presentation will show the current download procedure used by TQ3 Ireland to collect data from the CRS.
XBT Fall Rate Workshop AOML, Miami, FL March 10 – 12, Managing XBT Data in the Global Temperature–Salinity Profile Program (GTSPP) Data Base Charles.
The set of files includes : Tcl source of the POLYGON program The database (file obtained initially by P.Afonine from using phenix.model_vs_data.
June 19, 2007 GRIDDED MOS STARTS WITH POINT (STATION) MOS STARTS WITH POINT (STATION) MOS –Essentially the same MOS that is in text bulletins –Number and.
This material is approved for public release. Distribution is limited by the Software Engineering Institute to attendees. Sponsored by the U.S. Department.
Estimation Chapter 8. Estimating µ When σ Is Known.
A Comparison of Six Expendable Bathythermograph Data Acquisition Systems Derrick Snowden Molly Baringer Gustavo Goni.
Monitoring Heat Transport Changes using Expendable Bathythermographs Molly Baringer and Silvia Garzoli NOAA, AOML What are time/space scales of climate.
© Crown copyright Met Office The EN4 dataset of quality controlled ocean temperature and salinity profiles and monthly objective analyses Simon Good.
Introduction to Database, Fall 2004/Melikyan1 Hash-Based Indexes Chapter 10.
QUICK: Review of confidence intervals Inference: provides methods for drawing conclusions about a population from sample data. Confidence Intervals estimate.
Copyright 2010, The World Bank Group. All Rights Reserved. Testing and Documentation Part II.
© Crown copyright Met Office An ocean database of surface / sub-surface temperature and salinity observations (D4.5) Chris Atkinson and Nick Rayner Prototype.
G042 Lecture G042 Feedback 2011 Mr C Johnston ICT Teacher
Archived Data Management System Study Advisory Committee Meeting May 14, 2003.
Collecting and Utilizing an XBT/CTD Comparison Reference Database for XBT Bias Estimation Tim Boyer, John Antonov, Syd Levitus, Ricardo Locarnini, Dan.
MarLIN: a research data metadatabase for CSIRO Marine Research Tony Rees Divisional Data Centre CSIRO Marine Research, Hobart contact:
? INFORMATION CONTENT IN LOW DENSITY XBT TRANSECTS RELATIVE TO OCEANIC GYRES ROBERT L. MOLINARI FORMERLY: NOAA/AOML PRESENTLY: UNIVERSITY OF MIAMI- CIMAS.
Understanding Microsoft Excel Lesson 1 – Microsoft Excel 2013.
ICCS 2009 IDB Seminar – Nov 24-26, 2010 – IEA DPC, Hamburg, Germany Training Workshop on the ICCS 2009 database Weights and Variance Estimation picture.
Chapter 4 Decision Making. Agenda Function Goal Seek command AutoFilter command Worksheet operation Printing worksheet.
XBT FALL RATE EQUATION WORKSHOP National Oceanic and Atmospheric Administration Atlantic Oceanographic and Meteorological Laboratory, Miami, FL March 10-12,
Maximum likelihood estimators Example: Random data X i drawn from a Poisson distribution with unknown  We want to determine  For any assumed value of.
10.1 – Estimating with Confidence. Recall: The Law of Large Numbers says the sample mean from a large SRS will be close to the unknown population mean.
Homework 2 Hints. General Tips Remember what FORM view you are in! – Design, form, and layout view TABLE views include: – Design and Datasheet view.
© Crown copyright Met Office Ensemble of subsurface databases Simon Good, presented by Nick Rayner, ERA-CLIM workshop on observation errors, Vienna, April.
XBT fall rate corrections Summary of pre-meeting discussions Step 1: Making recommendations for future XBT data collection Step 2: Correction of the historical.
 Software reliability is the probability that software will work properly in a specified environment and for a given amount of time. Using the following.
Time, probe type and temperature variable bias corrections to historical eXpendable BathyThermograph observations 1. International Center for Climate and.
HOW TO FIX MSVCR100. DLL IS MISSING ERROR? missing-error.
Software Testing CS II: Data Structures & Abstraction
Understanding Microsoft Excel
GO! with Microsoft Office 2016
INITIAL WORLD OCEAN DATABASE COLLECTION
Lesson Objectives Aims – Know about…
Multidisciplinary Engineering Senior Design Project P06441 See Through Fog Imaging Preliminary Design Review 05/19/06 Project Sponsor: Dr. Rao Team Members:
Customization
Understanding Microsoft Excel
Data Analysis in Particle Physics
Understanding Microsoft Excel
Experiment Report Format
Confidence Intervals for the Mean (Large Samples)
The Lab Notebook ECE 2100 Dr. Dave Shattuck
Presentation transcript:

Metadata Limitations and the effect on XBT depth adjustment A. Gronell and R. Cowley CSIRO Marine and Atmospheric Research

CSIRO. Insert presentation title, do not remove CSIRO from start of footer Why we’re interested:

CSIRO. Insert presentation title, do not remove CSIRO from start of footer Depth correction: We need entire database to same vertical scale We do this by converting all t-7, deep blue, t-6 and t-4 profiles to conform to the Hanawa ‘85 equations High or full vert resolution depths are recalculated and replaced. Low vert resolution data depths are multiplied by

CSIRO. Insert presentation title, do not remove CSIRO from start of footer Depth correction procedures: High vertical resolution profiles with ‘known’ probe type : ‘fixes’ profiles with truncated or rounded depths. Replace depths with calculated depths. All depths now to.01 resolution Low resolution profiles that either need correction (DPC$01) or are of unknown probe type and fit the criteria for correction: Multiply depths by

CSIRO. Insert presentation title, do not remove CSIRO from start of footer Inadequate Metadata is currently the biggest hurdle GTSPP best copy datasets for IO were downloaded and run through Depth correction software Anything that was not straight-forward was revisited profiles were screened Issues affecting depth correction decisions

CSIRO. Insert presentation title, do not remove CSIRO from start of footer Metadata issues – con. Profiles from GTSPP best copy – profiles No probe type info18303Action depends on date and max depth PEQ$ missing but determined from elsewhere and added 11442Action depends on probe type determined Missing DPC$ field156Action depends on date and max depth Profiles with DPC$03 or no DPC$ – profiles 1000m OR post Do not change depths >200m AND <1000m AND pre Change depths

CSIRO. Insert presentation title, do not remove CSIRO from start of footer Metadata problems found in GTSPP best copy dataset CTDs that were identified as XBTs – this is a problem if the DPC$ field is 03 and they fit our other criteria T10 profiles that go to 1500m (actually t-5 probes) MBTs misidentified (probably XBTs) – max depth for MBTs is ~250m

CSIRO. Insert presentation title, do not remove CSIRO from start of footer MBTs that go deeper than 300m Red profiles are post 1975

CSIRO. Insert presentation title, do not remove CSIRO from start of footer MBT distribution in the Indian Ocean through time

CSIRO. Insert presentation title, do not remove CSIRO from start of footer Other issues Number of depths wrong – more or fewer in the parameter field Additional or missing depths – in full resolution profiles, depths duplicated or missing Deep_depth field value different from the actual deepest depth Single point profiles Profiles with exactly.6m resolution (depths assigned and not calculated?) – results in error of ~30m at 800m

CSIRO. Insert presentation title, do not remove CSIRO from start of footer Conclusions: Codes are confusing – there are too many places to find probe type information PEQ$ PRT$ FRE$ PTY$ PFR$ We should be able to reconcile all these into a sensible PEQ$, even if it’s unknown. DPC$ need clarification – 03 = not enough information, do not correct – but we know most of these should be corrected. 02 = known probe type, no correction – what does this mean? No correction done or no correction necessary?

CSIRO. Insert presentation title, do not remove CSIRO from start of footer Conclusions (con): To effectively calculate the corrections needed to fix the fall rate bias of XBTs, we need the best quality baseline data – all using the same base-line fall rate. We therefore need smart methods to get all profiles to the Hanawa equation. We can only do this if we have adequate metadata – otherwise, we’re just making educated guesses.