DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

Slides:

Advertisements

Similar presentations

John A. Orcutt Deputy Director, SIO Ocean Observations Initiative NSF MREFC Chair, NSF/CORE DEOS Comm.

Advertisements

Ocean Engineering Civil, Construction and Environmental Engineering Department Marine radar wave observations at the mouth of the Columbia River Merrick.

Future Directions and Initiatives in the Use of Remote Sensing for Water Quality.

NOS – National Ocean Service NWS – National Weather Service What is QARTOD? IOOC DMAC Steering Team Second Meeting January 2012 Washington, D.C.

1 Development of a Regional Ocean Modeling System (ROMS) for Real-Time Forecasting in Prince William Sound and Adjacent Alaska Coastal Waters YI CHAO,

National Data Buoy Center Presented to the QARTOD III Workshop November 2, 2005 Wave Data Quality Control Chung-Chu Teng.

QARTOD III Scripps Institution of Oceanography La Jolla, CA Quality Control, Quality Assurance, and Quality Flags Mark Bushnell, NOAA/NOS/CO-OPS November.

QARTOD III November 2-4, 2005 Metadata in the IOOS Community Julie Bosch NOAA Coastal Data Development Center QARTOD III November 2–4, 2005.

DATA INTEGRATION DEMONSTRATION QA/QC Focus Quality Assurance of Real Time Ocean Data QARTOD II Feb 28-March 2, 2005 National Federation Of Regional Associations.

QARTOD II Currents and Waves IN-SITU WAVE GROUP Kent Hathaway, Moderator QARTOD II February 28 – March 2, 2005.

Directional Wave Observations 1) Da Basics 2) Remote Sensing v. In Situ : It’s all good. 3) Estimating directional wave properties. 4) Measurement accuracy.

Integrated Ocean Observing System (IOOS) Demonstration Project Ports of Los Angeles/Long Beach Julie Thomas Southern California Coastal Ocean Observing.

A NOAA funded partnership of research institutions, state and regional resource managers, and private sector companies interested in developing and applying.

Integrated Ocean Observing System (IOOS) Julie Thomas Southern California Coastal Ocean Observing System (SCCOOS) Coastal Data Information Program (CDIP)

Remote Currents: HF Radar QA/QC and Standards Jack Harlan National Ocean Service Center for Operational Oceanographic Products and Services QARTOD

National Oceanic and Atmospheric Administration

SEA LEVEL RISE: A California Perspective Julie Thomas Coastal Data Information Program Southern California Ocean Observing System Scripps Institution of.

Phase Resolved X-Band Wave Inversions in Multi-modal Seas

Our Planet is Changing U.S. Integrated Ocean Observing System (IOOS) We need advanced tools to understand and monitor our oceans, coasts and Great Lakes.

Mouth of the Columbia River Buoy System Julie Thomas Program Manager, CDIP Executive Director, SCCOOS Ilwaco, WA June 18, 2009.

An Instrumented Coastal Process Modeling Test Bed US Army Corps of Engineers BUILDING STRONG ® Jeff Hanson U. S. Army Engineer Research and Development.

Using Ocean Observing Systems & Real Time Data to monitor and clean up Oil Spills.

Why We Care or Why We Go to Sea.

Towards a Standard for Real-time Quality Control Procedures for in situ Ocean Waves Richard Bouchard 1 and Julie Thomas 2 1.NOAA’s National Data Buoy Center.

SOUTHERN CALIFORNIA BEACH PROCESSES STUDY SCRIPPS INSTITUTION OF OCEANOGRAPHY UNIVERSITY OF CALIFORNIA, SAN DIEGO.

NOAA PORTS ® Partnerships MARACOOS Annual Meeting 12/15/2011 Darren Wright Maritime Services Program Manager.

JCOMM Data Buoy Cooperation Panel October 16, 2006 National Data Buoy Center 2006 Review: A Year of Growth Paul F. Moersdorf, PhD, Director.

Surface Current Mapping with High Frequency RADAR.

The US Integrated Ocean Observing System Mark E. Luther College of Marine Science University of South Florida US-GOOS Steering Committee.

CONRAD BLUCHER INSTITUTE ACTIVITIES SUPPORTING TEXAS PORTS AND WATERWAYS OPERATIONS Two Inter-related Services to the Port Community: 1. The Texas Coastal.

US Army Corps of Engineers Coastal Field Data Collection Program - ERDC Coastal Field Data Collection Program New coastal knowledge through measurements.

Alaska Ocean Observing System Regional association under IOOS Part of coastal GOOS Ocean component of GEOSS IPY opportunity.

Surface Current Mapping in the Lower Chesapeake Bay INTRODUCTION High frequency RADAR antennas are used to observe the surface circulation patterns in.

Automated Weather Observations from Ships and Buoys: A Future Resource for Climatologists Shawn R. Smith Center for Ocean-Atmospheric Prediction Studies.

1 | Program Name or Ancillary Texteere.energy.gov Water Power Peer Review Assessment of Energy Production Potential from Ocean Currents along the United.

August 24, C OASTAL D ATA I NFORMATION P ROGRAM C OASTAL D ATA I NFORMATION P ROGRAM present.

SCCOOS Web Site Training Surface Currents and Wave Conditions.

1 A Sample of NCDDC's GCOOS-Related Data Management Activities Julie Bosch NOAA/ National Coastal Data Development Center GCOOS DMAC Committee Meeting.

Observing System Monitoring Center (OSMC) Status Update April 2005 Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI)

Calibration/Validation Efforts at Calibration/Validation Efforts at UPRM Hamed Parsiani, Electrical & Computer Engineering Department University of Puerto.

Ocean.US and Coastal Ocean Applications and Science Team (COAST) Larry Atkinson September 2004 Corvallis.

Project IDA (International Deployment of Accelerometers) Project IDA II GSN Calibration Procedures November 16, 2011 Peter Davis Project IDA Scripps Institution.

Implementation of Google by the Coastal Data Information Program Julie Thomas Scripps Institution of Oceanography July 24, 2008.

1 Implementing QA/QC Standards for In Situ Ocean Sensors Using OGC-Sensor Web Enablement a.k.a. QARTOD to OGC a.k.a. Q2O Project Status Brief to NOAA IOOS.

Tools for Monitoring in Coastal Alaska and the Arctic Darcy Dugan Alaska Ocean Observing System.

Outcomes of CLIMAR-IV DAVID I. BERRY ETMC-V, 22 – 25 JUNE 2015.

Observations to Operations: Why validation is important? Julie Thomas Scripps Institution of Oceanography Hydrographic Review Panel Los Angeles, CA April.

AMSR-E Vapor and Cloud Validation Atmospheric Water Vapor –In Situ Data Radiosondes –Calibration differences between different radiosonde manufactures.

Summary of QARTOD and Recent Workshops on QA/QC March 9-10, 2006.

U.S. Integrated Ocean Observing System (IOOS ® ) Z Improve safetyEnhance our economyProtect our environment CIMAR-GOMC meeting – 25 Feb 2015 Zdenka Willis.

Great Lakes Environmental Research Laboratory Review – Ann Arbor, MI November 15-18, 2010 Page 1 Observing Systems & Advanced Technology Steve Ruberg.

Access to IOOS Data Relevant to OOI Kathleen Bailey NOAA/NOS/IOOS January 6, 2016.

Future needs and plans for ocean observing in the Arctic AOOS Arctic Town Hall Futur Zdenka Willis Integrated Ocean Observing System National Program Office.

US Army Corps of Engineers An Overall Vision of the Corps as Data Developers & Users William A. Birkemeier Coastal Field Data Collection Program Coastal.

A U.S. non-profit Corporation Recipient of NOAA planning grants and Congressionally directed funding Membership to include federal, state, provincial.

National Data Buoy Center Ian Sears National Data Buoy Center An Overview of Quality Control Procedures for Buoy Data.

NOAA EDMC Ocean Observatories Initiative Cyberinfrastructure Karen Stocks OOI CI Data Curator University of California, San Diego Ocean Observatories.

Quality Assurance of Real-Time Data February 2004 C OASTAL D ATA I NFORMATION P ROGRAM C OASTAL D ATA I NFORMATION P ROGRAM present.

Surface Current Mapping in the Lower Chesapeake Bay INTRODUCTION High frequency RADAR antennas are used to observe the surface circulation patterns in.

Data Sharing and Data Quality of Ocean Currents and Temperature: Towards an Operational Data Management System for the Southeast Region Southeast Regional.

Quality Assurance of Real-Time Oceanographic Data

Data Sharing and Data Quality of Ocean Currents and Temperature:

COASTAL DATA INFORMATION PROGRAM present

US IOOS®, NDBC, CO-OPS Partnership Discussion

OPERATIONAL OCEANOGRAPHY

Natalie Laudier Operational Oceanography 13Feb2009

Southern California Beach Processes Study (SCBPS)

Directional Wave Measurements: Answering the Question of Ground Truth

Southern California Coastal Ocean Observing System (SCCOOS) HF RADAR Network “SCCOOS brings together coastal observations in the Southern California Bight.

Presentation transcript:

DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop October 2007 La Jolla, CA

ACT QARTOD REAL-TIME CASE STUDY INTERNATIONAL EFFORTS WMO, OceanSITES/Eurosites/IFREMER, JCOMM, ……..

Directional Wave Observations 1) The Basics 2) Remote Sensing v. In Situ : It’s all good. 3) Estimating directional wave properties. 4) Measurement accuracy and user needs. 5) A Recipe for instrument evaluation. ALLIANCE FOR COASTAL TECHNOLOGIES ACT Wave Sensor Technologies University of South Florida, March By Bill O’Reilly

z x y w u v The Big 3 X, Y, Z The Basics: Estimating the Motion of a Sea Surface Particle Pressure Sensors Accelerometers Tilt sensors Angular Rate Sensors Acoustic Sensors Radar Lidar dz/dx, dz/dy z

In-Situ and Remotely Sensed Waves Method O(cm) X,Y,Z Accuracy Spatial Coverage Time Coverage In situ SAR,LIDAR HF, X-Band Radar In situ and remote sensing systems are complimentary, NOT redundant.

XYZ TIME SERIES

The Big 3: X, Y, Z  Time Series Analysis  The First 5: S(f),a1(f),b1(f),a2(f),b2(f) !! S

Theoretical maximum level of breaking wave in a fully developed sea Each box represents the number of hourly observation – Datawell Buoy Mark II w/ hippy used as data source (standard).

Comparison between a Datawell Buoy w/ hippy and a PROTOTYPE Datawell w/ GPS. Low numbers indicate good correlations. Instruments Were co-located. GPS instrument dropped out during low Frequency – causing spikes in data Instruments tend to disagree as they are interpreting sea surface differently under breaking wave conditions.

Datawell w/ hippy and Datawell w/ GPS tend to agree well with wave direction. Note how both instruments reach their noise floor during long period, low energy events.

Directional spread is where many instruments fall apart! Good indication of the quality of the instrument – demonstrates their directional noise level! GPS antenna on top of the buoy has a “natural” noise when it wobbles – a method has been devised to correct for this problem.

QUALITY ASSURANCE OF REAL-TIME DATA QARTOD QARTOD is a continuing multi-agency effort to address the Quality Assurance and Quality Control issues of the Integrated Ocean Observing System (IOOS) and broader international community. Quality Control standards have been submitted to DMAC for both waves and Currents. Ocean.US is now soliciting submissions from the Regional Associations for all standards including QA/QC. The QARTOD submissions Will be posted soon on the Ocean.US website. Parameters addressed through QARTOD: Waves, In-situ Currents, Remote Currents (HF RADAR), CTDs, Dissolved Oxygen. Collaborated with DMAC Metadata team for a one day appended workshop During QARTOD IV, June 2006.

Quality Assurance (QA) – Verify that instrumentation is calibrated and tested to assure collection of the highest quality data possible. Quality Control (QC) – Analyze and verify the data stream to assure the highest quality data possible.

VALIDATION CASE STUDY - Real-time Buoy Data Eel River Cape Mendocino (094) Humboldt Bay South Spit (128) OREGON CALIFORNIA NDBC BUOY 46022, EEL RIVER, re-deployed this summer with 3DMG sensor is 34 miles away from buoy (CDIP Datawell Buoy Station 094).

Full spectra looks ok at first glance!

Under predicts LONG PERIOD SWELL (12-33 sec) Noisy directional spread

Comparison of the Datawell /hippy and the NDBC (Eel River Buoy) w/ 3DMG sensor under predicts low frequency waves. Buoys are moored 34 miles apart. Part of this difference in the high frequency could be caused by local sea conditions.

Why is directional spread important? Why do we need accurate wave measurements? The models are only as good as their input source. In Southern California, for instance, 5 degrees can make a big difference in how much energy reaches the beach.

Let’s come together as an IOOS community and further validate our wave instrumentation!