MAY 3-5 2004 ICES – MDM 2004, BRUSSELS Processing and Quality Checks of Shipboard ADCP Michèle FICHAUT, IFREMER/SISMER.

Slides:



Advertisements
Similar presentations
In-situ ADCP.
Advertisements

Better Data, Better Science! [ Better Science through Better Data Management ] Todd D. OBrien NOAA – NMFS - COPEPOD.
The OLRAC Marine Data Solution is an advanced system for tracking marine related data that employs state of the art VMS technology and cutting edge encryption.
3D Mobile Mapping Dave Henderson Topcon Positioning Systems
Groom-gliders data-management workshop Brest, December 2012 Groom gliders data management n In 2012 : vertical profiles from 26 platforms.
HYSWEEP® SURVEY HYPACK 2013.
1 ADCP Primer OC679: Acoustical Oceanography. 2 Outline ► Principles of Operation   The Doppler Effect The Doppler Effect   BroadBand Doppler Processing.
TMSI/IDM/SISMER Sept 2000 SISMER SISMER Systèmes d’Informations Scientifiques pour la Mer F-NODC Quality Control Procedure at IFREMER Argo data management.
CELESTIAL NAVIGATION Section 22 Day’s Work at Sea Prepared by: John C. Hudson Saanich Peninsula Squadron, VISD Jan 2006 / Rev. Jan 2007.
QARTOD II Currents and Waves In-Situ Currents: Breakout Group Report Out QARTOD II February 28 – March 2, 2005.
11 MEDATLAS 2002: database and data management system for the long term monitoring of Mediterranean and Black seas EC-MAST Concerted Action (MAS3-CT /ERBIC20-CT
HYPACK® Multibeam Training Seminar
Abstract Overall Algorithm Target Matching Error Checking: By comparing what we transform from Kinect Camera coordinate to robot coordinate with what we.
 Some animals such as bats, use ultrasound waves to detect obstacles and objects around them.  Ultrasounds are reflected of surfaces or objects and.
First Data Management Training Workshop, February, 2007, Oostende, Belgium 1 Quality control checks description First Data Management Training Workshop.
Quality Control Standards for SeaDataNet Review status at 1 st Annual Meeting (March 2007) Review developments over last year Current status Future work.
2.3 Methods for Big Data What is “Big Data”? Summarizing Big Data.
WP1: Data collection and metadata compilation in Mediterranean Sea EMODNET Chemistry 2, Kick-off meeting Trieste (Italy), 3-5 June 2013 Sissy Iona, HCMR-HNODC.
7 th TTG meeting – Trieste – 3-4 March, 2015 SeaDataNet tools, new developments IFREMER : M. Fichaut, A. Briand, M. Larour, T. Loubrieu, V. Tosello ALTRAN.
EU/MAST-MATER database ( ): A reference database of high quality multidisciplinary data collected within the framework of a major international.
LC and SMBA Updates Office of Surface Water Hydroacoustics Webinar January 6 and 9, 2008 David S. Mueller.
Cthru Technical Brief Gary Morris Center of Higher Learning Stennis Space Center.
Hydrographic Survey Software for Windows.  Eye4Software B.V., based in the Netherlands was founded in  More then 15 years of experience in Hydrography.
MAY SEA-SEARCH MEETING CYPRUS METADATA and XML in compliance with ISO Michèle FICHAUT, IFREMER/SISMER Gilbert MAUDIRE, IFREMER/ISI Mickaël.
Survey Toolbox & Plume Detection Toolbox
WinRiver MOVING ADCP DATA PROCESSING. 1. Average data to a greater interval Use raw data Decreases errors and increases data quality.
USE OF GPS FOR CROP AREA MEASUREMENT The CIRAD experience.
U.S. Department of the Interior U.S. Geological Survey IMPROVING THE QUALITY AND EFFICIENCY OF ADCP STREAMFLOW MEASUREMENTS David S. Mueller U.S. Geological.
EC-Marine Science & Technology Programme Concerted Action (MAS3-CT /ERBIC20-CT ) MEDAR/MEDATLAS 2002 and future initiatives Mediterranean.
QC Procedures at INCOIS TVS Udaya Bhaskar, CLIVAR(GSOP), th June, 2013.
Data Management: Products and Procedures for August 2007 Cruises Bill Howe.
Annual Meeting, June , Istanbul, Turkey WP2: Data aggregation and products generation in the Atlantic Sea: results and criticalities EMODnet.
November 16, 2009 Page 1 of 28 Data and Data Management: Introduction to the BCO-DMO Presented to Professor Keiichi Uchida November 16, 2009 Robert C.
A Quantitative Overview to Gene Expression Profiling in Animal Genetics Armidale Animal Breeding Summer Course, UNE, Feb GP3xCLI GenePix Post-Processing.
WinRiver MOVING ADCP DATA PROCESSING. 1. Average data to a greater interval Use raw data Decreases errors and increases data quality.
MEDAR 2002 Database and Network The MEDAR Group MEDAR/MEDATLAS II Mediterranean Data Archaeology and Rescue of Temperature, Salinity and Bio-chemical Parameters.
PHYSICAL OCEANOGRAPHY Part 4: Sound in the Ocean
SWFWMD LiDAR Specifications – 18 April 2008 LiDAR Specifications at the SWFWMD Ekaterina Fitos & Al Karlin.
Hydrographic Survey Software for Windows
MAGNETOMETERS IN HYPACK® Data Collection & Data Processing.
Data Management System to Collect, Quality Control, Distribute, and Archive Near Real-time Marine Data Jeremy J. Rolph, Jacob T. Rettig, Mark A. Bourassa,
CMA Coastline Matching Algorithm SSIP’99 - Project 10 Team H.
RD Instruments Home of the ADCP Measuring Water in Motion and Motion in Water AVOIDING BIASED DATA DURING REAL TIME HADCP DATA COLLECTION.
Training course 2, Ostende, May 2014 IFREMER work-flow for production of CDIs data Michèle Fichaut, IFREMER, SISMER M. Fichaut, IFREMER.
Results Verification Has the model been correctly implemented?
Rolling Deck to Repository (R2R): How to Systematically Document Quality for the New Era of Data Re-Usability? AGU Poster IN21B-1048 AGU Fall Meeting December.
Ocean Monitoring and Forecasting A Commercial Perspective Dr Ralph Rayner Ocean Numerics/Fugro GEOS.
Sverdrup, Stommel, and Munk Theories of the Gulf Stream
The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.
02-04 Feb.2016Workshop on Development of the Red Sea Environment & Fisheries 1 Sea Level Variations along the Red Sea Coasts Tarek M. El-Geziry (PhD) Researcher.
SeaDataNet Technical Task Group meeting JRA1 Standards Development Task 1.2 Common Data Management Protocol (for dissemination to all NODCs and JRA3) Data.
SeaDataNet tools NEMO, OCTOPUS, MIKADO
The Course of Synoptic Meteorology
WinRiver.
NEMO – Reformating tool
GML in CDI and CSR ISO using Ends&Bends
U.S. Geological Survey Office of Surface Water.
Tessa de Wit, Marco Puts, Maarten Pouwels
A Closer Look at CODAR HF Radar Spectra
Ifremer naval facilities
Vectors in Three Dimensions
MOVING ADCP DATA PROCESSING
Volume 95, Issue 5, Pages e3 (August 2017)
Tools for generation of SDN NetCDF (CFPOINT) files
Ifremer activity report 2008
Anke Consten (14 October 2016,Ljubljana)
National Report of Trinidad and Tobago November 2018 MACHC 18
Experiences from the post processing of typical Finnish bathymetric data Jarmo Ahonen Shallow Survey 2008 Portsmouth, NH.
A Visualization System for Tidal Basins
An Analysis of San Clemente Basin: Crosshore vs. Alongshore
Presentation transcript:

MAY ICES – MDM 2004, BRUSSELS Processing and Quality Checks of Shipboard ADCP Michèle FICHAUT, IFREMER/SISMER

lfremer MAY ICES – MDM 2004, BRUSSELS2 Ship and Equipment Three IFREMER Ships L’ATALANTE : NB 75 and NB 300 THALASSA : NB75 and BB 150 SUROÎT : BB 150 One Hydrographic Office Ship BEAUTEMPS-BEAUPRE : NB 38 and BB 150

lfremer MAY ICES – MDM 2004, BRUSSELS3 Data transmission Since 2001, standard configuration on the IFREMER vessels Raw data at SISMER at the end of the cruise Errors in the acquisition are detected when processing the data Since 2004, Beautemps-Beaupré transmits ADCP data each day in real time Data are processed at the end of the cruise But errors in the acquisition can be detected on the first file and corrected directly onboard

lfremer MAY ICES – MDM 2004, BRUSSELS4 Processing Software CASCADE developed in IFREMER by the Laboratory of Physical Oceanography (Matlab) 4 steps for the processing : Reformatting raw data into NetCDF Generation of processed files (attitude and time corrections, calculation of terrestrial coordinates, filtering, means) Ground speed calculation Quality checks of the data

lfremer MAY ICES – MDM 2004, BRUSSELS5 Quality checks of the data Flags are attributed to the numerical values automatically and visually (flag 9)

lfremer MAY ICES – MDM 2004, BRUSSELS6 Example of QC Cruise of the BEAUTEMPS- BEAUBRE in the Red Sea, Aden Gulf and Oman Sea Corresponding quality flags for the whole cruise Inconsistent values -> Flag 9

lfremer MAY ICES – MDM 2004, BRUSSELS7 Presentation of the data For one cruise, one or several sections are defined

lfremer MAY ICES – MDM 2004, BRUSSELS8 Images of the sections Section 1, in the Red Sea E/W horizontal current speed component N/S horizontal current speed component Current vertical speed

lfremer MAY ICES – MDM 2004, BRUSSELS9 Whole cruise’s vector plots 0 – 100 m 100 – 300 m

lfremer MAY ICES – MDM 2004, BRUSSELS10 Section’s vector plots Eddies in the superficial water (0-100m and m) Current aligned on the central valley in the deepest part ( m)

lfremer MAY ICES – MDM 2004, BRUSSELS11 Detected errors Errors detected at the beginning of data processing : ADCP time is wrong and cannot be related to the navigation Raw data files are too big to be processed by the software : typically the standard procedure is one raw data file per one day of cruise maximum (12 hours is the optimal size). Errors detected after data processing Strong correlation between current speed and ship velocity Unrealistic current vectors

lfremer MAY ICES – MDM 2004, BRUSSELS12 Example of wrong data (1) Detected with correlation between ship velocity and current speed

lfremer MAY ICES – MDM 2004, BRUSSELS13 Example of wrong data (2) Detected with section’s vector plots

lfremer MAY ICES – MDM 2004, BRUSSELS14 Data distribution Since 2001 : 49 IFREMER cruises (21 processed), 3 SHOM cruises (all processed)

lfremer MAY ICES – MDM 2004, BRUSSELS15 Data volume 52 cruises : Raw data : 49 Gigabytes ~= 1 gigabyte per cruise Data dissemination : between 1 to 100 Mb per cruise

lfremer MAY ICES – MDM 2004, BRUSSELS16 Provinding data One NetCDF file per cruise Date/time, Latitude, Longitude, Depth, N/S, E/W, Vertical current speed, Echo intensity One tar file with figures Section map, images and vector plots of the sections One report Information about data collection Information about the quality checks and the processing procedures Any problem encountered with the data

lfremer MAY ICES – MDM 2004, BRUSSELS17 Conclusive remarks and questions Not fully compliant with MDM guidelines for ADCP: Dissemination format is NetCDF in stead of ASCII There is no international exchange for ADCP data : Is it worth doing one? What about the WDCA ? What do other members do with ADCP shipboard data if they have some ?