International Argo Data Management Team

Slides:



Advertisements
Similar presentations
ADMT10 - Toulouse, 30 Sept 2009 ADMT9 Action 24 “Develop a common method for determining the positions and observation times at DACs”
Advertisements

Groom-gliders data-management workshop Brest, December 2012 Groom gliders data management n In 2012 : vertical profiles from 26 platforms.
Kick-Off Seadatanet – Heraklion – 7-11 June Atlantic and global products C. Coatanoan, F. Gaillard, E. Autret, T. Loubrieu.
Argo Real-time Quality Control Process NOAA/AOML: Y.-H. DANESHZADEH, R. MOLINARI, R. SABINA, C. SCHMID CIMAS/UM: E. FORTEZA, X. XIA, H. YANG.
Argo QC with an emphasis on the North Atlantic Justin Buck British Oceanographic Data Centre Joseph Proudman Building 6 Brownlow Street Liverpool L3 5DA,
10th Argo data management 2009 Toulouse User’s manual comment Here is a list of comments received on User’s manual version 2.2 since August 28 th. Jean-Philippe.
Alphabet Soup: PSS Contribution April 3, 2013 Jamie Wyant |
Argo Status & issues for ADMT Argo TC ADMT#13 November 2012, Hyderabad.
Editing RT QC flag in delayed mode ? Virginie Thierry DMQC 4 Toulouse, 28 septembre 2009.
Zenghong Liu & Jianping Xu State Key Lab of Satellite Ocean Environment Dynamics The Second Institute of Oceanography, SOA GOVST-V , Beijing.
MyOcean2 First Annual Meeting – April 2013 WP 15 THEMATIC & ASSEMBLY CENTRE for In Situ MyOcean2 First Annual Meeting – Cork /16-17 April 2013.
EGO – COST - Groom-gliders Kiel meeting Kiel, June 2014 Data-management activity n Within Groom and with COST support, the glider data- management group.
Argo Status 3000 floats in November 2007 ! Commitments for 2008&2009 seem ok Global array issues QC and delayed mode processing Pressure errors New products.
GROOM Annual meeting Data Management issues Trieste 4-5 June 2013 Quoi de Neuf à Coriolis en 2008 ? GMMC Octobre 2008 S Pouliquen & Coriolis team.
International Argo structure Argo TC M. Belbeoch Accra, Ghana.
Argo workshop in Ghana, December North Atlantic Regional Centre S Pouliquen, V Thierry, C Coatanoan, F Gaillard, PM Poulain & al.
Argo workshop in Ghana, December Argo data status & data access.
2nd GODAE Observing System Evaluation Workshop - June Ocean state estimates from the observations Contributions and complementarities of Argo,
Argo & New Telecom. Systems Technical Workshop Introduction and Summary. ADMT#11 October 2010, Hamburg/Germany.
© Crown copyright Met Office The EN4 dataset of quality controlled ocean temperature and salinity profiles and monthly objective analyses Simon Good.
Silver Spring HRMM Workshop April Global Ocean Surface Underway Data project (GOSUD) Theirry Carval – Coriolis Ifremer Bob Keely – MEDS Thierry.
Developments at the US GDAC ADMT #10 – Toulouse, France 30 September - 2 October 2009 Mark Ignaszewski FNMOC ADMT September – 2 October 2009.
Welcome to SeaDataNet Technical Task Team Meeting + a few basic questions that the co-ordinator expects to get a preliminary answer before the Kick-Off.
An Introduction to the Argo Data Sytem South Pacific Workshop 11 – 14 October 2005 Mark Ignaszewski FNMOC.
The APEX Truncated Negative Pressure Drifts (TNPDs)
Copyright 2010, The World Bank Group. All Rights Reserved. Recommended Tabulations and Dissemination Section B.
The Argo Project: An International Partnership Dean Roemmich, International Argo Steering Team The role of partnerships in: Creating Argo Coordination.
10 th Argo data management 2009 Toulouse What is new at GDACs ?
Global Collecting Centres ETMC-5 Activities of the GCCs Geneva 2015 Activities of the GCCs ETMC-5 22 nd – 25 th June 2015, Geneva, Switzerland.
Summary of issues and conclusions from DMQC-4 1.Pressure Issues, especially Surface pressure offset, Druck microleak, APEXs that truncate negative pressures.
XBT FALL RATE EQUATION WORKSHOP National Oceanic and Atmospheric Administration Atlantic Oceanographic and Meteorological Laboratory, Miami, FL March 10-12,
ACTED Accountability Systems 8 April General Overview ACTED was a member of the Humanitarian Accountability Partnership (HAP) ACTED’s accountability.
GOSUD 5 th meeting Boulder, USA 2-4 May, Status GOSUD Meeting 2-4 May, 2006 Review of progress has been extracted from the Annual Report prepared.
Fall Improvement Team, Veterans Health Unit
L. Carrère, Y. Faugère, E. Bronner, J. Benveniste
Six-Sigma : DMAIC Cycle & Application
Implementing the New JCOMM Marine Climate Data System (MCDS)
WIGOS Data Quality Monitoring System (WDQMS)
GSICS Collaboration Servers a Vehicle for International Collaboration Status 2011 Peter Miu EUMETSAT.
Argo & Google Ocean.
CS 389 – Software Engineering
On the use of the CRC for decoding Argo data
M. Belbéoch, 8 June 2018 Global Argo Status M. Belbéoch,
Status on anomalies detected with altimetry
Enhanced File Consistency Checking
Argo Delayed-Mode Salinity Data
DOM Integration Meeting D. Vivolo - DOM Integration Meeting
Global Argo Data Repository Status Report for 2009
GOCDB current status and plans
Comparisons of Argo profiles and nearby high resolution CTD stations
Suggestion for next steps for PGA for REDD+ in Vietnam

Allocation of Unidentified Gas Statement - Update
Candyce Clark JCOMM Observations Programme Area Coordinator
Chapter 2 – Software Processes
SKADS Controller’s Meeting Timeline Annual Financial Report
Prepared by: Jennifer Saleem Arrigo, Program Manager
Amendment Invoice Task Force Progress Report
GODAE Quality Control Pilot Project
Argo Status Argo TC, M. Belbeoch
Dorothee Coppens.
Present Status of APEX Float Technology
NOAA Objective Sea Surface Salinity Analysis P. Xie, Y. Xue, and A
Amendment Invoice Task Force Progress Report
JCOMM Submitted by: TT-MOWIS (Doc 03b)
CEOS Work Plan Steven Hosford, ESA/CNES, CEO CEOS SIT-34
Support Activities and WG 6 Overview Status Report
Lunar Calibration Workshop Status of the preparation
Best Practices in Higher Education Student Data Warehousing Forum
Argo Information Centre & Argo Users
Presentation transcript:

International Argo Data Management Team S Pouliquen 10th Argo Steering Team meeting Hangzhou 22-23 March 2009 AST10 Hangzhou March 22-23 2009

Current Status: Active Floats by DAC 2009 Compared to 2008 Active Floats: 3 272 (255 on Grey List) + 240 floats( +8 % ) Total Floats: 6 128 (725 on Grey List) +842 floats ( +16 %) 10 Dacs (+ GTS) + 0 Dac AST9 Exeter March 18-20

Current Status: Real-time Distribution 90% within 24 hours GTS problems solved – mostly Most of active floats are processed by DACs and therefore very few GTS only floats =>GTS directory has been removed from official GDAC FTP site. It's only used by AIC to check GTS only floats… BUFR distribution started end 2007 at JMA and MEDS . Most of the Dacs are able to generate BUFR using the tools to transform NetCDF into BUFR provided by JMA and MEDS. DAC BUFR data ate under validation with MEDS AST9 Exeter March 18-20

Data available at GDAC and on GTS AST10 Hangzhou March 22-23 2009

What need to be improved Some bad data still passing through the automatic tests Some improvements were tested in 2008 but result not convincing Perform RT consistency test in near-real time to detect earlier that in DMQC suspicious floats. Better used of Statistical analysis residual at Coriolis Quarterly check against Altimetry Monthly Check against enhanced climatologies Improve the feedback to DACS to allow automatic processing AST9 Exeter March 18-20

Delayed mode processing Total Profiles: over 530 576 (407472 eligible for DMQC) Delayed Mode 269 472 66 % +55% DM profiles compared to 2008 _

Delayed mode processing All teams are making progress but slower then planned as man power insufficient to resume the backlog NB : Argo generates 100 000 profiles per year and the DM Operators process about 100 000 profiles per year More training in some “difficult” areas should be pursued Feedback from DM processing to update on RT flags : Would be useful to have a recommendation from AST for all Dacs to update the RT flags with DM correction The issue of Pressure correction for Apex ; a lot of discussions went on . A method was decided both in RT and DM . Implementation just started but not in all Dacs More in S Riser talk AST9 Exeter March 18-20

Developments Done at GDACS US-GDAC has been moved to NRL-Monterey last December GDAC are stable and working GDAC synchronization : it’s working. Improvement in monitoring and reporting has been done D-File checker under development at US-GDAC _ AST9 Exeter March 18-20

DMQC on trajectory Coriolis (M. Ollitrault and J.P. Rannou) worked on this issue and corrected the Coriolis DAC fleet (PROVOR and APEX) Coriolis started to correct Apex and Solo in collaboration with AOML (feedback was provided to AOML) Decoding problem of the WHOI Solo floats; new decoder written Similar work started with JMA When decoding errors are solved, the floats are working very well Good collaboration between Coriolis and the other DACs Results will be presented by M. Ollitrault/Ifremer at ASW3 meeting AST9 Exeter March 18-20

DMQC on trajectory Lessons learned Metadata files may be incorrect Important to standardized Technical files Simple coherency tests between metadata/profiles/traj/tech files should help detecting some anomalies Progress at national level but missing a leader at the international Argo level on this activity Need feedback from the DMQC of the profiles (pressure and salinity) Need to determine the mandatory data to accurately estimate float trajectory Need to revive the trajectory working group ? A format checker should be derived from the expertise gained by Coriolis to prevent incoherent data to be submitted on GDAC AST9 Exeter March 18-20 10

Decision on how to progress : Reference DB for Argo Decision on how to progress : Provide visibility on what exists Coordinate with NODCs and CCHDO to set up appropriate data flows Develop procedures for yearly updates July 2008 : new version of the Reference DB including WOD2005 and CCHDO/NODC updates was available October 2008 : First ARGO Ref DB issued ADMT9 : first priority Southern Ocean More in S Diggs talk AST9 Exeter March 18-20

Data Format Technical Parameters : a nomenclature was proposed to name the parameters . Has been validated at ADMT9. Implementation is under dev at DACs Gdacs have to accept this new format : USGDAC is updating the format checker All Dacs have to regenerate their tec files Hope to be one in coming months... Issue on how report new parameters measured by floats to be addressed by AST, AST9 Exeter March 18-20

Argo Regional Centers Argo Regional Centers Developing at very different rates Lack of scientific man power on the Data consistency issue which is not as trivial as expected even if some ARC are started some activities especially to detect suspicious floats. More dev on product generation ( Catalogue started at AST level) No ARC coordination presently Funding and Man power remains an issue… AST9 Exeter March 18-20

ADMT The group is dynamic and very responsive at the ADMT meeting Difficulties between meetings to make progress on the actions Lack of man power at GDAC and DAC level Reprocessing is expensive AST10 Hangzhou March 22-23 2009

Messages to AST RT processing is automatic and bad data are passing through: important to get tools to detect bad data in the Argo dataset earlier than DMQC There are still bad flagging/data in DM files and it’s urgent to review the DM dataset… Moreover some training on the method is needed Need a leader who can dedicate significant time on trajectory data to steer the work Man power is an issue in data management and must be taken into account while setting priorities AST9 Exeter March 18-20