Annual Meeting, June , Istanbul, Turkey WP2: Data aggregation and products generation in the Atlantic Sea: results and criticalities EMODnet Chemistry With IFREMER, IEO, IHPT and RIHMI ‐ WDC contributions
Annual Meeting, June , Istanbul, Turkey Outline Data inventory of the second harvesting Data aggregation / validation phase : issues and solutions Regional data buffer : space and time distribution by parameter DIVA maps production
3/15 Data collected by MARIS robot (28/10/2014) : Data inventory (1) CDI type Vertical profiles Time Series Total New CDIS Updated CDIs Old CDIs Total Annual Meeting, June , Istanbul, Turkey
4/15 Data collected by MARIS robot (28/10/2014) : Data inventory (1) CDI type Vertical profiles Time Series Total New CDIS Updated CDIs Old CDIs Total More than twice the first harvesting ! Annual Meeting, June , Istanbul, Turkey
5/15 First harvesting Data inventory (2) Second harvesting Old Updated New Enlarged data coverage Annual Meeting, June , Istanbul, Turkey
6/15 Distribution by partners Annual Meeting, June , Istanbul, Turkey CDI type IEOIfremerIHPT RIHMI- NODC IMRUniHB New CDIs Updat ed CDIs Old CDIs Total Data inventory (3)
7/15 Annual Meeting, June , Istanbul, Turkey CDI typeIEOIfremerIHPT RIHMI- NODC IMRUniHB New CDIs Updated CDIs Old CDIs Total Data inventory (3) Distribution by partners
8/15 2 nd harvesting CDI type PhosAmonSilicateNox New CDIs Updated CDIs Old CDIs Total Annual Meeting, June , Istanbul, Turkey Distribution by parameters Data inventory (4)
9/15 Use only data with Quality Flag = 0, 1, 2, 6 as initial collection to use only good data Unit conversion and aggregation (P35 vocabs): mol/l Deletion of empty lines in a station : some levels with no measurements for the parameter Deletion of lines with negative depth (incorrect missing value) Perform QC with ODV Search for out of “broad range” values with Flag = 1 Set a QC for all measurements with Flag = 0 Set default values with Flag = 0, 1 to Flag = 9 Deal with Flag 6 and zero values Write a report on QC and send results to MARIS and data providers Quality Checks - common rules Annual Meeting, June , Istanbul, Turkey Data aggregation and QC
10/15 Quality checks – problems faced Problem of unit conversion : ug/l to umol/l e.g. reload russian data and some spanish data Problem in CDI updating e.g.high spanish Phosphate to delete Some of the reported errors to data centres have not been corrected : we cannot just import the new collection in the collection built up after the first harvesting. We have to re-make the whole QC work. Annual Meeting, June , Istanbul, Turkey Data aggregation and QC
11/15 Annual Meeting, June , Istanbul, Turkey Data aggregation and QC 5 Aggregated Data Collection Qced produced and sent to MARIS : -Phosphate : Global_PHOS_collection.txt -Ammonium : Global_AMON_collection.txt -Nox : Global_NOX_collection.txt -Silicate : Global_SLCA_collection.txt -Timeseries of these 4 parameters : Global_nutrients_TS_CDIs.txt
12/15 Perform QC with ODV Search for out of range values with Flag = 1 Set a QC for all measurements with Flag = 0 Set default values with Flag = 0, 1 to Flag = 9 Deal with Flag 6 and zero values Annual Meeting, June , Istanbul, Turkey Data aggregation and QC Annual Meeting, June , Istanbul, Turkey
13/15 Flag value PHOS Before QC PHOS after QC total Annual Meeting, June , Istanbul, Turkey Data aggregation and QC Perform QC on New Phosphate with ODV Search for out of range values with Flag = 1 Set a QC for all measurements with Flag = 0 Set default values with Flag = 0, 1 to Flag = 9 Deal with Flag 6 and zero values
14/15 Regional data buffer Annual Meeting, June , Istanbul, Turkey Phosphate data a) Station map d) Data bins e) X/Y distributionf) Season histogram b) Vertical plot c) Time histogram
15/15 Nox data a) Station map d) Data binse) X/Y distributionf) Season histogram b) Vertical plot c) Time histogram Annual Meeting, June , Istanbul, Turkey Regional data buffer
16/15 Annual Meeting, June , Istanbul, Turkey Silicate data a) Station map d) Data binse) X/Y distributionf) Season histogram b) Vertical plot c) Time histogram Regional data buffer
17/15 Annual Meeting, June , Istanbul, Turkey Regional data buffer Ammonium data a) Station map d) Data binse) X/Y distributionf) Season histogram b) Vertical plot c) Time histogram
18/15 Annual Meeting, June , Istanbul, Turkey DIVA maps production DIVA maps settings : settingsAtlantic area DIVA version weighting patch Time period10-years running periods with yearly step for the 4 seasons Time range Seasonswinter (0103), spring (0406), summer (0709), autumn (1012) Vertical layersIODE standards (33 levels) parametersPO4, SiO4, Nox
19/15 Annual Meeting, June , Istanbul, Turkey Problems faced : Some difficulties in installing DIVA on a Window PC via cygwin : inconsistencies between netcdf and gfortran librairies Handle the different steps to produce an analyse Optimizing the parameter estimation: Do not run on the 46 periods – 4 seasons chose a decade with high coverage Some SN profiles very noisy test binning and weighting options Very long time-consuming runs reduce the space and time resolution Pb of generation of the big 4D netcdf file from the 3D files DIVA maps production
20/15 Annual Meeting, June , Istanbul, Turkey DIVA maps production Phosphate at surface (0m) – summer (0709) DIVA – 2005/2014 WOA – 1955/2012
21/15 Annual Meeting, June , Istanbul, Turkey DIVA maps production Phosphate at surface (0m) – summer (0709) DIVA 2005/2014 Data bins
22/15 Annual Meeting, June , Istanbul, Turkey DIVA maps production Silicate at surface (0m) – summer (0709) DIVA 2002/2011 WOA – 1955/2012
23/15 Annual Meeting, June , Istanbul, Turkey DIVA maps production Silicate at surface (0m) – summer (0709) DIVA 2002/2011 Data bins
Annual Meeting, June , Istanbul, Turkey Planning for the next weeks Data extraction (and weighting) Parameters optimization Run analysis Internal expert validation of products Phosphate Silicate Nox DIVA maps production 4D Netcdf files ready
Annual Meeting, June , Istanbul, Turkey Planning for the next weeks Data extraction (and weighting) Parameters optimization Run analysis Internal expert validation of products Phosphate Silicate Nox If needed DIVA maps production 4D Netcdf files ready
Annual Meeting, June , Istanbul, Turkey Planning for the next weeks Data extraction (and weighting) Parameters optimization Run analysis Internal expert validation of products Phosphate Silicate Nox If needed DIVA maps production Work with other parameters : oxygen, chlorophylle, … 4D Netcdf files ready
Thanks! Annual Meeting, June , Istanbul, Turkey