Annual Meeting, June 15-16 2015, Istanbul, Turkey WP2: Data aggregation and products generation in the Atlantic Sea: results and criticalities EMODnet.

Slides:



Advertisements
Similar presentations
WP1 - Data collection and metadata compilation in sea regions Sissy Iona (HCMR/HNODC) EMODNET Chemistry th Steering Committee, 2-3 December 2014,
Advertisements

EDMODnet Chemistry - DIVA Products from the Baltic Region Örjan Bäck, Lotta Fyrberg, Martin Hansson, Magnus Wenzer Swedish Meteorological and Hydrological.
Status of advanced access and viewing services following SeaDataNet D5.6 and D8.7 By Dick M.A. Schaap – Technical Coordinator Barcelona – Spain, 19 – 20.
WP2: Data products generation in Mediterranean Sea EMODNET Chemistry Data Products, Experts Workshop Split (Croatia), June 2014 Sissy Iona, HCMR-HNODC.
Marine Data Management within EMODNet Chemistry project: data aggregation, quality control and products preparation A.S. Iona 1, P. Karagevrekis 1, S.Balopoulou.
WP1: Data collection and metadata compilation in Mediterranean Sea EMODNET Chemistry 2, Kick-off meeting Trieste (Italy), 3-5 June 2013 Sissy Iona, HCMR-HNODC.
EMODnet Chemistry 2 Advanced services Progress by Deltares Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Istanbul.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
EMODNET Chemistry 2 Kick-off meeting Trieste (Italy), 3-5 June 2013 WP 1 : DATA COLLECTION AND METADATA COMPILATION IN ATLANTIC SEA.
EMODnet Chemistry 2: administrative issues, results and scheduling Alessandra Giorgetti, Lipizer Marina, Vinci Matteo, Alessandro Altenburger and Alberto.
Questionnaire based on ISO/IEC 17025: Data and Metadata QA/QC EMODNet Chemistry collects data and a complete set of metadata, including information.
4 th steering committee Amsterdam, Netherlands 2-3 December 2014 DATA QC AND PRODUCTS ON ATLANTIC AREA With IFREMER, RIHMI-WDC, IHPT and IEO contributions.
1 st year meeting SPLIT, Croatia June 2014 REPORT ON ATLANTIC AREA With IFREMER, RIHMI-WDC, IHPT and IEO contributions.
EMODNet Chemistry (MARE/2012/10) 1 st Expert Meeting introduction June 2014 Split, Croatia Matteo Vinci and Alessandra Giorgetti OGS, Trieste.
QC/QA and Diva Products in Mediterranean Sea EMODNET Chemistry 2 Meeting on ODV QC and Diva Products Ifremer Headquarter, Paris, 3 September 2014 Sissy.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Expertsmeeting SPLIT, Croatia June 2014 REPORT ON ATLANTIC AREA With IFREMER, RIHMI-WDC, IHPT and IEO contributions.
Emodnet Chemistry Lot Guidelines for data products.
From Emodnet Chemical Pilot to Emodnet Chemistry 2 Matteo Vinci and Alessandra Giorgetti, – OGS – NODC group, OCE - MODEG meeting, Copenhagen, 4 and 5.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Split, Croatia WP1: Data collection and metadata compilation in sea regions EMODnet Chemistry Partner contribution: PANGAEA.
EDMODnet Chemistry - DIVA Products from the Baltic Region Örjan Bäck, Lotta Fyrberg, Martin Hansson, Magnus Wenzer Swedish Meteorological and Hydrological.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Split, Croatia WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
EMODnet Chemistry 2 Service Contract MARE/2012/10 S How to make EMODnet Chemistry fit for purpose at system level By Dick M.A. Schaap – Technical.
EMODnet Chemistry: Next steps in the coming two years Alessandra Giorgetti (OGS, Italy) EMODNet Chemistry – First Expert Workshop, 19 June 2014.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner contribution: NIOZ Royal Netherlands Institute for.
EMODnet Chemistry 2 Technical progress and new challenges Service Contract MARE/2012/10 S By Dick M.A. Schaap – Technical Coordinator Venice,
EMODNet Chemistry (MARE/2012/10). The portal should collect the following groups of chemicals: - in 3 matrices: water column, biota, sediment. - in all.
EMODnet Chemistry Partner contribution: RIHMI-WDC 2-nd annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry Partner.
IMS-METU Annual Meeting, June , Istanbul, Turkey WP1: Data collection and metadata compilation in sea regions: current status EMODnet Chemistry.
The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.
Reiner Schlitzer Alfred Wegener Institute for Polar and Marine Research Ocean Data View Achievements and Future Developments.
EDMODnet Chemistry, Baltic Sea - Oxygen, Chlorophyll and contaminants - General issues Magnus Wenzer, Lotta Fyrberg, Örjan Bäck Swedish Meteorological.
DATA AGGREGATION AND PRODUCTS GENERATION
Partner contribution: IOF, Split Croatia
Partner contribution:
Data aggregation and products generation in the Mediterranean Sea
Using Ocean Data View for EMODnet Chemistry Reiner Schlitzer
EMODnet Chemistry WP2: Data aggregation and products generation
WP3: Data aggregation and products generation NE Atlantic Sea
Meeting on ODV QC and DIVA Products
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: IMGW OM – Wlodzimierz Krzyminski.
Partner contribution: SYKE
WP2 Products in Mediterranean Sea
Dick M.A. Schaap – Technical Coordinator SeaDataNet Training Workshop
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner 40: State Oceanographic Institute Alexander Korshenko,
Data aggregation and products generation
Data aggregation and products generation in the Mediterranean Sea
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: ISPRA Annual Meeting, June ,
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Latvian Institute of Aquatic Ecology.
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Institute of Marine Science and Management, Istanbul University.
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: Marine Hydrophysical Institute Annual.
EUTROPHICATION – NE ATLANTIC
Generation of data products in the Norwegian and Barents Seas
EMODnet Chemistry contribution to data publication
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: data delivery Annual Meeting, June.
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: IHPT, Portugal Annual Meeting, June.
Steering Committee Meeting Amsterdam, Dec 2014
Generation of data products in the Mediterranean Sea
EMODnet Chemistry WP1: Data collection and metadata compilation in sea regions: current status Partner contribution: NEA Partner’s logo Annual Meeting,
Presentation transcript:

Annual Meeting, June , Istanbul, Turkey WP2: Data aggregation and products generation in the Atlantic Sea: results and criticalities EMODnet Chemistry With IFREMER, IEO, IHPT and RIHMI ‐ WDC contributions

Annual Meeting, June , Istanbul, Turkey Outline Data inventory of the second harvesting Data aggregation / validation phase : issues and solutions Regional data buffer : space and time distribution by parameter DIVA maps production

3/15 Data collected by MARIS robot (28/10/2014) : Data inventory (1) CDI type Vertical profiles Time Series Total New CDIS Updated CDIs Old CDIs Total Annual Meeting, June , Istanbul, Turkey

4/15 Data collected by MARIS robot (28/10/2014) : Data inventory (1) CDI type Vertical profiles Time Series Total New CDIS Updated CDIs Old CDIs Total More than twice the first harvesting ! Annual Meeting, June , Istanbul, Turkey

5/15 First harvesting Data inventory (2) Second harvesting Old Updated New Enlarged data coverage Annual Meeting, June , Istanbul, Turkey

6/15 Distribution by partners Annual Meeting, June , Istanbul, Turkey CDI type IEOIfremerIHPT RIHMI- NODC IMRUniHB New CDIs Updat ed CDIs Old CDIs Total Data inventory (3)

7/15 Annual Meeting, June , Istanbul, Turkey CDI typeIEOIfremerIHPT RIHMI- NODC IMRUniHB New CDIs Updated CDIs Old CDIs Total Data inventory (3) Distribution by partners

8/15 2 nd harvesting CDI type PhosAmonSilicateNox New CDIs Updated CDIs Old CDIs Total Annual Meeting, June , Istanbul, Turkey Distribution by parameters Data inventory (4)

9/15 Use only data with Quality Flag = 0, 1, 2, 6 as initial collection to use only good data Unit conversion and aggregation (P35 vocabs):  mol/l Deletion of empty lines in a station : some levels with no measurements for the parameter Deletion of lines with negative depth (incorrect missing value) Perform QC with ODV  Search for out of “broad range” values with Flag = 1  Set a QC for all measurements with Flag = 0  Set default values with Flag = 0, 1 to Flag = 9  Deal with Flag 6 and zero values Write a report on QC and send results to MARIS and data providers Quality Checks - common rules Annual Meeting, June , Istanbul, Turkey Data aggregation and QC

10/15 Quality checks – problems faced Problem of unit conversion : ug/l to umol/l  e.g. reload russian data and some spanish data Problem in CDI updating  e.g.high spanish Phosphate to delete Some of the reported errors to data centres have not been corrected :  we cannot just import the new collection in the collection built up after the first harvesting.  We have to re-make the whole QC work. Annual Meeting, June , Istanbul, Turkey Data aggregation and QC

11/15 Annual Meeting, June , Istanbul, Turkey Data aggregation and QC  5 Aggregated Data Collection Qced produced and sent to MARIS : -Phosphate : Global_PHOS_collection.txt -Ammonium : Global_AMON_collection.txt -Nox : Global_NOX_collection.txt -Silicate : Global_SLCA_collection.txt -Timeseries of these 4 parameters : Global_nutrients_TS_CDIs.txt

12/15 Perform QC with ODV  Search for out of range values with Flag = 1  Set a QC for all measurements with Flag = 0  Set default values with Flag = 0, 1 to Flag = 9  Deal with Flag 6 and zero values Annual Meeting, June , Istanbul, Turkey Data aggregation and QC Annual Meeting, June , Istanbul, Turkey

13/15 Flag value PHOS Before QC PHOS after QC total Annual Meeting, June , Istanbul, Turkey Data aggregation and QC Perform QC on New Phosphate with ODV  Search for out of range values with Flag = 1  Set a QC for all measurements with Flag = 0  Set default values with Flag = 0, 1 to Flag = 9  Deal with Flag 6 and zero values

14/15 Regional data buffer Annual Meeting, June , Istanbul, Turkey Phosphate data a) Station map d) Data bins e) X/Y distributionf) Season histogram b) Vertical plot c) Time histogram

15/15 Nox data a) Station map d) Data binse) X/Y distributionf) Season histogram b) Vertical plot c) Time histogram Annual Meeting, June , Istanbul, Turkey Regional data buffer

16/15 Annual Meeting, June , Istanbul, Turkey Silicate data a) Station map d) Data binse) X/Y distributionf) Season histogram b) Vertical plot c) Time histogram Regional data buffer

17/15 Annual Meeting, June , Istanbul, Turkey Regional data buffer Ammonium data a) Station map d) Data binse) X/Y distributionf) Season histogram b) Vertical plot c) Time histogram

18/15 Annual Meeting, June , Istanbul, Turkey DIVA maps production DIVA maps settings : settingsAtlantic area DIVA version weighting patch Time period10-years running periods with yearly step for the 4 seasons Time range Seasonswinter (0103), spring (0406), summer (0709), autumn (1012) Vertical layersIODE standards (33 levels) parametersPO4, SiO4, Nox

19/15 Annual Meeting, June , Istanbul, Turkey Problems faced : Some difficulties in installing DIVA on a Window PC via cygwin : inconsistencies between netcdf and gfortran librairies Handle the different steps to produce an analyse Optimizing the parameter estimation:  Do not run on the 46 periods – 4 seasons  chose a decade with high coverage  Some SN profiles very noisy  test binning and weighting options Very long time-consuming runs  reduce the space and time resolution Pb of generation of the big 4D netcdf file from the 3D files DIVA maps production

20/15 Annual Meeting, June , Istanbul, Turkey DIVA maps production Phosphate at surface (0m) – summer (0709) DIVA – 2005/2014 WOA – 1955/2012

21/15 Annual Meeting, June , Istanbul, Turkey DIVA maps production Phosphate at surface (0m) – summer (0709) DIVA 2005/2014 Data bins

22/15 Annual Meeting, June , Istanbul, Turkey DIVA maps production Silicate at surface (0m) – summer (0709) DIVA 2002/2011 WOA – 1955/2012

23/15 Annual Meeting, June , Istanbul, Turkey DIVA maps production Silicate at surface (0m) – summer (0709) DIVA 2002/2011 Data bins

Annual Meeting, June , Istanbul, Turkey Planning for the next weeks Data extraction (and weighting) Parameters optimization Run analysis Internal expert validation of products Phosphate Silicate Nox  DIVA maps production 4D Netcdf files ready

Annual Meeting, June , Istanbul, Turkey Planning for the next weeks Data extraction (and weighting) Parameters optimization Run analysis Internal expert validation of products Phosphate Silicate Nox If needed  DIVA maps production 4D Netcdf files ready

Annual Meeting, June , Istanbul, Turkey Planning for the next weeks Data extraction (and weighting) Parameters optimization Run analysis Internal expert validation of products Phosphate Silicate Nox If needed  DIVA maps production  Work with other parameters : oxygen, chlorophylle, … 4D Netcdf files ready

Thanks! Annual Meeting, June , Istanbul, Turkey