Data aggregation and products generation in the Mediterranean Sea EMODnet Chemistry 3, Kick-Off Meeting, Trieste, Italy, 16-19 May 2017 Data aggregation and products generation in the Mediterranean Sea Sissy Iona, HCMR-HNODC
Outline Progress so far (EMODnet Chemistry 2, 2013-2016) Fertilizers, Chl-a, Oxygen Contaminants Next activities (EMODnet Chemistry 3, 2017-2019+2)
Data aggregation and products generation in Mediterranean Sea The activity included 4 steps: data harvesting by a robot harvester system and delivery to regional leaders regional data aggregation including parameter harmonisation (using ODV) regional quality control using and data validation (using ODV) development of regional data products (using DIVA), create metadata for products discovery
Regional data harvesting April 2014 => nutrients October 2014 => completed the 1st harvest nutrients, with additional data and metadata March 2016 => contaminants, Oxygen, Chl-a Harvests Nb of stations (CDIs) April 2014 29 583 October 2014 34 321 March 2016 96 349 Totals: 160253
22 Data Providers, 17 countries (80 data originators)
Data Aggregation & harmonization The ODV software was used for the automate parameter aggregation of data sets from the multiple sources e.g. more than 15 parameter codes for seawater dissolved oxygen in common use due to different units, collection methods, names, etc
Quality Controls Observations (fertilizers, Chl-a, Oxygen) Broad range control checks: High values Default not null values Negatives were excluded Zero values Duplications checks Comparison of each profile with a spatially averaged profiles, values outside the “mean ± 3 stdev” were rejected
An example of QC on Oxygen Wrong units
Feedback loop with data providers All corrections done to the data (mainly to flags) and metadata were sent to data providers in order to update their local data sets : improve Mediterranean data (both at local and regional level) Avoid doing the same errors at regional level at the next cycle of harvesting
Feedback loop with data providers All corrections done to the data (mainly to flags) and metadata were sent to data providers in order to update their local data sets : improve Mediterranean data (both at local and regional level) Avoid doing the same errors at regional level at the next cycle of harvesting Don’t forget to correct your files when you are notified to do so
Inventory – aggregated data distributions 27 894 profiles 7 628 profiles 21 875 profiles 23 101 profiles 5 393 profiles
Inventory – aggregated data distributions 14 563 profiles 5 623 profiles 23 102profiles 74 562 profiles 23 105 profiles
horizontal interpolation Analysis settings based on data distributions and project needs: Seasons for Mediterranean: 0103, 0406, 0709, 1012 Time frame: 10-years running averages Vertical resolution: IODE standards depths Correlation length: averaged seasonal profiles (depending on data distributions) S/N=3 (constant in all depths) Mean of values as background field Both open sea profiles and coastal monitoring stations (time series) were used and applied data weighting both to profiles and to time series (to reduce the influence of close measurements) Logarithmic transformation applied to the data prior to the analysis to avoid negative results
products Parameter Years Seasons Depth interval Phosphates 1960 - 2013 4 0 - 1500 Total P 1984 - 2007 0 - 1000 Nitrates Nitrites 1965 - 2013 Nitrate+Nitite 1986 - 2013 Ammonium 1977 - 2013 Total N 1990 - 2004 Silicates Oxygen 1971 – 2013 0 - 2500 Chl-a 1972 - 2013
Horizontal distribution Water depth (m): surface 5 10 20 30
Products on Ocean browser service 1980 1990 a b Spring surface distribution of phosphate (µmol/l) for the decades 1975-1984 (a), 1985-1994 (b), 1995- 2004 (c), and 2004-2013 (d). 10-year running mean centred on the year indicated 2000 2009 c d
Influence of coastal data and river inputs
Influence of coastal data and river inputs Usage of variable Correlation Length depending on the depth in the next updates
Contaminants, 3rd harvest, Mar. 2016 6718 CDIs received (3rd harvest Mar.2016) With 1065 user parameters names, 935 P01 terms 6178 CDIs imported successfully at ODV format problems, wrong extensions, wrong primary variable, empty files 5878 CDIS aggregated at 220 P35 terms as priority variables according to the EMODnet Chemistry aggregations rules*, Oct. 2016 Nb of CDIs Water column Biota Sediment Totals 4 483 329 5 380 *(www.emodnet-chemistry.eu/default/products/documents/EMODnet_Chemistry_AggregationRules.pdf)
Contaminants distribution (water, sediment, biota)
Contaminants - Summaries in Mediterranean
Contaminants - Summaries in Mediterranean
Contaminants distributions
Contaminants distributions
Contaminants distributions
Next Activities Regional leaders, under WP3: Generation of data products WP 3.1: Generating harmonised, aggregated and validated data collections and DIVA maps of eutrophication (M14) WP 3.2: Generating harmonised, aggregated and validated data collections and DIVA maps on contaminants (M20) WP 3.3: Generating validated data collections and maps for marine litter and beach litter (M12)
Next Activities Partners (start from M1) and as a follow up of this training: overview/correct the present CDIs for possible inconsistencies add extra info about qa-qc processes, laboratory methods, include info if it is from a monitoring activity and don’t forget to include also CSR references populate more nutrients, contaminants, oxygen, chlorophyll data and the new type: marine litter