Data aggregation and products generation EMODnet Chemistry 3 – Annual meeting February 2018 Roskilde, Denmark EUTROPHICATION Data aggregation and products generation NE Atlantic Sea Julie GATTI IFREMER

Outline 1st data Harvesting description QC workflow Check Format Check duplicates Data aggregation Aggregated collection Data QF status on-going Data QC High frequency data Next steps / Perspectives Roskilde, February 2018

1st data Harvesting: Eutrophication NE Atlantic region : MSFD definition (red) + MARIS polygon (blue) North limit : paralell 48°N West limit : 42°18’W Gibraltar strait : meridian line 5°55’W Roskilde, February 2018

1st data Harvesting: Eutrophication NE Atlantic region : 39.789 CDIs -> 38.876 CDIs without sediment data +34% EMODnet 2 Roskilde, February 2018

1st data Harvesting: Eutrophication Distribution by partners : 12 EDMOs with 1 new (MI)! 3.512 1 3 10.081 283 10.715 2.087 12 11.518 54 279 331 38.876 Roskilde, February 2018

1st data Harvesting: Eutrophication Vertical Profiles (VP) and Time Series (TS) VP TS Coastal monitoring BUT : -> underestimation of TS : how repeated VP have been defined in CDIs? -> overestimation of VP : trajectories of 1 measurement (surface underway data) Roskilde, February 2018

QC workflow : 1- Check format 1st step of QC : check format of ODV files SDN import in ODV 5.0.0 beta version Check format with OCTOPUS https://www.seadatanet.org/Software/OCTOPUS Errors in ODV files / CDIs No usable data found Wrong LOCAL_CDI_ID or EDMO code Errors in ODV-SDN format Extra character separator Wrong semantic in SDN mapping for units Missing values incorrectly coded -> flag 4 or 1 Warnings Date precision lower than ISO pattern SDN vocabularies version (Invalid P011/P061) Wrong SDN reference xlink Roskilde, February 2018

QC workflow : 1- Check format Warning on Date/Time format Octopus warning: Input: After ODV import and ODV spreadsheet export: -> Correction to do : 1961-05-19T22 into 1961-05-19T22:00:00.000 We loose time information ! Roskilde, February 2018

QC workflow: 2- Check duplicates 12 Duplicates in CANIGO Leg 2 1997 cruise between MI (396) and IEO (353) IEO MI PRES [decibar=10000 pascals] Pressure [dbar] TEMP [Celsius degree] SeaTemperature [degC] PSAL [P.S.U.] Salinity [dimensionless] 1.0 5 22.8354 36.9685 2.1 6 23.1459 36.6928 3.1 7 23.2518 36.6012 4.2 8 23.2192 36.6335 5.2 9 23.2232 36.6331 6.2 10 7.3 11 23.2233 8.3 12 23.2250 23.225 9.4 13 36.6330 36.633 10.4 14 23.2240 23.224 36.6328 11.5 15 23.2230 23.223 36.6327 12.5 16 23.2222 36.6308 13.5 17 23.1997 14.6 18 23.1665 36.6372 15.6 19 23.1336 36.6414 16.7 20 23.1337 36.6483 17.7 21 23.0888 36.6457 18.7 22 23.0292 36.6356 19.8 23 22.9550 22.955 36.6315 20.8 24 22.8739 36.6303 21.9 25 22.7928 36.6291 22.9 26 22.7682 36.6293 24.0 27 22.7453 36.6295 25.0 28 22.7551 36.6338 26.0 29 22.6984 36.6230 36.623 Depth shift 4dbar Same metadata (location) Same data Roskilde, February 2018

QC workflow: 2- Check duplicates List of the12 Duplicates in CANIGO Leg 2 1997 to discuss Cruise Station LOCAL_CDI_ID CDI-record id EDMO_code THALASSA LEG2 (CANIGO) 90 SI2919970023200090_353_H10 477067 353 CANIGO 0997 Leg 2 CTD profile from RV Thalassa, CANIGO 0997 Leg 2, Station 9, Cast ca01d009 Thalassa_CANIGO_0997_Leg_2_9579 2484659 396 110 SI2919970023200110_353_H10 477069 CTD profile from RV Thalassa, CANIGO 0997 Leg 2, Station 11, Cast ca01d011 Thalassa_CANIGO_0997_Leg_2_9581 2477240 290 SI2919970023200290_353_H10 477087 CTD profile from RV Thalassa, CANIGO 0997 Leg 2, Station 29, Cast ca01d029 Thalassa_CANIGO_0997_Leg_2_9599 2481994 340 SI2919970023200340_353_H10 477092 CTD profile from RV Thalassa, CANIGO 0997 Leg 2, Station 34, Cast ca01d034 Thalassa_CANIGO_0997_Leg_2_9604 2478461 460 SI2919970023200460_353_H10 477104 CTD profile from RV Thalassa, CANIGO 0997 Leg 2, Station 46, Cast ca01d046 Thalassa_CANIGO_0997_Leg_2_9616 2482600 870 SI2919970023200870_353_H10 477145 CTD profile from RV Thalassa, CANIGO 0997 Leg 2, Station 87, Cast ca01d087 Thalassa_CANIGO_0997_Leg_2_9657 2482989 1670 SI2919970023201670_353_H10 477219 CTD profile from RV Thalassa, CANIGO 0997 Leg 2, Station 167, Cast ca01d167 Thalassa_CANIGO_0997_Leg_2_9730 2482569 1730 SI2919970023201730_353_H10 477225 CTD profile from RV Thalassa, CANIGO 0997 Leg 2, Station 173, Cast ca01d173 Thalassa_CANIGO_0997_Leg_2_9736 2481977 2090 SI2919970023202090_353_H10 477239 CTD profile from RV Thalassa, CANIGO 0997 Leg 2, Station 209, Cast ca01d209 Thalassa_CANIGO_0997_Leg_2_9750 2485924 2140 SI2919970023202140_353_H10 477244 CTD profile from RV Thalassa, CANIGO 0997 Leg 2, Station 214, Cast ca01d214 Thalassa_CANIGO_0997_Leg_2_9755 2485119 CTD profile from RV Thalassa, CANIGO 0997 Leg 2, Station 65, Cast ca01d065 Thalassa_CANIGO_0997_Leg_2_9635 2478315 2486341 CTD profile from RV Thalassa, CANIGO 0997 Leg 2, Station 142, Cast ca01d142 Thalassa_CANIGO_0997_Leg_2_9709 2479749 2477287 Roskilde, February 2018

QC workflow : 3- data aggregation : Depth&Pres and P35 3 collections for vertical profiles: Ocean_depth_profiles Ocean_depth_profiles(1) Ocean_pressure_profiles 1 collection for time series: aggregated_time_series.odv P35 aggregation – check unmapped P01: Add Unit conversion Add P01/P35 mapping Other errors in format detected 1 collection : Aggregated_ocean_ALL_depth_profiles.odv Roskilde, February 2018

Aggregated collection Distribution by parameters Roskilde, February 2018

Data QF Nutrients and organic matter Status before QC Roskilde, February 2018

Data QF Chlorophyll pigment Status before QC Roskilde, February 2018

Data QF Oxygen and others Status before QC Roskilde, February 2018

Data QC – on going Phosphate example : High river mouth vatlue Zero values : flag 6 or 9? Out of range Roskilde, February 2018

Data QC – on going Oxygen example : Pb of unit/conversion ARGO data not yet validated in DM Roskilde, February 2018

High frequency data: Undulating/towed data and Underway surface data TH1099 cruise – Towed CTD: 1s sampling Mixed data JC025 cruise : scanfish data: 2s sampling DIVA maps JR20000412 cruise : CTD+TSGdata: 60s sampling Roskilde, February 2018

Next steps / Perspectives Data aggregation Finish the QC Send a report to the Atlantic partners Study the spatio-temporal distribution of each parameter DIVA maps DIVA workshop : how to use DIVAnd Update the Eutrophication maps Identify coastal areas near major river mouths to generate higher resolution DIVA maps Roskilde, February 2018

Thank you!