EC-Marine Science & Technology Programme 03/06/201527/10/98 1 IODE-XVI Lisbon, 30 October – 9 November 2000 MAST/MEDAR-MEDATLAS Mediterranean Data Archaeology and Rescue of Temperature, Salinity and Bio-chemical Parameters (MAS3-CT /ERBIC20-CT ) MEDAR Group presented by Catherine MAILLARD, project coordinator, IFREMER/SISMER

2 25/08/00 MEDAR GROUP IFREMER/SISMER Brest, France IEO Madrid, Spain UL/GHER Liège, Belgium ICES Copenhaguen, Dk INRH/DOTM Casablanca, Morocco ISMAL Alger, Algeria NCMR/HNODC Athens, Hellas TN/DNHO Istanbul, Turkey NIMH Sofia, Bulgaria IOC Paris, France UM-PO Msida, Malta RIHMI-WDC Obninsk, Russia MHI/MIST Sevastopol, Ukraine NIOF/ENODC Alexandria, Egypt FD-MANRE/CyNODC Nicosia, Cyprus NCSR-NCMS Batroun, Lebanon IOLR Haifa, Israel ENEA La Spezia, Italy OGS Trieste, Italy CNR/IMGA Bologne, Italy Collaborations and Scientific Advisers : GODAR Project - WDC-A, NODC-Croatia, Tunisia, Georgia EUROGOOS, IODE Network

3 25/08/00 Project History and Context  UNESCO/IOC/IODE : International Oceanographic Data & Information Exchange ä1993 : Global Oceanographic Data Archaeology and Rescue Project (GODAR) launched April 1995 : GODAR IV - IOC-ICSU-CEC Regional Workshop for Member States of the Mediterranean, Malta. UNESCO-IOC Report No 110 äDec 1996 : Mediterranean Data Archaeology and Rescue of temperature, salinity and bio-chemical parameter (MEDAR), officially endorsed by IOC äMay 1997 : Joint IOC, EC/MAST and Turkish Data Centre MEDAR/MEDATLAS Meeting, Istanbul. IOC/INF-1084 summary report  EC/MAST : Marine Science and Technology Programme äMODB (MAS2-CT , ) äMEDATLAS Pilot Project (MAS2-CT , ) äMEDAR/MEDATLAS II project submitted for a MAST/INCO Concerted action in June 1997, accepted for a 3-year support period December 1998 to 2001 äMarch 1999 : Kick-off Meeting in Paris

4 25/08/00 Questions Asked and Needs  Managing living and non-living resources, monitoring environmental changes in the sea and protecting the marine environment, require long time series of observations of: Dissolved Oxygen: low oxygen levels in the upper layers, can result in reduction of higher life forms, release of toxic forms of metals and pathology in living organisms. Nutrients: changes in nutrient fluxes can alter primary production and bio-diversity, and can directly affect aquaculture and fishing activity. Temperature and Salinity: are the primary indicators of climate change and allow the computation of other derived parameters such as density, sound velocity, and geostrophic current, widely used in scientific and technical studies.  The need for marine database and appropriate data management is particularly crucial in the Mediterranean and Black Sea : for environmental studies, for qualification of new data that requires statistics of expected values, for initialisation and qualification of numerical models  When the project started, not all of the data collected by the scientific laboratories of the bordering countries were inventoried and safeguarded. Data never archived in a public data bank are in danger of being lost. Studies show that without appropriate safeguarding, about 30% of them will be lost within 10 years. Data collected in variable environment cannot be remade.

5 25/08/00 Cyprus FD-MANRE Inventory Observed data Task V : QA Assesments > ICES ENEA, IMGA-CNR, IOC Data products Climatological Data MANAGEMENT Advisory GroupSteering Committee Co-ordinator EU/MAST Representative > IFREMER Task I : Data Rescue and Inventory > RIHMI-WDC Task II-ER Eastern Region Assembling & QC > NCMR Task II-WR Western Region Assembling & QC > IEO Task II-CR Central Region Assembling & QC > OGS Task II-BS Black Sea Assembling & QC > RIHMI-WDC Task III : Global Assembling, Processing, Products > IFREMER Task IV : Objective Analysis, Climatologies > GHER Morocco INRH Spain IEO France IFREMER Algeria ISMAL Malta UM-PO Italy OGS Greece NCMR Israel IOLR Turkey TN-DNHO Lebanon NCRS Egypt NIOF Turkey TN-DNHO Russia RIHMI-WDC Bulgaria NIMH Ukraine MHI/MIST MEDAR TASKS ORGANIZATION

6 25/08/00 Medatlas Inventory (Task 1-a)

7 25/08/00

8 Medatlas Common Protocol for Observations (Task II& V)  Objective : to insure coherence and compatibility between data sets from various sources  Methodology : ädevelopment of existing international standards äworkshop and job training in regional intercalibrated data centres  Content 1.common MEDATLAS exchange format, which According to ICES/IOC should: be autodescriptive be independant of the computer be flexible and accept (almost) any number of parameters keep track of the source and history of the data allow the processing of each profile independantly 2.quality checks procedure with automatic and visual checks, and quality flags as a result This protocol is already used in several Mediterranean projects

9 25/08/00 Medatlas Format

10 25/08/00 Quality Checks ©CHECKS â QC-0 : check the format : coherence of station date, time, latitude, longitude, cruise header, conformity of the codes for ship, data type, parameters names & units.. â QC-1 : check of the time and location, search for duplicates â QC-2 : check the data points ©RESULTS = ELIMINATION OR QUALITY FLAG (GTSPP) No QC Correct Inconsistent Doubtful Bad ChangedMissing

11 25/08/00 Automatic ChecksResult Duplicate data setsE DateE or Ship velocity E or Location/shoreline E or Bottom sounding (ETOPO5) E= Elimination = Correction/Interpolation = Flag «Inconsistant with statistics» - no correction QC-1 : check of the time, location & duplicates

12 25/08/00 QC-2 : check of the data points Automatic ChecksResult Pressure + one more observationE Out of the regional scale (min & max values) Increasing pressure Data below the bottom depth Coherence with pre-existing statistics (LEVITUS, MODB, MEDATLAS) No constant profiles Spikes Vertical stability E= Elimination

13 25/08/00 Regional Assembling and Quality Checks (Task II)

14 25/08/00 Task IV: Objective Analysis - Climatologies  VIM Software adaptations  Climatological Computations by VIM and Mapping  QC of T/S and bio-chemical climatological gridded analysed data  Software dissemination & documentation

15 25/08/00 Global Assembling, Processing, Products (Task III)  Global Assembling & Processing äFinal QC : format, duplicates äExtraction of data flagged to 1 äInterpolation at standard levels äMapping of the annual, seasonnal and monthly data position distribution  Edition of the Final Product on Cdrom including observed and gridded data files, documentation, maps and software tools

16 25/08/00 Task V : Quality Assurance Assesments  MEDAR/MEDATLAS protocol - Quality Assurance Manual for Observed data, climatological data, inventory äA Contribution to the development of International Standards for Marine Information Management äBased on existing international Reference Manuals UNESCO/IOC/IODE & MAST, 1993 : Manual of Quality control procedures for validation of oceanographic data. Manual and Guides 26. UNESCO/IOC & ICSU, 1991 : Manual on Oceanographic Data Exchange. Manual and Guides 9 UNESCO 1987 : Un format général pour les données relative à l’environnement terrestre. Description du format GF3 et des tables de code; Manuels et guides 17. UNESCO/SCOR/ICES/IAPSO 1983 : Algorigthms for comuputation of fundamental properties of seawater. Technical papers in marine science 44 Ref : UNESCO Intergovernmental Oceanographic Commission, IODE Handbook. Committee on International Oceanograhich Data and Information Exchange  Workshops äQC workshop for observed data : Brest and Athens 1999 äObjective Analysis and Mapping : Liège

17 25/08/00 Networking, Communication, Promotion  WWW Links between Coordinating, Regional, Thematic and National Websites, Brochures, Posters, Papers, Contribution to exhibitions and meetings and Actions at govermental levels through IOC mechanisms

18 25/08/00 MEDAR/MEDATLAS II FUTURE AND LONG TERM OBJECTIVES  1. to contribute to improve the overall level of data quality by developing and standardising common protocols for data management and data exchange, especially for handling oxygen and nutrients data  2. to decrease the time lag between data collection and data release, and facilitate the further use of the data among different scientific, operational and industrial communities äImportance of archiving data before they become archaeological äImportance of publishing regular updates of the database  3. to develop a distributed data management structure trained in data qualifying, processing, mapping, archiving and communication äCapacity building for real time & delayed mode data management äA database and a tool for the operational oceanography and the modelisation of the Mediteranean Sea äMore Information :

19 25/08/00 DISSEMINATION OF THE MEDAR/MEDATLAS RESULTS  During the project implementation äData servicing at each NODC/DNA through Medatlas I release + releasable new national data äWeb site : and hyperlinked websites for meta-data, data requests and dissemination of information äPromotion of the project through IOC mechanisms and participation to scientific meetings & exhibitions  After the project completion äMEDAR/Medatlas II data set published on Cdrom äFormat and QC protocol published and disseminated with IOC manuals äAccess to data, data products and information at the NODC/DNA for at least 5 year

20 25/08/00 Objectives and Tasks  Task 1: to inventory from a common cruise catalogue, compile, safeguard and make available historical data sets of : Temperature, Salinity, Oxygen, Nitrate, Nitrite, Ammonia, Total Nitrogen, Phosphate, Total Phosphorus, Silicate, H2S, pH, Alkalinity, Chlorophyll-a  Task 2: to make the archived data sets comparable and compatible by using the common MEDATLAS protocol for formatting and quality checking  QC involves automatic and visual checks and takes into account regional statistics  Task 3 : to prepare and disseminate qualified value added products by developing and using efficient gridding, and mapping methodology developed with the Variational Inverse Model of MODB (MAS2-CT BE)  Task 4: to publish the observed data, gridded data, maps, software and documentation on CDrom for further scientific, educational, industrial, governmental use  Task 5: to develop and document a common methodology for data and meta-data formatting and qualifying, in conformity with the internationally agreed standards. This protocol aims to be adapted to the historical data management of different data types, as well as new real time data.

21 25/08/00 National Data Rescue (Task I-b)

22 25/08/00

23 25/08/00

24 25/08/00 National Data Rescue (Task I-b)

25 25/08/00 QC-2 : check of the data points Automatic ChecksResult Pressure + one more observationE Out of the regional scale (min & max values) Increasing pressure Data below the bottom depth Coherence with pre-existing statistics (LEVITUS, MODB, MEDATLAS) No constant profiles Spikes Vertical stability E= Elimination

26 25/08/00 Time Schedule and Data Flow Data Flow Ù Bench Mark 1 : test the format of national data sets Ù Bench Mark 2 : test the format, codes and overall coherence between regional QC centres and the global assembling centre Ù Bench Mark 3 : test of the bio-chemical data sets processing ï Bench Marck 4 : test of the complete data set and the full processing Final processing of the complete data set  Reference protocol manual Time Schedule

27 25/08/00 MEDATLAS Pilot Project (MAST Supporting Initiative MAS2-CT ) Main Objective : to prepare a qualified data product useful for the Mediterranean scientific and technical programmes Results : Mediterranean Hydrographic Atlas : Database of observed temperature and salinity profiles from 21 countries and 9 data centres : ä CTD ä Bottle casts, ä XBT & MBT 2 : Monthly (upper temperature), Seasonnal and Annual Climatological Statistics variance and error on a 1/4*1/4 degree and 28 vertical levels and Maps 3 : MEDATLAS format and QC Protocol used in several other new Mediterranean projects Main Objective : to prepare a qualified data product useful for the Mediterranean scientific and technical programmes Results : Mediterranean Hydrographic Atlas : Database of observed temperature and salinity profiles from 21 countries and 9 data centres : ä CTD ä Bottle casts, ä XBT & MBT 2 : Monthly (upper temperature), Seasonnal and Annual Climatological Statistics variance and error on a 1/4*1/4 degree and 28 vertical levels and Maps 3 : MEDATLAS format and QC Protocol used in several other new Mediterranean projects IFREMER/SISMER (coordinator) C. MAILLARD, M. FICHAUT, G. MAUDIRE, D. CURE, M. LAROUR NCMR/HNODC E. BALOPOULOS, A. THEOCHARIS, A. IONA, A. LYKARDOPOULOS IEO (Spanish Institute of Oceanography) M-J. GARCIA, J.L. JURADO, N. CANO SHOM (French Navy) D. JOURDAN, L. BAUDET ICES (Scientific Adviser ) H. DOOLEY

28 25/08/00 Medatlas I - Data sources  CTD, Bottle casts, XBT, MBT, thermistor chains data from : äFrench research laboratories, compiled by IFREMER/SISMER äSpanish laboratories, compiled by IEO äHellenic laboratories and Navy + POEM project data set, compiled by NCMR/HNODC äItalian and Spanish scientific data compiled by the MODB consortium äHistorical dataset compiled by the WDC-A äHistorical dataset compiled by ICES äRecent German cruises archived by DOD äRecent British cruises archived by BODC äFrench, UK and Spanish Navies XBT and MBT compiled by SHOM/CMO, UKHO, IHM  Country sources of the final data set ]AustriaBelgiumDenmarkEgyptFrance  GermanyGreeceIsraelItalyMonaco ]NetherlandsNorwayPortugalSpainSweden ]TunisiaTurkeyRussia/FSUUnited KingdomUSA ] Croatia/FY

29 25/08/00 Medatlas Data Product Tools Selection criteria Geographical aera Data type Cruise name Cruise reference Time/Period Country Ship Parameters Quality flags Extraction Software for observed profiles Maps