NRT Data Management Giuseppe M.R.Manzella, Franco Reseghetti - ENEA

Slides:



Advertisements
Similar presentations
Add new ADCP on board of two of the four major ADRICOSM CTD network vessels Vanessa Cardin National Istitute of Oceanography and Experimental Geophysics.
Advertisements

1 Italian Activity in SOOP-VOS PMO-3-INT Hamburg March, 2006 Franco Reseghetti Giuseppe M.R. Manzella ENEA – La Spezia (on behalf of GNOO – National.
PMO-III, March 2006, Hamburg, Germany. Other PMO Activities.
1 Evaluation of two global HYCOM 1/12º hindcasts in the Mediterranean Sea Cedric Sommen 1 In collaboration with Alexandra Bozec 2 and Eric Chassignet 2.
TMSI/IDM/SISMER Sept 2000 SISMER SISMER Systèmes d’Informations Scientifiques pour la Mer F-NODC Quality Control Procedure at IFREMER Argo data management.
MAMA Workshop on Marine Data & Information Management Malta, 28 th January 2004 Recent experiences and future plans in oceanographic data management of.
Kick-Off Seadatanet – Heraklion – 7-11 June Atlantic and global products C. Coatanoan, F. Gaillard, E. Autret, T. Loubrieu.
Indirect Determination of Surface Heat Fluxes in the Northern Adriatic Sea via the Heat Budget R. P. Signell, A. Russo, J. W. Book, S. Carniel, J. Chiggiato,
SMOS SAG, Villafranca November 2-3, 2006 Development of a Global In-Situ Soil Moisture Network: A SMOS Project Contribution P.J. van Oevelen.
Operational Quality Control in Helsinki Testbed Mesoscale Atmospheric Network Workshop University of Helsinki, 13 February 2007 Hannu Lahtela & Heikki.
Available bandwidth measurement as simple as running wget D. Antoniades, M. Athanatos, A. Papadogiannakis, P. Markatos Institute of Computer Science (ICS),
Systems Oceanography: Observing System Design. Why not hard-wire the system? Efficiency of interface management –Hard-wire when component number small,
11 MEDATLAS 2002: database and data management system for the long term monitoring of Mediterranean and Black seas EC-MAST Concerted Action (MAS3-CT /ERBIC20-CT
Introduction to the course January 9, Points to Cover  What is GIS?  GIS and Geographic Information Science  Components of GIS Spatial data.
CSIRO Marine Research Commonwealth Scientific and Industrial Research Organisation, Australia.
Operational integration of biodiversity and physico-chemical data: experience at the BMDC Meerhaeghe A., De Cauwer K., Devolder M., Jans S., Scory S.
WP2: Data products generation in Mediterranean Sea EMODNET Chemistry Data Products, Experts Workshop Split (Croatia), June 2014 Sissy Iona, HCMR-HNODC.
Presented by Amira Ahmed El-Sharkawy Ibrahim.  There are six of eight turtle species in Ontario are listed as endangered, threatened or of special concern.
Marine Data Management within EMODNet Chemistry project: data aggregation, quality control and products preparation A.S. Iona 1, P. Karagevrekis 1, S.Balopoulou.
WP1: Data collection and metadata compilation in Mediterranean Sea EMODNET Chemistry 2, Kick-off meeting Trieste (Italy), 3-5 June 2013 Sissy Iona, HCMR-HNODC.
Needs for Data and Information Managing living and non-living resources, monitoring environmental changes in the sea and protecting the marine environment,
QC/QA and Diva Products in Mediterranean Sea EMODNET Chemistry 2 Meeting on ODV QC and Diva Products Ifremer Headquarter, Paris, 3 September 2014 Sissy.
EU/MAST-MATER database ( ): A reference database of high quality multidisciplinary data collected within the framework of a major international.
United Nations Economic Commission for Europe Statistical Division Seasonal Adjustment Process with Demetra+ Anu Peltola Economic Statistics Section, UNECE.
Using A Fleet of Slocum Battery Gliders in a Regional Scale Coastal Ocean Observatory Elizabeth L. Creed, Chhaya Mudgal, Scott M. Glenn and Oscar M. Schofield.
© Crown copyright Met Office The EN QC system for temperature and salinity profiles Simon Good.
Scientific Needs from the Climate Change Study in the Ocean Toshio Suga Tohoku University (Japan) International Workshop for GODAR-WESTPAC Hydrographic.
Final General Assembly – Paris, France – September 19, 2014 FP7-Infra : Design studies for European Research Infrastrutures 1st October 2011.
MyOcean2 First Annual Meeting – April 2013 WP 15 THEMATIC & ASSEMBLY CENTRE for In Situ MyOcean2 First Annual Meeting – Cork /16-17 April 2013.
SEADATANET Kick-Off Meeting Heraklion 8-10 June 2006 National Institute of Geophisics and Volcanology, Italy (INGV) SEADATANET Joint Reasearch Activities.
Use of sea level observations in DMIs storm surge model Jacob L. Høyer, Weiwei Fu, Kristine S. Madsen & Lars Jonasson Center for Ocean and Ice, Danish.
Good Practice for monitoring plans Viewpoint of a DOE Marco van der Linden, SGS Climate Change Programme
Quality Control for the World Ocean Database GSOP Quality Control Workshop June 12, 2013.
EC-Marine Science & Technology Programme Concerted Action (MAS3-CT /ERBIC20-CT ) MEDAR/MEDATLAS 2002 and future initiatives Mediterranean.
The Mediterranen Forecasting System: 10 years of developments (and the next ten) N.Pinardi INGV, Bologna, Italy.
Monitoring Heat Transport Changes using Expendable Bathythermographs Molly Baringer and Silvia Garzoli NOAA, AOML What are time/space scales of climate.
© Crown copyright Met Office The EN4 dataset of quality controlled ocean temperature and salinity profiles and monthly objective analyses Simon Good.
Wayne G. Leslie 13 November 2002 Harvard Ocean Prediction System (HOPS) Operational Forecasting and Adaptive Sampling.
MAMA Kickoff Meeting, Paris 11-12/3/20021 Work-Package 5: MAMA-NET Objective: To initiate a data and information exchange system (Net-MedGOOS) that will.
Cyberinfrastructure to promote Model - Data Integration Robert Cook, Yaxing Wei, and Suresh S. Vannan Oak Ridge National Laboratory Presented at the Model-Data.
CHAPTER 5: Data sampling design, data quality, calibration, presentation Sampling Physical variables are continuous, but samples (water samples) and digital.
MEDAR 2002 Database and Network The MEDAR Group MEDAR/MEDATLAS II Mediterranean Data Archaeology and Rescue of Temperature, Salinity and Bio-chemical Parameters.
Hellenic Centre for Marine Research (HCMR) MedOBIS - Ocean Biogeographic Information System for the Eastern Mediterranean and Black Sea.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Cal/Val for physics MED-MFC internal meeting CMCC-INGV-SOCIB Lecce E. Clementi, INGV.
XBT FALL RATE EQUATION WORKSHOP National Oceanic and Atmospheric Administration Atlantic Oceanographic and Meteorological Laboratory, Miami, FL March 10-12,
Geneva, April 2007 GTSPP by Bob Keeley (Canada) and Charles Sun (U.S.A)
Data Management Practices for Early Career Scientists: Closing Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN.
Data management dedicated for assessing and modeling of the Mediterranean and Black Seas ecosystem changes (SESAME integrated project). Isaac Gertman,
The SeaDataNet data products regional temperature and salinity historical data collections S. Simoncelli 1, C. Coatanoan 2, O. Bäck 3, H. Sagen 4, S.
RTOFS Monitoring and Evaluation Metrics Avichal Mehra MMAB/EMC/NCEP/NWS.
SeaDataNet Technical Task Group meeting JRA1 Standards Development Task 1.2 Common Data Management Protocol (for dissemination to all NODCs and JRA3) Data.
PROVIDING DATA SERVICES FOR THE MEDITERRANEAN AND BLACK SEAS
Validating SMAP SSS with in situ measurements
Data aggregation and products generation in the Mediterranean Sea
XBT and continuous ship-borne meteorological measurements
Work-Package 5: MAMA-NET Hellenic Centre for Marine Research – HCMR (former NCMR and IMBC) Objective to establish the basis of a prototype system for exchange.
Report on “what are the emerging research needs for CAMS”
MERMAID Innovative multi-purpose offshore platforms: planning, Design and operation MERMAID.
TNA FishAut SARTI-UPC, Spain General Assembly 2017
Operational Oceanography Science and Services for Europe and Mediterranean Srdjan Dobricic, CMCC, Bologna, Italy on behalf of National Group of Operational.
Flanders Marine Institute (VLIZ)
SA E2-M3A – SOUTHERN ADRIATIC DEEP WATER FORMATION, HEAT BUDGET, AND CARBONATE SYSTEM TO ASSESS CLIMATIC VARIATION AND OCEAN ACIDIFICATION OGS, Trieste,
Coding issues BUFR Binary Universal code Form for the Representation of meteorological data Binary Table driven code form (BUFR, CREX) Efficient compression.
NOAA Objective Sea Surface Salinity Analysis P. Xie, Y. Xue, and A
CTD/XBT Comparison, Quality of JJYY Data and XBT Data Analysis of the Mixed Layer Depth by LT Mike Roth OC MAR01.
Validating NAVO’s Navy Coastal Ocean Model
EMODNet Physics + My Ocean – SeaDataNet
EUTROPHICATION – NE ATLANTIC
Generation of data products in the Mediterranean Sea
Presentation transcript:

NRT Data Management Giuseppe M.R.Manzella, Franco Reseghetti - ENEA on behalf of the MFS/ADRICOSM VOS group: M. Borghini – CNR – Italy, V. Cardin - OGS – Italy, A.Cruzado – CSIC CEAB – Spain, V. Dadic – IOF – Croatia, F. Grilli – CNR – Italy, C. Galli – CNR – Italy, M. I. Gertman – IOLR – Israel, V. Malacic – MBS – Slovenia, C. Millot – CNRS LOB COM – France, M. Morovic – IOF – Croatia, E. Oszoy – IMS METU – Turkey, C. Tziavos – HCMR – Greece, G. Zodiatis – UC OCY – Cyprus, G. Montanari – Daphne – Italy, S. Serra – Daphne – Italy, N. Smodakla – CMR – Croatia, M. Marini – CNR – Italy, and … many … many other colleagues …

Outline of the presentation MFS- VOS system QA protocols QC procedures Data and viewing service Data access

MFS-VOS in the Mediterranean Started in September 1999 Sustained by: MFSPP (EC-DG Research) ADRICOSM (MATT) MFSTEP (EC-DG Research) ADRICOSM (IOC, MAE, MATT)

MFS-VOS system Activities in the framework of EuroGOOS and MedGOOS Supports the Mediterranean Forecasting System /Adricosm Included in the GMES Ocean component

Requirements An ideal sampling design is based on four goals: - 1. provide repetitive measurements along transects from coast to coast,  2. the transects must cross significant dynamical features of the circulation, 3. the sampling distance should resolve, as well as possible, the mesoscale, 4.  the technologies for data collection must be robust and simple, to be used on ships of opportunity, eventually by ship personnel.

MFS-VOS (XBT) in the Mediterranean XBT data from Sept 1999 to June 2006 MFSPP Adricosm PP MFSTEP Adricosm Ext

Adricosm (CTD) in the Adriatic Adricosm Pilot Project Adricosm Extension

Monitoring System in 2005

Phases of monitoring system and QA/QC Design of the Monitoring System Field work Data telemetry NRT data QC Sampling strategy and technology QA protocols for field work Tecnology for full resolution data transmission Methodology for NRT QC

Design Design of the Monitoring System Field work Data telemetry NRT data QC Sampling strategy and technology QA protocols for field work Tecnology for full resolution data transmission Methodology for NRT QC

Design of the Monitoring System Main paths and mesoscale

Design of the Monitoring System Dense Water formation

MFS-VOS in the Mediterranean From 1999 to 2006

Tracks vs Features

Tracks vs Ship routing (oil transport)

Technology Sippican system Industrial computer

Phases of monitoring system and QA/QC Design of the Monitoring System Field work Data telemetry NRT data QC Sampling strategy and technology QA protocols for field work Tecnology for full resolution data transmission Methodology for NRT QC

Check List (click) Description of principles Expected Results Responsibility Working Procedures Deviation/Deficiencies Expected data

Phases of monitoring system and QA/QC Design of the Monitoring System Field work Data telemetry NRT data QC Sampling strategy and technology QA protocols for field work Tecnology for full resolution data transmission Methodology for NRT QC

Transmission tools: from ARGOS to Globalstar Initially only some significant points extracted from the temperature profiles were transmitted by mean of ARGOS in real time. In order to have the full resolution profiles, the data transmission system was changed with the use of GSM and Internet systems. The data were transmitted in near-real time, e.g. with a delay of about 12 – 20 hours from data collection. Now full resolution profiles are transmitted by means of the Globalstar system

Advantages: from ARGOS to Globalstar

Data Flow and QC Data are transmitted from ships to MFS-VOS Thematic Data Centre Data are QC with a unique (improved) NRT procedure

Phases of monitoring system and QA/QC Design of the Monitoring System Field work Data telemetry NRT data QC Sampling strategy and technology QA protocols for field work Tecnology for full resolution data transmission Methodology for NRT QC

Sources of Error: wind/ship contact

Sources of Error: ground connection

QC Methodology – Initial Version The NRT.QC.XBT procedure then proceeds with 8 steps that in synthesis are (Manzella, Scoccimarro, Pinardi, Tonani - 2003) initial visual check gross range check* position control* elimination of spikes* interpolation at 1 metre interval* gaussian smoothing* general malfunction control* comparison with climatology* final visual check, confirming the validity of profiles and providing an overall consistency

Comparison with climatology This is done in terms of ‘distance’ of the XBT data to the mean monthly profile. If this ‘distance’ is less than 2 standard deviations, the XBT data are considered of good quality, if it is between 2 – 4 standard deviation or is greater than 4 a flag standard deviations the data values are flagged.

MFS-VOS_1 (XBT data)

MFS-VOS_1 (XBT data)

MFS-VOS_1 (XBT data)

MFS-VOS_1 (XBT data)

MFS-VOS_1 (XBT data)

MFS-VOS_1 (XBT data)

MFS-VOS_1 (XBT data)

MFS-VOS_1 (XBT data)

MFS-VOS_1 (XBT data)

MFS-VOS_1 (XBT data)

MFS-VOS_1 (XBT data)

MFS-VOS_1 (XBT data)

QC Methodology Improvement The use the ACQUISITION TIME (fixed increments due to the 10 Hz sampling rate) as free parameter. The APPLICATION of Gaussian smoothing before interpolation at 1 metre interval. START-UP problem  Systematic difference at the seasonal thermocline depth. The XBT recording system needs time before it measures stable T values (within 0.1 ºC). The observed averaged delay is 0.3 ± 0.1 s (2.0 m). Each profile could be rescaled. NEW FALL RATE COEFFICIENTS seem to be required in Mediterranean for XBTs. … (Paper by Reseghetti et al. Ocean Science – All improvements will be applied after the approval from SOOP community)

MFS-VOS Services Data selection through user friendly interface (geographical, temporal, parameter, quality selection) – Data downloading Data view (spatial and temporal distribution, vertical profiles, data, metadata) Format transformation (MedAtlas, ODV)

Services: data view and downloading

Services: data view and downloading

Download data: - Original format (raw) MedAtlas ODV (only QC data)

Other services (not visible in the web) Format transformation from: EDF (Sippican) to MedAtlas and ODV MedAtlas to ODV (ADRICOSM) SeaBird to MedAtlas and ODV (ADRICOSM)