Marine Core Service MY OCEAN WP 15 Thematic & Assemby Center for In Situ

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Black Sea IOBAS/Bulgaria Arctic: IMR / Norway Baltic Sea: SMHI/Sweden Temp & Salinity : BSH/Germany Current: SMHI/Sweden Sea Level: DMI/Denmark Bio : FMI-Syke/Finland Mediterranean Sea : HCMR/Greece Mooring : HCMR/Greece XBT/CTD: ENEA/Italy Drifter & Argo: OGS/Italy Glider and Argo: Coriolis/France South West Shelves: Puertos Del Estado/Spain Mooring : PdE Underway data: Coriolis/France North West Shelves: BSH/Germany Temp & Salinity : BSH/Germany Current: SMHI/Sweden Sea Level: DMI/Denmark Global Ocean : Coriolis/France Link with international network s: Coriolis/France Argo: Coriolis,BODC,BSH European Vessels: NIVA/Norway v Reminder - Partnership

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma MyOcean in-situ TAC tasks n Define common distribution means: vocabularies, formats, organization, monitoring tools,… n Develop a reliable distributed architecture for in-situ data delivery to MFCs and MyOcean users n Converge on common real time quality control procedures and flag conventions n Converge on Real –tIme QC methods for physical variables in coherence with international standards n Develop methods for Quality Control of biogeochemical data both in real time and delayed mode and provide recommendations for acquisition of biogeochemical data from various platforms n Enhance the T&S basin scale assessment methods for global ocean and adapt them to regional scales, if possible n Turn to operations enhanced calibration/validation methods n Coordinate at European Level with EuroGOOS and SeaDataNet, and with JCOMM observing program(as Argo, OceanSites,Gosud, DBCP,..)

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma R&D : main achievements n Main achievements are n The near real-time Quality control procedures developed for T&S, sea level and current have been endorsed by EuroGoos and passed by SeaDataNet to IOC n Similar NRT QC procedure has been developed for Biogeochemical data ( mainly Chlorophyll/Fluorescence and Oxygen) and have been deployed in the INS TAC centers n Validation procedures have been defined at regional scale n Main difficulties n Develop methods that can be extended to EuroGoos and SeaDataNet n Remaining activities/objectives n Develop KPI to monitor the INS TAC product quality for internal and later external use

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Dev. & Maintenance n Objectives Define an set up a distributed but reliable architecture for in situ data integration for operational oceanography n Steps n VO : 4 global products available from global component operated by Coriolis n V1: 6 regional + a global portals set up distributing 2+14 additional Real-Time products n V2 : Regional and Global portals enhanced with 7 scientifically analyzed T&S product for reanalysis purposes ( ) n V1 step up in 3 steps Stream1/Stream2 n November April 2010 : Data integration and distribution set up n March June 2010 /December 2010: Common real-time QC procedures applied in Stream1/Stream2 regions n September 2010-March 2011/ March-August 2011 : Scientific product assessment performed in Stream1/Stream2 regions

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Dev. & Maint. : main achievements n Main achievements are n The 12 PU and 7 DU have been set up and tested ( SIVP) n The NRT QC procedures have been deployed in all regions n The stream1 components has set up a first version of Validation/ Assessment of T&S product n The Oceanotron software that replaces OPEnDAP for insitu has been developed and deployed. Connection to MISGW is specified and should be available for V2 as well as WMS service for in situ n Main difficulties n Ins-Tac is highly distributed n The MyOcean tools need evolutions to handle in situ products n Remaining tasks n Implement KPI

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Reminder - Objectives for Production n Objectives, Products, Difficulties, … n Set up the regional, EU and global portals that would integrate, in a sustained manner, enough data to significantly ease the MFC and MyOcean users activities and have a real added value for the regions n Be able to operate this distributed infrastructure in a coherent and reliable way n Be able to turn to operation the methods defined in R&D

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Production : main achievements n Main achievements are n In all regions the link with data providers have been established and good collaboration with EuroGOOS ROOSes set up n the data are integrated in regional and global portals and used by some MFCs n More providers are interested to contribute n The service organization has been set up, and stream1 proved that the escalation process described in SIOPM was efficient n Main difficulties n In the Global component the DU was harder to set up than planned because of the number of platforms and time needed to update the portal n In NSW and Baltic regions the organization of the responsibilities has been revisited to secure operations n In some regions like Black sea there is very few real time observations n Remaining objectives n Set up an efficient monitoring of the production and alert system n Elaborate T&S re-analyzed product for reanalysis activities

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Monitoring platform availability per day Global Component ≈ 2100 platforms per day: 1250drifters, 30vessels, 300 floats,350 moorings ≈150 platforms from GTS Integrates Global Networks and Regional observations acquired in the In situ Tac components Jan 11 Mar 11

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Monitoring platform availability per day at PU level also 4 ferrybox lines acquired routinely by Niva PU and integrated in Global Du

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Monitoring platform availability per day NWS Component ≈ 140 platforms per day: 70 moorings, 60 drifters, <10 profilers, 1 vessel, some GTS data Baltic Component :≈ 90 platforms per day 90 moorings, 2 vessels

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Monitoring platform availability per day Med Component :≈ 100 platforms per day 24 drifters, moorings, up to 8 vessels, ≈10-15 floats, Arctic Component :≈ 120 platforms per day 80 drifters, 3-8 vessels, ≈10-15 floats, ≈10-20 platforms from GTS

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Monitoring platform availability per day Black sea Component 1 mooring 1 float, sometimes one drifter and one vessel IBI Component ≈ 250 platforms per day: 100drifters, 5-9vessels, 15floats,120 moorings,<10 platforms from GTS

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Service to Users n 117 registered users for INS TAC ( 6 products in the catalogue) n 378 product requested

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Service to Users n Increase in request for Global products n Regional products start to be requested (Arctic, Med) since V1 launch

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Production: T&S regional re-analysed products n Covers n Best values of T&S data available to be used for assimilation and/or validation depending of the regions n Contains data that have been through Delay Mode scientific assessment plus real time data scientifically assessed ( flagged but not corrected) within the INS TAC –Exhaustivity in term of data ( more and not less than WOD09, should include national cruises) –Better quality than WOD09 –Scientific assessment documented –Provide Information on the accuracy of the data better with the data but can be in the documentation n It's a Myocean product presently planned to be on the catalogue: –follow MyOcean data policy : freely available to registered users –Can be complemented by restricted access data for MyOcean MFCs only

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Production: Potential risk for T&S regional re-analysed product n SDN and MYO want to collaborate on building product for re-analysis but further work is needed to better specify the needs and speak the same language n The timing of the 2 projects doesn't fit : SDNI is finished, SDNII is in negotiation phase and KO is foreseen for end 2011, MYO-V2 is end 2011 n The "Best product " from SDN to MyO described in the MoU has not been developed in SDNI. –Presently the only regional aggregated T&S datasets that exist from SDN are the ones used for building the regional climatology but they are restricted access as they merge public data with restricted data. At the best they can provided as internal product for MFCs n What can be done for MYOI ? –Set up the mechanisms to be able to integrate the SDN products when available and Trace the access to the datasets provided by SDN and provide feedback to SDN. This will be possible when the connection to MISGW is fully implemented for INS-TAC –Provide the regional aggregated T&S datasets build for climatology by SDN to MyOcean MFCs ONLY if SDN agrees to provide them –Start building prototype of regional T&S data for MYO users A lot of T&S European data are presently available freely at US-NODC or ICES and some of them are included in the V1 Global T&S Re-analyzed product Some INS-TAC partners, also involved in SDN, can provide their institution data to start building the MyOI products as a temporary solution waiting for SDNII

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Reminder - Objectives for Cal / Val n Objectives n Assess scientifically the quality of the products using the methods develop in R&D n Process different for real time products and re-analyzed products n Difficulties n The amount of data available in an area to do perform consistency checks at basin scale n Based in most regions on Visual QC by an operator and test against Climatology ( plan to rely on SeaDataNet form enhanced regional climatology in Europe) n Steps n First work on T&S parameters as they are assimilated in MFCs n Second on current, sea level and biogeochemical data used for validation by MFCs

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Cal/Val : main achievements n Main achievements are n T&S stream 1 products have been validated and system is in place for quarterly assessment n T&S global re-analyzed product assessment has been performed using both statistical methods and visual assessment by a scientist n Validation process has been defined for all the V1 products and mainly rely on visual QC because data are to sparse n Main difficulties n For some data such as sea level it's difficult to do better than provider. INS-TAC is than essentially an integrator of observations n For biogeochemical data biofouling is an issue that may sometimes difficult to detect in RT. n Consistency between parameters will be used whenever possible to at list detect outliers. n Remaining tasks n Finalize the Product Quality KPI that will provide a traffic light view of the INS-TAC product quality taking into account the amount of platform versus expected, the delay between the date of the data and first delivery by INS TAC, the amount of bad/suspicious data versus good ones

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma n Organizational Challenges –Converge from different history on data sharing to common practices –Convince outside & national data providers n Technical Challenges –Lack of on the shelves data model standards and OGC services for sparse datasets n Operational Challenges –Guaranty operational services on a distributed architecture –Manage to elaborate re-analyzed T&S products for re-analysis at Global and regional scale for internal AND external users in collaboration with SeaDataNet, EuroGOOS for European data resolving the data policy issues n Ultimate Challenges … –The quality of the in situ product will depend on the availability and sustainability of the in-situ observing systems that presently are mostly funded on research funds Main Challenges

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma n Past (event, work or tasks achieved) : –September 2009 : Start of monthly phone meetings to better steer the INS-TAC activities –October 2009 : in situ portal specifications approved and presented at EuroGOOS annual meeting –December 2009-April 2010-April 2011: Plenary WP15 meetings –January 2010 : SeaDataNet-MyOcean MoU signed –February 2010: T&S real-time QC procedure approved and provided to SeaDataNet –March 2010-April 2010 : all INS-TAC portals are up and distributed products in prototype mode –June 2010 : RTQC procedures implemented for Stream 1- Assessment procedure defined –Autumn 2010 : Assessment procedure implemented for Stream 1- RTQC procedures implemented for stream2 –October 2010 MyOcean RTQC procedures endorsed by EuroGOOS –Summer –Autumn 2010: Service organization defined for INS TAC, and mandatory ITIL processes in place –December 2010 : Start of V1 service for stream1 products –March 2011 : RTQC procedures sent to IOC by SDN for proposal as a standard n Future : –June 2011: Start of V1 service for stream2 products –Summer 2011: set up of quality KPI –Summer 2011: Elaboration of V2 products in partnership with SDN ( even if SDNI finished and SDNII not started…) –December 2011: Start of V2 products Calendar

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Some illustrations… January 2010

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Some illustrations… Gliders FerryBox Moorings April 2011

Marine Core Service MyOcean : Second Annual Meeting / April 2011 / Roma Some illustrations…