GODAE OceanView Intercomparison Task Team Fabrice Hernandez and Matt Martin.

Slides:



Advertisements
Similar presentations
Marine Core Service MY OCEAN The GMES MyOcean Marine Service Bertil Håkansson SMHI, Core Service MyOcean Core User Requirements.
Advertisements

GODAE OceanView-CLIVAR Workshop, Santa Cruz, June 2011 GODAE OceanView and its Task Teams Centre for Australian Weather and Climate Research; Wealth.
MyOcean2 First Annual Meeting – April 2013 WP 5 MONITORING & FORECASTING CENTRE for the Global Ocean (GLO MFC) MyOcean2 First Annual Meeting – Cork.
OSE meeting GODAE, Toulouse 4-5 June 2009 Interest of assimilating future Sea Surface Salinity measurements.
Mercator Ocean activity
WP4 Task T4.2 WP4-T4.2 : Establishment of validation criteria of multidisciplinary information products
Marine Core Service MY OCEAN WP 13 Thematic Assemby Center for SST.
Assimilating SST and Ocean Colour into ocean forecasting models Rosa Barciela, NCOF, Met Office
1 Evaluation of two global HYCOM 1/12º hindcasts in the Mediterranean Sea Cedric Sommen 1 In collaboration with Alexandra Bozec 2 and Eric Chassignet 2.
The NCEP operational Climate Forecast System : configuration, products, and plan for the future Hua-Lu Pan Environmental Modeling Center NCEP.
Ocean Reanalysis D. Stammer. Continued development of ocean synthesis products and reanalysis; some now are truly global, including sea.
GOVST-III Meeting, ESA HQ, Paris, November 2011 Inter-comparison and Validation Task Team (IV-TT) Report for GOVST Matt Martin, Fabrice Hernandez.
The MyOcean Concept P.Bahurel, project coordinator.
JERICO KICK OFF MEETINGPARIS – Maison de la recherche - 24 & 25 May 2011 WP9: New Methods to Assess the Impact of Coastal Observing Systems Presented by.
MERSEA IP WP 5 “Integrated System Design and Assessment” Internal Metrics for the MERSEA Global Ocean: Specifications for Implementation Planning Workshop.
GOV Technical Workshop OSE-IV - Santa Cruz, USA, June 2011 Fabrice Hernandez (Mercator Océan, Fr) and Matt Martin (Met Office, UK) GODAE OceanView.
Marine Core Service MY OCEAN WP 18 URD Synthesis - Climate and Weather Forecasting.
GMES Marine Service MY OCEAN Cross Cutting Cal/Val Activities & Product Quality Working Group Scientific Assessment of External Products in MyOcean Second.
MERSEA Integrated System Exeter Nov 2005 IGST (F. Blanc) Brief Overview of Mersea
Collaborative Research: Toward reanalysis of the Arctic Climate System—sea ice and ocean reconstruction with data assimilation Synthesis of Arctic System.
Marine Core Service MY OCEAN Potential contribution of Observatories to GMES Marine Core Service, MyOcean Fabrice HERNANDEZ IRD/Mercator Ocean, France.
Ocean and sea-ice data assimilation and forecasting in the TOPAZ system L. Bertino, K.A. Lisæter, I. Kegouche, S. Sandven NERSC, Bergen, Norway Arctic.
Main components of monitoring and forecasting in Arctic and sub-Arctic regions Modelling and Forecasting capacity From MERSEA IP to the Marine Core Service.
Inter-comparison and Validation Task Team Breakout discussion.
TOPAZ evaluation L. Bertino, F. Counillon, P. Sakov Mohn-Sverdrup Center/NERSC GODAE workshop, Toulouse, June 2009.
NACLIM CT1/CT3 1 st CT workshop April 2013 Hamburg (DE) Johann Jungclaus.
MERSEA overall objective is to facilitate the visibility, understanding and exchange of the ocean modelling data, output products for users and evaluate.
Ocean Salinity validation of mission requirements review / improvements: Points of Reflexion ESL teams Mission Requirements: The so-called GODAE requirements:
ECOOP annual meeting February 2008 Athens Ole K. Leth Danish Meteorological Institute (DMI) Contribution to WP 4 (13 February 2008) – Modelling and.
IICWG 5 th Science Workshop, April Sea ice modelling and data assimilation in the TOPAZ system Knut A. Lisæter and Laurent Bertino.
Marine Core Service MY OCEAN WP 4 Monitoring & Forecasting Center for Global Ocean.
WP5 Task T5.4 WP5-T5.4 : Regional Iberia-Biscay-Irlande (IBI) integrated system ECOOP Annual Meeting.
Potential impact of HF radar and gliders on ocean forecast system Peter Oke June 2009 CSIRO Marine and Atmospheric Research.
1.Introduction Prediction of sea-ice is not only important for shipping but also for weather as it can have a significant climatic impact. Sea-ice predictions.
ENSEMBLES RT4/RT5 Joint Meeting Paris, February 2005 Overview of the WP5.3 Activities Partners: ECMWF, METO/HC, MeteoSchweiz, KNMI, IfM, CNRM, UREAD/CGAM,
2nd GODAE Observing System Evaluation Workshop - June Ocean state estimates from the observations Contributions and complementarities of Argo,
Mediterranean Sea Basin Scale model P.Lazzari, S. Salon, A. Teruzzi, K.Beranger, A. Crise Sesame WP3 meeting Villefranche sur Mer, Februay 2008 OGS,
GODAE Progress on national activities France (Mercator Ocean) Eric Dombrowsky - Mercator Océan.
GOVSTIII – Paris - November 2011 Eric Dombrowsky 1, Andreas Schiller 2, Kirsten Wilmer-Becker 3 1 Mercator Océan; 2 CSIRO; 3 the Met Office
1 Arun Kumar Climate Prediction Center 27 October 2010 Ocean Observations and Seasonal-to-Interannual Prediction Arun Kumar Climate Prediction Center NCEP.
IGST XIII – Washington 2/06/2008 Intercomparisons Working Groupe activities Status of the intercomparison exercice Some exemples of diagnostics based on.
© Crown copyright Met Office Inter-comparison and Validation Task Team Matt Martin, Fabrice Hernandez GOVST meeting, Paris, November 2011.
Observing System Evaluation (OSEval) Breakout Session Peter Oke, Gilles Larnicol Santa Cruz, California, USA, June 2011.
Application of a Hybrid Dynamical-Statistical Model for Week 3 and 4 Forecast of Atlantic/Pacific Tropical Storm and Hurricane Activity Jae-Kyung E. Schemm.
IGST XIII – Washington 2/06/2008 Status of the intercomparison exercice: Where are we ? Agenda: –Shift (one month now) for availability of products –Not.
GODAE IGST X Exeter, Nov Mercator Status 1. The system 2. Some users 3. The consortium 4. Mersea & plans
F. Hernandez, Mercator Océan – IGST XII – St Johns 8/08/2007 Intercomparisons Working Groupe activities Definition of metrics at the global level: where.
MERCATOR OCEAN French Global Ocean Monitoring and Forecasting Contribution to Arctic GOOS Pierre BAHUREL & Gilles GARRIC MERCATOR OCEAN 12 September 2006,
First GODAE OceanView Science Team Meeting, Mercator-Ocean, Toulouse, 8-10 June GODAE OceanView: Task Teams and International Relationships Andreas.
GODAE OceanView-GSOP-CLIVAR workshop June Monitoring the Ocean State from the Observations Stéphanie Guinehut Sandrine Mulet Marie-Hélène.
One-year re-forecast ensembles with CCSM3.0 using initial states for 1 January and 1 July in Model: CCSM3 is a coupled climate model with state-of-the-art.
Cal/Val for physics MED-MFC internal meeting CMCC-INGV-SOCIB Lecce E. Clementi, INGV.
CLIVAR PERSPECTIVE  Re-analysis and Seasonal Forecasting activities are common ground between the GODAE GOV and CLIVAR communities. This intersection.
Page 1 Andrew Lorenc WOAP 2006 © Crown copyright 2006 Andrew Lorenc Head of Data Assimilation & Ensembles Numerical Weather Prediction Met Office, UK Data.
MyOcean2 First Annual Meeting – April 2013 WP 06 MONITORING & FORECASTING CENTRE for ARCTIC Laurent Bertino, NERSC MyOcean2 First Annual Meeting.
Impact of TAO observations on Impact of TAO observations on Operational Analysis for Tropical Pacific Yan Xue Climate Prediction Center NCEP Ocean Climate.
Application of HYCOM in Eddy- Resolving Global Ocean Prediction Community Effort: Community Effort: NRL, Florida State, U. of Miami, GISS, NOAA/NCEP, NOAA/AOML,
The Mediterranean Forecasting INGV-Bologna.
U.S. GODAE: Global Ocean Prediction with Community Effort: Community Effort: NRL, U. of Miami, FSU, NASA-GISS, NOAA/NCEP, NOAA/AOML, NOAA/PMEL, PSI, FNMOC,
Objectives Review work done on impact studies, OSEs and OSSEs over the past years Identify robust and common features Understand differences in assimilation.
Climate Mission Outcome A predictive understanding of the global climate system on time scales of weeks to decades with quantified uncertainties sufficient.
RTOFS Monitoring and Evaluation Metrics Avichal Mehra MMAB/EMC/NCEP/NWS.
Real-time Ocean Reanalyses Intercomparison: Ocean/Climate Monitoring Using Ensemble Ocean Reanalysis Products Y. Xue1, M. Balmaseda2, Y. Fujii3, G. Vecchi4,
Norwegian Marine Data Centre contributions from Nansen Environmental and Remote Sensing Center Lasse H. Pettersson.
Users Requirements The inconsistencies between the UR and GCOS-2006 identified in some of the URDs will be reduced with the new iteration of the GCOS.
NSO8055 Okeanograafiline prognoos
Development of an advanced ensemble-based ocean data assimilation approach for ocean and coupled reanalyses Eric de Boisséson, Hao Zuo, Magdalena Balmaseda.
Real-time Ocean Reanalyses Intercomparison: Ocean/Climate Monitoring Using Ensemble Ocean Reanalysis Products Y. Xue1, M. Balmaseda2, Y. Fujii3, G. Vecchi4,
GODAE Final Symposium, 12 – 15 November 2008, Nice, France
Presentation transcript:

GODAE OceanView Intercomparison Task Team Fabrice Hernandez and Matt Martin

Contents Historical background: Cal/Val activities during GODAE Brief overview of existing metrics definitions Results from final GODAE intercomparison Issues coming out of that intercomparison DISCUSSION:  Objectives of the Intercomparison Task Team  Main areas to focus future effort

Historical background: 10 years of cal/val activities in the framework of GODAE MERSEA IP 6 months TOP1 6 months TOP2 MERSEA Strand 1 6 months MERSEA Interc. GODAEGODAE OceanView North Atlantic Med European Seas Global 3 months GODAE Interc. Ocean basins Global FOAM TOPAZ MFS MERCATOR HYCOM MyOcean FOAM TOPAZ MFS MERCATOR DMI-Baltic FOAM TOPAZ MERCATOR HYCOM MOVE/MRI BLUElink> C-NOOFS European Seas Global NWS- FOAM ARC- TOPAZ MED- MFS GLO- MERCATOR BAL- DMI Black Sea IBI NetCDF COARDS-CF OPENDAP/LAS NetCDF3 Class 1 ATL Class 2 ATL Class 3 ATL Class 1 glo Class 2 glo Class 3 glo Class 1 sea-ice Class 2 sea-ice Class 4 T/S Class 4 sea-ice Class 1 new Class 2 new

GODAE metrics definitions Class 1 – daily average model fields interpolated onto pre-defined grids ( eddy- permitting view ) on specified levels Class 2 – model fields interpolated to pre-defined mooring locations and sections. Class 3 – transports through sections and other integrated quantities such as Meridional Overturning Streamfunction and heat transports. Class 4 – assessment of forecasting capabilities through comparison of model with assimilated and independent observations

Final GODAE intercomparison Design of the Intercomparison experiment (~ ):  Extending MERSEA Class 1 and Class 2 metrics to global scale  Definition of intercomparison objectives: a) Demonstrate GODAE operational systems in operations b) Share expertise and design validation tools and metrics endorsed by GODAE operational centers c) Evaluate the overall scientific quality of the GODAE operational systems  Implementation of metrics computation Demonstration phase: 3 month period (Feb, Mar, Apr 2008). Phase of synthesis: June 2008 to GODAE Final Meeting in Nov Additional synthesis: until January 2009  GODAE metrics produced from various groups: BlueLink, FOAM, HYCOM, Mercator, MOVE/MRI,...  Data put on ftp servers and/or OpenDAP servers.  Most of the intercomparison results obtained so far have looked at monthly means and standard deviations against climatology or some other processed data (e.g. SST analyses)  No sea-ice results  Some intercomparisons (e.g. done by the Australians) have focussed more on comparison with assimilated and independent observations, e.g. SST, SLA, Argo and surface drifters, in the Indian Ocean and South Pacific regions.

GODAE systems in comparison Mercator NEMO ECMWF SEEK – RkF T,S, SLA, SST HYCOM FNOC-NOGAPS NCODA – MvOI T,S,(SLA), SST, ice FOAM NEMO UK-MetT, S, SLA, SST, ice BLUElink ind/spa MOM4 BoM BODAS – EnOI T,S,SLA,TG, SST TOPAZ nat/arc HYCOM ECMWF EN-kF T,S, SLAmaps, SST, ice MOVE/MRI npa MOVE JMA MRI - 3Dvar T,S, SLA, MG-SST C-NOOFS nw-nat NEMO Env. Canadano

FOAM HYCOM Mercator

Intercomparison in the TAT Snapshot SST comparison the 15th of February 2008 with respect to OSTIA. Numbers in brackets correspond to RMS differences in the box limited area in the Gulf of Guinée (15°W-5°E and 5°S-5°N), and the box limited area for the Northern Tropical Atlantic (55-15°W and 5-25°N), plotted for the OSTIA figure. Units +3/-3 in Kelvin. HYCOM (0.73 / 0.35) PSY2V3 (0.34 / 0.39)

TNA SAT OSTIA SST Std Feb-April 2008 HYCOM FOAM PSY3 PSY2 OSTIA HYCOM FOAM PSY3 PSY2 OSTIA 0.5°C Box averaged SST 0.5°C

Assessment of EKE in NAT TOPAZ FOAM HYCOM C-NOOFS SURCOUF Mercator

Monthly comparison in April’08

Final GODAE intercomparison: general scientific outcomes GODAE eddy-permitting systems are consistent (i.e. match qualitatively the climatology, general patterns of the ocean circulation) and there is no “bad” surprise Accuracy assessment reveals differences, biases, possible errors in model or assimilation schemes… These evidence are a first step for targeted corrections and improvements Impact of horizontal resolution is evidenced on kinetic energy levels. Further work need to be done to identify the causes of differences between the systems (e.g., impact of forcing, data assimilation schemes….)

Final GODAE intercomparison Successes of the intercomparison:  The hindcasts/forecasts were made available and easily accessible (and people were responsive if there were problems accessing the data).  Most/all of the work was done using the Class 1 fields. These fields were generally produced using the agreed definitions (at least close enough to make it relatively easy to use them).  The comparison of the Class 1 fields highlighted some interesting differences between the systems.  Visibility of this work through scientific communication and publication  Observations were made available by the observing community, involved now in operational oceanography, and supporting the ocean forecasting centers

Final GODAE intercomparison Shortcomings of the intercomparison:  Some systems produced the metrics in their normal operational setting, whereas others were re-run in hindcast mode.  Some groups upgrade their systems in the meantime of the Intercomparison synthesis  Some systems produced forecasts and others just analysis fields.  Class 1 still need some homogenisation  Class 2 and 3 metrics were produced by some systems but not all, and no comprehensive assessment of them was carried out.  Very little/no work done on Class 4 metrics intercomparison  Most GODAE partners used FTP rather than OPENDAP (not technically efficient)  A demonstration rather than a routine intercomparison.  A three month period is a really short period of time to overview ocean forecasting system behaviour and performance  It would have been useful to meet to present and discuss results: the calendar was very tight  Several groups had problems to fully contribute to the exercise, and human resources dedicated to intercomparison synthesis were not available in all forecasting centres.

Discussion and outlook 1. What is the role of a validation/intercomparison Task Team? 2. Strategy of the validation/intercomparison Task Team 3. Clarify workplan of Intercomp/Val TT and interactions with: OSE/OSSE TT Coastal and Shelf Seas TT Biogeochemical TT ET-OOFS WCRP-CAS WGNE

1. What is the role of a validation/intercomparison Task Team? Core scientific activity: develop metrics, share experience, evidence differences, cross-fertilized ideas among GODAE centers Be consistent as a group in our monitoring policy: provide tool for monitoring routinely the systems, and controlling inputs (e.g. link with data providers), and outputs (mandatory link with users)  Main benefit: improvements of the systems, and the quality of products Provide visibility as GODAE community: demonstration, publications…

2. Strategy of the validation/intercomparison Task Team Rely on new targeted intercomparison exercices ? Establish permanent monitoring among the OOFS? Expect outcomes from regional activities (e.g. MyOcean, US Navy)?

2. Strategy of the validation/intercomparison Task Team Suggested scientific aspects that should be addressed Extend comparison with other set of independent observations, e.g. ocean colour, surface drifters Assessing the performance of the data assimilation using observation-minus- background and observation-minus-analysis statistics:  Useful to show accuracy of short-range forecasts and the performance of the assimilation.  Different analysis time-windows and operational schedules make it difficult to intercompare (o-b) between systems. Assessing the performance of the model through estimates of forecast skill:  Anomaly correlations and RMS differences between forecasts and analyses (and between forecasts and observations). Multi-model ensemble statistics  provide error levels and monitoring tools Design user oriented metrics for targeted applications (ocean climate monitoring, oil spill, S&R…)  Demonstration of routine validation activity Internal External

3. Clarify workplan of Intercomp/Val TT and interactions Take into account new OOFS (NCEP, MFS, China…) Diagnostics that allow the characterisation of biases, long term changes (link with GSOP) Link with coastal validation  Assessing the accuracy/impact of IC/BC (downscaling)  Share scientific assessment methodology Link with biogeochemistry validation  Assessing the accuracy/impact of the physical variables (vertical diffusion, coupling)  Share scientific assessment methodology Link with OSE/OSSE TT (characterize the impact of incoming data, feedbacks to relevant data providers) :  Develop common metrics for both validation and data impact assessment

Suggested plan for the coming months Use of existing Feb-Mar-April 2008 dataset:  Extended scientific validation ?  Inform which metrics should be integrating a possible routine monitoring (daily NRT production) Discuss future implementation depending on chosen strategy  Prepare workplan : roadmap document By end of september 2009 Review by OOFS Beginning of implementation in 2010 Prepare calendar for meetings/discussions  Topics to be addressed in the roadmap: Discuss technical aspect of NRT production (storage and exchange): possible link with ET-OOFS focus on a sub-set of useful metrics