OSEval-TT Community papers - 2014. Talk Outline  Engagement  Summary of community papers  Types of studies  Types of analyses  Questions asked 

Slides:



Advertisements
Similar presentations
1 GlobModel The GlobModel study, initial findings and objectives of the day Zofia Stott 13 September 2007.
Advertisements

Overview of MDL Course: Survey of Operational Oceanographic Products Murray Brown MarineDataLiteracy.org
GODAE OceanView Observing system Evaluation Task Team Report Peter Oke 1 and Gilles Larnicol 2 1 CSIRO Marine and Atmospheric.
GODAE OceanView Observing System Evaluation Task Team (OSEval TT) Session Introduction Peter Oke CSIRO Marine and Atmospheric.
The Way Forward From JCOMM-IV Some Personal Perspectives D.E.Harrison NOAA/PMEL & Univ. Wa. JCOMM-IV Technical Symposium Yeosu, South Korea May 2012.
Introduction Objective: Develop regional ocean forecasting capability AU$15M co-investment for Phase 1 Partners: Bureau, CSIRO, Navy Launched 2003, Phase1.
OOPC and OCG, April 2002 * OOPC Pilot Projects * Other OOPC Initiatives * OceanObs99 St. Raphael * CEOS/IGOS Ocean Theme * Toward a products/system approach.
GODAE OceanView-CLIVAR Workshop, Santa Cruz, June 2011 GODAE OceanView and its Task Teams Centre for Australian Weather and Climate Research; Wealth.
1 A Data Assimilation System for Costal Ocean Real-Time Predictions Zhijin Li and Yi Chao Jet Propulsion Laboratory, California Institute of Technology.
ROMS User Workshop, October 2, 2007, Los Angeles
ECOOP Meeting March 14-21, 2005 ECOOP WP7 Pierre-Yves LE TRAON Better use of remote sensing and in-situ observing systems for coastal/regional seas Objective.
OSE meeting GODAE, Toulouse 4-5 June 2009 Interest of assimilating future Sea Surface Salinity measurements.
Mercator Ocean activity
Building Bluelink David Griffin, Peter Oke, Andreas Schiller et al. March 2007 CSIRO Marine and Atmospheric Research.
Observing and Modelling the East Australian Current and its Eddies using IMOS data and Bluelink models David Griffin, Madeleine Cahill and Peter Oke CSIRO.
Observing System Evaluation Task Team Peter Oke 1 and Gilles Larnicol 2 1 CSIRO – Centre for Australian Weather and Climate Research 2 Collecte Localisation.
The Centre for Australian Weather and Climate Research A partnership between CSIRO and the Bureau of Meteorology Oscar Alves, Yonghong Yin, Robin Wedd,
1 Framework Programme 7 Guide for Applicants
Climate modeling: where are we headed? Interactive biogeochemistry Large ensemble simulations (multi-century) Seasonal-interannual forecasts High resolution.
JERICO KICK OFF MEETINGPARIS – Maison de la recherche - 24 & 25 May 2011 WP9: New Methods to Assess the Impact of Coastal Observing Systems Presented by.
GOV Technical Workshop OSE-IV - Santa Cruz, USA, June 2011 Fabrice Hernandez (Mercator Océan, Fr) and Matt Martin (Met Office, UK) GODAE OceanView.
GOVST-V Meeting, Beijing, China, 13 – 17 October 2014 GODAE OceanView V Meeting Topics and Objectives Andreas Schiller, Fraser Davidson and Kirsten Wilmer-Becker.
2007 OSTST Meeting Multi-satellite/Operational Applications Splinter Summary Chairs: G. Jacobs, C. Birkett, P. Oke March 2007 Ocean Surface Topography.
Ocean Data Variational Assimilation with OPA: Ongoing developments with OPAVAR and implementation plan for NEMOVAR Sophie RICCI, Anthony Weaver, Nicolas.
Main components of monitoring and forecasting in Arctic and sub-Arctic regions Modelling and Forecasting capacity From MERSEA IP to the Marine Core Service.
Inter-comparison and Validation Task Team Breakout discussion.
Joint WMO-IOC Technical Commission for Oceanography and Marine Meteorology Contributions to WIGOS David Meldrum, vice chair, JCOMM OPA.
Ocean Salinity validation of mission requirements review / improvements: Points of Reflexion ESL teams Mission Requirements: The so-called GODAE requirements:
Observing System Evaluation Task Team Report Peter Oke and Gilles Larnicol CSIRO and CLS.
GOV- CLIVAR workshop, 13 th -17 th June OSEVal Task Team WorkPlan Gilles Larnicol (CLS), Peter R. Oke (CSIRO)
GODAE OceanView Observing system Evaluation Task Team Report Peter Oke 1 and Gilles Larnicol 2 1 CSIRO Marine and Atmospheric.
Global Observing System Simulation Experiments (Global OSSEs) How It Works Nature Run 13-month uninterrupted forecast produces alternative atmosphere.
CPPA Past/Ongoing Activities - Ocean-Atmosphere Interactions - Address systematic ocean-atmosphere model biases - Eastern Pacific Investigation of Climate.
Potential impact of HF radar and gliders on ocean forecast system Peter Oke June 2009 CSIRO Marine and Atmospheric Research.
The I nverse R egional O cean M odeling S ystem Development and Application to Variational Data Assimilation of Coastal Mesoscale Eddies. Di Lorenzo, E.
Nadia PinardiI CMCCI Via A.Moro 44, Bologna 5 to / Oslo / Norway 2 nd General Assembly WP9- NEW METHODS TO ASSESS THE IMPACT.
Assimilation of HF radar in the Ligurian Sea Spatial and Temporal scale considerations L. Vandenbulcke, A. Barth, J.-M. Beckers GHER/AGO, Université de.
2nd GODAE Observing System Evaluation Workshop - June Ocean state estimates from the observations Contributions and complementarities of Argo,
The Mediterranen Forecasting System: 10 years of developments (and the next ten) N.Pinardi INGV, Bologna, Italy.
MPO 674 Lecture 28 4/23/15. The course on one slide 1. Intro: numerical models, ensembles, the science of prediction 2. Lorenz 1963,
GOVSTIII – Paris - November 2011 Eric Dombrowsky 1, Andreas Schiller 2, Kirsten Wilmer-Becker 3 1 Mercator Océan; 2 CSIRO; 3 the Met Office
Temporal Variability of Thermosteric & Halosteric Components of Sea Level Change, S. Levitus, J. Antonov, T. Boyer, R. Locarnini, H. Garcia,
JCOMM Services Program Area Working together beyond GODAE for Operational Oceanography Dr. Craig Donlon JCOMM Service Programme Area Coordinator The Met.
The Application of Observation Adjoint Sensitivity to Satellite Assimilation Problems Nancy L. Baker Naval Research Laboratory Monterey, CA.
Observing System Evaluation (OSEval) Breakout Session Peter Oke, Gilles Larnicol Santa Cruz, California, USA, June 2011.
Weak Constraint 4DVAR in the R egional O cean M odeling S ystem ( ROMS ): Development and application for a baroclinic coastal upwelling system Di Lorenzo,
Building Bluelink David Griffin, Peter Oke, Andreas Schiller et al. March 2007 CSIRO Marine and Atmospheric Research.
The end users perspective – who are we doing this for? (e.g., climate science and data assimilation efforts) Peter Oke et.
Joint OS & SWH meeting in support of Wide-Swath Altimetry Measurements Washington D.C. – October 30th, 2006 Baptiste MOURRE ICM – Barcelona (Spain) Pierre.
Argo: Tracking the Pulse of the Global Oceans. How do Argo floats work? Argo floats collect a temperature and salinity profile and a trajectory every.
Evaluation of Tropical Pacific Observing Systems Using NCEP and GFDL Ocean Data Assimilation Systems Y. Xue 1, C. Wen 1, X. Yang 2, D. Behringer 1, A.
First GODAE OceanView Science Team Meeting, Mercator-Ocean, Toulouse, 8-10 June GODAE OceanView: Task Teams and International Relationships Andreas.
GODAE OceanView Intercomparison Task Team Fabrice Hernandez and Matt Martin.
Ocean Syntheses David Behringer NOAA/NCEP NOAA Ocean Climate Observation 8th Annual PI Meeting June 25-27, 2012 Silver Spring, Maryland.
GODAE OSE workshop: Towards Routine Monitoring. Pratical informations Coffee breaks: 2 are schedulled oustside at 10h30 and 15h30. Lunch : a cold buffet.
Mediterranean- Gaps and Needs Nadia Pinardi University of Bologna Istituto Nazionale di Geofisica e Vulcanologia Italy.
CLIVAR PERSPECTIVE  Re-analysis and Seasonal Forecasting activities are common ground between the GODAE GOV and CLIVAR communities. This intersection.
U.S. Integrated Ocean Observing System (IOOS ® ) Z Improve safetyEnhance our economyProtect our environment CIMAR-GOMC meeting – 25 Feb 2015 Zdenka Willis.
Sean Healy Presented by Erik Andersson
Speaker I Organism I adresse mail WP9: NEW METHODS TO ASSESS THE IMPACT OF COASTAL OBSERVING SYSTEMS Presented by Srdjan Dobricic on.
Impact of TAO observations on Impact of TAO observations on Operational Analysis for Tropical Pacific Yan Xue Climate Prediction Center NCEP Ocean Climate.
1 A multi-scale three-dimensional variational data assimilation scheme Zhijin Li,, Yi Chao (JPL) James C. McWilliams (UCLA), Kayo Ide (UMD) The 8th International.
Observations and Ocean State Estimation: Impact, Sensitivity and Predictability Andy Moore University of California Santa Cruz Hernan Arango Rutgers University.
Real-time Ocean Reanalyses Intercomparison Project for Quantifying Impacts of Tropical Pacific Observing Systems on Constraining Ocean Reanalyses for ENSO.
IGST 12 – August 2007 – St Johns GODAE-OOPC OSSE/OSE meeting Paris, November The GODAE initial requirements and a strategy for a global observing.
Objectives Review work done on impact studies, OSEs and OSSEs over the past years Identify robust and common features Understand differences in assimilation.
1 Modeling and Forecasting for SCCOOS (Southern California Coastal Ocean Observing System) Yi Chao 1, 2 & Jim McWilliams 2 1 Jet Propulsion Laboratory,
MonGOOS network Enrique Alvarez, (Puertos del Estado)
GODAE Final Symposium, 12 – 15 November 2008, Nice, France
Presentation transcript:

OSEval-TT Community papers

Talk Outline  Engagement  Summary of community papers  Types of studies  Types of analyses  Questions asked  Reviewers’ comments  Evaluating OSEs – what’s best practice?

Engagement  Two OSEval community papers (global & regional):  CSIRO, CLS, JMA/MRI, EnvCan, MetOff, Mercator, ECMWF, UMiami, NERSC (Norway), UFBA (Brazil), UCSC (Brazil), SOCIB (Spain), CMRE (Italy), INGV (Italy), BoM, NOAA, Legos … 17 different institutions … 18 independent contributions  TPOS: Fujii et al.  MRI, NRL, NOAA, CSIRO, JPL, ECMWF, Mercator, JAMSTEC, BoM, SIO, MetOff, EnvCan, GFDL Princeton … 14 different institutions

OSEs  what are the impacts on model-obs mis-fits? ORAS4 FOAM REMO Mercator Bluelink

OSEs  what are the impacts on model-obs mis-fits? GIOPS MOVE-G FOAM MFS

CSIRO/eReefs – footprint Other methods Bluelink – TS analysis Bluelink – spectra  What properties are constrained?  What regions are monitored?  What frequencies are resolved?

Other methods CLS – DFS Umiami - RMspec UCSC – 4dVar sensitivity  What is the relative information content from different observations?

Variety of methods used Bluelink OSEs MFS OSEs REMO OSEs FOAM OSEs (mammals) UMiami OSSEs Ligurian Sea ROMS OSSEs UCSC ROMS 4dVar sensitivity Umiami RMspec CSIRO/eReefs biological footprint Bluelink spectra Mercator OSEs FOAM NRT OSEs GIOPS OSEs Bluelink TS analysis CLS DFS ECMWF OSEs MOVE-F OSEs OSEsx9 OSSEsx2 4dVar sensitivity Rmspec Bio footprint Spectra TS analysis DFS

Reviewers’ Comments

Summary of key points from reviewers of the global study The topic is not really new but interesting, and the paper should well fit into the Journal of Operational Oceanography. – Multivariate impacts: the authors show how the Argo data impact on the spatial and temporal representation of the temperature and salinity. I would like to know the impact in term of sea level as it is made by the FOAM group. – The paper describes OSEs by different global ocean model operators; these experiments vary in their implementation but (mostly) produce similar results - that each component of the GOOS plays a role in improving the quality of ocean model simulations.

Summary of key points from reviewers of the regional study The paper provides a summary of GODAE OceanView observation impact studies at regional scales. This is an interesting and useful paper that provides a good summary of regional OSEs and OSSEs studies. The paper is structured as a series of results from different groups. This is fine but there should be more discussion on transverse issues (methodological aspects and "robust results and recommendations" that can be derived from the different experiments).

Summary of key points from reviewers of the regional study Comment on … the development of regional ocean observing systems to complement GOOS at regional scales (e.g. GOOS regional alliances). The following sentences were added: “Regional observation platforms include mooring arrays, land-based high- frequency (HF) radar arrays and repeat glider deployments and are organised under projects such as EuroGOOS ( USGOOS ( goos.org/usgoos) or IOOS ( IOGOOS ( and IMOS ( and other partnerships.” goos.org/usgooswww.ioos.noaa.govwww.incois.gov.in/Incois/iogoos/intro.jspwww.imos.org.au

Summary of key points from reviewers of the regional study I am unsure how to proceed with this paper. It has no scientific merit on its own, rather it serves to point the reader to other works. Taken as a whole, it provides no information about how observations impact forecasts or state estimates because each section merely describes that data were withheld and assimilated and compare the two. Haven't we grown beyond this as a field?

Summary of key points from reviewers of the regional study I am unsure how to proceed with this paper. It has no scientific merit on its own, rather it serves to point the reader to other works. Taken as a whole, it provides no information about how observations impact forecasts or state estimates because each section merely describes that data were withheld and assimilated and compare the two. Haven't we grown beyond this as a field? Response The methods showcased in this community paper include: Observing System Experiments (OSEs); Observing System Simulation Experiments (OSSEs); Adjoint sensitivity analysis; Analysis of the Representer Matrix Spectrum (RMspec) using Polynomial Chaos (PC) theory; Observation footprint estimation; and Spectral analysis. We don’t agree that … “each section merely describes that data were withheld and assimilated and compare the two”. I still don’t find it a particularly useful contribution 

Evaluating OSEs  Explain why you are using here a 90th percentile of the RMS difference (to estimate the maximum values).  Note that changes in T and S fields do not necessarily mean here improved T&S fields.

Evaluating OSEs  Explain why you are using here a 90th percentile of the RMS difference (to estimate the maximum values).  Note that changes in T and S fields do not necessarily mean here improved T&S fields. Fujii et al. (2014) – TPOS community paper

Evaluating OSEs “Suppose we compare the difference between two OSE simulations, where OSE X+Y assimilates observation types “X” and “Y”, and OSE Y that assimilates only observation type “Y”. The difference between OSE X+Y and OSE Y does not necessarily quantify the “improvement” attributable to observation type “X”. However, it does faithfully quantify the “impact” of observation type “X”. It is preferable to quantify the improvement, not just the impact, but the availability of sufficient independent observations is a common problem for systems that seek to assimilate all available observations.”

Reviewers’ Comments  Not really new;  Multivariate impacts;  OSEs from different systems produce similar results;  Discussion on transverse issues;  Regional observations compliment the GOOS;  Haven't we grown beyond this as a field?  What’s best practice for evaluating OSEs?

Discussion  What’s best practice for evaluating OSEs?  How are OSSE and OSE results best disseminated?  Are our methods acceptable? How can we improve/refine?