Data Assimilation Using Modulated Ensembles Craig H. Bishop, Daniel Hodyss Naval Research Laboratory Monterey, CA, USA September 14, 2009 Data Assimilation.

Slides:



Advertisements
Similar presentations
Introduction to data assimilation in meteorology Pierre Brousseau, Ludovic Auger ATMO 08,Alghero, september 2008.
Advertisements

Object Specific Compressed Sensing by minimizing a weighted L2-norm A. Mahalanobis.
The Inverse Regional Ocean Modeling System:
© Crown copyright Met Office Development of the Met Office's 4DEnVar System 6th EnKF Data Assimilation Workshop, May Andrew Lorenc, Neill Bowler,
Initialization Issues of Coupled Ocean-atmosphere Prediction System Climate and Environment System Research Center Seoul National University, Korea In-Sik.
Targetting and Assimilation: a dynamically consistent approach Anna Trevisan, Alberto Carrassi and Francesco Uboldi ISAC-CNR Bologna, Italy, Dept. of Physics.
Accounting for ensemble variance inaccuracy with Hybrid Ensemble 4D-VAR “There are known knowns; there are things we know we know. We also know there are.
Review of “Covariance Localization” in Ensemble Filters Tom Hamill NOAA Earth System Research Lab, Boulder, CO NOAA Earth System Research.
Advanced data assimilation methods with evolving forecast error covariance Four-dimensional variational analysis (4D-Var) Shu-Chih Yang (with EK)
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
UNBIASED ESTIAMTION OF ANALYSIS AND FORECAST ERROR VARIANCES
Two Methods of Localization  Model Covariance Matrix Localization (B Localization)  Accomplished by taking a Schur product between the model covariance.
Models for model error –Additive noise. What is Q(x 1, x 2, t 1, t 2 )? –Covariance inflation –Multiplicative noise? –Parameter uncertainty –“Structural”
A comparison of hybrid ensemble transform Kalman filter(ETKF)-3DVAR and ensemble square root filter (EnSRF) analysis schemes Xuguang Wang NOAA/ESRL/PSD,
Lili Lei1,2, David R. Stauffer1 and Aijun Deng1
Comparison of hybrid ensemble/4D- Var and 4D-Var within the NAVDAS- AR data assimilation framework The 6th EnKF Workshop May 18th-22nd1 Presenter: David.
Recent developments in data assimilation for global deterministic NWP: EnVar vs. 3D-Var and 4D-Var Mark Buehner 1, Josée Morneau 2 and Cecilien Charette.
The impact of localization and observation averaging for convective-scale data assimilation in a simple stochastic model Michael Würsch, George C. Craig.
Ensemble-variational sea ice data assimilation Anna Shlyaeva, Mark Buehner, Alain Caya, Data Assimilation and Satellite Meteorology Research Jean-Francois.
Ensemble Data Assimilation and Uncertainty Quantification Jeffrey Anderson, Alicia Karspeck, Tim Hoar, Nancy Collins, Kevin Raeder, Steve Yeager National.
ESA DA Projects Progress Meeting 2University of Reading Advanced Data Assimilation Methods WP2.1 Perform (ensemble) experiments to quantify model errors.
EnKF Overview and Theory
3D/4D-Var Methods Liang Xu (NRL) JCSDA Summer Colloquium on Satellite DA 1 3D-Var/4D-Var Solution Methods Liang Xu Naval Research Laboratory, Monterey,
Craig H. Bishop Naval Research Laboratory, Monterey JCSDA Summer Colloquium July 2012 Santa Fe, NM Background Error Covariance Modeling 1.
Space and Time Multiscale Analysis System A sequential variational approach Yuanfu Xie, Steven Koch Steve Albers and Huiling Yuan Global Systems Division.
CSDA Conference, Limassol, 2005 University of Medicine and Pharmacy “Gr. T. Popa” Iasi Department of Mathematics and Informatics Gabriel Dimitriu University.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
3DVAR Retrieval of 3D Moisture Field from Slant- path Water Vapor Observations of a High-resolution Hypothetical GPS Network Haixia Liu and Ming Xue Center.
MPO 674 Lecture 20 3/26/15. 3d-Var vs 4d-Var.
Stephanie Guedj Florence Rabier Vincent Guidard Benjamin Ménétrier Observation error estimation in a convective-scale NWP system.
Model dependence and an idea for post- processing multi-model ensembles Craig H. Bishop Naval Research Laboratory, Monterey, CA, USA Gab Abramowitz Climate.
Ensemble Data Assimilation for the Mesoscale: A Progress Report Massimo Bonavita, Lucio Torrisi, Francesca Marcucci CNMCA National Meteorological Service.
Potential Benefits of Multiple-Doppler Radar Data to Quantitative Precipitation Forecasting: Assimilation of Simulated Data Using WRF-3DVAR System Soichiro.
Can we Predict the Impact of Observations on 3 to 6 day Winter Weather Forecasts? Masters Thesis Defense May 10, 2007 Kathryn J. Sellwood University of.
The I nverse R egional O cean M odeling S ystem Development and Application to Variational Data Assimilation of Coastal Mesoscale Eddies. Di Lorenzo, E.
Data assimilation, short-term forecast, and forecasting error
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
Covariance Modeling “Where America’s Climate, Weather, Ocean and Space Weather Services Begin” JCSDA Summer Colloquium July 27, 2015 Presented by John.
Ensemble data assimilation in an operational context: the experience at the Italian Weather Service Massimo Bonavita and Lucio Torrisi CNMCA-UGM, Rome.
Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz First Experience with KENDA at MeteoSwiss Daniel Leuenberger,
Sabrina Rainwater David National Research Council Postdoc at NRL with Craig Bishop and Dan Hodyss Naval Research Laboratory Multi-scale Covariance Localization.
Deutscher Wetterdienst Vertical localization issues in LETKF Breogan Gomez, Andreas Rhodin, Hendrik Reich.
Lennart Bengtsson ESSC, Uni. Reading THORPEX Conference December 2004 Predictability and predictive skill of weather systems and atmospheric flow patterns.
Ensemble assimilation & prediction at Météo-France Loïk Berre & Laurent Descamps.
The Application of Observation Adjoint Sensitivity to Satellite Assimilation Problems Nancy L. Baker Naval Research Laboratory Monterey, CA.
Local Predictability of the Performance of an Ensemble Forecast System Liz Satterfield and Istvan Szunyogh Texas A&M University, College Station, TX Third.
Implementation and Testing of 3DEnVAR and 4DEnVAR Algorithms within the ARPS Data Assimilation Framework Chengsi Liu, Ming Xue, and Rong Kong Center for.
Developments of a dynamically consistent targeting and assimilation method Alberto Carrassi (°), Anna Trevisan (*) and Francesco Uboldi (§) (°) Dept. of.
The I nverse R egional O cean M odeling S ystem Development and Application to Variational Data Assimilation of Coastal Mesoscale Eddies. Di Lorenzo, E.
2007/3/19 MRI, Tsukuba Recent developments of the local ensemble transform Kalman filter (LETKF) at JMA Takemasa Miyoshi (NPD/JMA) Collaborators: Shozo.
Targetting and Assimilation: a dynamically consistent approach Anna Trevisan (*), Alberto Carrassi (°) and Francesco Uboldi (§) (*) ISAC-CNR Bologna,
A Random Subgrouping Scheme for Ensemble Kalman Filters Yun Liu Dept. of Atmospheric and Oceanic Science, University of Maryland Atmospheric and oceanic.
Global vs mesoscale ATOVS assimilation at the Met Office Global Large obs error (4 K) NESDIS 1B radiances NOAA-15 & 16 HIRS and AMSU thinned to 154 km.
The Ensemble Kalman filter
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
Hybrid Data Assimilation
Japan Meteorological Agency / Meteorological Research Institute
Methods for dealing with spurious covariances arising from small samples in ensemble data assimilation Jeff Whitaker NOAA Earth.
Data Assimilation Theory CTCD Data Assimilation Workshop Nov 2005
A comparison of 4D-Var with 4D-En-Var D. Fairbairn. and S. R. Pring
Observation Informed Generalized Hybrid Error Covariance Models
Accelerating Local Ensemble Tangent Linear Models with order reduction Craig H. Bishop The University of Melbourne, Parkville, Australia Joanna.
Vertical localization issues in LETKF
Andrew Lorenc 11th Adjoint Workshop, Aveiro Portugal, July 2018
FSOI adapted for used with 4D-EnVar
Initial trials of 4DEnVAR
Comparison of different combinations of ensemble-based and variational data assimilation approaches for deterministic NWP Mark Buehner Data Assimilation.
Project Team: Mark Buehner Cecilien Charette Bin He Peter Houtekamer
Sarah Dance DARC/University of Reading
Presentation transcript:

Data Assimilation Using Modulated Ensembles Craig H. Bishop, Daniel Hodyss Naval Research Laboratory Monterey, CA, USA September 14, 2009 Data Assimilation Using Modulated Ensembles

Overview Motivation for adaptive ensemble covariance localization Method Adaptive ensemble covariance localization in ensemble 4D-VAR Results from preliminary comparison of DA performance with operational covariance model using pseudo-obs Show that adaptive localization enables ensemble based TLM Conclusions

Data Assimilation Using Modulated Ensembles Ensembles give flow dependent, but noisy correlations Stable flow error correlations x10km Unstable flow error correlations Motivation

Data Assimilation Using Modulated Ensembles Today’s fixed localization functions limit adaptivity Current ensemble DA techniques reduce noise by multiplying ensemble correlation function by fixed localization function (green line). Resulting correlations (blue line) are too thin when true correlation is broad and too noisy when true correlation is thin. Stable flow error correlations x10km Unstable flow error correlations Fixed localization Motivation

Data Assimilation Using Modulated Ensembles Today’s fixed localization functions limit ensemble-based 4D DA Stable flow error correlations x10km Unstable flow error correlations Current ensemble localization functions poorly represent propagating error correlations. t = 0 Motivation

Data Assimilation Using Modulated Ensembles Stable flow error correlations x10km Unstable flow error correlations Current ensemble localization functions poorly represent propagating error correlations. t = 0 t = 1 Today’s fixed localization functions limit ensemble-based 4D DA Motivation

Data Assimilation Using Modulated Ensembles Green line now gives an example of one of the adaptive localization functions that are the subject of this talk. Want localization to adapt to width and propagation of true correlation Stable flow error correlations Unstable flow error correlations t = 0 t = 1 x10km

Data Assimilation Using Modulated Ensembles Stable flow error correlations km Unstable flow error correlations Current ensemble localization functions do not adapt to the spatial scale of raw ensemble correlations and they poorly preserve propagating error correlations. t = 0 t = 1 Motivation

Data Assimilation Using Modulated Ensembles _ _ An adaptive ensemble covariance localization technique (Bishop and Hodyss, 2007, QJRMS) Method

Data Assimilation Using Modulated Ensembles Green line now gives an example of one of the adaptive localization functions that are the subject of this talk. Stable flow error correlations Unstable flow error correlations t = 0 t = 1 km Key Finding: Moderation functions based on smoothed ensemble correlations provide scale adaptive and propagating localization functions. Method

Data Assimilation Using Modulated Ensembles (Bishop and Hodyss, 2009 a and b, Tellus) Modulated ensembles and localization

Data Assimilation Using Modulated Ensembles Raw ensemble member k Smooth ensemble member j Smooth ensemble member i Modulated ensemble member Modulated ensembles and localization

Data Assimilation Using Modulated Ensembles Modulated ensembles enable global 4DVAR

Data Assimilation Using Modulated Ensembles 06Z Ensemble based localization moves about 1000 km in 12 hrs. This is >=half-width of a typical LETKF observation volume (~900km). Application to global NWP model

Data Assimilation Using Modulated Ensembles 18Z Naval Research Laboratory Marine Meteorology Division Monterey, California Ensemble based localization moves about 1000 km in 12 hrs. This is >=half-width of a typical LETKF observation volume (~900km). Application to global NWP model

Data Assimilation Using Modulated Ensembles Increment 06Z Statistical TLM implied by mobile adaptively localized covariance propagates single observation increment 1000 km in 12 hrs. Application to global NWP model

Data Assimilation Using Modulated Ensembles Increment 18Z Statistical TLM implied by mobile adaptively localized covariance propagates single observation increment 1000 km in 12 hrs. Application to global NWP model

Data Assimilation Using Modulated Ensembles Red square  NAVDAS Blue Circle  Anomaly Correlation Higher is better RMS(Analysis Error)/RMS(Forecast Error) Lower is better Anomaly correlation is between analysis correction and the “perfect” correction that would have eliminated all initial condition error. Adaptively localized ensemble covariance produced smaller initial condition errors than covariance model used in operational 3D-PSAS/NAVDAS scheme Comparison of background covariances

Data Assimilation Using Modulated Ensembles 12 hr 6 hr Solid – attenuation Dashed – no attenuation Adaptive localization enables ensemble TLM

Data Assimilation Using Modulated Ensembles Accuracy of ECMWF TLM

Data Assimilation Using Modulated Ensembles It can be argued that the ability of the TLM to represent differences between perturbed and unperturbed trajectories is less important than its ability to accurately describe 4D covariances. Adaptively localized ensemble covariances have the advantage of incorporating the effects of non-linear dynamics on 4D covariances. Disadvantage of adaptive localization scheme shown here is that it does not handle linear dispersion as well as typical TLM/PFMs. Comment on TLM/PFM accuracy

Data Assimilation Using Modulated Ensembles Conclusions Adaptive localization should aim to account for propagation and scale variations of error distribution Proposed adaptive localization given by even powers of correlations of smoothed ensemble Huge modulated ensembles give square root of localized ensemble covariance matrix Errors can move over 1000 km in 12 hr window Modulated ensembles enable 4D-VAR global solve Adaptively localized covariance beats operational covariance model in idealized experiment with pseudo- obs Adaptive localization enables ensemble based TLMs