Ensemble variance loss in transport models:

Slides:



Advertisements
Similar presentations
Bayesian Belief Propagation
Advertisements

ASME-PVP Conference - July
Environmental Data Analysis with MatLab Lecture 8: Solving Generalized Least Squares Problems.
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
AOSS 321, Winter 2009 Earth System Dynamics Lecture 10 2/10/2008 Christiane Jablonowski Eric Hetland
Observers and Kalman Filters
Jidong Gao and David Stensrud Some OSSEs on Assimilation of Radar Data with a Hybrid 3DVAR/EnKF Method.
1 MECH 221 FLUID MECHANICS (Fall 06/07) Tutorial 6 FLUID KINETMATICS.
Symmetry. Phase Continuity Phase density is conserved by Liouville’s theorem.  Distribution function D  Points as ensemble members Consider as a fluid.
Probability theory 2011 The multivariate normal distribution  Characterizing properties of the univariate normal distribution  Different definitions.
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Chapter 4 Numerical Solutions to the Diffusion Equation.
Accounting for correlated AMSU-A observation errors in an ensemble Kalman filter 18 August 2014 The World Weather Open Science Conference, Montreal, Canada.
Numerical Methods for Partial Differential Equations
Probability theory 2008 Outline of lecture 5 The multivariate normal distribution  Characterizing properties of the univariate normal distribution  Different.
Lecture II-2: Probability Review
Separate multivariate observations
Nonlinear Data Assimilation and Particle Filters
LECTURE 2. GENERALIZED LINEAR ECONOMETRIC MODEL AND METHODS OF ITS CONSTRUCTION.
CSDA Conference, Limassol, 2005 University of Medicine and Pharmacy “Gr. T. Popa” Iasi Department of Mathematics and Informatics Gabriel Dimitriu University.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
A cell-integrated semi-Lagrangian dynamical scheme based on a step-function representation Eigil Kaas, Bennert Machenhauer and Peter Hjort Lauritzen Danish.
Introduction 1. Similarity 1.1. Mechanism and mathematical description 1.2. Generalized variables 1.3. Qualitative analysis 1.4. Generalized individual.
MODEL ERROR ESTIMATION EMPLOYING DATA ASSIMILATION METHODOLOGIES Dusanka Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University.
Serge Andrianov Theory of Symplectic Formalism for Spin-Orbit Tracking Institute for Nuclear Physics Forschungszentrum Juelich Saint-Petersburg State University,
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
Multiscale data assimilation on 2D boundary fluxes of biological aerosols Yu Zou 1 Roger Ghanem 2 1 Department of Chemical Engineering and PACM, Princeton.
Errors, Uncertainties in Data Assimilation François-Xavier LE DIMET Université Joseph Fourier+INRIA Projet IDOPT, Grenoble, France.
Quality of model and Error Analysis in Variational Data Assimilation François-Xavier LE DIMET Victor SHUTYAEV Université Joseph Fourier+INRIA Projet IDOPT,
Data Modeling Patrice Koehl Department of Biological Sciences National University of Singapore
Local Predictability of the Performance of an Ensemble Forecast System Liz Satterfield and Istvan Szunyogh Texas A&M University, College Station, TX Third.
1 EE571 PART 3 Random Processes Huseyin Bilgekul Eeng571 Probability and astochastic Processes Department of Electrical and Electronic Engineering Eastern.
Determining Key Model Parameters of Rapidly Intensifying Hurricane Guillermo(1997) Using the Ensemble Kalman Filter Chen Deng-Shun 16 Apr, 2013, NCU Godinez,
Data assimilation applied to simple hydrodynamic cases in MATLAB
Chapter 2: Probability. Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance.
Geogg124: Data assimilation P. Lewis. What is Data Assimilation? Optimal merging of models and data Models Expression of current understanding about process.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Kalman Filter with Process Noise Gauss- Markov.
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and  2 Now, we need procedures to calculate  and  2, themselves.
Chapter 5 Joint Probability Distributions and Random Samples  Jointly Distributed Random Variables.2 - Expected Values, Covariance, and Correlation.3.
École Doctorale des Sciences de l'Environnement d’Île-de-France Année Universitaire Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
11/25/03 3D Model Acquisition by Tracking 2D Wireframes Presenter: Jing Han Shiau M. Brown, T. Drummond and R. Cipolla Department of Engineering University.
Data Modeling Patrice Koehl Department of Biological Sciences
Numerical Solutions to the Diffusion Equation
Hybrid Data Assimilation
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and 2 Now, we need procedures to calculate  and 2 , themselves.
CHEM-E7130 Process Modeling Lecture 6
Chapter 2: Measurements and Calculations
An accurate, efficient method for calculating hydrometeor advection in multi-moment bulk and bin microphysics schemes Hugh Morrison (NCAR*) Thanks to:
Continuum Mechanics (MTH487)
Adjoint modeling and applications
CH 5: Multivariate Methods
Addy Satija and Jef Caers Department of Energy Resources Engineering
Advection – Diffusion Equation
background error covariance matrices Rescaled EnKF Optimization
Advection – Diffusion Equation
Quantum One.
FSOI adapted for used with 4D-EnVar
topic13_grid_generation
STOCHASTIC HYDROLOGY Random Processes
Bayes and Kalman Filter
Feature space tansformation methods
Generally Discriminant Analysis
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and 2 Now, we need procedures to calculate  and 2 , themselves.
11. Conditional Density Functions and Conditional Expected Values
11. Conditional Density Functions and Conditional Expected Values
Kalman Filter: Bayes Interpretation
Accelerator Physics Statistical Effects
Accelerator Physics G. A. Krafft, A. Bogacz, and H. Sayed
Accelerator Physics G. A. Krafft, A. Bogacz, and H. Sayed
Presentation transcript:

Ensemble variance loss in transport models: Its relation with model numerical discretization by Richard Ménard and Sergey Skachko Environment and Climate Change Canada Dorval, Quebec, CANADA Workshop on Meteorological Sensitivity and Data Assimilation Aveiro, Portugal, July 2, 2018

Motivation The transport of information from one observation time to the next is important for an optimal data assimilation system Initial condition uncertainty is important to the forecast uncertainty To what extent the numerical discretization of the model influences the forecast uncertainty ? We will examine this question with one of the simplest processes – advection (and here linear advection – not Burgers equation ) CLAES (IR emission) HALOE (solar occultation) and within an assimilation cycle medium dense observations coverage sparse obs. After 5 days of pure transport , Ne = 500

Motivation When using different numerical schemes the model error variance t can differ by a factor 2 (with a modestly dense observations) Analysis error variance can also be different by a factor 2 standard KF KF with variance correction Ménard et al 2000 MWR, Ménard and Chang 2000 MWR

Transport of passive tracer Eulerian coordinates passive tracer, e.g. mass mixing ratio of an air constituent Lagrangian coordinates Let represent the position of fluid particles at t=0, and moving with the flow The flow is given by the winds V

Conservative properties in Lagrangian coordinates Assuming that the flow is known (i.e. deterministic) makes the advection a linear problem. ● Consider an ensemble of Ne initial Tracer values for each fluid particles ● The ensemble mean is conserved, ● covariance between a pair particles is also conserved, ● in fact the full pdf , p , is conserved in the Lagrangian coordinates. A nice property it we were to apply it to particle filters.

But the Eulerian and the Lagrangian models may give widely different uncertainties

Same numerical model to evolve V and calculate Pii After 8 day of transport evolving V (Lagrangian solution) contours are for each 1% contours are for each 10-20 %

Time stepping of the error covariance is done by in two steps Consider 1D advection uniform wind. Donor cell upstream or semi-lagrangian where is the Courant number. Time stepping of the error covariance is done by in two steps 1) updating with respect to the x1 coordinate 2) updating with respect to the x2 coordinate Remark: In matrix form, the result of step 1 and 2 is equivalent to Specifically for the 1D advection transport scheme above

The difference, equation (2) minus equation (1), is Combining those two equations and writing the result for i = j (the same point) i.e. the error variance (1) Whereas from the Lagrangian description, the error variance should simply be advected (2) The difference, equation (2) minus equation (1), is a net loss of error variance (3) To recover the variance predicted by a Lagrangian description, the error variance obtained from an Eulerian model need to be increased by the deficit (3), i.e. This is an explicit form for inflation. Usually inflation is modeled as multiplicative or additive or a combination of both. But here we can see that inflation (correction) also depends on the courant number and the correlation length

Inflation – illustration in a 1D case simple upstream scheme, uniform wind EnKF numerical solution = Advection of variance + correction term with a simple upstream scheme the correction error term =

Variance evolution for different 1D models: uniform winds

Pdf evolution for ODE models: Liouville equation Suppose we discretized the variable q into a N components (i.e. state space of dimension N). The model evolution can be written in the form The pdf evolution is given by forward Kolmogorov (or Fokker-Planck) equation with no browning motion, i.e. Liouville equation is a contracting of volume in phase space conservation of volume in phase space. The model equation is time reversible Egger 1996, MWR

Evolution for discrete time models The probability to find realizations in an N-dimensional volume in phase space, should be equal to find the same realizations next time step in the evolved state space volume or to say that The change in the N-dimensional volume is given by

a piece of intuition If we consider a phase space of dimension = 1, and a uniform distribution is a measure of volume in phase space. The variance of q is a b Variance and volume in phase space are related. So, let’s assume that the changes in error variance is linked with the changes in phase space volume

Variance evolution for different 1D models: uniform winds mean deformation per axis scheme determinant ^(1/N) Lagrangian 1 Spectral Semi-lag (2) 0.6376 Upwind donor cell semi-lag(2) and upwind Courant det^(1/N) 0.0 1.00 0.2 0.64 0.5 0.25 0.8 1.0 * results rather independent of N

Conclusions Spatial discretization errors rather than time discretization errors give rise (generally) to loss of error variance (i.e. information). The spatial splitting error (not the time splitting) in the covariance evolution is the critical to Inflation used in EnKF compensates, at least in part, to the numerical variance loss. We derived an analytical form for the inflation for the semi-Lagrangian and upstream scheme. This expression depends on the local courant number, the covariance and the covariance length scale. Pieces to finish this work Refine and used other 1D models Extend the uniform distribution argument to normal distributions Ongoing work with a 3D transport models Postdoc at Environment Canada Air quality DA and chemical model reduction

Thanks for your attention

Evolution of covariance function with we get (as in Cohn 1993) solution using the method of characteristics Then is a function of time only

Solution : variance function equation for then the characteristics remain coincident x1(t) x2(t) x1(0) x2(0) the covariance at the same point (i.e. the variance) is constant along the characteristics (or along the flow)

How does it relate to an EnKF ? We start with …………….(1) discretize in space, and solve the evolution by operator splitting (first-order), on and then on We can show that this is equivalent to solving the covariance matrices as ……(2) where M is the solution operator of