Ekaterina Klimova Ekaterina TECHNIQUE OF DATA ASSIMILATION ON THE BASIS OF THE KALMAN FILTER Institute of Computational Technologies SB RAS

Slides:



Advertisements
Similar presentations
Operational Numerical Forecasting on Tropical Cyclones Yuqing Wang International Pacific Research Center and Department of Meteorology University of Hawaii.
Advertisements

Ross Bannister Balance & Data Assimilation, ECMI, 30th June 2008 page 1 of 15 Balance and Data Assimilation Ross Bannister High Resolution Atmospheric.
ECMWF flow dependent workshop, June Slide 1 of 14. A regime-dependent balanced control variable based on potential vorticity Ross Bannister, Data.
Page 1 of 26 A PV control variable Ross Bannister* Mike Cullen *Data Assimilation Research Centre, Univ. Reading, UK Met Office, Exeter, UK.
Chapter 13 – Weather Analysis and Forecasting
A fast physical algorithm for hyperspectral sounding retrieval Zhenglong Li #, Jun Li #, Timothy J. and M. Paul Menzel # # Cooperative Institute.
1B.17 ASSESSING THE IMPACT OF OBSERVATIONS AND MODEL ERRORS IN THE ENSEMBLE DATA ASSIMILATION FRAMEWORK D. Zupanski 1, A. Y. Hou 2, S. Zhang 2, M. Zupanski.
Introduction to data assimilation in meteorology Pierre Brousseau, Ludovic Auger ATMO 08,Alghero, september 2008.
Probabilistic Reasoning over Time
Incorporation of dynamic balance in data assimilation and application to coastal ocean Zhijin Li and Kayo Ide SAMSI, Oct. 5, 2005,
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
Dimension reduction (1)
Initialization Issues of Coupled Ocean-atmosphere Prediction System Climate and Environment System Research Center Seoul National University, Korea In-Sik.
Effects of model error on ensemble forecast using the EnKF Hiroshi Koyama 1 and Masahiro Watanabe 2 1 : Center for Climate System Research, University.
Balance in the EnKF Jeffrey D. Kepert Centre for Australian Weather and Climate Research A partnership between the Australian Bureau of Meteorology and.
Data assimilation schemes in numerical weather forecasting and their link with ensemble forecasting Gérald Desroziers Météo-France, Toulouse, France.
Toward a Real Time Mesoscale Ensemble Kalman Filter Gregory J. Hakim Dept. of Atmospheric Sciences, University of Washington Collaborators: Ryan Torn (UW)
14-15/Oct.2010 G. Levy – Data Assimilation/Forecasting 1 Data Assimilation – An Overview Outline: –What is data assimilation? –What types of data might.
A Concept of Environmental Forecasting and Variational Organization of Modeling Technology Vladimir Penenko Institute of Computational Mathematics and.
To understand the differing localization strength, consider two grid points, observation at grid point 1. K for grid point 2: (d 12 = distance between.
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Two Methods of Localization  Model Covariance Matrix Localization (B Localization)  Accomplished by taking a Schur product between the model covariance.
Principal Component Analysis Principles and Application.
A comparison of hybrid ensemble transform Kalman filter(ETKF)-3DVAR and ensemble square root filter (EnSRF) analysis schemes Xuguang Wang NOAA/ESRL/PSD,
Statistical Methods for long-range forecast By Syunji Takahashi Climate Prediction Division JMA.
Numerical Weather Prediction Division The usage of the ATOVS data in the Korea Meteorological Administration (KMA) Sang-Won Joo Korea Meteorological Administration.
Introduction to Data Assimilation: Lecture 2
The Importance of Atmospheric Variability for Data Requirements, Data Assimilation, Forecast Errors, OSSEs and Verification Rod Frehlich and Robert Sharman.
1 ESTIMATING THE STATE OF LARGE SPATIOTEMPORALLY CHAOTIC SYSTEMS: WEATHER FORECASTING, ETC. Edward Ott University of Maryland Main Reference: E. OTT, B.
CSDA Conference, Limassol, 2005 University of Medicine and Pharmacy “Gr. T. Popa” Iasi Department of Mathematics and Informatics Gabriel Dimitriu University.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
« Data assimilation in isentropic coordinates » Which Accuracy can be achieved using an high resolution transport model ? F. FIERLI (1,2), A. HAUCHECORNE.
A study of relations between activity centers of the climatic system and high-risk regions Vladimir Penenko & Elena Tsvetova.
Data assimilation and observing systems strategies Pierre Gauthier Data Assimilation and Satellite Meteorology Division Meteorological Service of Canada.
Tbilisi, GGSWBS'14 Optimization for inverse modelling Ketevan Kasradze 1 Hendrik Elbern 1,2
Chapter 21 R(x) Algorithm a) Anomaly Detection b) Matched Filter.
Applications of optimal control and EnKF to Flow Simulation and Modeling Florida State University, February, 2005, Tallahassee, Florida The Maximum.
Assimilating chemical compound with a regional chemical model Chu-Chun Chang 1, Shu-Chih Yang 1, Mao-Chang Liang 2, ShuWei Hsu 1, Yu-Heng Tseng 3 and Ji-Sung.
MODEL ERROR ESTIMATION EMPLOYING DATA ASSIMILATION METHODOLOGIES Dusanka Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University.
Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005.
Research Vignette: The TransCom3 Time-Dependent Global CO 2 Flux Inversion … and More David F. Baker NCAR 12 July 2007 David F. Baker NCAR 12 July 2007.
Data assimilation, short-term forecast, and forecasting error
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
Multiscale data assimilation on 2D boundary fluxes of biological aerosols Yu Zou 1 Roger Ghanem 2 1 Department of Chemical Engineering and PACM, Princeton.
Errors, Uncertainties in Data Assimilation François-Xavier LE DIMET Université Joseph Fourier+INRIA Projet IDOPT, Grenoble, France.
Quality of model and Error Analysis in Variational Data Assimilation François-Xavier LE DIMET Victor SHUTYAEV Université Joseph Fourier+INRIA Projet IDOPT,
Local Predictability of the Performance of an Ensemble Forecast System Liz Satterfield and Istvan Szunyogh Texas A&M University, College Station, TX Third.
École Doctorale des Sciences de l'Environnement d’Île-de-France Année Universitaire Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
Hydrologic Data Assimilation with a Representer-Based Variational Algorithm Dennis McLaughlin, Parsons Lab., Civil & Environmental Engineering, MIT Dara.
Data assimilation applied to simple hydrodynamic cases in MATLAB
Data assimilation for weather forecasting G.W. Inverarity 06/05/15.
MPO 674 Lecture 2 1/20/15. Timeline (continued from Class 1) 1960s: Lorenz papers: finite limit of predictability? 1966: First primitive equations model.
One-dimensional assimilation method for the humidity estimation with the wind profiling radar data using the MSM forecast as the first guess Jun-ichi Furumoto,
École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
École Doctorale des Sciences de l'Environnement d’Île-de-France Année Universitaire Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
Presented by: Muhammad Wasif Laeeq (BSIT07-1) Muhammad Aatif Aneeq (BSIT07-15) Shah Rukh (BSIT07-22) Mudasir Abbas (BSIT07-34) Ahmad Mushtaq (BSIT07-45)
Korea Institute of Atmospheric Prediction Systems (KIAPS) ( 재 ) 한국형수치예보모델개발사업단 Identical Twin Experiments for the Representer Method with a Spectral Element.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
Carbon Cycle Data Assimilation with a Variational Approach (“4-D Var”) David Baker CGD/TSS with Scott Doney, Dave Schimel, Britt Stephens, and Roger Dargaville.
LECTURE 10: DISCRIMINANT ANALYSIS
PSG College of Technology
Ensemble variance loss in transport models:
Numerical Analysis Lecture 16.
An Overview of Atmospheric Data Assimilation
Symmetric Matrices and Quadratic Forms
LECTURE 09: DISCRIMINANT ANALYSIS
Feature Selection Methods
Sarah Dance DARC/University of Reading
Symmetric Matrices and Quadratic Forms
Presentation transcript:

Ekaterina Klimova Ekaterina TECHNIQUE OF DATA ASSIMILATION ON THE BASIS OF THE KALMAN FILTER Institute of Computational Technologies SB RAS

ATMOSPHERIC PROCESSES in SPACE-ATMOSPHERE-SEA/LAND system

Definitions. Definition 1. The problem of the numerical (objective) analysis we shall name a problem of obtaining of "best" in any sense values of an estimated field on the observations. Definition 2. The problem of the joint account of the observational data and forecast model for the most exact description of time-space distribution of the meteorological fields is named a data assimilation problem.

The Data Assimilation Problem Variational approach Kalman filter 4DVAR RRKF(redused rank Kalman filter) ECMWF, Meteo France (M.Fisher, E.Andersson): Canada, Atmospheric Environment Service (H.Mitchel, P.L.Houtekmer): Ensemble Kalman Filter NASA, DAO (Data Assimilation Office) (D.Dee, S.Cohn): Suboptimal algorithm (1-D, 2-D models)

Variational data assimilation problem Data on

Variational data assimilation problem

The optimal filtration problem

Kalman Filter

The connection between 4DVAR and Kalman filter In the case, when: The model of atmosphere is linear, The model errors are absent Algorithms 4DVAR and Kalman filter are algebraically equivalent

ForecastAnalysesForecastAnalyses ….. Data Procedure of the data assimilation The forecast: on 12 hours on regional model of an atmosphere The analysis: box - variant of three-dimensional multivariate optimal interpolation The data: GMC of Russia 12 hours

Optimal interpolation - rand m-vector of observational errors The forecast errors covariances The analyses of observations

The procedure of the analysis Initial processing Predanalyses Analyses Postanalyses Data The processed data Values Telegrams, a climate Grid, statistics ( errors of observations and the forecast), first guest

Regional model of short-term weather forecast Boundary conditions on vertical : Lateral boundary conditions:

Numerical experiments with the data assimilation system Relative error of the forecast and coefficient of correlations. Forecast from to

Kalman Filter Forecast Data Analyses Dimension : 26*22*15*5=42900

Algorithm of calculation of the forecast errors covariances, based on a splitting-up method:

Model for the forecast errors covariances in a homogeneous izotropic case System of equations for the forecast errors :

The equations for the forecast errors covariances values in 1-st point- in 2-nd point. The system of equations for the adaptation step:

Model for the forecast errors covariances in a homogeneous izotropic case Model for the forecast errors covariances in a homogeneous izotropic case (Under condition, when 2-dimensional vector of wind speed is rotational). System of the equations for expansion coefficients on eigen vectors of the vertical operator of model - finite-difference analogue of the operator

The simplified models for the forecast errors calculation Lets assume, that: the state of the atmosphere in the Kalman filter algorithm is estimated for vertical normal modes of the prognostic model; the calculation of covariances of prediction errors is based on the assumption that the errors of vertical normal modes do not correlate with each other; it is well-known that the eigenvectors of the vertical operator are close to the natural orthogonal basis. Therefore, they can be assumed to be statistically independent; the covariances of prediction errors are calculated only for the height field of an isobaric surface, and the covariances of wind field errors are calculated on the basis of geostrophic relations; the wind velocity fields in the advection operator do not depend on the vertical coordinate p (that is, the background flow is close to a barotropic one).

The simplified models for the forecast errors calculation Model-1 for expansion coefficients on eigen vectors of the vertical operator of model - finite-difference analogue of the operator Lets concider, that

The simplified models for the forecast errors calculation Model-2 Model-2 is based on the equation of quazigestrophic vorticity transfer. Model-3 Model-3 is a quasi-linear model described by the equation of quazigestrophic vorticity transfer. - are wind velocity fields at time

The equation for the forecast errors in case - n – th eigen vector Let where :

Numerical experiments on the estimation of the simplified models properties Numerical experiments on the estimation of the properties of the simplified models are based on a method of forecasting of ensembles. On N=50 of the rand initial fields 50 forecasts on initial model were counted. On this ensemble values the "true" covariance matrixes were appreciated and these values were compared with forecasted ones. Let (i – the grid number). Let's designate Then - the values of isobaric heights

The first eigen vector of matrix Р1 for time The first eigen vector of matrix Р1 for time t = 1 hour (а, б) and t =6 hour. (в,г).

The 6-hour forecast of error covariances of the height field with the help of the simplified model

Suboptimal algorithm, based on the Kalman filter The algorithm, based on Kalman filter, is named suboptimal, if in it for calculation of forecast error covariances the simplified model is used.

Suboptimal algorithm, based on the Kalman filter

The optimal Kalman filter algoritm (continuous in time ) Let: С(t)=I, G(t)=I, and A, Q, R do not depend from t.

The optimal Kalman filter algoritm (continuous in time )

Connection of the estimation received in suboptimal algorithm, with an estimation of Kalman filter I algorithm: II algorithm : III algorithm :

Numerical experiments on the data assimilation with the use of suboptimal algorithm, based on the Kalman filter The algorithm of Kalman filter in which for calculation of matrixes of the forecast errors covariances the simplified model is used is named suboptimal. Calculations on 48 hours assimilation the model data on a height field in each 12 hours were carried out. The data of observations were set in 143 points of a regular grid allocated on forecast area. At realization of experiments it was supposed, that observational errors do not correlate among themselves.

Numerical experiments with «model» data (identical twin) «True»: Forecast: Observations:

Root-mean-square forecast error (Q=0) Root-mean-square forecast error (Q=0) s0 – forecast without assimilation; s1 – forecast with assimilation (forecast-analyses cycle); s2 – forecast with assimilation (Kalman filter).

Forecast error covariance of the height field for n=1 (for central point of the region) at t=0 h. (а) and t=12 h. (б).

Adaptive assimilation algorithm based on the Kalman filter

Trace of the forecast error covariance

Dependence of weight factors of the analysis on the mesh point number (the forecast on 12 hours)

Dependence of weight factors of the analysis on the mesh point number (the forecast on 24 hours) Dependence of weight factors of the analysis on the mesh point number (the forecast on 24 hours)

Root-mean-square forecast error

Kalman filter R.Todling, S.Cohn (DAO, NASA), 1994 Suboptimal algorithms, Based on the Kalman, numerical experiments with the 2-dimensional shallow-water equation (modeled data). M.K.Tippett, S.E.Cohn, 1999 Low-dimensional representation of error covariance (Singular Vectors- SV, 1-dimensional equation of advection). H.Mitchel, P.L.Houtekmer (Canada), 1997 Ensemble Kalman filter (3-level quasi-geostrophic model, modeled data); 1999 ensemble adaptive Kalman filter (the same model); 2001 Sequantial Ensemble Kalman filter (splitting of the data into subsets), only analyses, modeled data; 2002 – SEKF – numerical experiments with the global adiabatic model 21*144*72, modeled data.

Kalman filter P.F.J.Lermusiaux (Harvard University, Cambridge), 1994 Ensemble Kalman filter on the EOF subspace, model data (identical twin). С.P.Keppenne (Goddard Space Flight Center, Mariland), 2000 Ensemble Kalman filter, sub-regions, 2-level spectral shallow-water model. B.R.Hunt, E.Kalnay et al (University of Maryland, Arizona State University, USA), 2004 Four-dimensional ensemble Kalman filtering ( 4DVAR and ensemble KF, model of Lorenc).