Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth.

Slides:

Advertisements

Similar presentations

Variational data assimilation and forecast error statistics

Advertisements

Introduction to Data Assimilation NCEO Data-assimilation training days 5-7 July 2010 Peter Jan van Leeuwen Data Assimilation Research Center (DARC) University.

Object Specific Compressed Sensing by minimizing a weighted L2-norm A. Mahalanobis.

Assimilation Algorithms: Tangent Linear and Adjoint models Yannick Trémolet ECMWF Data Assimilation Training Course March 2006.

The Inverse Regional Ocean Modeling System:

Setup of 4D VAR inverse modelling system for atmospheric CH 4 using the TM5 adjoint model Peter Bergamaschi Climate Change Unit Institute for Environment.

Incorporation of dynamic balance in data assimilation and application to coastal ocean Zhijin Li and Kayo Ide SAMSI, Oct. 5, 2005,

Polly Smith, Alison Fowler, Amos Lawless School of Mathematical and Physical Sciences, University of Reading Exploring coupled data assimilation using.

Page 1© Crown copyright 2005 Numerical space weather prediction: can meteorologists forecast the way ahead? Dr Mike Keil, Dr Richard Swinbank and Dr Andrew.

Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.

Inversion of coupled groundwater flow and heat transfer M. Bücker 1, V.Rath 2 & A. Wolf 1 1 Scientific Computing, 2 Applied Geophysics Bommerholz ,

Simple Linear Regression. Start by exploring the data Construct a scatterplot  Does a linear relationship between variables exist?  Is the relationship.

Effects of model error on ensemble forecast using the EnKF Hiroshi Koyama 1 and Masahiro Watanabe 2 1 : Center for Climate System Research, University.

Probabilistic Robotics

Probabilistic Robotics

Probabilistic Robotics SLAM. 2 Given: The robot’s controls Observations of nearby features Estimate: Map of features Path of the robot The SLAM Problem.

(Includes references to Brian Clipp

Presenter: Yufan Liu November 17th,

Lecture 11: Recursive Parameter Estimation

Motion Analysis (contd.) Slides are from RPI Registration Class.

CS 547: Sensing and Planning in Robotics Gaurav S. Sukhatme Computer Science Robotic Embedded Systems Laboratory University of Southern California

Advanced data assimilation methods with evolving forecast error covariance Four-dimensional variational analysis (4D-Var) Shu-Chih Yang (with EK)

© 2005, it - instituto de telecomunicações. Todos os direitos reservados. Gerhard Maierbacher Scalable Coding Solutions for Wireless Sensor Networks IT.

Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”

Page 1© Crown copyright 2007 Data assimilation for systems with multiple time-scales Mike Cullen and Gordon Inverarity 4 September 2007.

Principles of Time Scales

Numerical Weather Prediction Division The usage of the ATOVS data in the Korea Meteorological Administration (KMA) Sang-Won Joo Korea Meteorological Administration.

RLSELE Adaptive Signal Processing 1 Recursive Least-Squares (RLS) Adaptive Filters.

ROBOT MAPPING AND EKF SLAM

Principles of the Global Positioning System Lecture 13 Prof. Thomas Herring Room A;

Helsinki University of Technology Adaptive Informatics Research Centre Finland Variational Bayesian Approach for Nonlinear Identification and Control Matti.

Muhammad Moeen YaqoobPage 1 Moment-Matching Trackers for Difficult Targets Muhammad Moeen Yaqoob Supervisor: Professor Richard Vinter.

© Crown copyright Met Office Adaptive mesh method in the Met Office variational data assimilation system Chiara Piccolo and Mike Cullen Adaptive Multiscale.

1 Hybrid methods for solving large-scale parameter estimation problems Carlos A. Quintero 1 Miguel Argáez 1 Hector Klie 2 Leticia Velázquez 1 Mary Wheeler.

Kalman filtering techniques for parameter estimation Jared Barber Department of Mathematics, University of Pittsburgh Work with Ivan Yotov and Mark Tronzo.

The Inverse Regional Ocean Modeling System: Development and Application to Data Assimilation of Coastal Mesoscale Eddies. Di Lorenzo, E., Moore, A., H.

Coupled Model Data Assimilation: Building an idealised coupled system Polly Smith, Amos Lawless, Alison Fowler* School of Mathematical and Physical Sciences,

Computing a posteriori covariance in variational DA I.Gejadze, F.-X. Le Dimet, V.Shutyaev.

23 rd to 24 th October 2006GIST 25, UK Met Office, Exeter In-flight Assessment of the end-to-end spectral responses of the GERB radiometer detectors Glyn.

Potential benefits from data assimilation of carbon observations for modellers and observers - prerequisites and current state J. Segschneider, Max-Planck-Institute.

Space-Time Mesoscale Analysis System A sequential 3DVAR approach Yuanfu Xie, Steve Koch John McGinley and Steve Albers Global Systems Division Earth System.

Data Assimilation Using Modulated Ensembles Craig H. Bishop, Daniel Hodyss Naval Research Laboratory Monterey, CA, USA September 14, 2009 Data Assimilation.

Data assimilation, short-term forecast, and forecasting error

Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.

Sabrina Rainwater David National Research Council Postdoc at NRL with Craig Bishop and Dan Hodyss Naval Research Laboratory Multi-scale Covariance Localization.

Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 12 Analyzing the Association Between Quantitative Variables: Regression Analysis Section.

Quality of model and Error Analysis in Variational Data Assimilation François-Xavier LE DIMET Victor SHUTYAEV Université Joseph Fourier+INRIA Projet IDOPT,

3.7 Adaptive filtering Joonas Vanninen Antonio Palomino Alarcos.

Implementation and Testing of 3DEnVAR and 4DEnVAR Algorithms within the ARPS Data Assimilation Framework Chengsi Liu, Ming Xue, and Rong Kong Center for.

Overview of Adaptive Filters Quote of the Day When you look at yourself from a universal standpoint, something inside always reminds or informs you that.

Chap 5 The Multiple Regression Model

Recursive Least-Squares (RLS) Adaptive Filters

Geology 5670/6670 Inverse Theory 27 Feb 2015 © A.R. Lowry 2015 Read for Wed 25 Feb: Menke Ch 9 ( ) Last time: The Sensitivity Matrix (Revisited)

Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Kalman Filter with Process Noise Gauss- Markov.

École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.

École Doctorale des Sciences de l'Environnement d’Île-de-France Année Universitaire Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.

École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.

The Ensemble Kalman filter

Multiscale Ensemble Filtering in Reservoir Engineering Applications

Probability Theory and Parameter Estimation I

ASEN 5070: Statistical Orbit Determination I Fall 2014

H.L. Tanaka and K. Kondo University of Tsukuba

…Don’t be afraid of others, because they are bigger than you

لجنة الهندسة الكهربائية

Science Update Ross Bannister, DARC PI Meeting, Oct. 17th 2005

Consider Covariance Analysis Example 6.9, Spring-Mass

Probabilistic Robotics

Principles of the Global Positioning System Lecture 13

Sarah Dance DARC/University of Reading

Stochastic Methods.

Presentation transcript:

Page 1 The Construction and Use of Linear Models in Large-scale Data Assimilation Tim Payne Large-Scale Inverse Problems and Applications in the Earth Sciences October 24th 2011

Page 2 © Crown copyright 2011 Part I. The Construction of Linear Models in Data Assimilation

Page 3 © Crown copyright 2011 Notation

Page 4 © Crown copyright 2011 Update-Prediction Cycle

Page 5 © Crown copyright 2011 First Strategy – exact evolution of covariances

Page 6 © Crown copyright 2011 Second strategy – EKF using tangent-linear

Page 7 © Crown copyright 2011 Third strategy – EKF using best linear approximation

Page 8 © Crown copyright 2011 Explicit formula for best linear approximation

Page 9 © Crown copyright 2011 Basic properties of best linear approximation

Page 10 © Crown copyright 2011 Cloud function

Page 11 © Crown copyright 2011 Smith Cloud Scheme with ‘ad hoc’ Regularisation

Page 12 © Crown copyright 2011 Smith Cloud Scheme with ‘Optimal’ Regularisation

Page 13 © Crown copyright 2011 Incremental 4D-Var

Page 14 © Crown copyright 2011 Options for linearisation step required for incremental 4D-Var

Page 15 © Crown copyright 2011 Gain matrix implied by each option

Page 16 © Crown copyright 2011 Advantage of BLA over TL in incremental 4D-Var

Page 17 © Crown copyright 2011 Pseudo Chain-rule for best linear approximation

Page 18 © Crown copyright 2011 Use of best linear approximation in EKF

Page 19 © Crown copyright 2011 The prior covariance implied by different approximations

Page 20 © Crown copyright 2011 Prior covariance using best linear estimate

Page 21 © Crown copyright 2011 Prior covariance using the best linear estimate always underestimates the true prior

Page 22 © Crown copyright 2011 The Duffing Map

Page 23 © Crown copyright ,000 iterates of Duffing Map

Page 24 © Crown copyright 2011 Reminder of EKF algorithm

Page 25 © Crown copyright 2011 Prior covariance for Duffing Map

Page 26 © Crown copyright 2011 Mean square analysis error in Duffing map: TL and best linear estimate compared

Page 27 © Crown copyright 2011 Part II. The Use of Linear Models in Data Assimilation

Page 28 © Crown copyright 2011 Linearisation error in 4D-Var as used in real numerical weather prediction models

Page 29 © Crown copyright 2011

Page 30 © Crown copyright 2011 Linear model for evolution of increments

Page 31 © Crown copyright 2011 Linearisation error as a stochastic error

Page 32 © Crown copyright 2011 Issues in forming EKF

Page 33 © Crown copyright 2011 Signal model for system with time correlated linearisation error

Page 34 © Crown copyright 2011 EKF with time correlated linearisation error

Page 35 © Crown copyright 2011 Parameters for filter including linearistion error

Page 36 © Crown copyright 2011 Example: L95, nearly perfect full model, persistence for linear model

Page 37 © Crown copyright 2011 Example: L95, nearly perfect full model, persistence for linear model, results

Page 38 © Crown copyright 2011 Variational version: weak constraint 4D-Var allowing for time correlated linearisation error

Page 39 © Crown copyright 2011 Remarks on variational form

Page 40 © Crown copyright 2011 Long window weak constraint 4D-Var allowing for linearisation error, same example

Page 41 © Crown copyright 2011 Summary to Part I

Page 42 © Crown copyright 2011 Summary to Part II

Page 43 © Crown copyright 2011 The End