Data assimilation for weather forecasting G.W. Inverarity 06/05/15.

Slides:



Advertisements
Similar presentations
Variational data assimilation and forecast error statistics
Advertisements

Curved Trajectories towards Local Minimum of a Function Al Jimenez Mathematics Department California Polytechnic State University San Luis Obispo, CA
The Inverse Regional Ocean Modeling System:
Incorporation of dynamic balance in data assimilation and application to coastal ocean Zhijin Li and Kayo Ide SAMSI, Oct. 5, 2005,
Classification and Prediction: Regression Via Gradient Descent Optimization Bamshad Mobasher DePaul University.
Jonathan Richard Shewchuk Reading Group Presention By David Cline
1cs542g-term Notes  Assignment 1 due tonight ( me by tomorrow morning)
Function Optimization Newton’s Method. Conjugate Gradients
Unconstrained Optimization Rong Jin. Recap  Gradient ascent/descent Simple algorithm, only requires the first order derivative Problem: difficulty in.
1cs542g-term Notes  Extra class this Friday 1-2pm  If you want to receive s about the course (and are auditing) send me .
1/20 Accelerating minimizations in ensemble variational assimilation G. Desroziers, L. Berre Météo-France/CNRS (CNRM/GAME)
Tutorial 12 Unconstrained optimization Conjugate gradients.
Motion Analysis (contd.) Slides are from RPI Registration Class.
Methods For Nonlinear Least-Square Problems
Announcements  Homework 4 is due on this Thursday (02/27/2004)  Project proposal is due on 03/02.
Design Optimization School of Engineering University of Bradford 1 Numerical optimization techniques Unconstrained multi-parameter optimization techniques.
Tutorial 5-6 Function Optimization. Line Search. Taylor Series for Rn
Retrieval Theory Mar 23, 2008 Vijay Natraj. The Inverse Modeling Problem Optimize values of an ensemble of variables (state vector x ) using observations:
Function Optimization. Newton’s Method Conjugate Gradients Method
Advanced Topics in Optimization
Maximum Liklihood Ensemble Filter (MLEF) Dusanka Zupanski, Kevin Robert Gurney, Scott Denning, Milia Zupanski, Ravi Lokupitiya June, 2005 TransCom Meeting,
Unconstrained Optimization Rong Jin. Logistic Regression The optimization problem is to find weights w and b that maximizes the above log-likelihood How.
9 1 Performance Optimization. 9 2 Basic Optimization Algorithm p k - Search Direction  k - Learning Rate or.
UNCONSTRAINED MULTIVARIABLE
MATH 685/ CSI 700/ OR 682 Lecture Notes Lecture 9. Optimization problems.
The Inverse Regional Ocean Modeling System: Development and Application to Data Assimilation of Coastal Mesoscale Eddies. Di Lorenzo, E., Moore, A., H.
ENCI 303 Lecture PS-19 Optimization 2
Computing a posteriori covariance in variational DA I.Gejadze, F.-X. Le Dimet, V.Shutyaev.
Optimization in Engineering Design Georgia Institute of Technology Systems Realization Laboratory 101 Quasi-Newton Methods.
3D/4D-Var Methods Liang Xu (NRL) JCSDA Summer Colloquium on Satellite DA 1 3D-Var/4D-Var Solution Methods Liang Xu Naval Research Laboratory, Monterey,
CSDA Conference, Limassol, 2005 University of Medicine and Pharmacy “Gr. T. Popa” Iasi Department of Mathematics and Informatics Gabriel Dimitriu University.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
Tbilisi, GGSWBS'14 Optimization for inverse modelling Ketevan Kasradze 1 Hendrik Elbern 1,2
Efficient Integration of Large Stiff Systems of ODEs Using Exponential Integrators M. Tokman, M. Tokman, University of California, Merced 2 hrs 1.5 hrs.
2004 SIAM Annual Meeting Minisymposium on Data Assimilation and Predictability for Atmospheric and Oceanographic Modeling July 15, 2004, Portland, Oregon.
Applications of optimal control and EnKF to Flow Simulation and Modeling Florida State University, February, 2005, Tallahassee, Florida The Maximum.
Mathematical/Numerical optimization. What are the effects of including correlated observation errors on the minimization? How does it affect the hessian.
Data assimilation, short-term forecast, and forecasting error
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
Quality of model and Error Analysis in Variational Data Assimilation François-Xavier LE DIMET Victor SHUTYAEV Université Joseph Fourier+INRIA Projet IDOPT,
Quasi-Newton Methods of Optimization Lecture 2. General Algorithm n A Baseline Scenario Algorithm U (Model algorithm for n- dimensional unconstrained.
MECH4450 Introduction to Finite Element Methods Chapter 9 Advanced Topics II - Nonlinear Problems Error and Convergence.
Unscented Kalman Filter 1. 2 Linearization via Unscented Transform EKF UKF.
1 Chapter 6 General Strategy for Gradient methods (1) Calculate a search direction (2) Select a step length in that direction to reduce f(x) Steepest Descent.
Survey of unconstrained optimization gradient based algorithms
Prepared by Dusanka Zupanski and …… Maximum Likelihood Ensemble Filter: application to carbon problems.
Performance Surfaces.
Hand-written character recognition
Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.
METHOD OF STEEPEST DESCENT ELE Adaptive Signal Processing1 Week 5.
MECH593 Introduction to Finite Element Methods
Ensemble forecasting/data assimilation and model error estimation algorithm Prepared by Dusanka Zupanski and Milija Zupanski CIRA/CSU Denning group meeting.
10 1 Widrow-Hoff Learning (LMS Algorithm) ADALINE Network  w i w i1  w i2  w iR  =
Neural networks (2) Reminder Avoiding overfitting Deep neural network Brief summary of supervised learning methods.
Mesoscale Assimilation of Rain-Affected Observations Clark Amerault National Research Council Postdoctoral Associate - Naval Research Laboratory, Monterey,
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
H.L. Tanaka and K. Kondo University of Tsukuba
A Fast Trust Region Newton Method for Logistic Regression
Information content in ensemble data assimilation
Unscented Kalman Filter
Widrow-Hoff Learning (LMS Algorithm).
CS5321 Numerical Optimization
Chapter 10. Numerical Solutions of Nonlinear Systems of Equations
METHOD OF STEEPEST DESCENT
Parameterizations in Data Assimilation
Performance Surfaces.
Performance Optimization
Sarah Dance DARC/University of Reading
Section 3: Second Order Methods
First-Order Methods.
Presentation transcript:

Data assimilation for weather forecasting G.W. Inverarity 06/05/15

Contents What is data assimilation? Global forecast optimization Regional forecast optimization Summary

What is data assimilation? We need to know the present state of the atmosphere to use as an initial condition for the forecast model. Use observations collected in a recent time window to adjust the last forecast at the start of the window. Majority of information comes from the forecast.

What is data assimilation? Writing ||z|| A =(z T A -1 z) 1/2 Good covariance representation of forecast and observation errors critical to success. State vector typically has O(10 9 )elements so forecast-error covariance matrix with O(10 18 ) entries is too large to represent explicitly. Either modelled using a sequence of transforms incorporating simplifying assumptions or estimated from an ensemble of forecasts.

Global forecast optimization Observation operator and forecast model weakly nonlinear. Conjugate gradient method preconditioned with Hessian eigenvectors. Perform 30 minimization iterations of quadratic approximation to penalty function while computing leading eigenvectors. Perform another 35 minimization iterations of the preconditioned penalty function, re-linearizing the observation operator every ten iterations.

Regional forecast optimization Observation operator strongly nonlinear. Limited-memory quasi-Newton minimization of non- quadratic penalty function. Perform 10 minimization iterations, apply vertically adaptive grid (AG) transform, perform 10 minimization iterations, apply AG transform again then minimize to convergence (typically 60 iterations).

Summary State vector has O(10 9 ) elements but can only afford O(100) minimization iterations to assimilate O(10 6 ) observations in 20 minutes for global or 5 minutes for regional forecast. Global data assimilation uses Hessian-eigenvector preconditioned conjugate gradient method. Regional data assimilation uses limited-memory quasi- Newton method. Can we do better?