Variance for the error covariance. horizontal scale for the error covariance.

Slides:



Advertisements
Similar presentations
Week 2 Vocabulary Review Quiz Friday, September 3 rd.
Advertisements

© Crown copyright Met Office Implementing a diurnal model at the Met Office James While, Matthew Martin.
Page 1 of 26 A PV control variable Ross Bannister* Mike Cullen *Data Assimilation Research Centre, Univ. Reading, UK Met Office, Exeter, UK.
Active Appearance Models
Scale & Affine Invariant Interest Point Detectors Mikolajczyk & Schmid presented by Dustin Lennon.
Line Search.
Statistical Techniques I EXST7005 Simple Linear Regression.
The Inverse Regional Ocean Modeling System:
© Crown copyright Met Office Does the order of the horizontal and vertical transforms matter in the representation of an operational static covariance.
Optimization : The min and max of a function
1 Introduction to GSI Daryl T. Kleist National Monsoon Mission Scoping Workshop IITM, Pune, India April 2011.
The loss function, the normal equation,
1cs542g-term Notes  Extra class this Friday 1-2pm  If you want to receive s about the course (and are auditing) send me .
1/20 Accelerating minimizations in ensemble variational assimilation G. Desroziers, L. Berre Météo-France/CNRS (CNRM/GAME)
NOTES ON MULTIPLE REGRESSION USING MATRICES  Multiple Regression Tony E. Smith ESE 502: Spatial Data Analysis  Matrix Formulation of Regression  Applications.
Optimization Methods One-Dimensional Unconstrained Optimization
Advanced Topics in Optimization
PETE 603 Lecture Session #29 Thursday, 7/29/ Iterative Solution Methods Older methods, such as PSOR, and LSOR require user supplied iteration.
Optimization Methods One-Dimensional Unconstrained Optimization
Computational Optimization
Taylor Series.
Understanding the 3DVAR in a Practical Way
Feature and object tracking algorithms for video tracking Student: Oren Shevach Instructor: Arie nakhmani.
3D-Var Revisited and Quality Control of Surface Temperature Data Xiaolei Zou Department of Meteorology Florida State University June 11,
The Inverse Regional Ocean Modeling System: Development and Application to Data Assimilation of Coastal Mesoscale Eddies. Di Lorenzo, E., Moore, A., H.
Non-Linear Models. Non-Linear Growth models many models cannot be transformed into a linear model The Mechanistic Growth Model Equation: or (ignoring.
Different options for the assimilation of GPS Radio Occultation data within GSI Lidia Cucurull NOAA/NWS/NCEP/EMC GSI workshop, Boulder CO, 28 June 2011.
EMIS 8381 – Spring Netflix and Your Next Movie Night Nonlinear Programming Ron Andrews EMIS 8381.
Non-Linear Models. Non-Linear Growth models many models cannot be transformed into a linear model The Mechanistic Growth Model Equation: or (ignoring.
Ocean Data Variational Assimilation with OPA: Ongoing developments with OPAVAR and implementation plan for NEMOVAR Sophie RICCI, Anthony Weaver, Nicolas.
Resources applied to WRF 3DVAR NCAR0.75 FTE, split among 1-3 people FSL0.50 FTE, mostly Devenyi CAPS0.80 FTE, 1-2 people NCEP1.30 FTE, Wan-shu Wu (1.0)
Earth, Atmospheric and Planetary Sciences Massachusetts Institute of Technology 77 Massachusetts Avenue | Cambridge MA V F
CS 782 – Machine Learning Lecture 4 Linear Models for Classification  Probabilistic generative models  Probabilistic discriminative models.
Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005.
Research Vignette: The TransCom3 Time-Dependent Global CO 2 Flux Inversion … and More David F. Baker NCAR 12 July 2007 David F. Baker NCAR 12 July 2007.
11 Background Error Daryl T. Kleist* National Monsoon Mission Scoping Workshop IITM, Pune, India April 2011.
6/29/2010 Wan-Shu Wu1 GSI Tutorial 2010 Background and Observation Error Estimation and Tuning.
The OR-WA coastal ocean forecast system Initial hindcast assimilation tests 1 Goals for the COMT project: -DA in presence of the Columbia River -Develop.
Geology 5670/6670 Inverse Theory 21 Jan 2015 © A.R. Lowry 2015 Read for Fri 23 Jan: Menke Ch 3 (39-68) Last time: Ordinary Least Squares Inversion Ordinary.
Optical Flow. Distribution of apparent velocities of movement of brightness pattern in an image.
BE, gen_be and Single ob experiments Syed RH Rizvi National Center For Atmospheric Research NCAR/MMM, Boulder, CO-80307, USA Syed.
Progressive AAM and Multi- band modeling 报告人:崔 滢 2011 年 12 月 16 日.
July, 2009 WRF-Var Tutorial Syed RH Rizvi 0 WRFDA Background Error Estimation Syed RH Rizvi National Center For Atmospheric Research NCAR/ESSL/MMM, Boulder,
Non-Linear Models. Non-Linear Growth models many models cannot be transformed into a linear model The Mechanistic Growth Model Equation: or (ignoring.
Adaptive Control Loops for Advanced LIGO
L25 Numerical Methods part 5 Project Questions Homework Review Tips and Tricks Summary 1.
29 June 2011DTC – Summer Tutorial Overview of GSI John C. Derber NOAA/NWS/NCEP/EMC.
Introducing Error Co-variances in the ARM Variational Analysis Minghua Zhang (Stony Brook University/SUNY) and Shaocheng Xie (Lawrence Livermore National.
Comparing initial large-scale fields from two HWRF runs with GFS analysis --Two HWRF configurations ❶ H14C : GSI is used on Domain 1 ❷ T14C: GSI is not.
NCAR April 1 st 2003 Mesoscale and Microscale Meteorology Data Assimilation in AMPS Dale Barker S. Rizvi, and M. Duda MMM Division, NCAR
One-dimensional assimilation method for the humidity estimation with the wind profiling radar data using the MSM forecast as the first guess Jun-ichi Furumoto,
École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
Environmental Data Analysis with MatLab 2 nd Edition Lecture 22: Linear Approximations and Non Linear Least Squares.
Mesoscale Assimilation of Rain-Affected Observations Clark Amerault National Research Council Postdoctoral Associate - Naval Research Laboratory, Monterey,
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
CSC321: Neural Networks Lecture 9: Speeding up the Learning
Excel’s Solver Use Excel’s Solver as a tool to assist the decision maker in identifying the optimal solution for a business decision. Business decisions.
Hybrid Data Assimilation
The simple linear regression model and parameter estimation
Ting-Chi Wu CIRA Data Assimilation Group, CSU 5/9/2016
Large Margin classifiers
The β-spiral Determining absolute velocity from density field
5.3 Mixed-Integer Nonlinear Programming (MINLP) Models
Boosting and Additive Trees (2)
CH 5: Multivariate Methods
Chapter 12 Curve Fitting : Fitting a Straight Line Gab-Byung Chae
The loss function, the normal equation,
Mathematical Foundations of BME Reza Shadmehr
Vector components Resolving Vectors.
Presentation transcript:

variance for the error covariance

horizontal scale for the error covariance

vertical scale for the error covariance

vertical scale profile for the error covariance

projection of stream function onto balanced temperature

projection of streamfunction onto velocity potential

projection of streamfunction onto balanced ln(ps)

4-6 Jan 2005GSI User orientation meeting Minimization and Preconditioning John C. Derber NOAA/NWS/NCEP/EMC

4-6 Jan 2005GSI User orientation meeting Basic structure Outer iteration – Most of outer iteration in routine glbsoi – Accounts for small nonlinearities which are complex to include and changes in quality control (especially for radiances) – If linear and no changes in QC should be same as doing more inner iterations Inner iteration – Solves partially linearized version of objective function – Mostly in routine pcgsoi

4-6 Jan 2005GSI User orientation meeting Outer iteration Currently background error cannot change in outer iteration (due to preconditioning in inner interation) For the current problem, we find that 2 outer iterations appears to work reasonably well except for precip. Often we run three outer iterations so that we can see the fit to the obs. at the end of the second outer iteration

4-6 Jan 2005GSI User orientation meeting Outer iteration Major operations within outer iteration – Read current solution (read_wrf_…, read_guess) – Read in statistics (prewgt, first outer iteration only) – Call setup routines (setuprhsall) – Call pcgsoi (solve inner iteration) – Write solution Difference from background kept in xhatsave and yhatsave (= B -1 xhatsave).

4-6 Jan 2005GSI User orientation meeting Inner iteration Solves partially linearized sub-problem Uses preconditioned conjugate gradient Stepsize calculation exact for linear terms and approximate for nonlinear term Current nonlinear terms (if not using variational QC) – SSM/I wind speeds – Precipitation – Penalizing q for supersaturation and negative values

4-6 Jan 2005GSI User orientation meeting Inner iteration - algorithm J = x T B -1 x + (Hx-o) T O -1 (Hx-o) (assume linear) define y = B -1 x J = x T y + (Hx-o) T O -1 (Hx-o) Grad J x = B -1 x +H T O -1 (Hx-o) = y + H T O -1 (Hx-o) Grad J y = x + BH T O -1 (Hx-o) = B Grad J x Solve for both x and y using preconditioned conjugate gradient (where the x solution is preconditioned by B and the solution for y is preconditioned by B -1 )

4-6 Jan 2005GSI User orientation meeting Inner iteration - algorithm Specific algorithm x 0 =y 0 =0 Iterate over n Grad x n = y n-1 + H T O -1 (Hx n-1 -o) Grad y n = B Grad x n Dir x n = Grad y n + β Dir x n-1 Dir y n = Grad x n + β Dir y n-1 x n = x n-1 + α Dir x n (Update xhatsave as well) y n = y n-1 + α Dir y n (Update yhatsave as well) Until max iteration or gradient sufficiently minimized

4-6 Jan 2005GSI User orientation meeting Inner iteration - algorithm intall routine calculate H T O -1 (Hx-o) bkerror multiplies by B dprod x calculates β and magnitude of gradient stpcalc calculates stepsize Note that consistency between x and y allows this algorithm to work properly

4-6 Jan 2005GSI User orientation meeting Inner iteration – algorithm Estimation of β β = (Grad x n -Gradx n-1 ) T Grad y n / (Grad x n -Gradx n-1 ) T Dir x n Calculation performed in dprodx Also produces (Grad x n ) T Grad y n

4-6 Jan 2005GSI User orientation meeting Inner iteration – algorithm Estimation of α (the stepsize) The stepsize is estimated through estimating the ratio of contributions for each term α = ∑a ∕ ∑b The a’s and b’s can be estimated exactly for the linear terms. For nonlinear terms, the a’s and b’s are estimated by fitting a quadratic using 3 points around an estimate of the stepsize The estimate for the nonlinear terms is reestimated using the stepsize for the first estimate

4-6 Jan 2005GSI User orientation meeting Inner iteration – u,v Analysis variables are streamfunction and velocity potential u,v needed for int routines u,v updated along with other variables by calculating derivatives of streamfunction and velocity potential components of dir x and creating a dir x (u,v)