Variational assimilation: method & technicalities Claude Fischer & Patrick Moll, CNRM/GMAP, Météo-France.

Slides:



Advertisements
Similar presentations
Assimilation of radar data - research plan
Advertisements

GEMS Kick- off MPI -Hamburg CTM - IFS interfaces GEMS- GRG Review of meeting in January and more recent thoughts Johannes Flemming.
Page 1 of 26 A PV control variable Ross Bannister* Mike Cullen *Data Assimilation Research Centre, Univ. Reading, UK Met Office, Exeter, UK.
Using PALM to integrate variational data assimilation algorithms with OPA ECMWF, 29 june 2005, Reading. Nicolas Daget CERFACS, Toulouse.
Introduction to data assimilation in meteorology Pierre Brousseau, Ludovic Auger ATMO 08,Alghero, september 2008.
Recent developments and perspectives in meteorological data assimilation Jean Pailleux (Météo-France /CNRM / Toulouse) Presentation.
Assimilation Algorithms: Tangent Linear and Adjoint models Yannick Trémolet ECMWF Data Assimilation Training Course March 2006.
The Inverse Regional Ocean Modeling System:
Setup of 4D VAR inverse modelling system for atmospheric CH 4 using the TM5 adjoint model Peter Bergamaschi Climate Change Unit Institute for Environment.
Status and performance of HIRLAM 4D-Var Nils Gustafsson.
Polly Smith, Alison Fowler, Amos Lawless School of Mathematical and Physical Sciences, University of Reading Exploring coupled data assimilation using.
ECMWF COSPAR Training Fortaleza, Brasil, 11-Nov A very first introduction to data assimilation for NWP systems Joaquín Muñoz Sabater ECMWF.
Toulouse, Sept 20-22, 2010Aladin/LACE/Hirlam maintenance training workshop IFS code overhaul & Object Oriented Programming: a likely evolution of our codes.
DA/SAT Training Course, March 2006 Variational Quality Control Erik Andersson Room: 302 Extension: 2627
ECMWF CO 2 Data Assimilation at ECMWF Richard Engelen European Centre for Medium-Range Weather Forecasts Reading, United Kingdom Many thanks to Phil Watts,
Data assimilation schemes in numerical weather forecasting and their link with ensemble forecasting Gérald Desroziers Météo-France, Toulouse, France.
Advanced data assimilation methods with evolving forecast error covariance Four-dimensional variational analysis (4D-Var) Shu-Chih Yang (with EK)
Forecasting convective initiation over Alpine terrain by means of automatic nowcasting and a high-resolution NWP model Georg Pistotnik, Thomas Haiden,
1 NGGPS Dynamic Core Requirements Workshop NCEP Future Global Model Requirements and Discussion Mark Iredell, Global Modeling and EMC August 4, 2014.
Exploring strategies for coupled 4D-Var data assimilation using an idealised atmosphere-ocean model Polly Smith, Alison Fowler & Amos Lawless School of.
Objectives & generalities about phasing and The phasing roadmap Claude Fischer.
Overview of the present HIRLAM surface assimilation Mainly taken from: HIRLAM Technical Report No. 58.
Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz Statistical Characteristics of High- Resolution COSMO.
The ELDAS system implementation and output production at Météo-France Gianpaolo BALSAMO, François BOUYSSEL, Jöel NOILHAN ELDAS 2nd progress meetin – INM.
Different options for the assimilation of GPS Radio Occultation data within GSI Lidia Cucurull NOAA/NWS/NCEP/EMC GSI workshop, Boulder CO, 28 June 2011.
Ocean Data Variational Assimilation with OPA: Ongoing developments with OPAVAR and implementation plan for NEMOVAR Sophie RICCI, Anthony Weaver, Nicolas.
Advances in LAM 3D-VAR formulation Vincent GUIDARD Claude FISCHER Météo-France, CNRM/GMAP.
Tbilisi, GGSWBS'14 Optimization for inverse modelling Ketevan Kasradze 1 Hendrik Elbern 1,2
Progress in the joint HIRLAM/ALADIN mesoscale data assimilation activities Nils Gustafsson and Claude Fischer.
Outline Background Highlights of NCAR’s R&D efforts A proposed 5-year plan for CWB Final remarks.
HIRLAM 3/4D-Var developments Nils Gustafsson, SMHI.
RC LACE 25th EWGLAM Meeting 6-9 October 2003, Lisbon1.
26 th EWGLAM & 11 th SRNWP meetings, Oslo, Norway, 4 th - 7 th October 2004 Stjepan Ivatek-Šahdan RC LACE Data Manager Croatian Meteorological and Hydrological.
Use of radar data in ALADIN Marián Jurašek Slovak Hydrometeorological Institute.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
The status and development of the ECMWF forecast model M. Hortal, M. Miller, C. Temperton, A. Untch, N. Wedi ECMWF.
Computing at Météo-France CAS 2003, Annecy 1.News from computers 2.News from models.
Page 1© Crown copyright 2004 SRNWP Lead Centre Report on Data Assimilation 2005 for EWGLAM/SRNWP Annual Meeting October 2005, Ljubljana, Slovenia.
2 nd GRAS-SAF USER WORKSHOP Assimilation of GPS radio occultation measurements at DAO (soon GMAO) P. Poli 1,2 and J. Joiner 3 Data Assimilation Office.
A revised 4D-Var algorithm Yannick Trémolet ECMWF IMA W/S 29 April, 2002 Mike Fisher, Lars Isaksen and Erik Andersson For increased efficiency and improved.
Implementation and Testing of 3DEnVAR and 4DEnVAR Algorithms within the ARPS Data Assimilation Framework Chengsi Liu, Ming Xue, and Rong Kong Center for.
1 Observation Impact Using a Variational Adjoint System PI: Dr. James Cummings, Code Co-PIs: Dr. Hans.
AROME/ALADIN discussions, Prague Data assimilation and variational algorithms in ALADIN 11-12th April, Data assimilation and variational algorithms.
MIIDAPS Application to GSI for QC and Dynamic Emissivity in Passive Microwave Data Assimilation.
Cloudy GOES-Imager assimilation with hydrometeor control variable Byoung-Joo JUNG NCAR/MMM Student presentation at JCSDA Summer Colloquium on Satellite.
Slide 1 NEMOVAR-LEFE Workshop 22/ Slide 1 Current status of NEMOVAR Kristian Mogensen.
Vincent N. Sakwa RSMC, Nairobi
Incrementing moisture fields with satellite observations
1 3D-Var assimilation of CHAMP measurements at the Met Office Sean Healy, Adrian Jupp and Christian Marquardt.
November 21 st 2002 Summer 2009 WRFDA Tutorial WRF-Var System Overview Xin Zhang, Yong-Run Guo, Syed R-H Rizvi, and Michael Duda.
1 Radiative Transfer Models and their Adjoints Paul van Delst.
Status of the NWP-System & based on COSMO managed by ARPA-SIM COSMO I77 kmBCs from IFSNudgingCINECA COSMO I22.8 kmBCs from COSMO I7 Interpolated from COSMO.
1 Data assimilation developments for NEMO  A working group was created at the 2006 Developers Meeting with the objective of standardizing for NEMO certain.
ALADIN 3DVAR at the Hungarian Meteorological Service 1 _____________________________________________________________________________________ 27th EWGLAM.
OSEs with HIRLAM and HARMONIE for EUCOS Nils Gustafsson, SMHI Sigurdur Thorsteinsson, IMO John de Vries, KNMI Roger Randriamampianina, met.no.
The assimilation of satellite radiances in LM F. Di Giuseppe, B. Krzeminski,R. Hess, C. Shraff (1) ARPA-SIM Italy (2) IMGW,Poland (3)DWD, Germany.
Mesoscale Assimilation of Rain-Affected Observations Clark Amerault National Research Council Postdoctoral Associate - Naval Research Laboratory, Monterey,
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
The Centre for Australian Weather and Climate Research A partnership between CSIRO and the Bureau of Meteorology Studying the impact of hourly RAMSSA_skin.
Hybrid Data Assimilation
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course
Aspects of using observations in Data Assimilation
Japan Meteorological Agency / Meteorological Research Institute
Progress in development of HARMONIE 3D-Var and 4D-Var Contributions from Magnus Lindskog, Roger Randriamampianina, Ulf Andrae, Ole Vignes, Carlos Geijo,
Tadashi Fujita (NPD JMA)
Adjoint modeling and applications
FSOI adapted for used with 4D-EnVar
Lidia Cucurull, NCEP/JCSDA
Parameterizations in Data Assimilation
Sarah Dance DARC/University of Reading
Presentation transcript:

Variational assimilation: method & technicalities Claude Fischer & Patrick Moll, CNRM/GMAP, Météo-France

Overview of some principles of VAR assimilation as applied in our NWP systems

Principle of VAR (in as short as possible …) t X X1 X2 X3 X4 t 1 (analysis) X = vector of model variables t2t2 t0t0 4D variational assimilation : Search for the model trajectory approaching best the available observations => iterative minimization process - 3D variational assimilation : a « reduced » version of 4D- VAR => no time integration, all obs are considered valid for time t1

Picture view of 4D-VAR assimilation t0=9ht1=12ht2=15h Assimilation window JbJb JoJo JoJo JoJo obs analysis xaxa xbxb corrected forecast previous forecast background

General formulation of 4D-VAR in NWP systems Full (Nonlinear) cost function: Linearized cost function (k=outer loop):

Incremental formulation (I) Cost function: is the « simplified » (low resolution) increment at outer loop and Trajectory (analysis) updates: with

Incremental formulation (II) To pre-condition the problem, an additional change of variable is performed: CHAVAR New cost function: CHAVARIN

Incremental 4D-Var algorithm (ECMWF documentation)

3D-VAR – LAM - (I) Cost function => no model integration => There is no time window (1 timeslot) and only one outer loop and Analysis updates => no « simplification » operator ! => the increment is computed on the same grid than the background:

3D-VAR – LAM - (II) To pre-condition the problem, an additional change of variables is Performed (4D-VAR == 3D-VAR): CHAVAR New cost function: CHAVARIN

Computation of Jo in 4D-VAR These high resolution departures are computed during high the resolution integrations and stored in the ODB files. In practice, one computes: where are the « high resolution » departures. Low Resol. depart. - Obs. + High Resol. depart.

Computation of Jo in LAM 3D- VAR The departures are computed only once, during high the screening step and stored in the ODB files. In the code, one computes like for incremental 4D-VAR: With k=1 and i=0 only and: are the « high resolution » departures. « Low Resol. » depart.- Obs. + « High Resol. » depart.

Chain of operations in a VAR minimisation loop (SIM4D) compute trajectory (take Xb in 3D-VAR) read (stored in ODB) (*) compute Jb and its gradient compute TL of Jo: And store in the ODB compute AD of Jo: compute J: call minimizer; go to (*) until convergence

Major messages to keep in mind: 3D-VAR is a reduced (« simpler ») version of 4D-VAR Aladin 3D-VAR is a code installed inside the global IFS/Arpège code (as we will see in the last slides)

Back to application … with pictures !

SURFACE OBSERVATIONS FOR ALADIN-France

Resolution volum, ray path : standard refraction (4/3 Earth’radius)   z h r N model level Bi-linear interpolation of the simulated hydrometeors (T,q, qr, qs, qg) Compute « radar reflectivity » on each model level Backscattering cross section: Rayleigh (attenuation neglected) Microphysic Scheme in AROME Diameter of particules Simulated Reflectivity factor in « beam volum bv» Antenna’s radiation pattern: gaussian function for main lobe (side lobes neglected) Resolution volume, ray path: standard refraction (4/3 Earth’s radius) Assimilation of Reflectivity : Observation operator implemented in the 3DVar ALADIN/AROME

Apparition de bande étroite de front froid: moins intense et légèrement plus sud dans ALADIN. Courbure derrière le front froid: cassure trop nette dans ALADIN (à l’arrière, développement de la convection dans la traîne ou pseudo-limite dans ALADIN)

The VAR assimilation in Ald/Aro: scripting sequence Observations are taken +/- 3 h around base time in Aladin; +/- 1.5 h in Arome Analysis time = background time and no « high » / « low » resolution Full analysis sequence (altitude fields): Full ODB database enters Screening => computes departures and performs QC and first-guess check ODB base is compressed (~ keep only active data in the output ODB) Variational analysis: minimization of cost function Write out analysis file

Technical aspects about the LAM VAR code inside the IFS

The observation operators in the variational cost function We have seen that the J o part of the cost function can be finally written : J o (x) =   (y ik – H ik [x b ]) T R ik -1 (y i – H ik [x b ]) Where H ik is the observation operator for obs n° k of type n° i. The operator H ik is subdivided into a sequence of operators, each one of which performs part of the transformation from control variable to observed parameters : Conversion from control variable to model variables Inverse spectral transforms put the model variables on the gridpoint space A horizontal interpolation provides vertical profiles of model variables at observation locations Vertical integration if necessary (hydrostatic equation for geopotential, radiative transfer equation for radiances…) Vertical interpolation to the level of the observations

The observation operators in the variational cost function Horizontal interpolations : A 12-point bi-cubic or 4-point bi-linear horizontal interpolation gives vertical profiles of model variables at observation locations. The surface fields are interpolated bilinearly to avoid spurious maxima and minima Vertical interpolations : it depends on the variable Linear in pressure for temperature and specific humidity Linear in logarithm of pressure for wind Linear in logarithm of pressure for geopotential (performed in terms of departures from the ICAO standard atmosphere). New operator until a few years, specific to Météo-France, better consistent with hydrostatism. Vertical interpolations for surface observations (T2m, V10m, Hu2m) are done consistently with the physics of the model

Adjoints of the observation operators The solution of the minimisation problem is given by  J(x a )=0 At each step of the descent algorithm,  J has to be computed :  J(x) =2B -1 (x-x b ) – 2H T R -1 (y – H[x b ]) Where H T is the the adjoint (  transpose) of the the observation operator (or the tangent linear of the observation operator when it is non-linear). It means that the adjoints of the obs operators have to be computed, which is easy for the interpolations, but more difficult for the vertical integrations, in particular for the radiative transfer equation or other operators containing non differentiable processes. The observations in the variational cost function

DIRECT AND ADJOINT OBSERVATION OPERATORS H1 HnH2 H1 * H2 * Hn * …..….. …………. X (model var.) y mod X y Jo Chain of direct operators Chain of adjoint operators

Chain of operations in a VAR minimisation loop (SIM4D) compute trajectory (take Xb in 3D-VAR) read (stored in ODB) (*) compute Jb and its gradient compute TL of Jo: And store in the ODB compute AD of Jo: compute J: call minimizer; go to (*) until convergence

Global // LAM code interfacing for VAR Simulator and model: H.dx  Jo=B1/2. GradJo J=Jb+Jo;  J Minimisation Jb=  ;  Jb=2  GradJo=H*.R-1. (y-H(x)-H.dx) dx=B1/2.  einv_trans cpgtl obshortl obsvtl edir_trans ecoupl1 espcmtl H.dx Var inner loop (SIM4D)

Global // LAM code interfacing for VAR Architecture: obshortl coupling Slightly different code: LELAM key Completely different code Fully shared dataflow between IFS and Aladin (especially in gridpoint space), but quite separate dimensioning and addressing in spectral buffers (spherical versus bi-Fourier). Coupling code is of course only LAM.

Global // LAM code interfacing for VAR Change of variable: chavarin cvar2insqrtbincvaru3ijgcori cv2spa ejgvcori jgnrsi cvargptl etransinv_jb etransdir_jb ebalstat ebalvert spa1=ylvazx%lamcv*tmeanuver addbgs ejghcori

Phasing of LAM 3D-VAR ODB & bator need to work (almost same as Arpège, plus LAMFLAG) At every new cycle with IFS, a careful inspection of B-matrix setup and change of variable routines, SPECTRAL_FIELDS and CONTROL_VECTOR structures, specific observation-related code is needed (~ 1 week of work). Additionally, TL and AD LAM code may need to be checked. LAM 3D-VAR does not use multi-incremental I/O prepared for IFS-Arpège: no WRMLPPADM/RDFPINC, no SAVMINI/GETMINI, NUPTRA>1, « traj » recomputation of innovations

Thank you for your attention