Maximum Liklihood Ensemble Filter (MLEF) Dusanka Zupanski, Kevin Robert Gurney, Scott Denning, Milia Zupanski, Ravi Lokupitiya June, 2005 TransCom Meeting,

Slides:



Advertisements
Similar presentations
1 -Classification: Internal Uncertainty in petroleum reservoirs.
Advertisements

Introduction to Data Assimilation NCEO Data-assimilation training days 5-7 July 2010 Peter Jan van Leeuwen Data Assimilation Research Center (DARC) University.
Ensemble data assimilation (EnsDA) activities of the GOES-R project Progress report Dusanka Zupanski CIRA/CSU GOES-R meeting 8 September 2004 Dusanka Zupanski,
P2.1 ENSEMBLE DATA ASSIMILATION: EXPERIMENTS USING NASA’S GEOS COLUMN PRECIPITATION MODEL D. Zupanski 1, A. Y. Hou 2, S. Zhang 2, M. Zupanski 1, C. D.
Dusanka Zupanski CIRA/Colorado State University Fort Collins, Colorado Model Error and Parameter Estimation Joint NCAR/MMM CSU/CIRA Data Assimilation Workshop.
Critical issues of ensemble data assimilation in application to GOES-R risk reduction program D. Zupanski 1, M. Zupanski 1, M. DeMaria 2, and L. Grasso.
1B.17 ASSESSING THE IMPACT OF OBSERVATIONS AND MODEL ERRORS IN THE ENSEMBLE DATA ASSIMILATION FRAMEWORK D. Zupanski 1, A. Y. Hou 2, S. Zhang 2, M. Zupanski.
Dusanka Zupanski CIRA/Colorado State University Fort Collins, Colorado A General Ensemble-Based Approach to Data Assimilation Model Error and Parameter.
P1.8 QUANTIFYING AND REDUCING UNCERTAINTY BY EMPLOYING MODEL ERROR ESTIMATION METHODS Dusanka Zupanski Cooperative Institute for Research in the Atmosphere.
Model error estimation employing ensemble data assimilation Dusanka Zupanski and Milija Zupanski CIRA/Colorado State University, Fort Collins, CO, U.S.A.
MODEL ERROR ESTIMATION Cooperative Institute for Research in the Atmosphere Research Benefits to NOAA:This is a novel research approach, providing an optimal.
Methane inversion from satellite, TRANSCOM meeting, Jena,12-15 May 2003 Inversion strategy 4D-var method adjoint model of TM3 CH4-only version has been.
The Inverse Regional Ocean Modeling System:
Setup of 4D VAR inverse modelling system for atmospheric CH 4 using the TM5 adjoint model Peter Bergamaschi Climate Change Unit Institute for Environment.
Polly Smith, Alison Fowler, Amos Lawless School of Mathematical and Physical Sciences, University of Reading Exploring coupled data assimilation using.
Page 1© Crown copyright 2005 Numerical space weather prediction: can meteorologists forecast the way ahead? Dr Mike Keil, Dr Richard Swinbank and Dr Andrew.
Initialization Issues of Coupled Ocean-atmosphere Prediction System Climate and Environment System Research Center Seoul National University, Korea In-Sik.
Effects of model error on ensemble forecast using the EnKF Hiroshi Koyama 1 and Masahiro Watanabe 2 1 : Center for Climate System Research, University.
Ibrahim Hoteit KAUST, CSIM, May 2010 Should we be using Data Assimilation to Combine Seismic Imaging and Reservoir Modeling? Earth Sciences and Engineering.
Andrew Schuh, Scott Denning, Marek Ulliasz Kathy Corbin, Nick Parazoo A Case Study in Regional Inverse Modeling.
A Concept of Environmental Forecasting and Variational Organization of Modeling Technology Vladimir Penenko Institute of Computational Mathematics and.
Carbon Flux Bias Estimation at Regional Scale using Coupled MLEF-PCTM model Ravindra Lokupitiya Department of Atmospheric Science Colorado State University.
Kalman Filtering Jur van den Berg. Kalman Filtering (Optimal) estimation of the (hidden) state of a linear dynamic process of which we obtain noisy (partial)
Ensemble Kalman Filter Methods
Course AE4-T40 Lecture 5: Control Apllication
Experimenting with the LETKF in a dispersion model coupled with the Lorenz 96 model Author: Félix Carrasco, PhD Student at University of Buenos Aires,
Modeling framework for estimation of regional CO2 fluxes using concentration measurements from a ring of towers Modeling framework for estimation of regional.
A comparison of hybrid ensemble transform Kalman filter(ETKF)-3DVAR and ensemble square root filter (EnSRF) analysis schemes Xuguang Wang NOAA/ESRL/PSD,
Exploring strategies for coupled 4D-Var data assimilation using an idealised atmosphere-ocean model Polly Smith, Alison Fowler & Amos Lawless School of.
1 Hybrid methods for solving large-scale parameter estimation problems Carlos A. Quintero 1 Miguel Argáez 1 Hector Klie 2 Leticia Velázquez 1 Mary Wheeler.
Ensemble Data Assimilation and Uncertainty Quantification Jeffrey Anderson, Alicia Karspeck, Tim Hoar, Nancy Collins, Kevin Raeder, Steve Yeager National.
Computing a posteriori covariance in variational DA I.Gejadze, F.-X. Le Dimet, V.Shutyaev.
CSDA Conference, Limassol, 2005 University of Medicine and Pharmacy “Gr. T. Popa” Iasi Department of Mathematics and Informatics Gabriel Dimitriu University.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
1 Geophysical Fluid Dynamics Laboratory Review June 30 - July 2, 2009.
Potential benefits from data assimilation of carbon observations for modellers and observers - prerequisites and current state J. Segschneider, Max-Planck-Institute.
Dusanka Zupanski And Scott Denning Colorado State University Fort Collins, CO CMDL Workshop on Modeling and Data Analysis of Atmospheric CO.
DoD Center for Geosciences/Atmospheric Research at Colorado State University WSMR November 19-20, 2003 ARMY Research Lab and CIRA/CSU Collaboration on.
2004 SIAM Annual Meeting Minisymposium on Data Assimilation and Predictability for Atmospheric and Oceanographic Modeling July 15, 2004, Portland, Oregon.
A unifying framework for hybrid data-assimilation schemes Peter Jan van Leeuwen Data Assimilation Research Center (DARC) National Centre for Earth Observation.
Applications of optimal control and EnKF to Flow Simulation and Modeling Florida State University, February, 2005, Tallahassee, Florida The Maximum.
Assimilating chemical compound with a regional chemical model Chu-Chun Chang 1, Shu-Chih Yang 1, Mao-Chang Liang 2, ShuWei Hsu 1, Yu-Heng Tseng 3 and Ji-Sung.
MODEL ERROR ESTIMATION EMPLOYING DATA ASSIMILATION METHODOLOGIES Dusanka Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University.
Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005.
MODEL ERROR ESTIMATION IN ENSEMBLE DATA ASSIMILATION FRAMEWORK Dusanka Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University.
Research Vignette: The TransCom3 Time-Dependent Global CO 2 Flux Inversion … and More David F. Baker NCAR 12 July 2007 David F. Baker NCAR 12 July 2007.
Development of an EnKF to estimate CO 2 fluxes from realistic distributions of X CO2 Liang Feng, Paul Palmer
INVERSE MODELING OF ATMOSPHERIC COMPOSITION DATA Daniel J. Jacob See my web site under “educational materials” for lectures on inverse modeling atmospheric.
# # # # An Application of Maximum Likelihood Ensemble Filter (MLEF) to Carbon Problems Ravindra Lokupitiya 1, Scott Denning 1, Dusanka Zupanski 2, Kevin.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
DATA ASSIMILATION AND MODEL ERROR ESTIMATION Dusanka Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University Fort Collins,
MPO 674 Lecture 28 4/23/15. The course on one slide 1. Intro: numerical models, ensembles, the science of prediction 2. Lorenz 1963,
NCAF Manchester July 2000 Graham Hesketh Information Engineering Group Rolls-Royce Strategic Research Centre.
Parameter estimation of forest carbon dynamics using Kalman Filter methods –Preliminary results Chao Gao, 1 Han Wang, 2 S Lakshmivarahan, 3 Ensheng Weng,
Prepared by Dusanka Zupanski and …… Maximum Likelihood Ensemble Filter: application to carbon problems.
Nonlinear State Estimation
Data assimilation for weather forecasting G.W. Inverarity 06/05/15.
Ensemble data assimilation and model error estimation algorithm Developed by Milija Zupanski and Dusanka Zupanski CIRA/CSU Dusanka Zupanski, CIRA/CSU
FastOpt CAMELS A prototype Global Carbon Cycle Data Assimilation System (CCDAS) Wolfgang Knorr 1, Marko Scholze 2, Peter Rayner 3,Thomas Kaminski 4, Ralf.
Ensemble forecasting/data assimilation and model error estimation algorithm Prepared by Dusanka Zupanski and Milija Zupanski CIRA/CSU Denning group meeting.
The application of ensemble Kalman filter in adaptive observation and information content estimation studies Junjie Liu and Eugenia Kalnay July 13th, 2007.
École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
The Ensemble Kalman filter
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
Carbon Cycle Data Assimilation with a Variational Approach (“4-D Var”) David Baker CGD/TSS with Scott Doney, Dave Schimel, Britt Stephens, and Roger Dargaville.
Hybrid Data Assimilation
Information content in ensemble data assimilation
New Approaches to Data Assimilation
Hartmut Bösch and Sarah Dance
Sarah Dance DARC/University of Reading
Presentation transcript:

Maximum Liklihood Ensemble Filter (MLEF) Dusanka Zupanski, Kevin Robert Gurney, Scott Denning, Milia Zupanski, Ravi Lokupitiya June, 2005 TransCom Meeting, Paris

CSU context Avoid adjoint formulation (4Dvar out) Amenable to parallel environment – cluster computing Avail of “in-house” expertise Flexible to linear, non-linear, coupled model frameworks Dusanka & Milia Zupanski (formerly at NCEP) – long history and developmental expertise in ensemble methods. Currently developing applications of MLEF.

Error covariances Forecast error covariance - If we had a “dynamical model” (we don’t, right now): variables ensembles But, we don’t have a dynamical model (just an observational operator), so the current timestep forecast error can be taken from the previous timestep’s analysis error. Analysis error covariance = (Hessian) -1

Hessian preconditioning Cost function The inverse Hessian: This very likely has a high condition number…..can we transform the Hessian into a space with a low(er) condition number? An ideal “pre-conditioner” looks like: This is ideal! CN=1

Transformation Now we have a tranformation operator we can use to go from out physical space to a low condition number space (the ensemble subspace): Control variable in ensemble space the i th column of C:

The C matrix Interesting! The transformation scales the forecast error covariance by a matrix that embodies the result of the perturbed fluxes in concentration space. An S x S matrix, invert using usual techniques cleaning up:

Impact

The last bit Insert the definition for (x-x b ) into cost function, determine the gradient, employ numerical scheme (conjugate gradient) and locate the minimum. The analysis error covariance is the inverse Hessian at the minimum: Go back and do it again……..

Practical sequence P f (random 1 st time then run a cold start) Compute C Compute gradient of cost function in ensemble space Conjugate gradient method to find X opt Compute P a from Hessian at X opt

Plans at CSU  TRANSCOM - Estimate CO 2 fluxes - Estimate the uncertainties of fluxes  SiB Parameter estimation - Estimate control parameters on the fluxes - MLEF calculates uncertainties of all parameters (in terms of P a and P f )  LPDM - Estimate monthly mean carbon fluxes, empirical parameters - Estimate uncertainties of the mean fluxes and empirical parameters  SiB-CASA-RAMS - Use various observations of weather, eddy-covariance fluxes, CO2 - Estimate carbon fluxes, empirical parameters (e.g., light response, allocation, drought stress, phonological triggers) - Time evolution of state variables, provided by the coupled model, is critical for updating P f

Summary  MLEF is an iterative/numerical ensemble approach that avails of the efficiency gained through preconditioning.  The MLEF is currently being evaluated in various atmospheric science applications, showing encouraging results.  The MLEF is suitable for assimilation of numerous new carbon observations, employing complex non-linear coupled models.  Work in carbon applications has just started. Results will be presented in the future.