Presentation is loading. Please wait.

Presentation is loading. Please wait.

Ensemble forecasting/data assimilation and model error estimation algorithm Prepared by Dusanka Zupanski and Milija Zupanski CIRA/CSU Denning group meeting.

Published byMilton Parrish Modified over 9 years ago

Similar presentations

Presentation on theme: "Ensemble forecasting/data assimilation and model error estimation algorithm Prepared by Dusanka Zupanski and Milija Zupanski CIRA/CSU Denning group meeting."— Presentation transcript:

1 Ensemble forecasting/data assimilation and model error estimation algorithm Prepared by Dusanka Zupanski and Milija Zupanski CIRA/CSU Denning group meeting December 29, 2004 Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu References Zupanski, M., 2005: The Maximum Likelihood Ensemble Filter. Theoretical aspects. Accepted in Mon. Wea. Rev. [Available at ftp://ftp.cira.colostate.edu/milija/papers/MLEF_MWR.pdf] Zupanski, D., and M. Zupanski, 2005: Model error estimation employing ensemble data assimilation approach. Submitted to Mon. Wea. Rev. [Available at ftp://ftp.cira.colostate.edu/Zupanski/manuscripts/MLEF_model_err.revised2.pdf]

2 Maximum Likelihood Ensemble Filter (MLEF) Developed using ideas from :  Variational data assimilation (3DVAR, 4DVAR)  Iterated Kalman Filters  Ensemble Transform Kalman Filter (ETKF, Bishop et al. 2001) What the MLEF can do ?  Calculate optimal estimates of: - model state variables (e.g., carbon fluxes, sources, sinks) - empirical parameters (e.g., light response, allocation, drought stress) - model error (bias) - boundary conditions error (lateral, top, bottom boundaries)  Calculate uncertainty of all estimates  Calculate information content of observations (observability in ensemble subspace) Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu

3  Calculate sensitivity, defined in calculus of variations - find the most likely sources/sinks of carbon  Define targeted observations strategies, based on the forecast uncertainty - the system knows where, when and which observations are needed in order to reduce forecast uncertainty  Acquire new knowledge about atmospheric and carbon processes - the system learns from the past about the state variables, model errors, empirical parameters, etc. - the system is adaptive (updates error covariance matrices in each data assimilation cycle) What the MLEF can do (continued) ? Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu

4 DATA ASSIMILATION (ESTIMATION THEORY) Discrete stochastic-dynamic model Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu Discrete stochastic observation model x k-1 – model state w k-1 – model error (stochastic forcing) M – non-linear dynamic (NWP) model G – operator reflecting the state dependence of model error  k – measurement + representativeness error M  D H– non-linear observation operator ( M  D ) Gurney et al. (2003, Tellus) (?)

5 MLEF APPROACH Change of variable - control vector in ensemble space of dim Nens Minimize cost function J - model state vector of dim Nstate >>Nens Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu

6 MLEF APPROACH (continued) Analysis error covariance In Gurney et al. (2003) Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu

7 Forecast error covariance In standard Kalman filter Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu MLEF APPROACH (continued)

8 Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu Initial cycles carry more information. Model has a capability to learn from the observations in later cycles. MLEF application to calculate information content RAMS model example Observation categories within the same cycle Multiple cycles

9 Ensemble Data Assimilation results with CSU global shallow-water model Impact (contribution) from each observation type can be quantified ! Milija Zupanski, CIRA/CSU ZupanskiM@CIRA.colostate.edu Observation categories within the same cycle Multiple cycles

10 MLEF Algorithm prep_ensda.sh cycle_ensda.sh WARM start: Copy files from previously completed cycle COLD start: Run randomly-perturbed ensemble forecasts to initialize fcst err cov icycle < N_cycles_max fcsterr_cov.sh - Prepare first-guess (background) vector - Prepare forecast error covariance (from ensembles) prep_obs.sh Given ‘OBSTYPE’ and ‘delobs’, select and copy available obs files assimilation.sh Iterative minimization of cost function, save current cycle output Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu

11 MLEF Algorithm assimilation.sh script assimilation.sh iter < ioutmax forward.sh: Transformation from model space to observation space - Analysis error covariance calculation - Save current cycle output files - Post-processing (chi-square, RMS, etc.) Hessian preconditioning (only for iter=1) Gradient calculation (ensembles) Cost function calculation (diagnostic) Minimization (ensemble subspace) Step-length (line-search) Control variable update (transformation from ensemble subspace to model (physical) space) Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu

12 MLEF Algorithm Options Models: KdVB, GEOS, SWM, RAMS, … Observations: Synthetic or include various real observations Obs. operators:Include various forward operators Solution Type:Mode (max likelihood-MLEF) or Mean (ensemble mean ETKF) Estimator:Filter or Smoother Control variable:Initial conditions, Model bias, Model parameters Covariances:Localized, or Non-localized forecast error covariance Minimization:Minimization algorithm (C-G, L-BFGS) MPI:Parallel MPI run or a Single processor run Verifications:Innovation statistics (chi-square test, K-S test), RMS-errors Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu

13  Decide which MODELs will be used (LPDM, SiB-CASA-RAMS, PCTM)  In initial experiments use MODEL as in Gurney et al. (2003)  Install LAPACK on your computer, unless it already exists. Compile with 32 bit object code option (LAPACK can be found at http://www.cs.colorado.edu/~lapack)  Install MLEF algorithm on your computer  Include MODEL into MLEF - develop an interface between MODEL and MLEF (a template from SWM, RAMS is available) - prepare all input files for the model  Prepare observations - synthetic observations of atmospheric and carbon variables - separate observations into groups (if needed) - define data assimilation interval Tasks Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu

14  Perform initial data assimilation experiments with synthetic observations - perfect model assumption experiments - parameter estimation experiments - model error estimation experiments  Develop observation operators for: - atmospheric observations (u,v,T,p,q, etc.) - carbon observations  Data assimilation and ensemble forecasting experiments with real observations - LPDM - SiB-CASA-RAMS - PCTM Tasks (continued) Major development assignments  Model related tasks (LPDM, SiB-CASA-RAMS, PCTM)  Observation operators related tasks Dusanka Zupanski, CIRA/CSU Zupanski@CIRA.colostate.edu

Download ppt "Ensemble forecasting/data assimilation and model error estimation algorithm Prepared by Dusanka Zupanski and Milija Zupanski CIRA/CSU Denning group meeting."

Similar presentations

Introduction to Data Assimilation Peter Jan van Leeuwen IMAU.

Introduction to Data Assimilation Peter Jan van Leeuwen IMAU.
Ensemble data assimilation (EnsDA) activities of the GOES-R project Progress report Dusanka Zupanski CIRA/CSU GOES-R meeting 8 September 2004 Dusanka Zupanski,

Ensemble data assimilation (EnsDA) activities of the GOES-R project Progress report Dusanka Zupanski CIRA/CSU GOES-R meeting 8 September 2004 Dusanka Zupanski,
P2.1 ENSEMBLE DATA ASSIMILATION: EXPERIMENTS USING NASA’S GEOS COLUMN PRECIPITATION MODEL D. Zupanski 1, A. Y. Hou 2, S. Zhang 2, M. Zupanski 1, C. D.

P2.1 ENSEMBLE DATA ASSIMILATION: EXPERIMENTS USING NASA’S GEOS COLUMN PRECIPITATION MODEL D. Zupanski 1, A. Y. Hou 2, S. Zhang 2, M. Zupanski 1, C. D.
Dusanka Zupanski CIRA/Colorado State University Fort Collins, Colorado Model Error and Parameter Estimation Joint NCAR/MMM CSU/CIRA Data Assimilation Workshop.

Dusanka Zupanski CIRA/Colorado State University Fort Collins, Colorado Model Error and Parameter Estimation Joint NCAR/MMM CSU/CIRA Data Assimilation Workshop.
Critical issues of ensemble data assimilation in application to GOES-R risk reduction program D. Zupanski 1, M. Zupanski 1, M. DeMaria 2, and L. Grasso.

Critical issues of ensemble data assimilation in application to GOES-R risk reduction program D. Zupanski 1, M. Zupanski 1, M. DeMaria 2, and L. Grasso.
1B.17 ASSESSING THE IMPACT OF OBSERVATIONS AND MODEL ERRORS IN THE ENSEMBLE DATA ASSIMILATION FRAMEWORK D. Zupanski 1, A. Y. Hou 2, S. Zhang 2, M. Zupanski.

1B.17 ASSESSING THE IMPACT OF OBSERVATIONS AND MODEL ERRORS IN THE ENSEMBLE DATA ASSIMILATION FRAMEWORK D. Zupanski 1, A. Y. Hou 2, S. Zhang 2, M. Zupanski.
Dusanka Zupanski CIRA/Colorado State University Fort Collins, Colorado A General Ensemble-Based Approach to Data Assimilation Model Error and Parameter.

Dusanka Zupanski CIRA/Colorado State University Fort Collins, Colorado A General Ensemble-Based Approach to Data Assimilation Model Error and Parameter.
Dusanka Zupanski CIRA/Colorado State University Fort Collins, Colorado Ensemble Kalman Filter Guest Lecture at AT 753: Atmospheric Water Cycle 21 April.

Dusanka Zupanski CIRA/Colorado State University Fort Collins, Colorado Ensemble Kalman Filter Guest Lecture at AT 753: Atmospheric Water Cycle 21 April.
P1.8 QUANTIFYING AND REDUCING UNCERTAINTY BY EMPLOYING MODEL ERROR ESTIMATION METHODS Dusanka Zupanski Cooperative Institute for Research in the Atmosphere.

P1.8 QUANTIFYING AND REDUCING UNCERTAINTY BY EMPLOYING MODEL ERROR ESTIMATION METHODS Dusanka Zupanski Cooperative Institute for Research in the Atmosphere.
Model error estimation employing ensemble data assimilation Dusanka Zupanski and Milija Zupanski CIRA/Colorado State University, Fort Collins, CO, U.S.A.

Model error estimation employing ensemble data assimilation Dusanka Zupanski and Milija Zupanski CIRA/Colorado State University, Fort Collins, CO, U.S.A.
Dusanka Zupanski CIRA/Colorado State University Fort Collins, Colorado Ensemble Data Assimilation and Prediction: Applications to Environmental Science.

Dusanka Zupanski CIRA/Colorado State University Fort Collins, Colorado Ensemble Data Assimilation and Prediction: Applications to Environmental Science.
MODEL ERROR ESTIMATION Cooperative Institute for Research in the Atmosphere Research Benefits to NOAA:This is a novel research approach, providing an optimal.

MODEL ERROR ESTIMATION Cooperative Institute for Research in the Atmosphere Research Benefits to NOAA:This is a novel research approach, providing an optimal.
Initialization Issues of Coupled Ocean-atmosphere Prediction System Climate and Environment System Research Center Seoul National University, Korea In-Sik.

Initialization Issues of Coupled Ocean-atmosphere Prediction System Climate and Environment System Research Center Seoul National University, Korea In-Sik.
Ibrahim Hoteit KAUST, CSIM, May 2010 Should we be using Data Assimilation to Combine Seismic Imaging and Reservoir Modeling? Earth Sciences and Engineering.

Ibrahim Hoteit KAUST, CSIM, May 2010 Should we be using Data Assimilation to Combine Seismic Imaging and Reservoir Modeling? Earth Sciences and Engineering.
1/20 Accelerating minimizations in ensemble variational assimilation G. Desroziers, L. Berre Météo-France/CNRS (CNRM/GAME)

1/20 Accelerating minimizations in ensemble variational assimilation G. Desroziers, L. Berre Météo-France/CNRS (CNRM/GAME)
A Concept of Environmental Forecasting and Variational Organization of Modeling Technology Vladimir Penenko Institute of Computational Mathematics and.

A Concept of Environmental Forecasting and Variational Organization of Modeling Technology Vladimir Penenko Institute of Computational Mathematics and.
Advanced data assimilation methods with evolving forecast error covariance Four-dimensional variational analysis (4D-Var) Shu-Chih Yang (with EK)

Advanced data assimilation methods with evolving forecast error covariance Four-dimensional variational analysis (4D-Var) Shu-Chih Yang (with EK)
Carbon Flux Bias Estimation at Regional Scale using Coupled MLEF-PCTM model Ravindra Lokupitiya Department of Atmospheric Science Colorado State University.

Carbon Flux Bias Estimation at Regional Scale using Coupled MLEF-PCTM model Ravindra Lokupitiya Department of Atmospheric Science Colorado State University.
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland 17-22 July 2006.

Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Ensemble Kalman Filter Methods

Ensemble Kalman Filter Methods

Similar presentations

Ads by Google