Ensemble Kalman Filters for WRF-ARW Chris Snyder MMM and IMAGe National Center for Atmospheric Research Presented by So-Young Ha (MMM/NCAR)

Slides:



Advertisements
Similar presentations
Ensemble Kalman filter data assimilation for the MPAS system
Advertisements

3.11 Adaptive Data Assimilation to Include Spatially Variable Observation Error Statistics Rod Frehlich University of Colorado, Boulder and RAL/NCAR Funded.
MPO 674 Lecture 15 3/3/15. Bayesian update Jeff Anderson’s Tutorial A | C = Prior based on previous information C A | BC = Posterior based on previous.
CHOICES FOR HURRICANE REGIONAL ENSEMBLE FORECAST (HREF) SYSTEM Zoltan Toth and Isidora Jankov.
Representing Model Error in Ensemble DA Chris Snyder (NCAR) NCAR is supported by the National Science Foundation.
Convection-permitting forecasts initialized with continuously-cycling limited-area 3DVAR, EnKF and “hybrid” data assimilation systems Craig Schwartz and.
Toward a Real Time Mesoscale Ensemble Kalman Filter Gregory J. Hakim Dept. of Atmospheric Sciences, University of Washington Collaborators: Ryan Torn (UW)
Performance Characteristics of a Pseudo-operational Ensemble Kalman Filter April 2006, EnKF Wildflower Meeting Greg Hakim & Ryan Torn University of Washington.
Initializing a Hurricane Vortex with an EnKF Yongsheng Chen Chris Snyder MMM / NCAR.
An Efficient Ensemble Data Assimilation Approach and Tests with Doppler Radar Data Jidong Gao Ming Xue Center for Analysis and Prediction of Storms, University.
ASSIMILATION of RADAR DATA at CONVECTIVE SCALES with the EnKF: PERFECT-MODEL EXPERIMENTS USING WRF / DART Altuğ Aksoy National Center for Atmospheric Research.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Background In deriving basic understanding of atmospheric phenomena, the analysis often revolves around discovering and exploiting relationships between.
WRF/DART Forecasts from Weather Research and Forecasting model, assimilation from Data Assimilation Research Testbed. DART is general purpose ensemble.
Models for model error –Additive noise. What is Q(x 1, x 2, t 1, t 2 )? –Covariance inflation –Multiplicative noise? –Parameter uncertainty –“Structural”
A comparison of hybrid ensemble transform Kalman filter(ETKF)-3DVAR and ensemble square root filter (EnSRF) analysis schemes Xuguang Wang NOAA/ESRL/PSD,
Lili Lei1,2, David R. Stauffer1 and Aijun Deng1
Ensemble Data Assimilation and Uncertainty Quantification Jeffrey Anderson, Alicia Karspeck, Tim Hoar, Nancy Collins, Kevin Raeder, Steve Yeager National.
EnKF Overview and Theory
Observing Strategy and Observation Targeting for Tropical Cyclones Using Ensemble-Based Sensitivity Analysis and Data Assimilation Chen, Deng-Shun 3 Dec,
Nonlinear Data Assimilation and Particle Filters
The fear of the LORD is the beginning of wisdom 陳登舜 ATM NCU Group Meeting REFERENCE : Liu., H., J. Anderson, and Y.-H. Kuo, 2012: Improved analyses.
Computational Issues: An EnKF Perspective Jeff Whitaker NOAA Earth System Research Lab ENIAC 1948“Roadrunner” 2008.
1 ESTIMATING THE STATE OF LARGE SPATIOTEMPORALLY CHAOTIC SYSTEMS: WEATHER FORECASTING, ETC. Edward Ott University of Maryland Main Reference: E. OTT, B.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
MPO 674 Lecture 20 3/26/15. 3d-Var vs 4d-Var.
Assimilation of HF Radar Data into Coastal Wave Models NERC-funded PhD work also supervised by Clive W Anderson (University of Sheffield) Judith Wolf (Proudman.
Hybrid Variational/Ensemble Data Assimilation
1 GSI/ETKF Regional Hybrid Data Assimilation with MMM Hybrid Testbed Arthur P. Mizzi NCAR/MMM 2011 GSI Workshop June 29 – July 1, 2011.
Assimilating Reflectivity Observations of Convective Storms into Convection-Permitting NWP Models David Dowell 1, Chris Snyder 2, Bill Skamarock 2 1 Cooperative.
2004 SIAM Annual Meeting Minisymposium on Data Assimilation and Predictability for Atmospheric and Oceanographic Modeling July 15, 2004, Portland, Oregon.
Applications of optimal control and EnKF to Flow Simulation and Modeling Florida State University, February, 2005, Tallahassee, Florida The Maximum.
Outline Background Highlights of NCAR’s R&D efforts A proposed 5-year plan for CWB Final remarks.
MODEL ERROR ESTIMATION EMPLOYING DATA ASSIMILATION METHODOLOGIES Dusanka Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University.
Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005.
Research Vignette: The TransCom3 Time-Dependent Global CO 2 Flux Inversion … and More David F. Baker NCAR 12 July 2007 David F. Baker NCAR 12 July 2007.
Putting a Vortex in Its Place Chris Snyder National Center for Atmospheric Research.
A Sequential Hybrid 4DVAR System Implemented Using a Multi-Grid Technique Yuanfu Xie 1, Steven E. Koch 1, and Steve Albers 1,2 1 NOAA Earth System Research.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
DATA ASSIMILATION FOR HURRICANE PREDICTION Experimental system and results of semi-operational implementation during the 2010 Atlantic Hurricane Season.
Sabrina Rainwater David National Research Council Postdoc at NRL with Craig Bishop and Dan Hodyss Naval Research Laboratory Multi-scale Covariance Localization.
Application of COSMIC refractivity in Improving Tropical Analyses and Forecasts H. Liu, J. Anderson, B. Kuo, C. Snyder, and Y. Chen NCAR IMAGe/COSMIC/MMM.
ASSIMILATING DENSE PRESSURE OBSERVATIONS— A PREVIEW OF HOW THIS MAY IMPACT ANALYSIS AND NOWCASTING Luke Madaus -- Wed., Sept. 21, 2011.
Implementation and Testing of 3DEnVAR and 4DEnVAR Algorithms within the ARPS Data Assimilation Framework Chengsi Liu, Ming Xue, and Rong Kong Center for.
Preliminary results from assimilation of GPS radio occultation data in WRF using an ensemble filter H. Liu, J. Anderson, B. Kuo, C. Snyder, A. Caya IMAGe.
ENSEMBLE KALMAN FILTER DATA ASSIMILATION FOR THE MPAS SYSTEM So-Young Ha, Chris Snyder, Bill Skamarock, Jeffrey Anderson*, Nancy Collins*, Michael Duda,
Hybrid (3D-VAR /ETKF) Data Assimilation System
Ensemble forecasting/data assimilation and model error estimation algorithm Prepared by Dusanka Zupanski and Milija Zupanski CIRA/CSU Denning group meeting.
Future Directions in Ensemble DA for Hurricane Prediction Applications Jeff Anderson: NCAR Ryan Torn: SUNY Albany Thanks to Chris Snyder, Pavel Sakov The.
November 21 st 2002 Summer 2009 WRFDA Tutorial WRF-Var System Overview Xin Zhang, Yong-Run Guo, Syed R-H Rizvi, and Michael Duda.
ENSEMBLE KALMAN FILTER IN THE PRESENCE OF MODEL ERRORS Hong Li Eugenia Kalnay.
École Doctorale des Sciences de l'Environnement d’Île-de-France Année Universitaire Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
École Doctorale des Sciences de l'Environnement d’ Î le-de-France Année Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
Assimilating Cloudy Infrared Brightness Temperatures in High-Resolution Numerical Models Using Ensemble Data Assimilation Jason A. Otkin and Rebecca Cintineo.
The Ensemble Kalman filter
Korea Institute of Atmospheric Prediction Systems (KIAPS) ( 재 ) 한국형수치예보모델개발사업단 LETKF 앙상블 자료동화 시스템 테스트베드 구축 및 활용방안 Implementation and application of LETKF.
Multi-scale Analysis and Prediction of the 8 May 2003 Oklahoma City Tornadic Supercell Storm Assimilating Radar and Surface Network Data using EnKF Ting.
Hybrid Data Assimilation
Jeffrey Anderson, NCAR Data Assimilation Research Section
Methods for dealing with spurious covariances arising from small samples in ensemble data assimilation Jeff Whitaker NOAA Earth.
Data Assimilation Theory CTCD Data Assimilation Workshop Nov 2005
Radar Data Assimilation
background error covariance matrices Rescaled EnKF Optimization
New Approaches to Data Assimilation
8th EnKF Workshop Discussion.
Assimilation of Global Positioning System Radio Occultation Observations Using an Ensemble Filter in Atmospheric Prediction Models Hui Liu, Jefferey Anderson,
Impact of Assimilating AMSU-A Radiances on forecasts of 2008 Atlantic TCs Initialized with a limited-area EnKF Zhiquan Liu, Craig Schwartz, Chris Snyder,
Data Assimilation Initiative, NCAR
Sarah Dance DARC/University of Reading
Presentation transcript:

Ensemble Kalman Filters for WRF-ARW Chris Snyder MMM and IMAGe National Center for Atmospheric Research Presented by So-Young Ha (MMM/NCAR)

Preliminaries Notation: –x = model ’ s state w.r.t. some discrete basis, e.g. grid-pt values –y = Hx +  = vector of observations with random error  –Superscript f denotes forecast quantities, superscript a analysis, e.g. x f –P f = Cov(x f ) = forecast covariance matrix … a.k.a. B in Var

Ensemble Kalman Filter (EnKF) EnKF analysis step –As in KF analysis step, but uses sample (ensemble) estimates for covariances –e.g. one element of P f H T is Cov(x f,y f ) = N e -1 ∑(x i f - mean(x))(y i f - mean(y f )) where y f = Hx f is the forecast, or prior, observation. –Output of EnKF analysis step is ensemble of analyses EnKF forecast step –Each member integrated forward with full nonlinear model –Monte-Carlo generalization of KF forecast step

Relation of Var and KF … as long as P f and R are the same in both systems

How the EnKF works Suppose we wish to assimilate an observation of v r Consider how assimilation affects a model variable, say w. Begin with: –ensemble of short-range forecasts (of model variables) –Observed value of v r

How the EnKF works (cont.) 1. Compute v r for each ensemble member

How the EnKF works (cont.) 1. Compute v r for each ensemble member vrvr w                  

How the EnKF works (cont.) 1. Compute v r for each ensemble member vrvr w                   Ensemble mean

How the EnKF works (cont.) 1. Compute v r for each ensemble member vrvr w                   Ensemble mean Observed value

How the EnKF works (cont.) 2. Compute best-fit line that relates v r and w vrvr w                  

How the EnKF works (cont.) 3. Analysis moves toward observed value of v r and along best-fit line vrvr w                   Analysis (ensemble mean)

How the EnKF works (cont.) 3. Analysis moves toward observed value of v r and along best-fit line … have gained information about unobserved variable, w vrvr w                   Analysis (ensemble mean)

How the EnKF works (cont.) 4. Update deviation of each ensemble member about the mean as well. Yields initial conditions for ensemble forecast to time of next observation.

Flavors of EnKF ETKF –P f is sample covariance from ensemble –Analysis increments lie in ensemble subspace –Computationally cheap--reduces to N e x N e matrices –Useful for EF but not for DA: In Var “ hybrid ” system, ETKF updates ensemble deviations but not ensemble mean “ Localized ” EnKF –Cov(y,x) assumed to decrease to zero at sufficient distances –Reduces computations and allows increments outside ensemble subspace –  approximate equivalence with  -CV option in Var--different way of solving same equations –Numerous variants; DART provides several with interfaces for WRF

Data Assimilation Research Testbed (DART) DART is general software for ensemble filtering: –Assimilation scheme(s) are independent of model –Interfaces exist for numerous models: WRF (including global and single column), CAM (spectral and FV), MOM, ROSE, others –See Parallelization –Forecasts parallelized at script level as separate jobs; also across processors, if allowed by OS –Analysis has generic parallelization, independent of model and grid structure

WRF/DART Consists of: –Interfaces between WRF and DART (e.g. translate state vector, compute distances, … ) –Observation operators –Scripts to generate IC ensemble, generate LBC ensemble, advance WRF Easy to add fields to state vector (e.g. tracers, chem species) –Namelist control of fields in state vector A few external users (5-10) so far

Nested Grids in WRF/DART Perform analysis across multiple nests simultaneously –Innovations calculated w.r.t. finest available grid –All grid points within localization radius updated D1 D2 D3.. obs

Var/DART DART algorithm –First, calculate “ observation priors: ” H(x f ) for each member –Then solve analysis equations Possible to use Var for H(x f ), DART for rest of analysis –Same interface as between Var and ETKF: H(x f ) are written by Var to gts_omb_oma files, then read by DART –Allows EnKF within existing WRF/Var framework, and use of Var observation operators with DART –Under development

Some Applications Radar assimilation for convective scales –Altug Aksoy (NOAA/HRD) and David Dowell (NCAR) Assimilation of surface observations –David Dowell and So-Young Ha –Also have single-column version of WRF/DART from Josh Hacker (NCAR) Tropical cyclones –Ryan Torn (SUNY-Albany), Yongsheng Chen (York), Hui Liu (NCAR) GPS occultation observations –Liu

References Bengtsson T., C. Snyder, and D. Nychka, 2003: Toward a nonlinear ensemble filter for high-dimensional systems. J. Geophys. Res., 62(D24), Dowell, D., F. Zhang, L. Wicker, C. Snyder and N. A. Crook, 2004: Wind and thermodynamic retrievals in the 17 May 1981 Arcadia, Oklahoma supercell: Ensemble Kalman filter experiments. Mon. Wea. Rev., 132, Snyder, C. and F. Zhang, 2003: Assimilation of simulated Doppler radar observations with an ensemble Kalman filter. Mon. Wea. Rev., 131, Torn, R. D., G. J. Hakim, and C. Snyder, 2006: Boundary conditions for limited-area ensemble Kalman filters. Mon. Wea. Rev., 134, Hacker, J. P., and C. Snyder, 2005: Ensemble Kalman filter assimilation of fixed screen-height observations in a parameterized PBL. Mon. Wea. Rev., 133, Caya, A., J. Sun and C. Snyder, 2005: A comparison between the 4D-Var and the ensemble Kalman filter techniques for radar data assimilation. Mon. Wea. Rev., 133, Chen, Y., and C. Snyder, 2007: Assimilating vortex position with an ensemble Kalman filter. Mon. Wea. Rev., 135, Anderson, J. L., 2007: An adaptive covariance inflation error correction algorithm for ensemble filters. Tellus A, 59, Snyder, C. T. Bengtsson, P. Bickel and J. L. Anderson, 2008: Obstacles to high-dimensional particle filtering. Mon. Wea. Rev., accepted. Aksoy, A., D. Dowell and C. Snyder, 2008: A multi-case comparative assessment of the ensemble Kalman filter for assimilation of radar observations. Part I: Storm-scale analyses. Mon. Wea. Rev., accepted.