MPO 674 Lecture 20 3/26/15. 3d-Var vs 4d-Var.

Slides:



Advertisements
Similar presentations
Xuguang Wang, Xu Lu, Yongzuo Li, Ting Lei
Advertisements

Hybrid variational-ensemble data assimilation for the NCEP GFS Tom Hamill, for Jeff Whitaker NOAA Earth System Research Lab, Boulder, CO, USA
NOAA THORPEX Highlights John Cortinas Tom Hamill NOAA/OAR 1.
Geophysical Fluid Dynamics Laboratory Review June 30 - July 2, 2009 Geophysical Fluid Dynamics Laboratory Review June 30 - July 2, 2009.
CHOICES FOR HURRICANE REGIONAL ENSEMBLE FORECAST (HREF) SYSTEM Zoltan Toth and Isidora Jankov.
1 Hybrid variational-ensemble data assimilation (HVEDAS) High Impact Weather Working Group Workshop 24 February, 2011 – Norman, OK Daryl T. Kleist 1,3.
NOAA/NWS Change to WRF 13 June What’s Happening? WRF replaces the eta as the NAM –NAM is the North American Mesoscale “timeslot” or “Model Run”
Ensemble-4DVAR for NCEP hybrid GSI- EnKF data assimilation system 1 5 th EnKF workshop, New York, May 22, 2012 Xuguang Wang, Ting Lei University of Oklahoma,
The 2014 Warn-on-Forecast and High-Impact Weather Workshop
Improving High Resolution Tropical Cyclone Prediction Using a Unified GSI-based Hybrid Ensemble-Variational Data Assimilation System for HWRF Xuguang Wang.
5/22/201563rd Interdepartmental Hurricane Conference, March 2-5, 2009, St. Petersburg, FL Experiments of Hurricane Initialization with Airborne Doppler.
Jidong Gao and David Stensrud Some OSSEs on Assimilation of Radar Data with a Hybrid 3DVAR/EnKF Method.
Balance in the EnKF Jeffrey D. Kepert Centre for Australian Weather and Climate Research A partnership between the Australian Bureau of Meteorology and.
Toward a Real Time Mesoscale Ensemble Kalman Filter Gregory J. Hakim Dept. of Atmospheric Sciences, University of Washington Collaborators: Ryan Torn (UW)
Assimilating Sounding, Surface and Profiler Observations with a WRF-based EnKF for An MCV Case during BAMEX Zhiyong Meng & Fuqing Zhang Texas A&M University.
1/20 Accelerating minimizations in ensemble variational assimilation G. Desroziers, L. Berre Météo-France/CNRS (CNRM/GAME)
Performance Characteristics of a Pseudo-operational Ensemble Kalman Filter April 2006, EnKF Wildflower Meeting Greg Hakim & Ryan Torn University of Washington.
Initializing a Hurricane Vortex with an EnKF Yongsheng Chen Chris Snyder MMM / NCAR.
Review of “Covariance Localization” in Ensemble Filters Tom Hamill NOAA Earth System Research Lab, Boulder, CO NOAA Earth System Research.
ASSIMILATION of RADAR DATA at CONVECTIVE SCALES with the EnKF: PERFECT-MODEL EXPERIMENTS USING WRF / DART Altuğ Aksoy National Center for Atmospheric Research.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Ensemble-based adaptive sampling and data assimilation issues in tropical cyclones Sharanya J. Majumdar (RSMAS/U.Miami) Collaborators, present and future:
The Relative Contribution of Atmospheric and Oceanic Uncertainty in TC Intensity Forecasts Ryan D. Torn University at Albany, SUNY World Weather Open Science.
Two Methods of Localization  Model Covariance Matrix Localization (B Localization)  Accomplished by taking a Schur product between the model covariance.
A comparison of hybrid ensemble transform Kalman filter(ETKF)-3DVAR and ensemble square root filter (EnSRF) analysis schemes Xuguang Wang NOAA/ESRL/PSD,
Comparison of hybrid ensemble/4D- Var and 4D-Var within the NAVDAS- AR data assimilation framework The 6th EnKF Workshop May 18th-22nd1 Presenter: David.
Targeting strategies to improve hurricane track forecasts (JHT 03-05) PIs: Dr Sharanya J. Majumdar (University of Miami) Dr Sim D. Aberson (NOAA/AOML/HRD)
GSI Hybrid EnKF-3DVAR Upgrade Components –GPS RO bending angle rather than refractivity –Inclusion of compressibility factors for atmosphere –Retune SBUV.
UKmet February Hybrid Ensemble-Variational Data Assimilation Development A partnership to develop and implement a hybrid 3D-VAR system –Joint venture.
EnKF Overview and Theory
Observing Strategy and Observation Targeting for Tropical Cyclones Using Ensemble-Based Sensitivity Analysis and Data Assimilation Chen, Deng-Shun 3 Dec,
The fear of the LORD is the beginning of wisdom 陳登舜 ATM NCU Group Meeting REFERENCE : Liu., H., J. Anderson, and Y.-H. Kuo, 2012: Improved analyses.
1 ESTIMATING THE STATE OF LARGE SPATIOTEMPORALLY CHAOTIC SYSTEMS: WEATHER FORECASTING, ETC. Edward Ott University of Maryland Main Reference: E. OTT, B.
Space and Time Multiscale Analysis System A sequential variational approach Yuanfu Xie, Steven Koch Steve Albers and Huiling Yuan Global Systems Division.
Hybrid Variational/Ensemble Data Assimilation for the NCEP GFS Tom Hamill, for Jeff Whitaker NOAA Earth System Research Lab, Boulder, CO, USA
Development of an EnKF/Hybrid Data Assimilation System for Mesoscale Application with the Rapid Refresh Ming Hu 1,2, Yujie Pan 3, Kefeng Zhu 3, Xuguang.
Hybrid Variational/Ensemble Data Assimilation
Vaisala/University of Washington Real-observation Experiments Vaisala/University of Washington Real-observation Experiments Clifford Mass, Gregory Hakim,
1 GSI/ETKF Regional Hybrid Data Assimilation with MMM Hybrid Testbed Arthur P. Mizzi NCAR/MMM 2011 GSI Workshop June 29 – July 1, 2011.
1/11/20101 Vortex Initialization of the Atmospheric Model in HWRF HWRF Tutorial, 2014 Qingfu Liu, Vijay Tallapragada, Xuejin Zhang (HRD) Mingjing Tong,
14 th Annual WRF Users’ Workshop. June 24-28, 2013 Improved Initialization and Prediction of Clouds with Satellite Observations Tom Auligné Gael Descombes,
MODEL ERROR ESTIMATION EMPLOYING DATA ASSIMILATION METHODOLOGIES Dusanka Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University.
11 Background Error Daryl T. Kleist* National Monsoon Mission Scoping Workshop IITM, Pune, India April 2011.
Putting a Vortex in Its Place Chris Snyder National Center for Atmospheric Research.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
DATA ASSIMILATION FOR HURRICANE PREDICTION Experimental system and results of semi-operational implementation during the 2010 Atlantic Hurricane Season.
Development and Testing of a Regional GSI-Based EnKF-Hybrid System for the Rapid Refresh Configuration Yujie Pan 1, Kefeng Zhu 1, Ming Xue 1,2, Xuguang.
Ensemble data assimilation in an operational context: the experience at the Italian Weather Service Massimo Bonavita and Lucio Torrisi CNMCA-UGM, Rome.
Deutscher Wetterdienst Vertical localization issues in LETKF Breogan Gomez, Andreas Rhodin, Hendrik Reich.
Ensemble Kalman filter assimilation of Global-Hawk-based data from tropical cyclones Jason Sippel, Gerry Heymsfield, Lin Tian, and Scott Braun- NASAs GSFC.
Ensemble assimilation & prediction at Météo-France Loïk Berre & Laurent Descamps.
Use ensemble error covariance information in GRAPES 3DVAR Jiandong GONG, Ruichun WANG NWP center of CMA Oct 27, 2015.
Studying impacts of the Saharan Air Layer on hurricane development using WRF-Chem/EnKF Jianyu(Richard) Liang Yongsheng Chen 6th EnKF Workshop York University.
Implementation and Testing of 3DEnVAR and 4DEnVAR Algorithms within the ARPS Data Assimilation Framework Chengsi Liu, Ming Xue, and Rong Kong Center for.
DRAFT – Page 1 – January 14, 2016 Development of a Convective Scale Ensemble Kalman Filter at Environment Canada Luc Fillion 1, Kao-Shen Chung 1, Monique.
Determining Key Model Parameters of Rapidly Intensifying Hurricane Guillermo(1997) Using the Ensemble Kalman Filter Chen Deng-Shun 16 Apr, 2013, NCU Godinez,
University of Oklahoma, Norman, OK
MPO 674 Lecture 2 1/20/15. Timeline (continued from Class 1) 1960s: Lorenz papers: finite limit of predictability? 1966: First primitive equations model.
The operational Meteo-France ensemble 4D-Var (L. Berre, G. Desroziers, and co-authors) Ensemble assimilation (operational with 6 members…) :
Ensemble prediction review for WGNE, 2010 Tom Hamill 1 and Pedro de Silva-Dias 2 1 NOAA/ESRL 2 Laboratório Nacional de Computação Científica
Future Directions in Ensemble DA for Hurricane Prediction Applications Jeff Anderson: NCAR Ryan Torn: SUNY Albany Thanks to Chris Snyder, Pavel Sakov The.
© Crown copyright Met Office Mismatching Perturbations at the Lateral Boundaries in Limited-Area Ensemble Forecasting Jean-François Caron … or why limited-area.
Hybrid Data Assimilation
Methods for dealing with spurious covariances arising from small samples in ensemble data assimilation Jeff Whitaker NOAA Earth.
background error covariance matrices Rescaled EnKF Optimization
Vertical localization issues in LETKF
New Approaches to Data Assimilation
14th Cyclone Workshop Brian Ancell The University of Washington
Sarah Dance DARC/University of Reading
Presentation transcript:

MPO 674 Lecture 20 3/26/15

3d-Var vs 4d-Var

Ensemble Kalman Filters Want flow-dependent, dynamical covariances Several different types of Kalman filter exist, all of which have a linear inference. Non-linear filters are too hard. Seek simple approximations... Ensemble Kalman filters use P f = Z f Z fT Z f is an n x k matrix containing k ensemble perturbations (about a mean state) of length n. Perturbation

P f = Z f Z fT (u’1)1 (u’1)2 (u’1)3 (v’1)1 (v’1)2 (v’1)3 (T’1)1 (T’1)2 (T’1)3 (p’1)1 (p’1)2 (p’1)3 (u’2)1 (u’2)2 (u’2)3 (v’2)1 (v’2)2 (v’2)3 (T’2)1 (T’2)2 (T’2)3 (p’2)1 (p’2)2 (p’2)3 (u’3)1 (u’3)2 (u’3)3 … … … (u’1)1 (v’1)1 (T’1)1 (p’1)1 (u’2)1 (v’2)1 (T’2)1 (p’2)1 (u’3)1 (u’1)2 (v’1)2 (T’1)2 (p’1)2 (u’2)2 (v’2)2 (T’2)2 (p’2)2 (u’3)2 (u’1)3 (v’1)3 (T’1)3 (p’1)3 (u’2)3 (v’2)3 (T’2)3 (p’2)3 (u’3) Ensemble members

P f = Z f Z fT (u’1)1 (v’1)1 (T’1)1 (p’1)1 (u’2)1 (v’2)1 (T’2)1 (p’2)1 (u’3)1 (u’1)2 (v’1)2 (T’1)2 (p’1)2 (u’2)2 (v’2)2 (T’2)2 (p’2)2 (u’3)2 (u’1)3 (v’1)3 (T’1)3 (p’1)3 (u’2)3 (v’2)3 (T’2)3 (p’2)3 (u’3)3 (u’1)1 (u’1)2 (u’1)3 (v’1)1 (v’1)2 (v’1)3 (T’1)1 (T’1)2 (T’1)3 (p’1)1 (p’1)2 (p’1)3 (u’2)1 (u’2)2 (u’2)3 (v’2)1 (v’2)2 (v’2)3 (T’2)1 (T’2)2 (T’2)3 (p’2)1 (p’2)2 (p’2)3 (u’3)1 (u’3)2 (u’3)3 … … … Ensemble members

P f = Z f Z fT (u’1)1 (v’1)1 (T’1)1 (p’1)1 (u’2)1 (v’2)1 (T’2)1 (p’2)1 (u’3)1 (u’1)2 (v’1)2 (T’1)2 (p’1)2 (u’2)2 (v’2)2 (T’2)2 (p’2)2 (u’3)2 (u’1)3 (v’1)3 (T’1)3 (p’1)3 (u’2)3 (v’2)3 (T’2)3 (p’2)3 (u’3) Ensemble members (u’1)1 (u’1)2 (u’1)3 (v’1)1 (v’1)2 (v’1)3 (T’1)1 (T’1)2 (T’1)3 (p’1)1 (p’1)2 (p’1)3 (u’2)1 (u’2)2 (u’2)3 (v’2)1 (v’2)2 (v’2)3 (T’2)1 (T’2)2 (T’2)3 (p’2)1 (p’2)2 (p’2)3 (u’3)1 (u’3)2 (u’3)3 … … …

DA in Tropical Cyclones Artificial operational methods: –Bogus Vortex (US Navy, UKMet) –Relocation (NCEP GFS) –Vortex Spin-Up (GFDL) Can one develop a physically consistent method to do DA in hurricanes?

(Brian Etherton)

WRF: PRELIMINARY RESULTS (Xuguang Wang, U. Oklahoma) (1) Assimilation of one v ob: 5 m/s higher than first guess v

(2) EnKF-based covariance of decrease in central sea level pressure with T and v

Single 850 hPa u observation (3 m/s O-F, 1m/s error) in Hurricane Ike EnKF 3d-Var hybrid Whitaker, Hamill, Kleist, Parrish, Derber, Wang

Innovation 10 m/s Ob error 0.1 m/s 4 (u,v) obs 1 degree from center in GSI 1 v ob 150km east of center in WRF/EnKF. CAVEAT: Different Storms! 3d-Var vs EnKF

GSI Analysis Increment of v (m/s) Operational L z WRF/EnKF Analysis Increment of v (m/s)

GSI Analysis Increment of v (m/s) 2 x L z WRF/EnKF Analysis Increment of v (m/s)

GSI Analysis Increment of v (m/s) 4 x L z WRF/EnKF Analysis Increment of v (m/s)

3d-Var –Geostrophic & hydrostatic correction (needed 4 “obs”). –Local horizontal correction. –Significant increment only through boundary layer. –Increasing L z improved storm structure and track forecast. EnKF –Gradient wind correction (used only 1 “obs”). –Stronger winds associated with shifting the storm further east and increasing intensity of winds. –Troposphere-deep increment: vertical error correlation lengthscale equivalent to 4x of GSI. Summary: 3d-Var vs EnKF

From Tom Hamill

Sampling Error and Covariance Localization

Petrie (1998, MS Thesis)

Example of covariance localization Background-error correlations estimated from 25 members of a 200-member ensemble exhibit a large amount of structure that does not appear to have any physical meaning. Without correction, an observation at the dotted location would produce increments across the globe. Proposed solution is element-wise multiplication of the ensemble estimates (a) with a smooth correlation function (c) to produce (d), which now resembles the large-ensemble estimate (b). This has been dubbed “covariance localization.” from Hamill, Chapter 6 of “Predictability of Weather and Climate” obs location

Why localization? Relative sampling errors depend on ensemble size, correlation. True background-error covariance of model with two grid points: Suppose there is inaccurate estimate of background-error covariance matrix and obs at grid point 1 with error covariance How do errors change with correlation and ensemble size? Relative error is large when correlation and/or ensemble size is small. Ref: Hamill et al, 2001, MWR, 129, pp From Tom Hamill

Spreads and errors as function of localization length scale Ref: Houtekamer and Mitchell, 2001, MWR, 129, pp (1) Small ensembles minimize error with short length scale, large ensemble with longer length scale. That is, less localization needed for large ensemble. (2) The longer the localization length scale, the less spread in the posterior ensemble. From Tom Hamill

Filter Divergence

Hamill et al. (2001, MWR)