1 Hybrid variational-ensemble data assimilation (HVEDAS) High Impact Weather Working Group Workshop 24 February, 2011 – Norman, OK Daryl T. Kleist 1,3.

Slides:



Advertisements
Similar presentations
Assimilation of T-TREC-retrieved wind data with WRF 3DVAR for the short-Term forecasting of Typhoon Meranti (2010) at landfall Xin Li 1, Yuan Wang 1, Jie.
Advertisements

Xuguang Wang, Xu Lu, Yongzuo Li, Ting Lei
Background and Observation Errors:
Adaptation of the Gridpoint Statistical Interpolation (GSI) for hourly cycled application within the Rapid Refresh Ming Hu 1,2, Stan Benjamin 1, Steve.
Hybrid variational-ensemble data assimilation for the NCEP GFS Tom Hamill, for Jeff Whitaker NOAA Earth System Research Lab, Boulder, CO, USA
Assimilate NOAA P3 Tail Doppler Radar Data for Hurricane Initialization at NCEP Mingjing Tong1 Collaborators: David Perish2, Daryl Kleist3, Russ Treadon2,
Ensemble-4DVAR for NCEP hybrid GSI- EnKF data assimilation system 1 5 th EnKF workshop, New York, May 22, 2012 Xuguang Wang, Ting Lei University of Oklahoma,
The 2014 Warn-on-Forecast and High-Impact Weather Workshop
Improving High Resolution Tropical Cyclone Prediction Using a Unified GSI-based Hybrid Ensemble-Variational Data Assimilation System for HWRF Xuguang Wang.
5/22/201563rd Interdepartmental Hurricane Conference, March 2-5, 2009, St. Petersburg, FL Experiments of Hurricane Initialization with Airborne Doppler.
Jidong Gao and David Stensrud Some OSSEs on Assimilation of Radar Data with a Hybrid 3DVAR/EnKF Method.
Implementation plans of Hybrid 4D EnVar for the NCEP GFS
Convection-permitting forecasts initialized with continuously-cycling limited-area 3DVAR, EnKF and “hybrid” data assimilation systems Craig Schwartz and.
1/20 Accelerating minimizations in ensemble variational assimilation G. Desroziers, L. Berre Météo-France/CNRS (CNRM/GAME)
Performance Characteristics of a Pseudo-operational Ensemble Kalman Filter April 2006, EnKF Wildflower Meeting Greg Hakim & Ryan Torn University of Washington.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Progress in Cloudy Microwave Satellite Data Assimilation at NCEP Andrew Collard 1, Emily Liu 4, Yanqiu Zhu 1, John Derber 2, Daryl Kleist 3, Rahul Mahajan.
Background and Status of Q1FY16 Global Implementation
Current Status of the Development of the Local Ensemble Transform Kalman Filter at UMD Istvan Szunyogh representing the UMD “Chaos-Weather” Group Ensemble.
A comparison of hybrid ensemble transform Kalman filter(ETKF)-3DVAR and ensemble square root filter (EnSRF) analysis schemes Xuguang Wang NOAA/ESRL/PSD,
Numerical Weather Prediction Division The usage of the ATOVS data in the Korea Meteorological Administration (KMA) Sang-Won Joo Korea Meteorological Administration.
Comparison of hybrid ensemble/4D- Var and 4D-Var within the NAVDAS- AR data assimilation framework The 6th EnKF Workshop May 18th-22nd1 Presenter: David.
GSI Hybrid EnKF-3DVAR Upgrade Components –GPS RO bending angle rather than refractivity –Inclusion of compressibility factors for atmosphere –Retune SBUV.
UKmet February Hybrid Ensemble-Variational Data Assimilation Development A partnership to develop and implement a hybrid 3D-VAR system –Joint venture.
EnKF Overview and Theory
Observing Strategy and Observation Targeting for Tropical Cyclones Using Ensemble-Based Sensitivity Analysis and Data Assimilation Chen, Deng-Shun 3 Dec,
Hybrid 4D EnVar for the NCEP GFS (with comments on initialization) Daryl Kleist 1,3, Jeff Whitaker 2, Kayo Ide 3, and John Derber 1 Lili Lei 2,4, Rahul.
An OSSE-based evaluation of 4D-Ensemble- Var (and hybrid variants) for the NCEP GFS Daryl Kleist 1,2 and Kayo Ide 2 1 CMOS 2012 Congress AMS 21 st NWP.
GSI-based Hybrid Data Assimilation:
MPO 674 Lecture 20 3/26/15. 3d-Var vs 4d-Var.
On Improving GFS Forecast Skills in the Southern Hemisphere: Ideas and Preliminary Results Fanglin Yang Andrew Collard, Russ Treadon, John Derber NCEP-EMC.
Data assimilation and observing systems strategies Pierre Gauthier Data Assimilation and Satellite Meteorology Division Meteorological Service of Canada.
GSI EXPERIMENTS FOR RUA REFLECTIVITY/CLOUD AND CONVENTIONAL OBSERVATIONS Ming Hu, Stan Benjamin, Steve Weygandt, David Dowell, Terra Ladwig, and Curtis.
JCSDA Summer Colloquium on Data Assimilation
Hybrid Variational/Ensemble Data Assimilation for the NCEP GFS Tom Hamill, for Jeff Whitaker NOAA Earth System Research Lab, Boulder, CO, USA
Development of an EnKF/Hybrid Data Assimilation System for Mesoscale Application with the Rapid Refresh Ming Hu 1,2, Yujie Pan 3, Kefeng Zhu 3, Xuguang.
A description of the tangent linear normal mode constraint (TLNMC) in GSI David Parrish.
Hybrid Variational/Ensemble Data Assimilation
14 th Annual WRF Users’ Workshop. June 24-28, 2013 Improved Initialization and Prediction of Clouds with Satellite Observations Tom Auligné Gael Descombes,
Challenges and practical applications of data assimilation in numerical weather prediction Data Assimilation Education Forum Part I: Overview of Data Assimilation.
11 Background Error Daryl T. Kleist* National Monsoon Mission Scoping Workshop IITM, Pune, India April 2011.
1 EMC’s Current and future GSI development John C. Derber Environmental Modeling Center NCEP/NWS/NOAA With input from: Many others.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
6/29/2010 Wan-Shu Wu1 GSI Tutorial 2010 Background and Observation Error Estimation and Tuning.
Covariance Modeling “Where America’s Climate, Weather, Ocean and Space Weather Services Begin” JCSDA Summer Colloquium July 27, 2015 Presented by John.
Development and Testing of a Regional GSI-Based EnKF-Hybrid System for the Rapid Refresh Configuration Yujie Pan 1, Kefeng Zhu 1, Ming Xue 1,2, Xuguang.
Ensemble data assimilation in an operational context: the experience at the Italian Weather Service Massimo Bonavita and Lucio Torrisi CNMCA-UGM, Rome.
Retrieval of Moisture from GPS Slant-path Water Vapor Observations using 3DVAR and its Impact on the Prediction of Convective Initiation and Precipitation.
Ensemble assimilation & prediction at Météo-France Loïk Berre & Laurent Descamps.
Assess Observation Impacts in the Hybrid GSI-EnKF Data Assimilation Systems for NCEP Global Forecast System Model Through OSE and Ensemble Based Observation.
Use ensemble error covariance information in GRAPES 3DVAR Jiandong GONG, Ruichun WANG NWP center of CMA Oct 27, 2015.
Statistical Post Processing - Using Reforecast to Improve GEFS Forecast Yuejian Zhu Hong Guan and Bo Cui ECM/NCEP/NWS Dec. 3 rd 2013 Acknowledgements:
Implementation and Testing of 3DEnVAR and 4DEnVAR Algorithms within the ARPS Data Assimilation Framework Chengsi Liu, Ming Xue, and Rong Kong Center for.
Preliminary results from assimilation of GPS radio occultation data in WRF using an ensemble filter H. Liu, J. Anderson, B. Kuo, C. Snyder, A. Caya IMAGe.
, Karina Apodaca, and Man Zhang Warn-on-Forecast and High-Impact Weather Workshop, February 6-7, 2013, National Weather Center, Norman, OK Utility of GOES-R.
University of Oklahoma, Norman, OK
The operational Meteo-France ensemble 4D-Var (L. Berre, G. Desroziers, and co-authors) Ensemble assimilation (operational with 6 members…) :
Mesoscale Assimilation of Rain-Affected Observations Clark Amerault National Research Council Postdoctoral Associate - Naval Research Laboratory, Monterey,
Tom Hamill, Jeff Whitaker, Brian Etherton, and Zoltan Toth with contributions from Phil Pegion, Gary Bates, Don Murray, others 1 Ensemble-based data assimilation.
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
2015 CIRA Training in Data Assimilation
Hybrid Data Assimilation
4D EnVar for the NCEP GFS Daryl Kleist NOAA/NWS/NCEP
Presented by: David Groff NOAA/NCEP/EMC IM Systems Group
New Approaches to Data Assimilation
FSOI adapted for used with 4D-EnVar
Comparison of different combinations of ensemble-based and variational data assimilation approaches for deterministic NWP Mark Buehner Data Assimilation.
Impact of Assimilating AMSU-A Radiances on forecasts of 2008 Atlantic TCs Initialized with a limited-area EnKF Zhiquan Liu, Craig Schwartz, Chris Snyder,
Project Team: Mark Buehner Cecilien Charette Bin He Peter Houtekamer
Presentation transcript:

1 Hybrid variational-ensemble data assimilation (HVEDAS) High Impact Weather Working Group Workshop 24 February, 2011 – Norman, OK Daryl T. Kleist 1,3 Dave Parrish 1, John Derber 1,Jeff Whitaker 2, Kayo Ide 3, & Xuguang Wang 4 1 NOAA/NCEP/EMC, 2 NOAA/ESRL, 3 University of Maryland-College Park, 4 University of Oklahoma

2 Variational Data Assimilation J : Penalty (Fit to background + Fit to observations + Constraints) x’ : Analysis increment (x a – x b ) ; where x b is a background B Var : Background error covariance H : Observations (forward) operator (eg. CRTM) R : Observation error covariance (Instrument + representativeness) y o ’ : Observation innovations J c : Constraints (physical quantities, balance/noise, etc.) B is typically static and estimated a-priori/offline

3 Motivation Current background error covariance (applied operationally) in VAR –Isotropic recursive filters –Poor handle on cross-variable covariance –Minimal flow-dependence added Implicit flow-dependence through linearization in normal mode constraint (Kleist et al. 2009) Flow-dependent variances (only for wind, temperature, and pressure) based on background tendencies –Tuned NMC-based estimate (lagged forecast pairs)

4 Hybrid Variational-Ensemble Incorporate ensemble perturbations directly into variational cost function through extended control variable –Lorenc (2003), Buehner (2005), Wang et. al. (2007), etc.  f &  e : weighting coefficients for fixed and ensemble covariance respectively x t : (total increment) sum of increment from fixed/static B (x f ) and ensemble B  k : extended control variable; :ensemble perturbation L: correlation matrix [localization on ensemble perturbations]

5 Why Hybrid? VAR (3D, 4D) EnKFHybridReferences Benefit from use of flow dependent ensemble covariance instead of static B xx Hamill and Snyder 2000; Wang et al. 2007b,2008ab, 2009b, Wang 2011; Buehner et al. 2010ab Robust for small ensemble x Wang et al. 2007b, 2009b; Buehner et al. 2010b Better localization for integrated measure, e.g. satellite radiance x Campbell et al Easy framework to add various constraints xx Framework to treat non- Gaussianity xx Use of various existing capabilities in VAR xx Acknowledgement: Xuguang Wang

6 Hybrid with (global) GSI Control variable has been implemented into GSI 3DVAR* –Full B preconditioning (Wang 2011) Working on extensions to B 1/2 preconditioned minimization options –Spectral filter for horizontal part of A Eventually replace with (anisotropic) recursive filters –Recursive filter used for vertical –Dual resolution capability Ensemble can be from different resolution than background/analysis (vertical levels are the exception) –Various localization options for A Grid units or scale height Level dependent (plans to expand) –Option to apply TLNMC (Kleist et al. 2009) to analysis increment *Acknowledgement: Dave Parrish for original implementation of extended control variable

7 Single Observation Single 850mb Tv observation (1K O-F, 1K error)

8 Single Observation Single ps observation (-2mb O-F, 1mb error) near center of Hurricane Ike

9 Single Observation Single 850mb zonal wind observation (3 m/s O-F, 1m/s error) in Hurricane Ike circulation

EnKF member update member 2 analysis high res forecast GSI Hybrid Ens/Var high res analysis member 1 analysis member 2 forecast member 1 forecast recenter analysis ensemble Dual-Res Coupled Hybrid member 3 forecast member 3 analysis Previous CycleCurrent Update Cycle

11 Hybrid Var-EnKF GFS experiment Model –GFS deterministic (T574L64; post July 2010 version – current operational version) –GFS ensemble (T254L64) 80 ensemble members, EnKF update, GSI for observation operators Observations –All operationally available observations (including radiances) –Includes early (GFS) and late (GDAS/cycled) cycles as in production Dual-resolution/Coupled High resolution control/deterministic component –Includes TC Relocation on guess Ensemble is recentered every cycle about hybrid analysis –Discard ensemble mean analysis Satellite bias corrections –Coefficients come from GSI/VAR Parameter settings 1/3 static B, 2/3 ensemble Fixed localization: 800km & 1.5 scale heights Test Period –15 July 2010 – 15 October 2010 (first two weeks ignored for “spin-up”)

hPa Anom.Corr. Northern HemisphereSouthern Hemisphere

13 Forecast Fits to Obs (Tropical Winds) Forecasts from hybrid analyses fit observation much better.

14 Tropical Wind Errors (72hr) Verification against ‘consensus analysis’ [ECMWF, NCEP, UKMET]

15 Hybrid versus 3DVAR Track Error

16 Hybrid versus 3DVAR Intensity Bias

17 HVEDAS (3D) for GDAS/GFS Prototype dual-resolution, two-way coupled hybrid Var/EnKF system outperforms standard 3DVAR in GFS experiments –2010 Hurricane Season (August 15 through October ) run off- site –Emphasis on AC, RMSE, TC Tracks Plan underway to implement into GDAS/GFS operationally –Target: Spring 2012 (subject to many potential issues) Porting of codes/scripts back to IBM P6 Cost analysis (will everything fit in production suite?) More thorough (pre-implementation) testing and evaluation –More test periods (including NH winter) –Other/more verification metrics Potential moratorium associated with move to new NCEP facility Issues –Weighting between ensemble and static B –Localization –How should EnKF be used within ensemble forecasting paradigm?

18 HVEDAS Extension to other Applications Expand hybrid to 4D –Hybrid within ‘traditional 4DVAR’ (with adjoint) –Pure ensemble 4DVAR (non-adjoint) –Ensemble 4DVAR with static B supplement (non-adjoint) Non-GFS applications in development –NASA GEOS-5 (GMAO) –NAM (Dave Parrish, others) –Hurricanes/HWRF (Mingjing Tong, HFIP, many collaborators) –Storm-scale initialization (Jacob Carley, collaborators) –RR (Xuguang Wang, Ming Xue, Stan Benjamin, Jeff Whitaker, Steve Weygandt, others) NCEP strives to have single DA system to develop, maintain, and run operationally (global, mesoscale, severe weather, hurricanes, etc.) –GSI (including hybrid development) is community code supported through DTC –EnKF used for GFS-based hybrid being expanded for use with other applications

19 Backup Slides

20 Applications of hybrid DA WRFVAR based hybrid (Wang et al 2008ab, MWR) Application for hurricane track forecasts (Wang 2011, WAF) For radar data assimilation for hurricanes, Li et al. FAA application with GSI-based hybrid, Zhu et al. Li et al. 2011

21 A natural extension of 3DVAR-based hybrid with no static covariance B. Temporal evolution of the increment is obtained through evolved ensemble perturbations in the assimilation window. ens4dvar is a 4DVAR with no need for tangent linear and adjoint of the forecast model (Liu et al. 2009). GSI-based ‘ensemble 4DVAR’ Lei, Wang et al. 2011

22 Temporal evolution of the error covariance t t-3h t+3h Temp. Height t-3htt+3h Upstream impact Downstream impact