Hybrid variational-ensemble data assimilation for the NCEP GFS Tom Hamill, for Jeff Whitaker NOAA Earth System Research Lab, Boulder, CO, USA

Slides:



Advertisements
Similar presentations
Xuguang Wang, Xu Lu, Yongzuo Li, Ting Lei
Advertisements

Background and Observation Errors:
Assimilate NOAA P3 Tail Doppler Radar Data for Hurricane Initialization at NCEP Mingjing Tong1 Collaborators: David Perish2, Daryl Kleist3, Russ Treadon2,
Statistical post-processing using reforecasts to improve medium- range renewable energy forecasts Tom Hamill and Jeff Whitaker NOAA Earth System Research.
1 What constrains spread growth in forecasts initialized from ensemble Kalman filters? Tom Hamill (& Jeff Whitaker) NOAA Earth System Research Lab Boulder,
1 Hybrid variational-ensemble data assimilation (HVEDAS) High Impact Weather Working Group Workshop 24 February, 2011 – Norman, OK Daryl T. Kleist 1,3.
Ensemble-4DVAR for NCEP hybrid GSI- EnKF data assimilation system 1 5 th EnKF workshop, New York, May 22, 2012 Xuguang Wang, Ting Lei University of Oklahoma,
The 2014 Warn-on-Forecast and High-Impact Weather Workshop
Improving High Resolution Tropical Cyclone Prediction Using a Unified GSI-based Hybrid Ensemble-Variational Data Assimilation System for HWRF Xuguang Wang.
Ensemble Air Quality Modeling Using the Coupled WRF-CMAQ Model Robert Gilliam*, Christian Hogrefe*, James Godowitch*, Rohit Mathur*, Jun Du** *US EPA,
5/22/201563rd Interdepartmental Hurricane Conference, March 2-5, 2009, St. Petersburg, FL Experiments of Hurricane Initialization with Airborne Doppler.
Jidong Gao and David Stensrud Some OSSEs on Assimilation of Radar Data with a Hybrid 3DVAR/EnKF Method.
1/20 Accelerating minimizations in ensemble variational assimilation G. Desroziers, L. Berre Météo-France/CNRS (CNRM/GAME)
Performance Characteristics of a Pseudo-operational Ensemble Kalman Filter April 2006, EnKF Wildflower Meeting Greg Hakim & Ryan Torn University of Washington.
Probabilistic Mesoscale Analyses & Forecasts Progress & Ideas Greg Hakim University of Washington Brian Ancell, Bonnie.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Progress in Cloudy Microwave Satellite Data Assimilation at NCEP Andrew Collard 1, Emily Liu 4, Yanqiu Zhu 1, John Derber 2, Daryl Kleist 3, Rahul Mahajan.
Background and Status of Q1FY16 Global Implementation
1 NGGPS Dynamic Core Requirements Workshop NCEP Future Global Model Requirements and Discussion Mark Iredell, Global Modeling and EMC August 4, 2014.
Current Status of the Development of the Local Ensemble Transform Kalman Filter at UMD Istvan Szunyogh representing the UMD “Chaos-Weather” Group Ensemble.
A comparison of hybrid ensemble transform Kalman filter(ETKF)-3DVAR and ensemble square root filter (EnSRF) analysis schemes Xuguang Wang NOAA/ESRL/PSD,
Improved NCEP SST Analysis
Comparison of hybrid ensemble/4D- Var and 4D-Var within the NAVDAS- AR data assimilation framework The 6th EnKF Workshop May 18th-22nd1 Presenter: David.
GSI Hybrid EnKF-3DVAR Upgrade Components –GPS RO bending angle rather than refractivity –Inclusion of compressibility factors for atmosphere –Retune SBUV.
UKmet February Hybrid Ensemble-Variational Data Assimilation Development A partnership to develop and implement a hybrid 3D-VAR system –Joint venture.
Recent developments in data assimilation for global deterministic NWP: EnVar vs. 3D-Var and 4D-Var Mark Buehner 1, Josée Morneau 2 and Cecilien Charette.
EnKF Overview and Theory
Observing Strategy and Observation Targeting for Tropical Cyclones Using Ensemble-Based Sensitivity Analysis and Data Assimilation Chen, Deng-Shun 3 Dec,
An OSSE-based evaluation of 4D-Ensemble- Var (and hybrid variants) for the NCEP GFS Daryl Kleist 1,2 and Kayo Ide 2 1 CMOS 2012 Congress AMS 21 st NWP.
Computational Issues: An EnKF Perspective Jeff Whitaker NOAA Earth System Research Lab ENIAC 1948“Roadrunner” 2008.
GSI-based Hybrid Data Assimilation:
MPO 674 Lecture 20 3/26/15. 3d-Var vs 4d-Var.
On Improving GFS Forecast Skills in the Southern Hemisphere: Ideas and Preliminary Results Fanglin Yang Andrew Collard, Russ Treadon, John Derber NCEP-EMC.
Data assimilation and observing systems strategies Pierre Gauthier Data Assimilation and Satellite Meteorology Division Meteorological Service of Canada.
Hybrid Variational/Ensemble Data Assimilation for the NCEP GFS Tom Hamill, for Jeff Whitaker NOAA Earth System Research Lab, Boulder, CO, USA
Development of an EnKF/Hybrid Data Assimilation System for Mesoscale Application with the Rapid Refresh Ming Hu 1,2, Yujie Pan 3, Kefeng Zhu 3, Xuguang.
Hybrid Variational/Ensemble Data Assimilation
14 th Annual WRF Users’ Workshop. June 24-28, 2013 Improved Initialization and Prediction of Clouds with Satellite Observations Tom Auligné Gael Descombes,
Verification of Global Ensemble Forecasts Fanglin Yang Yuejian Zhu, Glenn White, John Derber Environmental Modeling Center National Centers for Environmental.
11 Background Error Daryl T. Kleist* National Monsoon Mission Scoping Workshop IITM, Pune, India April 2011.
A Sequential Hybrid 4DVAR System Implemented Using a Multi-Grid Technique Yuanfu Xie 1, Steven E. Koch 1, and Steve Albers 1,2 1 NOAA Earth System Research.
. Outline  Evaluation of different model-error schemes in the WRF mesoscale ensemble: stochastic, multi-physics and combinations thereof  Where is.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
Covariance Modeling “Where America’s Climate, Weather, Ocean and Space Weather Services Begin” JCSDA Summer Colloquium July 27, 2015 Presented by John.
Development and Testing of a Regional GSI-Based EnKF-Hybrid System for the Rapid Refresh Configuration Yujie Pan 1, Kefeng Zhu 1, Ming Xue 1,2, Xuguang.
Ensemble data assimilation in an operational context: the experience at the Italian Weather Service Massimo Bonavita and Lucio Torrisi CNMCA-UGM, Rome.
Evaluation of impact of satellite radiance data within the hybrid variational/EnKF Rapid Refresh data assimilation system Haidao Lin Steve Weygandt Ming.
Deutscher Wetterdienst Vertical localization issues in LETKF Breogan Gomez, Andreas Rhodin, Hendrik Reich.
Assess Observation Impacts in the Hybrid GSI-EnKF Data Assimilation Systems for NCEP Global Forecast System Model Through OSE and Ensemble Based Observation.
Evaluation of radiance data assimilation impact on Rapid Refresh forecast skill for retrospective and real-time experiments Haidao Lin Steve Weygandt Stan.
Use ensemble error covariance information in GRAPES 3DVAR Jiandong GONG, Ruichun WANG NWP center of CMA Oct 27, 2015.
Statistical Post Processing - Using Reforecast to Improve GEFS Forecast Yuejian Zhu Hong Guan and Bo Cui ECM/NCEP/NWS Dec. 3 rd 2013 Acknowledgements:
Implementation and Testing of 3DEnVAR and 4DEnVAR Algorithms within the ARPS Data Assimilation Framework Chengsi Liu, Ming Xue, and Rong Kong Center for.
An Examination Of Interesting Properties Regarding A Physics Ensemble 2012 WRF Users’ Workshop Nick P. Bassill June 28 th, 2012.
Wind Gust Analysis in RTMA Yanqiu Zhu, Geoff DiMego, John Derber, Manuel Pondeca, Geoff Manikin, Russ Treadon, Dave Parrish, Jim Purser Environmental Modeling.
University of Oklahoma, Norman, OK
MPO 674 Lecture 2 1/20/15. Timeline (continued from Class 1) 1960s: Lorenz papers: finite limit of predictability? 1966: First primitive equations model.
ENSEMBLE KALMAN FILTER IN THE PRESENCE OF MODEL ERRORS Hong Li Eugenia Kalnay.
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
Hybrid Data Assimilation
Progress in development of HARMONIE 3D-Var and 4D-Var Contributions from Magnus Lindskog, Roger Randriamampianina, Ulf Andrae, Ole Vignes, Carlos Geijo,
Ron Gelaro and Yanqiu Zhu NASA Global Modeling and Assimilation Office
A comparison of 4D-Var with 4D-En-Var D. Fairbairn. and S. R. Pring
FSOI adapted for used with 4D-EnVar
Comparison of different combinations of ensemble-based and variational data assimilation approaches for deterministic NWP Mark Buehner Data Assimilation.
Impact of Assimilating AMSU-A Radiances on forecasts of 2008 Atlantic TCs Initialized with a limited-area EnKF Zhiquan Liu, Craig Schwartz, Chris Snyder,
Project Team: Mark Buehner Cecilien Charette Bin He Peter Houtekamer
Global Forecast System (GFS) Model
Presentation transcript:

Hybrid variational-ensemble data assimilation for the NCEP GFS Tom Hamill, for Jeff Whitaker NOAA Earth System Research Lab, Boulder, CO, USA Daryl Kleist, Dave Parrish and John Derber National Centers for Environmental Prediction, Camp Springs, MD, USA Xuguang Wang University of Oklahoma, Norman, OK, USA 1 a NOAA-THORPEX funded project

Hybrid: best of both worlds? Features from EnKFFeatures from VAR Extra flow-dependence in BLocalization done correctly (in model space) More flexible treatment of model error Reduction in sampling error in time-lagged covariances. Automatic initialization of ensemble Ease of adding extra constraints to cost function

4 NCEP GSI 3D-Var Hybrid Incorporate ensemble perturbations directly into variational cost function through “extended control variable” – Lorenc (2003), Buehner (2005), Wang et. al. (2007), etc.  f &  e : weighting coefficients for fixed and ensemble covariance respectively x t : (total increment) sum of increment from fixed/static B (x f ) and ensemble B  k : extended control variable; :ensemble perturbation L: correlation matrix [localization on ensemble perturbations] [more info]more info

5 Single-observation increments Single 850 hPa T v observation (1K O-F, 1K error) EnKF GSI hybrid

6 Single-observation increments Single 850 hPa zonal wind observation (3 m/s O-F, 1m/s error) in Hurricane Ike EnKF GSI hybrid

7 Why use EnKF for ensemble data assimilation and ensemble forecast initialization instead of operational ETR? ETR (Ensemble transform with rescaling) – Not designed to represent 6-h forecast error covariances - viable for hybrid paradigm? – Update of breeding method to include orthogonalization of perturbations in analysis variance norm. – Virtually no additional computational cost beyond forward integration – Perturbations based on resizing to analysis-error mask derived for 500 hPa streamfunction – Tuned for medium range forecast spread and “fast error growth” – T190L28 version of the GFS model EnKF – Perturbations specifically designed to represent analysis and background errors (parameters tuned by running DA stand-alone) – T254L64 version of the GFS – Extra computational costs worth it for hybrid?

8 EnKF vs. ETR perturbation magnitude comparison, surface pressure EnKF (green) versus ETR (red) spread/standard deviation for surface pressure (mb) valid Surface Pressure spread normalized difference (ETR has much less spread, except poleward of 70N)

9 EnKF vs. ETR comparison, u-wind component EnKF zonal wind (m/s) ensemble standard deviation valid ETR zonal wind (m/s) ensemble standard deviation valid

10 EnKF vs. NMC B comparison, u-wind component EnKF zonal wind (m/s) ensemble standard deviation valid Zonal Wind standard deviation (m/s) from “NMC-method”

11 Hybrid Var-EnKF GFS experiment Model – GFS deterministic (T574L64; current operational version) – GFS ensemble (T254L64) 80 ensemble members, EnKF update, GSI for observation operators Observations – All operationally available observations (including radiances) – Includes early (GFS) and late (GDAS/cycled) cycles as in production Dual-resolution/Coupled High resolution control/deterministic component – Includes TC Relocation on guess (will probably drop) Ensemble is re-centered every cycle about hybrid analysis – Discard ensemble mean analysis Satellite bias corrections – Coefficients come from GSI/VAR (although EnKF can compute it’s own) Parameter settings 1/3 static B, 2/3 ensemble Fixed localization: 2000 km & 1.5 scale heights Additive and multiplicative inflation. Test Period – 15 July 2010 – 15 October 2010 (first 3 weeks ignored for “spin-up”)

The bad: RMS errors, Zonal wind (Tropics) Temperature (NH) 3D-Var Hybrid minus 3D-Var [higher errors in stratosphere, apparently due to allowing ozone to increment state]

The ok news: 500 hPa anomaly correlation (3D-Var, Hybrid) Day Day

The good news Precipitation over CONUS with respect to 1-degree analyses, July-Oct EnKF here, not hybrid. EnKF + T254 + new GFS narrows the difference between NCEP and ECMWF, especially at higher amounts. Much of impact due to new GFS model version, however. 14

The excellent news

Conclusions and plans Mostly improvement in forecasts seen in using EnKF-based ensemble covariances in GSI 3D-Var, but – EnKF analyses are somewhat noisy – post analysis balancing degrades performance. – Increments to wind/temp from stratospheric ozone obs can be quite large (unrealistic?) Schedule (deadlines already slipping…) – Testing at NCEP and ESRL, now-August 2011 – Code frozen late Oct 2011 – Final real-time parallel testing Dec 2011-Jan 2012 – Final field evaluation late Jan 2012 – Operational implementation Feb 2012

17 Extensions and improvements Scale-dependent weighting of fixed and ensemble covariances? Expand hybrid to 4D – Hybrid within‘traditional 4D-Var’(with adjoint) – Pure ensemble 4D-Var (non-adjoint) – Ensemble 4D-Var with static B supplement (non-adjoint) EnKF improvements – Adaptive localization – Stochastic physics – Perturbed SSTs – Balance Non-GFS applications in development – Other global models (NASA GEOS-5, NOAA FIM, GFDL) – NAM /Mesoscale Modeling – Hurricanes/HWRF – Storm-scale initialization – Rapid Refresh NCEP strives to have single DA system to develop, maintain, and run operationally (global, mesoscale, severe weather, hurricanes, etc.) – GSI (including hybrid development) is community code supported through DTC – EnKF used for GFS-based hybrid being expanded for use with other applications

Pure Ensemble 4D-Var (Xuguang Wang, Ting Lei: Univ of Oklahoma) Extension of 3D-Var hybrid using 4D- ensemble covariances at hourly intervals in assimilation window without TLM/adjoint (similar to Buehner et al 2010). T190L64 experiments show Improvement over 3D-Var hybrid – similar to pure EnKF. To do: Dual resolution, 2- way coupling, addition of static B component.

19 Computational expense Analysis / GSI side – Minimal additional cost (mostly I/O reading ensemble) Additional “GDAS” Ensemble (T254L64 GDAS) – EnKF ensemble update Cost comparable to current GSI 3D-Var – Includes ensemble of GSI runs to get O-F and actual ensemble update step – 9-h forecasts, needs to be done only in time for next (not current) cycle. Already done for ETR, but with fewer vertical levels and only to 6-h.

Lorenc 2003 QJ [back]back