Implementation plans of Hybrid 4D EnVar for the NCEP GFS

Slides:



Advertisements
Similar presentations
Xuguang Wang, Xu Lu, Yongzuo Li, Ting Lei
Advertisements

Polly Smith, Alison Fowler, Amos Lawless School of Mathematical and Physical Sciences, University of Reading Exploring coupled data assimilation using.
© Crown copyright Met Office Development of the Met Office's 4DEnVar System 6th EnKF Data Assimilation Workshop, May Andrew Lorenc, Neill Bowler,
Hybrid variational-ensemble data assimilation for the NCEP GFS Tom Hamill, for Jeff Whitaker NOAA Earth System Research Lab, Boulder, CO, USA
Assimilate NOAA P3 Tail Doppler Radar Data for Hurricane Initialization at NCEP Mingjing Tong1 Collaborators: David Perish2, Daryl Kleist3, Russ Treadon2,
1 What constrains spread growth in forecasts initialized from ensemble Kalman filters? Tom Hamill (& Jeff Whitaker) NOAA Earth System Research Lab Boulder,
CHOICES FOR HURRICANE REGIONAL ENSEMBLE FORECAST (HREF) SYSTEM Zoltan Toth and Isidora Jankov.
1 Hybrid variational-ensemble data assimilation (HVEDAS) High Impact Weather Working Group Workshop 24 February, 2011 – Norman, OK Daryl T. Kleist 1,3.
Ensemble-4DVAR for NCEP hybrid GSI- EnKF data assimilation system 1 5 th EnKF workshop, New York, May 22, 2012 Xuguang Wang, Ting Lei University of Oklahoma,
The 2014 Warn-on-Forecast and High-Impact Weather Workshop
Improving High Resolution Tropical Cyclone Prediction Using a Unified GSI-based Hybrid Ensemble-Variational Data Assimilation System for HWRF Xuguang Wang.
1/20 Accelerating minimizations in ensemble variational assimilation G. Desroziers, L. Berre Météo-France/CNRS (CNRM/GAME)
ASSIMILATION of RADAR DATA at CONVECTIVE SCALES with the EnKF: PERFECT-MODEL EXPERIMENTS USING WRF / DART Altuğ Aksoy National Center for Atmospheric Research.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
Advanced data assimilation methods with evolving forecast error covariance Four-dimensional variational analysis (4D-Var) Shu-Chih Yang (with EK)
Validation and intercomparation discussion Items Size of assimilation ensembles. Is it to be determined only by numerical stability of algorithms? (O.
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Progress in Cloudy Microwave Satellite Data Assimilation at NCEP Andrew Collard 1, Emily Liu 4, Yanqiu Zhu 1, John Derber 2, Daryl Kleist 3, Rahul Mahajan.
Background and Status of Q1FY16 Global Implementation
1 NGGPS Dynamic Core Requirements Workshop NCEP Future Global Model Requirements and Discussion Mark Iredell, Global Modeling and EMC August 4, 2014.
Current Status of the Development of the Local Ensemble Transform Kalman Filter at UMD Istvan Szunyogh representing the UMD “Chaos-Weather” Group Ensemble.
A comparison of hybrid ensemble transform Kalman filter(ETKF)-3DVAR and ensemble square root filter (EnSRF) analysis schemes Xuguang Wang NOAA/ESRL/PSD,
Slide 1 Evaluation of observation impact and observation error covariance retuning Cristina Lupu, Carla Cardinali, Tony McNally ECMWF, Reading, UK WWOSC.
GSI Hybrid EnKF-3DVAR Upgrade Components –GPS RO bending angle rather than refractivity –Inclusion of compressibility factors for atmosphere –Retune SBUV.
UKmet February Hybrid Ensemble-Variational Data Assimilation Development A partnership to develop and implement a hybrid 3D-VAR system –Joint venture.
Recent developments in data assimilation for global deterministic NWP: EnVar vs. 3D-Var and 4D-Var Mark Buehner 1, Josée Morneau 2 and Cecilien Charette.
EnKF Overview and Theory
Hybrid 4D EnVar for the NCEP GFS (with comments on initialization) Daryl Kleist 1,3, Jeff Whitaker 2, Kayo Ide 3, and John Derber 1 Lili Lei 2,4, Rahul.
An OSSE-based evaluation of 4D-Ensemble- Var (and hybrid variants) for the NCEP GFS Daryl Kleist 1,2 and Kayo Ide 2 1 CMOS 2012 Congress AMS 21 st NWP.
1 NCEP data assimilation systems status and plans John C. Derber Environmental Modeling Center NCEP/NWS/NOAA With input from: Many others.
Computational Issues: An EnKF Perspective Jeff Whitaker NOAA Earth System Research Lab ENIAC 1948“Roadrunner” 2008.
CSDA Conference, Limassol, 2005 University of Medicine and Pharmacy “Gr. T. Popa” Iasi Department of Mathematics and Informatics Gabriel Dimitriu University.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
GSI-based Hybrid Data Assimilation:
Ocean Data Variational Assimilation with OPA: Ongoing developments with OPAVAR and implementation plan for NEMOVAR Sophie RICCI, Anthony Weaver, Nicolas.
MPO 674 Lecture 20 3/26/15. 3d-Var vs 4d-Var.
On Improving GFS Forecast Skills in the Southern Hemisphere: Ideas and Preliminary Results Fanglin Yang Andrew Collard, Russ Treadon, John Derber NCEP-EMC.
JCSDA Summer Colloquium on Data Assimilation
Hybrid Variational/Ensemble Data Assimilation for the NCEP GFS Tom Hamill, for Jeff Whitaker NOAA Earth System Research Lab, Boulder, CO, USA
Development of an EnKF/Hybrid Data Assimilation System for Mesoscale Application with the Rapid Refresh Ming Hu 1,2, Yujie Pan 3, Kefeng Zhu 3, Xuguang.
A unifying framework for hybrid data-assimilation schemes Peter Jan van Leeuwen Data Assimilation Research Center (DARC) National Centre for Earth Observation.
Assimilating chemical compound with a regional chemical model Chu-Chun Chang 1, Shu-Chih Yang 1, Mao-Chang Liang 2, ShuWei Hsu 1, Yu-Heng Tseng 3 and Ji-Sung.
Outline Background Highlights of NCAR’s R&D efforts A proposed 5-year plan for CWB Final remarks.
Challenges and practical applications of data assimilation in numerical weather prediction Data Assimilation Education Forum Part I: Overview of Data Assimilation.
Research Vignette: The TransCom3 Time-Dependent Global CO 2 Flux Inversion … and More David F. Baker NCAR 12 July 2007 David F. Baker NCAR 12 July 2007.
11 Background Error Daryl T. Kleist* National Monsoon Mission Scoping Workshop IITM, Pune, India April 2011.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
Ensemble data assimilation in an operational context: the experience at the Italian Weather Service Massimo Bonavita and Lucio Torrisi CNMCA-UGM, Rome.
Use ensemble error covariance information in GRAPES 3DVAR Jiandong GONG, Ruichun WANG NWP center of CMA Oct 27, 2015.
1 (Global) Data Assimilation Priorities Presented By: John. Derber (NWS/NCEP) Contributors: Jeff Whitaker (ESRL/PSD), EMC DA team.
Implementation and Testing of 3DEnVAR and 4DEnVAR Algorithms within the ARPS Data Assimilation Framework Chengsi Liu, Ming Xue, and Rong Kong Center for.
University of Oklahoma, Norman, OK
JCSDA Workshop Brock Burghardt August Model Configuration WRF-ARW v3.5.1 Forecasts integrated 30 hours Cycled every 6 hours (non-continuous boundaries)
The operational Meteo-France ensemble 4D-Var (L. Berre, G. Desroziers, and co-authors) Ensemble assimilation (operational with 6 members…) :
Slide 1© ECMWF The effect of perturbation re-centring on ensemble forecasts Simon Lang, Martin Leutbecher, Massimo Bonavita.
Current Issues and Challenges in Ensemble Forecasting Junichi Ishida (JMA) and Carolyn Reynolds (NRL) With contributions from WGNE members 31 th WGNE Pretoria,
Hybrid Data Assimilation
Forecast Sensitivity - Observation Impact (FSOI)
4D EnVar for the NCEP GFS Daryl Kleist NOAA/NWS/NCEP
Presented by: David Groff NOAA/NCEP/EMC IM Systems Group
Kostas M. Andreadis1, Dennis P. Lettenmaier1
New Approaches to Data Assimilation
FSOI adapted for used with 4D-EnVar
Mohamed Jardak (presenter), N. E. Bowler, A. M. Clayton, G. W
Developing 4D-En-Var: thoughts and progress
8th EnKF Workshop Discussion.
Initial trials of 4DEnVAR
Comparison of different combinations of ensemble-based and variational data assimilation approaches for deterministic NWP Mark Buehner Data Assimilation.
Development of an advanced ensemble-based ocean data assimilation approach for ocean and coupled reanalyses Eric de Boisséson, Hao Zuo, Magdalena Balmaseda.
Project Team: Mark Buehner Cecilien Charette Bin He Peter Houtekamer
Presentation transcript:

Implementation plans of Hybrid 4D EnVar for the NCEP GFS Rahul Mahajan1,4, Daryl Kleist1,3, Jeff Whitaker2, and John Derber1 1NOAA/NWS/NCEP/EMC 2NOAA/OAR/ESRL/PSD 3University of Maryland 4IMSG With contributions from Lili Lei (CIRES), Misha Rancic (EMC), Catherine Thomas (IMSG) and many others WWOSC 2014, Montreal

Ensemble-Var methods: nomenclature En-4DVar: Propagate ensemble Pb from one assimilation window to the next (updated using EnKF for example), replace static Pb with ensemble estimate of Pb at start of 4DVar window, Pb propagated with tangent linear model within window. 4D-EnVar: Pb at every time in the assim. window comes from ensemble estimate (TLM no longer used). As above, with hybrid in name: Pb is a linear combination of static and ensemble components. 3D-EnVar: same as 4D ensemble Var, but Pb is assumed to be constant through the assim. window (current NCEP implementation).

CURRENT Dual-Res Coupled Hybrid Var/EnKF Cycling Generate new ensemble perturbations given the latest set of observations and first-guess ensemble member 1 forecast member 1 analysis T254L64 EnKF member update member 2 forecast member 2 analysis recenter analysis ensemble member 3 analysis member 3 forecast Ensemble contribution to background error covariance Replace the EnKF ensemble mean analysis and inflate GSI 3D Hybrid Ens/Var high res forecast high res analysis T574L64 Previous Cycle Current Update Cycle

4D EnVar: The Way Forward ? Natural extension to operational 3D EnVar Uses variational approach with already available 4D ensemble perturbations No need for development of maintenance of TLM and ADJ models Makes use of 4D ensemble to perform 4D analysis Modular, usable across a wide variety of models Highly scalable Aligns with technological/computing advances Computationally inexpensive relative to 4DVAR (with TL/AD) Estimates of improved efficiency by 10x or more, e.g. at Env. Canada (6x faster than 4DVAR on half as many cpus) Compromises to gain best aspects of (4D) variational and ensemble DA algorithms Other centers exploring similar path forward for deterministic NWP Canada (potentially replace 4DVAR), UKMO (potentially replace En4DVar)

Single Observation (-3h) Example for 4D Variants TLMADJ 4DENSV ENSONLY H-4DVAR_AD bf-1=0.25 H-4DENSV bf-1=0.25 TLMADJ

Low Resolution GFS/GDAS Experiments with real observations Basic configuration T254L64 GFS, opnl obs, GFS/GDAS cycles 20120701-20121001 PR3LOEX0 3DVAR PRHLOEX1 Hybrid 3D EnVar, 80 member T126L64 ensemble with fully coupled (two-way) EnKF update, slightly re-tuned localization and inflation for lower resolution, TLNMC on total increment, 75% ensemble & 25% static PRH4DEX1 Hybrid 4D EnVar, TLNMC on all time levels, only 1x150 iterations Hourly TC relocation, O-G, binning of observations

500 hPa Die Off Curves Southern Hemisphere Northern Hemisphere 4DHYB ---- 3DHYB ---- 3DVAR ---- 4DHYB ---- 3DHYB ---- 3DVAR ---- 4DHYB-3DHYB 3DVAR-3DHYB Move from 3D Hybrid (current operations) to Hybrid 4D-EnVar yields improvement that is about 75% in amplitude in comparison from going to 3D Hybrid from 3DVAR.

(Preliminary) Results and Comments 4D extension has positive impact in OSSE and real observation (low resolution) framework 4D EnVar does have slower convergence As configured, 4D EnVar was 40% more expensive than 3D hybrid (caveats being different iteration count, low resolution and machine variability) TLNMC (balance constraint) over all time levels quite expensive I/O potential issue, optimization is needed prior to implementation. Option to post-process ensemble prior to use in assimilation in subsequent cycle

(4D) Incremental Analysis Update In addition to TLNMC, we currently utilize full-field digital filter initialization in the GFS Can have undesirable impacts being a full field filter IAU (Bloom et al.) has been used at GMAO and elsewhere as alternative to DFI Increment is passed to model throughout the window as a forcing term However, this has typically been done using a 3D increment (rescaled) through the window 4D EnVar lends itself to a minor modification of the IAU procedure to use the 4D increment This also provides a mechanism for passing the 4D solution to the model Perhaps a way to help spin up/spin down of clouds, precipitation, etc. Promising preliminary results in EnKF context, work underway in 4D hybrid EnVar context

EnKF-IAU noticeably better EnKF-IAU and EnKF-DFI EnKF-IAU noticeably better

Compare 6-h forecasts to EC analysis EnKF-IAU forecasts closer to EC analysis, esp for winds Temperature Uwind (Vwind is similar to Uwind)

Accounting for under-represented source of uncertainty Current operations Multiplicative inflation – Helps compensate for finite-sized ensemble Additive perturbations – Helps compensate for lack of consideration of model uncertainty Proposed configuration for T1534 SL (3072 x 1536) GFS Keep multiplicative inflation Reduce additive perturbations from 32 to 5% Add stochastic physics in model SPPT -- Stochastic Physics Perturbation Tendency SKEB – Stochastic Energy Backscatter VC – Vorticity Confinement SHUM – Boundary Layer Humidity perturbations

Better spread behavior (2014042400) Current Stoch. Phy Current operations Spread too large Spread decays and recovers Stochastic Physics Spread decreased overall (consistent with error estimates) Spread grows through assimilation window Wind Tv 3HR 6HR 9HR Q

PROPOSED - Dual-Res Coupled Hybrid Var/EnKF Cycling Generate new ensemble perturbations given the latest set of observations and first-guess ensemble member 1 forecast member 1 analysis T574L64 EnKF member update member 2 forecast member 2 analysis recenter analysis ensemble Ensemble contribution to background error covariance member 3 analysis member 3 forecast GSI 4D Hybrid Ens/Var Replace the EnKF ensemble mean analysis and inflate high res forecast T1534L64 Low-to-high res analysis Previous Cycle Current Update Cycle

Tests for FY2015 Implementation Analysis on ensemble grid at T574 instead of hi-res deterministic grid T1534 Configure update and outer loop Quasi-outer loop (rerun of nonlinear model as in 4D Var) Re-scale ensemble perturbations for successive outer-loops? Continue to investigate use of IAU to force 4D increment into model Test role of stochastic physics as replacement for additive inflation Relaxed binning criteria within the assimilation window Lengthen assimilation window (backward) in catch-up cycle Improved (or at least tuned) localization Optimize static B for 4D hybrid Computationally (current static B is bottleneck in code) Add temporal information (FOTO) Weights, including scale-dependence Increase role of ensemble (to 100%?) 4D EnVar tentatively scheduled to be part of GDAS/GFS upgrade in late 2015