2007/3/19 MRI, Tsukuba Recent developments of the local ensemble transform Kalman filter (LETKF) at JMA Takemasa Miyoshi (NPD/JMA) Collaborators: Shozo.

Slides:



Advertisements
Similar presentations
Seasonal variation of the errors in an objective analysis over Vietnam area Miki Hattori 1, Qoosaku Moteki 1, Jun Matsumoto 1, 2, Hironari Kanamori 2 and.
Advertisements

Introduction to data assimilation in meteorology Pierre Brousseau, Ludovic Auger ATMO 08,Alghero, september 2008.
Effects of model error on ensemble forecast using the EnKF Hiroshi Koyama 1 and Masahiro Watanabe 2 1 : Center for Climate System Research, University.
Design and Validation of Observing System Simulation Experiments (OSSEs) Ronald Errico Goddard Earth Sciences Technology and Research Center at Morgan.
Convection-permitting forecasts initialized with continuously-cycling limited-area 3DVAR, EnKF and “hybrid” data assimilation systems Craig Schwartz and.
Toward a Real Time Mesoscale Ensemble Kalman Filter Gregory J. Hakim Dept. of Atmospheric Sciences, University of Washington Collaborators: Ryan Torn (UW)
ASSIMILATION of RADAR DATA at CONVECTIVE SCALES with the EnKF: PERFECT-MODEL EXPERIMENTS USING WRF / DART Altuğ Aksoy National Center for Atmospheric Research.
Probabilistic Mesoscale Analyses & Forecasts Progress & Ideas Greg Hakim University of Washington Brian Ancell, Bonnie.
Some Innovative Applications and Approaches Using Nudging Four Dimensional Data Assimilation: Lili Lei and David R. Stauffer Dept. of Meteorology, Penn.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
Advanced data assimilation methods- EKF and EnKF Hong Li and Eugenia Kalnay University of Maryland July 2006.
Current Status of the Development of the Local Ensemble Transform Kalman Filter at UMD Istvan Szunyogh representing the UMD “Chaos-Weather” Group Ensemble.
Background In deriving basic understanding of atmospheric phenomena, the analysis often revolves around discovering and exploiting relationships between.
Comparison of hybrid ensemble/4D- Var and 4D-Var within the NAVDAS- AR data assimilation framework The 6th EnKF Workshop May 18th-22nd1 Presenter: David.
Francesca Marcucci, Lucio Torrisi with the contribution of Valeria Montesarchio, ISMAR-CNR CNMCA, National Meteorological Center,Italy First experiments.
UKmet February Hybrid Ensemble-Variational Data Assimilation Development A partnership to develop and implement a hybrid 3D-VAR system –Joint venture.
EnKF Overview and Theory
Observing Strategy and Observation Targeting for Tropical Cyclones Using Ensemble-Based Sensitivity Analysis and Data Assimilation Chen, Deng-Shun 3 Dec,
Advances in the use of observations in the ALADIN/HU 3D-Var system Roger RANDRIAMAMPIANINA, Regina SZOTÁK and Gabriella Csima Hungarian Meteorological.
Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz Statistical Characteristics of High- Resolution COSMO.
WWOSC 2014, Aug 16 – 21, Montreal 1 Impact of initial ensemble perturbations provided by convective-scale ensemble data assimilation in the COSMO-DE model.
ISDA 2014, Feb 24 – 28, Munich 1 Impact of ensemble perturbations provided by convective-scale ensemble data assimilation in the COSMO-DE model Florian.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
3DVAR Retrieval of 3D Moisture Field from Slant- path Water Vapor Observations of a High-resolution Hypothetical GPS Network Haixia Liu and Ming Xue Center.
MPO 674 Lecture 20 3/26/15. 3d-Var vs 4d-Var.
Predictability of explosive cyclogenesis over the northwestern Pacific region using ensemble reanalysis Akira Kuwano-Yoshida (Application Laboratory, JAMSTEC)
On Improving GFS Forecast Skills in the Southern Hemisphere: Ideas and Preliminary Results Fanglin Yang Andrew Collard, Russ Treadon, John Derber NCEP-EMC.
30 November December International Workshop on Advancement of Typhoon Track Forecast Technique 11 Observing system experiments using the operational.
Development of an EnKF/Hybrid Data Assimilation System for Mesoscale Application with the Rapid Refresh Ming Hu 1,2, Yujie Pan 3, Kefeng Zhu 3, Xuguang.
Hybrid Variational/Ensemble Data Assimilation
Vaisala/University of Washington Real-observation Experiments Vaisala/University of Washington Real-observation Experiments Clifford Mass, Gregory Hakim,
1 GSI/ETKF Regional Hybrid Data Assimilation with MMM Hybrid Testbed Arthur P. Mizzi NCAR/MMM 2011 GSI Workshop June 29 – July 1, 2011.
Ensemble Data Assimilation for the Mesoscale: A Progress Report Massimo Bonavita, Lucio Torrisi, Francesca Marcucci CNMCA National Meteorological Service.
Assimilating chemical compound with a regional chemical model Chu-Chun Chang 1, Shu-Chih Yang 1, Mao-Chang Liang 2, ShuWei Hsu 1, Yu-Heng Tseng 3 and Ji-Sung.
Sensitivity Analysis of Mesoscale Forecasts from Large Ensembles of Randomly and Non-Randomly Perturbed Model Runs William Martin November 10, 2005.
A Sequential Hybrid 4DVAR System Implemented Using a Multi-Grid Technique Yuanfu Xie 1, Steven E. Koch 1, and Steve Albers 1,2 1 NOAA Earth System Research.
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
Development and Testing of a Regional GSI-Based EnKF-Hybrid System for the Rapid Refresh Configuration Yujie Pan 1, Kefeng Zhu 1, Ming Xue 1,2, Xuguang.
Ensemble data assimilation in an operational context: the experience at the Italian Weather Service Massimo Bonavita and Lucio Torrisi CNMCA-UGM, Rome.
Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz First Experience with KENDA at MeteoSwiss Daniel Leuenberger,
Deutscher Wetterdienst Vertical localization issues in LETKF Breogan Gomez, Andreas Rhodin, Hendrik Reich.
Page 1© Crown copyright 2004 SRNWP Lead Centre Report on Data Assimilation 2005 for EWGLAM/SRNWP Annual Meeting October 2005, Ljubljana, Slovenia.
Introduction of temperature observation of radio-sonde in place of geopotential height to the global three dimensional variational data assimilation system.
Local Predictability of the Performance of an Ensemble Forecast System Liz Satterfield and Istvan Szunyogh Texas A&M University, College Station, TX Third.
Use ensemble error covariance information in GRAPES 3DVAR Jiandong GONG, Ruichun WANG NWP center of CMA Oct 27, 2015.
Implementation and Testing of 3DEnVAR and 4DEnVAR Algorithms within the ARPS Data Assimilation Framework Chengsi Liu, Ming Xue, and Rong Kong Center for.
MODIS Winds Assimilation Impact Study with the CMC Operational Forecast System Réal Sarrazin Data Assimilation and Quality Control Canadian Meteorological.
The application of ensemble Kalman filter in adaptive observation and information content estimation studies Junjie Liu and Eugenia Kalnay July 13th, 2007.
LOCAL ENSEMBLE KALMAN FILTER (LETKF) ANALYSIS OF LOOP CURRENT & EDDY IN THE GULF OF MEXICO Fanghua Xu 1, Leo Oey 1, Yasumasa Miyazawa 2, Peter Hamilton.
ENSEMBLE KALMAN FILTER IN THE PRESENCE OF MODEL ERRORS Hong Li Eugenia Kalnay.
1 Satellite Winds Superobbing Howard Berger Mary Forsythe John Eyre Sean Healy Image Courtesy of UW - CIMSS Hurricane Opal October 1995.
Global vs mesoscale ATOVS assimilation at the Met Office Global Large obs error (4 K) NESDIS 1B radiances NOAA-15 & 16 HIRS and AMSU thinned to 154 km.
OSEs with HIRLAM and HARMONIE for EUCOS Nils Gustafsson, SMHI Sigurdur Thorsteinsson, IMO John de Vries, KNMI Roger Randriamampianina, met.no.
Munehiko Yamaguchi 12, Takuya Komori 1, Takemasa Miyoshi 13, Masashi Nagata 1 and Tetsuo Nakazawa 4 ( ) 1.Numerical Prediction.
Korea Institute of Atmospheric Prediction Systems (KIAPS) ( 재 ) 한국형수치예보모델개발사업단 LETKF 앙상블 자료동화 시스템 테스트베드 구축 및 활용방안 Implementation and application of LETKF.
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
Takemasa Miyoshi Numerical Prediction Division, JMA
Progress in development of HARMONIE 3D-Var and 4D-Var Contributions from Magnus Lindskog, Roger Randriamampianina, Ulf Andrae, Ole Vignes, Carlos Geijo,
H.L. Tanaka and K. Kondo University of Tsukuba
Tadashi Fujita (NPD JMA)
Vertical localization issues in LETKF
The 8th EnKF Data Assimilation Workshop, Montreal, Canada, May 9, 2018
FSOI adapted for used with 4D-EnVar
Developing 4D-En-Var: thoughts and progress
S. Kotsuki, K. Kurosawa, T. Miyoshi
Comparison of different combinations of ensemble-based and variational data assimilation approaches for deterministic NWP Mark Buehner Data Assimilation.
Impact of Assimilating AMSU-A Radiances on forecasts of 2008 Atlantic TCs Initialized with a limited-area EnKF Zhiquan Liu, Craig Schwartz, Chris Snyder,
Project Team: Mark Buehner Cecilien Charette Bin He Peter Houtekamer
Sarah Dance DARC/University of Reading
Presentation transcript:

2007/3/19 MRI, Tsukuba Recent developments of the local ensemble transform Kalman filter (LETKF) at JMA Takemasa Miyoshi (NPD/JMA) Collaborators: Shozo Yamane (CIS and FRCGC) Yoshiaki Sato (NPD/JMA) Kohei Aranami (NPD/JMA) Takeshi Enomoto (ESC)

Outline 1. What is LETKF? 2. LETKF developments at JMA with three models: AFES (AGCM for the Earth Simulator) Collaborative work among the Forecast Department/JMA, JAMSTEC, and Chiba Institute of Science NHM (JMA Nonhydrostatic Regional Model) GSM (JMA Global Model)

EnKF = ensemble fcst. + ensemble update A schematic of EnKF Obs. Analysis Ens. mean FCST Ens. mean P Generate ensemble members best representing the analysis errors An initial condition with errors T=t0 T=t1 T=t2 EnKF = ensemble fcst. + ensemble update

EnKF EnKF considers flow-dependent error structures, or the “errors of the day” “advanced” data assimilation method 4D-Var is also an “advanced” method. How different? EnKF analyzes the analysis errors in addition to analysis itself “ideal” ensemble perturbations

EnKF vs. 4D-Var EnKF 4D-Var “advanced” method? Y Simple to code? N (e.g., Minimizer) Adjoint model? N Observation operator Only forward (e.g., TC center) Adjoint required Asynchronous obs? Y (4D-EnKF) Y (intrinsic) Initialization after analysis? Analysis errors? Y (ensemble ptb) Limitation ensemble size Assim. window EnKF with infinite ensemble size and 4D-Var with infinite window are equivalent.

What is LETKF? Two categories of the EnKF (Ensemble Kalman Filter) LETKF (Local Ensemble Transform Kalman Filter) is a kind of ensemble square root filter (SRF) is efficient with the parallel architecture Perturbed observation (PO) method Square root filter (SRF) Classical Relatively new Already in operations (Canadian EPS) Not in operations yet Additional sampling errors by PO No such additional sampling errors

AFES-LETKF (Miyoshi, Yamane, and Enomoto) AFES: AGCM for the Earth Simulator Resolution: T159/L48 – 480x240x48 grid points 40 ensemble members Assimilate observations except satellite radiances 1.5-year cycle from May 2005 till Nov 2006: ALERA (AFES-LETKF Experimental Reanalysis) This is the collaborative work among the Forecast Department/JMA, JAMSTEC, and Chiba Institute of Science. We used the Earth Simulator under support of JAMSTEC.

AFES-LETKF tested in Aug 2004 Sea-level pressure August 16, 2004 00UTC LETKF JMA SPREAD DIFFERENCE

Flow of analysis errors 500hPa Height Analysis (usually available by reanalysis) Analysis ensemble spread (analysis error field) (available by EnKF)

Forecast verifications in Aug 2004 Adapted from Miyoshi and Yamane (2006)

Summary of the test Test exp. have shown very good performance of the AFES-LETKF system Miyoshi and Yamane, 2007: Mon. Wea. Rev., in press.

ALERA (AFES-LETKF Experimental ReAnalysis) 500Z RMS diff (1-day running mean) ALERA - NCEP REANAL Very stable! Apply vertical localization of Ps

Summary ALERA (AFES-LETKF Experimental ReAnalysis) Miyoshi, Yamane and Enomoto, 2007: SOLA, in press. Stable performance over 1.5 years The product of every 6-hour analysis of 40 ensemble members is useful for further studies “Ensemble reforecasting” Further verifications and analyses of the products are in progress

LETKF without local patches SLP analysis ensemble spread after the first analysis step The discontinuities caused by the local patches disappear.

NHM-LETKF (Miyoshi and Aranami) NHM: JMA nonhydrostatic model (in operations) Perfect model experiment in a small region Miyoshi and Aranami, 2006: SOLA, 128-131. 5-km grid spacing, 10 members Experiment with real obs in July 2004 20-km grid spacing, 20 members

Perfect model experiment

Precipitation NO DA w/o rain obs w/ rain obs TRUTH TIME

Exp. with real observations Experimental settings Experiment period 2004/6/25-7/15 Grid spacing 20 km Region (# of grid points) JMA operational (181x145x50) Ensemble size 20 Gaussian localization length Horizontal: 5-grid Vertical: 3-grid Local patch size 21x21x13 Covariance inflation 10% multiplicative spared inflation Boundary condition Fixed for all ensemble members

6-hr fcst initiated at 00Z July 4, 2004 Operational hydrostatic MSM as of July 2004 LETKF ensemble mean

Ensemble spreads

Summary Perfect model experiment indicates the LETKF works appropriately. With real obs, LETKF reproduces similar analysis as the JMA operational MSM. Growing modes appear inside the region; the effects of boundaries are limited near the boundaries NOTE: Growing modes with longer wavelengths are artificially damped due to the fixed boundary. NHM-LETKF is a useful tool for future studies in mesoscale NWP

GSM-LETKF (Miyoshi and Sato) GSM: JMA global model (in operations) Resolution: TL159/L48 – 320x160x48 grid points 20 and 50 ensemble members Real obs including satellite radiances Miyoshi and Sato, 2007: SOLA, 37-40.

Assimilation of satellite radiances AMSU-A Vertical localization is required. Normalized sensitivity function is used as the localization weights. Canadian operational EnKF uses the Guassian function in the same manner as the conventional obs. SSM/I

Spaghetti diagrams w/o satellite radiances w/ satellite radiances w/o vertical localization Too small spread Caused by spurious covariance due to sampling errors w/ satellite radiances w/ vertical localization Larger spread due to damping sampling errors

Residuals against JMA analysis 20 members BIAS SLP [hPa] Red: w/ vertical local. Blue: w/o vertical local. Green: w/o satellite assim. RMSE (solid) SPREAD (dashed) Too small SPREAD Too large RMSE SLP [hPa]

Effects by satellite radiances RMSE and bias against radiosondes Reduced RMSE of Z in mid-upper troposphere (500-100hPa), especially in the SH and Tropics Blue: w/o satellite radiances Red: w/ satellite radiances Reduced negative bias of Z and T 20 members

Ensemble size 20  50 RMSE and bias against radiosondes Blue: Operational 4D-Var Red: 20-member LETKF Green: 50-member LETKF 50 members > 20 members Generally 4D-Var > LETKF Exception: mid-upper tropospheric temperature in the SH w/ satellite radiances

Z500 global forecast anomaly score Anomaly Correlations (against own analyses) Blue: Operational 4D-Var Red: 20-member LETKF Green: 50-member LETKF

Tuning parameters…in progress Red: LETKF Blue: 4D-Var

Summary LETKF has been successfully applied to the three models: AFES (AGCM for the Earth Simulator) NHM (JMA nonhydrostatic regional model) GSM (JMA global model) GSM-LETKF with 50 members indicates identical performance to the operational 4D-Var system in the NH. Ideas for further improvements Further retuning 50 members  100 members TL159  TL319 Adaptive bias correction for satellite radiances Incremental method (high-resolution first guess) The ALERA dataset will be available to researchers for free!

Thank you for your attention!

ALERA system description Ensemble size 40 Localization parameters 21x21x13 local patch 6-grid horizontal 3-grid vertical Gaussian localization Covariance inflation parameter 10% multiplicative spread inflation (21% cov inflation) Experimental period May 1, 2005 towards present (now computing… June, 2006) Assimilated observations Operationally used observations in JMA global cycle analysis except satellite radiances

SLP analyses on May 2, 2006

KF and EnKF Kalman Filter Ensemble Kalman Filter Forecast equations Ensemble forecasts Approximated by Kalman gain [pxp] matrix inverse Analysis equations Solve for the ensemble mean Ensemble perturbations

LETKF algorithm In the space spanned by Eigenvalue decomposition: Analysis equations LETKF analysis Ensemble analysis increments