Slide 1 NWS Activities in Satellite Data Assimilation Andrew Collard, Daryl Kleist, John Derber, Li Bi, Lidia Cucurull, David Groff, Xu Li, Emily Liu,

Slides:



Advertisements
Similar presentations
Numerical Weather Prediction Readiness for NPP And JPSS Data Assimilation Experiments for CrIS and ATMS Kevin Garrett 1, Sid Boukabara 2, James Jung 3,
Advertisements

© The Aerospace Corporation 2014 Observation Impact on WRF Model Forecast Accuracy over Southwest Asia Michael D. McAtee Environmental Satellite Systems.
Data Assimilation Andrew Collard. Overview Introduction to Atmospheric Data Assimilation Control Variables Observations Background Error Covariance Summary.
Handling Cloud-Affected Infrared Radiances in the GSI Will McCarty GSFC/Global Modeling and Assimilation Office JCSDA Workshop 10 October 2012.
Enhancements of Radiance Bias Correction in NCEP’s Data Assimilation Systems Yanqiu Zhu Contributions from: John Derber, Andrew Collard, Dick Dee, Russ.
Satellite SST Radiance Assimilation and SST Data Impacts James Cummings Naval Research Laboratory Monterey, CA Sea Surface Temperature Science.
ECMWF CO 2 Data Assimilation at ECMWF Richard Engelen European Centre for Medium-Range Weather Forecasts Reading, United Kingdom Many thanks to Phil Watts,
1 ATOVS and SSM/I assimilation at the Met Office Stephen English, Dave Jones, Andrew Smith, Fiona Hilton and Keith Whyte.
Progress in Cloudy Microwave Satellite Data Assimilation at NCEP Andrew Collard 1, Emily Liu 4, Yanqiu Zhu 1, John Derber 2, Daryl Kleist 3, Rahul Mahajan.
Improved NCEP SST Analysis
Sean P.F. Casey 1,2,3,4, Lars Peter Riishojgaard 2,3, Michiko Masutani 3,5, Jack Woollen 3,5, Tong Zhu 3,4 and Robert Atlas 6 1 Cooperative Institute for.
ECMWF – 1© European Centre for Medium-Range Weather Forecasts Developments in the use of AMSU-A, ATMS and HIRS data at ECMWF Heather Lawrence, first-year.
Data assimilation of polar orbiting satellites at ECMWF
Recent activities on utilization of microwave imager data in the JMA NWP system - Preparation for AMSR2 data assimilation - Masahiro Kazumori Japan Meteorological.
Operational Global Model Plans John Derber. Timeline July 25, 2013: Completion of phase 1 WCOSS transition August 20, 2013: GDAS/GFS model/analysis upgrade.
Impact of Infrared, Microwave and Radio Occultation Satellite Observations on Operational Numerical Weather Prediction Lidia Cucurull (1) and Richard A.
Assimilation of GOES Hourly and Meteosat winds in the NCEP Global Forecast System (GFS) Assimilation of GOES Hourly and Meteosat winds in the NCEP Global.
Slide 1 Model Assimilation of Satellite Observations and Retrievals Andrew Collard
The fear of the LORD is the beginning of wisdom 陳登舜 ATM NCU Group Meeting REFERENCE : Liu., H., J. Anderson, and Y.-H. Kuo, 2012: Improved analyses.
Different options for the assimilation of GPS Radio Occultation data within GSI Lidia Cucurull NOAA/NWS/NCEP/EMC GSI workshop, Boulder CO, 28 June 2011.
1 NCEP data assimilation systems status and plans John C. Derber Environmental Modeling Center NCEP/NWS/NOAA With input from: Many others.
Slide 1 EUMETSAT Fellow Day, 9 March 2015 Observation Errors for AMSU-A and a first look at the FY-3C MWHS-2 instrument Heather Lawrence, second-year EUMETSAT.
On Improving GFS Forecast Skills in the Southern Hemisphere: Ideas and Preliminary Results Fanglin Yang Andrew Collard, Russ Treadon, John Derber NCEP-EMC.
Satellite Bias Correction for CFSRR Haixia Liu, Russ Treadon, Robert Kistler, John Derber, Suru Saha and Hua-lu Pan Nov. 7, 2007 with input from Jack Woollen,
A NON-RAINING 1DVAR RETRIEVAL FOR GMI DAVID DUNCAN JCSDA COLLOQUIUM 7/30/15.
P1.85 DEVELOPMENT OF SIMULATED GOES PRODUCTS FOR GFS AND NAM Hui-Ya Chuang and Brad Ferrier Environmental Modeling Center, NCEP, Washington DC Introduction.
Recent developments for a forward operator for GPS RO Lidia Cucurull NOAA GPS RO Program Scientist NOAA/NWS/NCEP/EMC NCU, Taiwan, 16 August
1 EMC’s Current and future GSI development John C. Derber Environmental Modeling Center NCEP/NWS/NOAA With input from: Many others.
1 Hyperspectral Infrared Water Vapor Radiance Assimilation James Jung Cooperative Institute for Meteorological Satellite Studies Lars Peter Riishojgaard.
USE OF AIRS/AMSU DATA FOR WEATHER AND CLIMATE RESEARCH Joel Susskind University of Maryland May 12, 2005.
AIRS Radiance and Geophysical Products: Methodology and Validation Mitch Goldberg, Larry McMillin NOAA/NESDIS Walter Wolf, Lihang Zhou, Yanni Qu and M.
Application of COSMIC refractivity in Improving Tropical Analyses and Forecasts H. Liu, J. Anderson, B. Kuo, C. Snyder, and Y. Chen NCAR IMAGe/COSMIC/MMM.
AIRS, HIRS and CSBT Experiments Plus Other FY05/06 Results by James A. Jung Tom H. Zapotocny and John Le Marshall Cooperative Institute for Meteorological.
Evaluation of radiance data assimilation impact on Rapid Refresh forecast skill for retrospective and real-time experiments Haidao Lin Steve Weygandt Stan.
I 5.11 Validation of the GMAO OSSE Prototype Runhua Yang 1,2 and Ronald Errico 1,3 1 Global Modeling and Assimilation office, GSFC, NASA 2 Science Systems.
The Infrastructure, Design and Applications of Observing System Simulation Experiments at NASA's Global Modeling and Assimilation Office By Ronald M. Errico.
ECMWF reanalysis using GPS RO data Sean Healy Shinya Kobayashi, Saki Uppala, Mark Ringer and Mike Rennie.
Preliminary results from assimilation of GPS radio occultation data in WRF using an ensemble filter H. Liu, J. Anderson, B. Kuo, C. Snyder, A. Caya IMAGe.
The Hyperspectral Environmental Suite (HES) and Advanced Baseline Imager (ABI) will be flown on the next generation of NOAA Geostationary Operational Environmental.
Layered Water Vapor Quick Guide by NASA / SPoRT and CIRA Why is the Layered Water Vapor Product important? Water vapor is essential for creating clouds,
MIIDAPS Application to GSI for QC and Dynamic Emissivity in Passive Microwave Data Assimilation.
© Crown copyright Met Office Assimilating cloud affected infrared radiances at the Met Office Ed Pavelin and Roger Saunders, Met Office, Exeter.
A step toward operational use of AMSR-E horizontal polarized radiance in JMA global data assimilation system Masahiro Kazumori Numerical Prediction Division.
Cloudy Radiance Assimilation in the NCEP Global Forecast System NOAA/NCEP/EMC 4 ESSIC, University of Maryland,
1 3D-Var assimilation of CHAMP measurements at the Met Office Sean Healy, Adrian Jupp and Christian Marquardt.
Towards Assimilation of GOES Hourly winds in the NCEP Global Forecast System (GFS) Xiujuan Su, Jaime Daniels, John Derber, Yangrong Lin, Andy Bailey, Wayne.
Infrared Sounding Data in the GMAO Data Assimilation System JCSDA Infrared Sounding Working Group (ISWG) 30 January 2009.
NCEP Assessment of ATMS Radiances Andrew Collard 1, John Derber 2 and Russ Treadon 2 1 IMSG at NOAA/NCEP/EMC 2 NOAA/NCEP/EMC 1NPP ATMS SDR Product Review13th.
1 Satellite Winds Superobbing Howard Berger Mary Forsythe John Eyre Sean Healy Image Courtesy of UW - CIMSS Hurricane Opal October 1995.
Xiujuan Su 1, John Derber 2, Jaime Daniel 3,Andrew Collard 1 1: IMSG, 2: EMC/NWS/NOAA, 3.NESDIS Assimilation of GOES hourly shortwave and visible AMVs.
Status on Cloudy Radiance Data Assimilation in NCEP GSI 1 Min-Jeong Kim JCSDA 9th Workshop on Satellite Data Assimilation, May 24-25, 2011, M-J. Kim 2.
Assimilation experiments with CHAMP GPS radio occultation measurements By S. B. HEALY and J.-N. THÉPAUT European Centre for Medium-Range Weather Forecasts,
Workshop on Soundings from High Spectral Resolution Infrared Observations May 6-8, 2003 University of Wisconsin-Madison.
© Crown copyright Met Office Assimilating infra-red sounder data over land John Eyre for Ed Pavelin Met Office, UK Acknowledgements: Brett Candy DAOS-WG,
Assimilation of GPM satellite radiance in improving hurricane forecasting Zhaoxia Pu and ChauLam (Chris) Yu Department of Atmospheric Sciences University.
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
1 MODIS winds assimilation experiments and impact studies to date at the Met Office Howard Berger, Mary Forsythe, Met Office, Bracknell/Exeter, UK UW-CIMSS.
The development of the NSST within the NCEP GFS/CFS
Indirect impact of ozone assimilation using Gridpoint Statistical Interpolation (GSI) data assimilation system for regional applications Kathryn Newman1,2,
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course
Data Assimilation Training
Impact of Traditional and Non-traditional Observation Sources using the Grid-point Statistical Interpolation Data Assimilation System for Regional Applications.
MO – Design & Plans UERRA GA 2016 Peter Jermey
FSOI adapted for used with 4D-EnVar
Lidia Cucurull, NCEP/JCSDA
Initialization of Numerical Forecast Models with Satellite data
Infrared Satellite Data Assimilation at NCAR
Satellite Foundational Course for JPSS (SatFC-J)
Comparison of different combinations of ensemble-based and variational data assimilation approaches for deterministic NWP Mark Buehner Data Assimilation.
Project Team: Mark Buehner Cecilien Charette Bin He Peter Houtekamer
Presentation transcript:

Slide 1 NWS Activities in Satellite Data Assimilation Andrew Collard, Daryl Kleist, John Derber, Li Bi, Lidia Cucurull, David Groff, Xu Li, Emily Liu, Quanhua Liu, Xiujuan Su, Cathy Thomas, Russ Treadon, P aul van Delst, Yanqiu Zhu 1 JCSDA Workshop May

Slide 2 Plan of the Presentation Upgrades for QY14 implementation: Resolution Changes Radiative Transfer (CRTM) Enhanced Bias Correction AMSU-A Bug Fix SSMIS Atmospheric Motion Vectors MetOp-B GRAS and GPSRO QC MetOp-B IASI and Minor QC changes to satellite data Upgrades for Future Implementation Near Sea Surface Temperature Cloudy Radiance Slide 2 JCSDA Workshop May

Slide 3 EnKF/DA-Resolution components in T1534 GFS Package (Daryl Kleist, Russ Treadon) JCSDA Workshop May

Slide 4 Resolution for Data Assimilation Current operations Analysis done on linear grid that corresponds to the model truncation: T574 – 1152 x 576 However, the 80 member ensemble that prescribes 75% of the solution is at T254 – 512 x 256. Proposed configuration for T1534 SL (3072 x 1536) GFS Increase 80 member EnKF resolution to T574 (SL) Compute GSI-hybrid analysis increment at the ensemble resolution (T574 – 1152 x 576) Recall, 75% of the solution is driven by information at this (or coarser) resolution already Increment is transformed to wave space and added to full resolution background Note that the O-F is computed at truncated resolution (need to fix this in future) Static B has MPI bottleneck making it difficult to perform analyses on high resolution grids (being worked on) JCSDA Workshop May

Slide 5 CRTM Upgrade (Dave Groff, Paul van Delst, Quanhua Liu) JCSDA Workshop May

Slide 6 FASTEM-5 May JCSDA Workshop

Slide 7 Bias Correction Upgrades (Yanqiu Zhu) JCSDA Workshop May

Slide 8 The control variables and are estimated by minimizing (Derber et al., 1991, Derber and Wu, 1998) is radiative transfer model Air-mass dependent in GSI Separate scan-angle dependent Original radiance bias correction scheme A two-step procedure where is pre-specified parameter is predictor term with predictor coeff. May JCSDA Workshop

Slide 9 Enhancements to the Radiance Bias Correction Scheme  Combine the scan angle and air-mass bias components inside the GSI variational framework, simplify the operational job suite  With the modified pre-conditioning, the pre-specified parameter for each predictor is removed  Add new emissivity sensitivity bias predictor to handle large land-sea differences  Automatically initialize the bias of any new radiance data  Automatically detect any new/missing/recovery of radiance data  Quickly capture any changes in the data and the data assimilation system, preferred scheme for re-analysis projects  Faster GSI minimization convergence 9

Slide 10 is computed outside GSI, a running average of OMF The predictors of air-mass are computed inside the GSI Enhanced scheme: a one-step procedure Original scheme: a two-step procedure Variational angle bias correction, is computed inside the GSI along with other predictor terms satang file no longer needed Special attention to the initialization of bias coefficients: using quality-controlled data from previous run; or mode of all data May JCSDA Workshop

Slide 11 Change of the Preconditioning Hessian w.r.t. predictor coeff. of the cost function Modified block-diagonal preconditioning is set to be the inverse of ( Dee 2004 ) Current preconditionerModified preconditioner For simplicity, only diagonal elements of are considered at each analysis cycle May JCSDA Workshop

Slide 12 Convergence comparison 00Z July 15, 2012 May JCSDA Workshop

Slide 13 Variance vs. Observation number A big drop of obs number prompts a jump of variance AIRS CH22 13  Adaptive background error variance for bias predictor coef.: set to be the estimate of analysis error variance of the coef. from previous analysis cycle. More & higher quality data smaller variance Enhancements to the Radiance Bias Correction Scheme (cont.)

Slide 14 Enhancements to the Radiance Bias Correction Scheme (cont.)  Provide a convenient and efficient way, via the newly added passive channel bias correction capability, to obtain the bias of any new satellite data that are not used but monitored for preparation for future use, such as the radiance data from NPP satellite 14 Passive channel bias correction: at the end of analysis minimizing the functional where

Slide 15 HGT 500hpa SH Anomaly Correlation May JCSDA Workshop

Slide 16 New Emissivity-based bias predictor JCSDA Workshop Old CRTM New CRTM (Others are various configurations using emissivity BC) New CRTM has larger land-sea differences which were being aliased into the CLW bias-correction for microwave instruments. This was solved by the addition of a new bias predictor applied over land to remove the systematic land-sea difference in radiance innovation. May

Slide 17 AMSU-A Bug Fix (Emily Liu) JCSDA Workshop May

Slide 18 AMSU-A Bug Fix The AMSU-A Cloud Liquid Water retrieval code returns CLW=0 when the sea surface temperature is below 0C. As CLW is a predictor used in bias correction of AMSU-A radiances, this means that uncorrected cloudy fields of view are being assimilated near the ice-edge where the water is below 0C but still not frozen (the sea freezes around -1.9C), are therefore systematically warm-biased. JCSDA Workshop May

Slide 19 Impact on Analysis JCSDA Workshop May

Slide 20 Impact on 48h Forecast JCSDA Workshop May

Slide 21 Impact on SH 850hPa Wind JCSDA Workshop Control With Bug Fix Control with FASTEM-1 May

Slide 22 SSMIS (Emily Liu) JCSDA Workshop May

Slide Jan Global Dsc Asc July Asc Dsc Global O-B (no bc) SSMIS F18 Bias Characteristics Jan Ascending NodeDescending Node July O-B (no bc) vs. Latitudes Ascending NodeDescending Node Jan July O-B (no bc) Ascending and descending biases are significant (summer season is worse) Ascending pass is warmer than the descending pass Latitudinal biases are significant; locations of max/min biases change with season T (K) Latitude T (K) May JCSDA Workshop

Slide 24 Variational Bias Correction Scheme Variational bias correction provides an automatic inter-calibration of the observing system in the context of the forecast model, producing bias corrections that improve the consistency of the information entering the analysis For instruments other than SSMIS the bias correction is calculated using five air-mass predictors and four scan angle predictors For SSMIS a variety of different additional predictors were tried based on experience at the Met Office, NRL and ECMWF The Met Office scheme was found to give the best results Air-massSSMIS specificScan angle (θ) const offset zenith angle cloud liquid water lapse rate lapse rate square * *node is +1 if ascending, -1 if descending Bias correction predictors used are: May JCSDA Workshop

Slide 25 Application of NWP Bias Correction for SSMIS F18 Ascending NodeDescending Node Latitude Unbias & Bias Corrected O-B O-B Before Bias Correction Global Dsc Asc O-B After Bias Correction Global Dsc Asc O-B Before Bias Correction O-B After Bias Correction Using Met Office SSMIS Bias Correction Predictors T (K) May JCSDA Workshop

Slide 26 Application of NWP Noise Reduction for SSMIS By design SSMIS oversamples the brightness temperature field at relatively high noise Must apply spatial averaging before assimilating the data to reduce the noise A spatial averaging scheme was implemented inside of analysis(GSI) for SSMIS May JCSDA Workshop F-18 F-17 F-16 F-18 NR F-17 NR F-16 NR

Slide 27 Impact is not significant in northern hemisphere Marginally significant positive impact in southern hemisphere Impact of Assimilating SSMIS into Current Operational System (1) 15 Jan to 30 Mar 2012 (00Z cycles only) Control Enhance Control Enhance Northern Hemisphere 500 hPa Geopotential Height Anomaly Correlation Southern Hemisphere 500 hPa Geopotential Height Anomaly Correlation May JCSDA Workshop

Slide hPa shows statistically significant positive impact in medium range Some small but significant positive impact in short range for 200hPa winds Tropical (20°N-20°S) 0 to 5 Day Wind Forecast RMS Errors Impact of Assimilating SSMIS into Current Operational System (2) 15 Jan to 30 Mar 2012 (00Z cycles only) 200hPa 850hPa Control Enhance Control Enhance May JCSDA Workshop

Slide 29 Atmospheric Motion Vectors (Xiujuan Su) JCSDA Workshop May

Slide 30 Assimilation of GOES hourly and Meteosat water vapor satellite winds in GSI GOES hourly winds replace current 3 hour GOES satellite winds GOES winds are currently supplied at three-hourly intervals with observation times within one hour of the analysis time. We will change to receiving GOES hourly winds and will assimilate observations throughout the six-hour assimilation window. This results in the data counts increasing by a factor of six. The quality of data from both products are similar. Meteosat water vapor winds The data was not used in GSI, data count is about 7000 each cycle after thinning May JCSDA Workshop

Slide 31 Assimilation strategy GOES hourly winds Tighten current quality control, add normalized Estimated Error (a new QC variable from the data providers) as new quality and new observation error Meteosat winds Add new quality control, observation error and thinning the data May JCSDA Workshop

Slide 32 Impacts The impact on forecast skills by adding these data are neutral for most part with slight improvement on southern hemisphere. Adding these data also improve observation fit on satellite winds. May JCSDA Workshop

Slide 33 GPS Radio Occultation (Lidia Cucurull) JCSDA Workshop May

Slide 34 GPS RO changes RO observations from MetOp-A and MetOp-B are rejected below 8 km (refractivity and bending angle) Improved the quality control for RO observations (refractivity and bending angle) in the lower troposphere under the presence of large vertical gradients of atmospheric refractivity (primarily moisture) Bending angle: (a) if model detects 75% of the critical value around the height of the observation (we look at several model layers surrounding the observation), the observation is rejected if at/below this model layer. If several layers exist, we chose the top layer. (b) if bending angle > 0.03 rad and model detects at least 50% of critical gradient around the observation height, we select the observation within the profile with the largest bending angle. Any observation within the same profile and below the selected observation is rejected. May JCSDA Workshop

Slide mb Geopotential Height anomaly correlation May JCSDA Workshop

Slide 36 Other Satellite Data Usage Changes (Andrew Collard, Li Bi) JCSDA Workshop May

Slide 37 Other Satellite Data Usage Changes 1) Turn on new instruments: IASI MetOp-B (same as MetOp-A) 2) Turn off known bad channels: NOAA-19 AMSU-A Ch 7 NOAA-19 MHS Ch 3 Aqua AIRS Ch 321 3) Increase obs errors for sounding channels on ATMS: Chs 6-10 increased to 0.4K (from 0.3K) Chs increased to 0.45K (from 0.35 and 0.4K) 4) Turn on cloud detection channels for monitored instruments: NOAA-17 HIRS, NOAA-19 HIRS, GOES-13 and GOES-14 sounders (we might also want to remove some of these instruments completely) 5) Turn on OSCAT (unfortunately OSCAT is no longer working) JCSDA Workshop May

Slide 38 Projects for Future Implementations JCSDA Workshop May

Slide 39 Near Sea-Surface Temperature (NSST) (Xu Li) JCSDA Workshop May

Slide 40 Why is SST, an oceanic variable, analyzed in an atmospheric data assimilation system? More consistent initial conditions A single cost function and air-sea interaction More effective use of satellite data Assimilating satellite radiance directly to analyze the oceanic variable Taking advantage of the atmospheric data assimilation Advanced and updated frequently A direction to coupled data assimilation A single cost function for two media The covariance between the atmosphere and ocean Not included yet EnKF is able to handle it

Slide 41 Improved Oceanic Component within the NCEP GFS (1/2) An SST analysis scheme has been developed within the NCEP GFS (3DVAR GSI) SST extended to NSST (Near-Surface Sea Temperature), a T-Profile due to diurnal warming and sub-layer cooling The foundation temperature(Tf) is selected as the oceanic analysis variable NSST model developed (plus CRTM) to relate Tf and observed satellite radiance and oceanic temperature The combination of Tf and NSST profile provides the more appropriate boundary conditions of radiative transfer model and atmospheric forecasting model All the data are assimilated directly, including wavelength dependent satellite radiance and depth dependent in situ buys and ships sea temperature. Tf is analyzed 6-hourly together with atmospheric variables by minimizing a single cost function with GSI Partially atmosphere-ocean coupled in prediction mode

Slide 42 Improved Oceanic Component within the NCEP GFS (1/2) Results based on the cycling runs for one summer and one winter season SST analysis: Improved, in terms of (O-B) statistics against buoys, such as more Gaussin, lower bias and RMS, more used data SST prediction: Improved against buoys but degraded against own analysis, since more variability introduced in the new scheme and the suppressed variability in the control run Atmosphere prediction against own analysis: improved in tropics, neutral in higher latitude areas Conclusions An atmosphere-ocean partially coupled data assimilation and prediction system has been developed within the NCEP GFS and the results are encouraging Fully Coupled data assimilation (future) Strongly coupling (the combination of NSST and the NCEP CFS) Atmosphere-ocean convariance with Hybrid EnKF

Slide 43 The Impact of the NSST on atmospheric prediction: RMS difference (EXP – CTL), Tropics, Jan Based on 124 (31 days, 4 times a day) 7-day forecasting. Positive impact in tropics at all levels except for near surface in T and RH (since more oceanic variability introduced in the NSST and the suppressed oceanic variability in the control run)

Slide 44 Cloudy Radiance Assimilation (Li Bi, Haixia Liu, Cathy Thomas, Xiaoyan Zhang, Yanqiu Zhu) JCSDA Workshop May

Slide 45 Cloudy Radiance Projects Use new overcast radiance output from CRTM to convert GSI IR cloud detection scheme to radiance space. Microwave cloudy radiance assimilation Following ECMWF approach Focussing on non-precipitating clouds initially Infrared cloudy radiance assimilation CTP/cloud pressure retrieval approach Direct cloud assimilation approach Cloud cleared infrared radiances Use either new or existing cloud cleared radiance algorithm inside the GSI. Work on examining and extending the ensembles to make maximum use of cloud information May JCSDA Workshop

Slide 46 Any Questions JCSDA Workshop May