GFS MOS Wind Guidance: Problem Solved? Eric Engle and Kathryn Gilbert MDL/Statistical Modeling Branch 15 May 2012.

Slides:



Advertisements
Similar presentations
Slide 1ECMWF forecast User Meeting -- Reading, June 2006 Verification of weather parameters Anna Ghelli, ECMWF.
Advertisements

Page 1 NAE 4DVAR Oct 2006 © Crown copyright 2006 Mark Naylor Data Assimilation, NWP NAE 4D-Var – Testing and Issues EWGLAM/SRNWP meeting Zurich 9 th -12.
SNPP VIIRS green vegetation fraction products and application in numerical weather prediction Zhangyan Jiang 1,2, Weizhong Zheng 3,4, Junchang Ju 1,2,
Multiple Linear Regression uses 2 or more predictors General form: Let us take simplest multiple regression case--two predictors: Here, the b’s are not.
Gridded MOS – A Prototype System
Further Development of a Statistical Ensemble for Tropical Cyclone Intensity Prediction Kate D. Musgrave 1 Mark DeMaria 2 Brian D. McNoldy 3 Yi Jin 4 Michael.
Comparison of Several Methods for Probabilistic Forecasting of Locally-Heavy Rainfall in the 0-3 Hour Timeframe Z. Sokol 1, D. Kitzmiller 2, S. Guan 2.
Rapid Refresh and RTMA. RUC: AKA-Rapid Refresh A major issue is how to assimilate and use the rapidly increasing array of off-time or continuous observations.
A tale of two severe weather surprises – The isolated event of 16 July 2010 and the severe weather outbreak of 17 July 2010 Neil A. Stuart NOAA/NWS Albany,
1 AirWare : R elease R5.3 beta AERMOD/AERMET DDr. Kurt Fedra Environmental Software & Services GmbH A-2352 Gumpoldskirchen AUSTRIA
Functional Data Analysis T Chapters 10,11,12 Markus Kuusisto.
MOS Developed by and Run at the NWS Meteorological Development Lab (MDL) Full range of products available at:
Hydrometeorological Prediction Center HPC Medium Range Grid Improvements Mike Schichtel, Chris Bailey, Keith Brill, and David Novak.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
RADIATION FOG STUDY. Office Stats 00z ELM TAF 00z ELM TAF POD for FG – 0.53 POD for FG – 0.53 FAR – 0.55 FAR – z ELM TAF 06z ELM TAF POD for FG.
Transitioning unique NASA data and research technologies to the NWS 1 Evaluation of WRF Using High-Resolution Soil Initial Conditions from the NASA Land.
MOS What does acronym stand for ? –MODEL OUTPUT STATISTICS What is the difference between the GFS and GFS MOS ?
Improving Gridded Localized Aviation MOS Program (LAMP) Guidance by Using Emerging Forecast and Observation Systems Judy E. Ghirardelli, Jerome P. Charba,
MOS Performance MOS significantly improves on the skill of model output. National Weather Service verification statistics have shown a narrowing gap between.
Consortium Meeting June 3, Thanks Mike! Hit Rates.
A Regression Model for Ensemble Forecasts David Unger Climate Prediction Center.
Statistical Methods for long-range forecast By Syunji Takahashi Climate Prediction Division JMA.
1 Localized Aviation Model Output Statistics Program (LAMP): Improvements to convective forecasts in response to user feedback Judy E. Ghirardelli National.
Improving Cloud Simulation in Weather Research and Forecasting (WRF) Through Assimilation of GOES Satellite Observations Andrew White Advisor: Dr. Arastoo.
“1995 Sunrise Fire – Long Island” Using an Ensemble Kalman Filter to Explore Model Performance on Northeast U.S. Fire Weather Days Michael Erickson and.
On the impact of the SSO scheme in the COSMO model into the development of a deep cyclone in the Tirrenian sea Case study: April Antonella Morgillo.
Probabilistic forecasts of (severe) thunderstorms for the purpose of issuing a weather alarm Maurice Schmeits, Kees Kok, Daan Vogelezang and Rudolf van.
Guidance on Intensity Guidance Kieran Bhatia, David Nolan, Mark DeMaria, Andrea Schumacher IHC Presentation This project is supported by the.
June 19, 2007 GRIDDED MOS STARTS WITH POINT (STATION) MOS STARTS WITH POINT (STATION) MOS –Essentially the same MOS that is in text bulletins –Number and.
OUTLINE Current state of Ensemble MOS
Modification of GFS Land Surface Model Parameters to Mitigate the Near- Surface Cold and Wet Bias in the Midwest CONUS: Analysis of Parallel Test Results.
1 Discussion of Observational Biases of Some Aircraft Types at NCEP Dr. Bradley Ballish NCEP/NCO/PMB 7 September 2006 “Where America’s Climate and Weather.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Accounting for Change: Local wind forecasts from the high-
MDL Lightning-Based Products Kathryn Hughes NOAA/NWS/OST December 3, 2003
Model Post Processing. Model Output Can Usually Be Improved with Post Processing Can remove systematic bias Can produce probabilistic information from.
Operational ALADIN forecast in Croatian Meteorological and Hydrological Service 26th EWGLAM & 11th SRNWP meetings 4th - 7th October 2004,Oslo, Norway Zoran.
Transitioning unique NASA data and research technologies to the NWS 1 Evaluation of WRF Using High-Resolution Soil Initial Conditions from the NASA Land.
WRF Problems: Some Solutions, Some Mysteries Cliff Mass and David Ovens University of Washington.
2006(-07)TAMDAR aircraft impact experiments for RUC humidity, temperature and wind forecasts Stan Benjamin, Bill Moninger, Tracy Lorraine Smith, Brian.
CC Hennon ATMS 350 UNC Asheville Model Output Statistics Transforming model output into useful forecast parameters.
Verification Verification with SYNOP, TEMP, and GPS data P. Kaufmann, M. Arpagaus, MeteoSwiss P. Emiliani., E. Veccia., A. Galliani., UGM U. Pflüger, DWD.
Multiple Regression INCM 9102 Quantitative Methods.
Linear Regression Simon Mason Seasonal Forecasting Using the Climate Predictability Tool Bangkok, Thailand, 12 – 16 January 2015.
Page 1© Crown copyright 2004 SRNWP Lead Centre Report on Data Assimilation 2005 for EWGLAM/SRNWP Annual Meeting October 2005, Ljubljana, Slovenia.
1 Gridded Localized Aviation MOS Program (LAMP) Guidance for Aviation Forecasting Judy E. Ghirardelli and Bob Glahn National Weather Service Meteorological.
Atlantic Simplified Track Model Verification 4-year Sample ( ) OFCL shown for comparison Forecast Skill Mean Absolute Error.
Statistical Post Processing - Using Reforecast to Improve GEFS Forecast Yuejian Zhu Hong Guan and Bo Cui ECM/NCEP/NWS Dec. 3 rd 2013 Acknowledgements:
OPERATIONAL 2-H THUNDERSTORM GUIDANCE FCSTS TO 24 HRS ON 20-KM GRID JESS CHARBA FRED SAMPLATSKY METEOROLOGICAL DEVELOPMENT LABORATORY OST / NWS / NOAA.
The LAMP/HRRR MELD FOR AVIATION FORECASTING Bob Glahn, Judy Ghirardelli, Jung-Sun Im, Adam Schnapp, Gordana Rancic, and Chenjie Huang Meteorological Development.
MOS AVN = Dynamical Model –Seven fundamental equations ! AVN MOS = Statistical Model –No seven fundamental equations ! –Equations are statistical, not.
An Examination Of Interesting Properties Regarding A Physics Ensemble 2012 WRF Users’ Workshop Nick P. Bassill June 28 th, 2012.
Exploring the Possibility to Forecast Annual Mean Temperature with IPCC and AMIP Runs Peitao Peng Arun Kumar CPC/NCEP/NWS/NOAA Acknowledgements: Bhaskar.
Alan F. Hamlet Andy Wood Dennis P. Lettenmaier JISAO Center for Science in the Earth System Climate Impacts Group and the Department.
Improved Gridded Localized Aviation MOS Program (LAMP) Ceiling and Visibility Guidance using HRRR model output Presenting: Judy E. Ghirardelli/Adam Schnapp.
MOS and Evolving NWP Models Developer’s Dilemma: Frequent changes to NWP models… Make need for reliable statistical guidance more critical Helps forecasters.
Bias Correction of RTFDDA Surface Forecasts Presented by: Daran Rife National Center for Atmospheric Research Research Applications Laboratory Boulder,
MDL Requirements for RUA Judy Ghirardelli, David Myrick, and Bruce Veenhuis Contributions from: David Ruth and Matt Peroutka 1.
1 3D-Var assimilation of CHAMP measurements at the Met Office Sean Healy, Adrian Jupp and Christian Marquardt.
Comparison of LM Verification against Multi Level Aircraft Measurements (MLAs) with LM Verification against Temps Ulrich Pflüger, Deutscher Wetterdienst.
Satellite Data Assimilation Activities at CIMSS for FY2003 Robert M. Aune Advanced Satellite Products Team NOAA/NESDIS/ORA/ARAD Cooperative Institute for.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Experiments at MeteoSwiss : TERRA / aerosols Flake Jean-Marie.
Aviation Products from the Localized Aviation MOS Program (LAMP) Judy E. Ghirardelli National Weather Service Meteorological Development Laboratory Presented.
Developing GFS-based MOS Thunderstorm Guidance for Alaska Phillip E. Shafer* and Kathryn Gilbert Meteorological Development Laboratory, NWS, NOAA
Impact of AMDAR/RS Modelling at the SAWS
WRF Four-Dimensional Data Assimilation (FDDA)
Update on the Northwest Regional Modeling System 2013
Model Post Processing.
Post Processing.
New Developments in Aviation Forecast Guidance from the RUC
MOS What does acronym stand for ?
Presentation transcript:

GFS MOS Wind Guidance: Problem Solved? Eric Engle and Kathryn Gilbert MDL/Statistical Modeling Branch 15 May 2012

 Reason for Refresh  Development Sample  Predictand Definition  Predictors and Equation Development  Independent Test Systems  Verification  Impact on Gridded MOS Overview

 GFS Model “bugfix” implemented in May 2011  Set new thermal roughness length to address a low level warm bias over land  Affected the behavior of the low level wind fields  Usually chosen as predictors (10-m u, v, speed) Reason for Refresh

GFS Vegetation Type Vegetation Type Description 7: Groundcover only (perennial) 8: Broadleaf shrubs with perennial groundcover 9: Broadleaf shrubs with bare soil 11: Bare soil  Roughness length change has most impact in these vegetation type areas.  Verifications show this is true (not shown) VEGETATION TYPES (DORMAN AND SELLERS, 1989; JAM)

 GFS Model “bugfix” implemented in May 2011  Set new thermal roughness length to address a low level warm bias over land  Affected the behavior of the low level wind fields  Usually chosen as predictors (10-m u, v, speed)  Had a direct impact on GFS MOS wind speed guidance  Large guidance errors (strong positive biases)  Western CONUS (low vegetation/desert areas)  Most pronounced in warm season, during daytime hours Reason for Refresh

Implementation 32.2 knot error

2009 Credit: Dr. Yun Fan Jan-Apr 2011 May-July

 GFS Model “bugfix” implemented in May 2011  Set new thermal roughness length to address a low level warm bias over land  Affected the behavior of the low level wind fields  Usually chosen as predictors (10-m u, v, speed)  Had a direct impact on GFS MOS wind speed guidance  Large forecast busts (strong positive biases)  Western CONUS (low vegetation/desert areas)  Most pronounced in warm season, during daytime hours  Complaints from NWS forecasters and private sector  GFS MOS wind guidance “unusable” Reason for Refresh

“Our workload has increased due to this problem” “…we continue to deal with serious fire weather conditions…” “The forecaster stated that this issue makes the point and gridded MOS…typically used to populate GFE…unusable and times.” “The situation with the MAV guidance winds has become a source of frustration and a workload issue for our office.” Responses from Users

 Turning off partial inflation (PI)  Many stations benefit from PI  Development without boundary layer model predictors  Many stations benefit from these  Bias correction  Big project…significant MOS production overhead  The solution…collect sufficient mixed sample and redevelop  Most timely Solutions Investigated

 Previous two warm seasons available  April through September, 2010 and  Comprised of three different versions of GFS model. Development Sample Date RangeVersion April – June 2010Pre (operational) July – September (reforecast) April – May (operational) May 10 – September (operational)  Balance the influence of “new” model data (version 9.0.1) with a sufficient sample size  64% “new” / 36% “old”

 Predictands:  10-m U-wind  10-m V-wind  10-m Wind Speed  Derived from hourly observed 10-m wind speed and direction  Wind data are quality controlled via MDL software  Regression equations for predictands are developed simultaneously  Predictors selected that best fit all 3 predictands  Different coefficient  3-hourly guidance to 192-h  6-hourly guidance from 204-h to 264-h Predictand Definition

 U, V, Speed at 1000, 925, 850, 700, and 500 hPa; and 10-m  Mass divergence, relative vorticity, vertical velocity at 925, 850, 700, and 500 hPa  Mean Layer RH ; hPa; and sigma  Temperature Difference between , , and hPa levels  K index  Sine and cosine DOY (harmonic functions)  PBL mixing parameter  Bilinear interpolation  Observed predictors offered out to 15-h (persistence) Predictors Offered

 Single station equation development  Multiple linear regression (forward selection)  Maximum number of predictors: 10 (no forcing)  100 “cases” required equation to be developed  Three independent test systems were developed  Determine the best mix of “old” and “new” GFS model sample Regression and Equation Development

 TEST1  Only GFS v9.0.1 “new” used  July-Sept (reforecast); May 10 – Sept  TEST2  Same as TEST1, but includes April 1 – May 9, 2011 (GFS v9.0.0)  TEST3  All data from previous 2 warm seasons included  April-Sept and 2011 Independent Test Systems

 Cross-validation “leave one out” technique used  Each of the 3 test systems comprised of 8 equation sets  7 out of 8 months of “new” GFS model data included in each equation set  Withheld month is used to verify the equation set in which it was held back.  End up with 8 fully independent months of guidance to verify against Independent Testing

Compare Equations for KPHX (24-h) 00Z Operational (as of 5/14/2012) PredictorCoeff. 10-m U-wind m V-wind m Wind Speed sigma Mean Layer RH hPa Mass Divergence hPa Mean Layer RH hPa Temp difference Cosine 2*DOY hPa Wind Speed hPa Vert. Velocity (GB) New (awaiting implementation) PredictorCoeff. 925 hPa U-wind hPa Wind Speed m V-Wind Cosine DOY hPa Wind Speed hPa Mean Layer RH PBL Mixing (low) hPa Vert. Velocity (GB) hPa Mass Divergence K Index (GB) ( ≥ 40)

 Verifications show TEST3 being the most accurate/skillful system  Attribute this to a longer sample  New equations have similar skill in wind direction guidance as the old equations  Guidance in Alaska degraded with test developments  Existing equations will remain in place Verification Summary

 MOS-2000 software uses ASCII files that contain regression equation information for a particular suite of elements  Grouped by season and model cycle  Wind: 1 file for 00Z, warm season that contains all equations for all stations and projections  Decompose these files and merge with “new” equation files. Merging Equation Files

Impact on Gridded MOS

GMOS Example

 Change in GFS thermal roughness length  Negative impact on GFS MOS  Wind equations redeveloped using previous 2 warm seasons  Except for Alaska  Large wind speed guidance errors removed  Positive impact on Gridded MOS  Future work?  Bias correction  Redevelop again with longer sample  Implementation in June 2012 Summary

See the New Equations in Action…

Questions?