An Investigation of Cool Season Extratropical Cyclone Forecast Errors Within Operational Models Brian A. Colle 1 and Michael Charles 1,2 1 School of Marine.

Slides:

Advertisements

Similar presentations

Investigating medium-range forecast uncertainty and large error cases along the East coast using ensemble and diagnostic tools  Minghua Zheng, Brian Colle,

Advertisements

New York City Storm Surges: Climatology and An Analysis of the Wind and Cyclone Evolution Dr. Brian A. Colle, Katherine Rojowsky, and F. Bounaiuto School.

Meteorological Evolution and Model Performance for Fire Threat Days Over the Northeast U.S. Joe Pollina 1,2, Brian A. Colle 1, Mike Erickson 1 1 School.

Similar Day Ensemble Post-Processing as Applied to Wildfire Threat and Ozone Days Michael Erickson 1, Brian A. Colle 1 and Joseph J. Charney 2 1 School.

Using ensemble data assimilation to investigate the initial condition sensitivity of Western Pacific extratropical transitions Ryan D. Torn University.

Qualitative Verification of the Operational GFS and the Ensemble Mean 12UTC 13 March 2003 Serena Chew.

Application of Numerical Model Verification and Ensemble Techniques to Improve Operational Weather Forecasting. Northeast Regional Operational Workshop.

Validation of Storm Surge Models for the New York Bight and Long Island Regions and the Impact of Ensembles Tom Di Liberto Dr. Brian A. Colle Stony Brook.

The Collaborative Effort Between Stony Brook University and the National Weather Service Part 3 – Integration of Mesoscale Models in Operational Weather.

East Coast vs. West Coast: A Documentation of Model Forecast Failures for Eta, NAM, GFS, GEM, and ECMWF Garrett Wedam Lynn McMurdie, Cliff Mass.

United States Coast Guard 1985 Evaluation of a Multi-Model Storm Surge Ensemble for the New York Metropolitan Region Brian A. Colle Tom Di Liberto Stony.

Evaluation of a Mesoscale Short-Range Ensemble Forecasting System over the Northeast United States Matt Jones & Brian A. Colle NROW, 2004 Institute for.

CSTAR Update: New Tools for More Efficient Use of Ensembles in Operations Brian A. Colle, Minghua Zheng, and Edmund K.M. Chang, School of Marine and Atmospheric.

The Blizzard Discussion 1.Summary Discussion a. Medium Range Issues (Days 4-7) b. Short-Range Issues c. Ensemble trends d. Upstream differences.

Ensemble Post-Processing and it’s Potential Benefits for the Operational Forecaster Michael Erickson and Brian A. Colle School of Marine and Atmospheric.

The Impact of GPS Radio Occultation Data on the Analysis and Prediction of Tropical Cyclones Bill Kuo UCAR.

Coastal Meteorology and Atmospheric Prediction (COMAP) Research at Stony Brook University Michael Erickson, Brian A. Colle, Sara Ganetis, Nathan Korfe,

“1995 Sunrise Fire – Long Island” Using an Ensemble Kalman Filter to Explore Model Performance on Northeast U.S. Fire Weather Days Michael Erickson and.

Climatology and Predictability of Cool-Season High Wind Events in the New York City Metropolitan and Surrounding Area Michael Layer School of Marine and.

Phillip Bothwell Senior Development Meteorologist-Storm Prediction Center 3 rd Annual GOES-R GLM Science Meeting Dec. 1, 2010 Applying the Perfect Prog.

Towards the Usage of Post-processed Operational Ensemble Fire Weather Indices over the Northeast United States Michael Erickson 1, Brian A. Colle 1, and.

Forecast Skill and Major Forecast Failures over the Northeastern Pacific and Western North America Lynn McMurdie and Cliff Mass University of Washington.

Improvements in Deterministic and Probabilistic Tropical Cyclone Wind Predictions: A Joint Hurricane Testbed Project Update Mark DeMaria and Ray Zehr NOAA/NESDIS/ORA,

“Nature Run” Diagnostics Thomas Jung ECMWF. Another “Nature Run” A large set of seasonal T L 511L91 integrations has been carried out for many summers.

Evaluation of AMPS Forecasts Using Self-Organizing Maps (SOMs) John J. Cassano Cooperative Institute for Research in Environmental Science and Program.

ATM 401/501 Status of Forecasting: Spring Forecasting at NCEP Environmental Modeling Center Ocean Prediction Center.

The Development of a Wave Packet Tracking Algorithm: Preliminary Climatological and Model Verification Results Matthew Souders, Brian Colle, Edmund Chang.

In this study, HWRF model simulations for two events were evaluated by analyzing the mean sea level pressure, precipitation, wind fields and hydrometeors.

Forecast Pressure. Pressure Observations ASOS is the best…the gold standard Ships generally the worst.

Vaisala/University of Washington Real-observation Experiments Vaisala/University of Washington Real-observation Experiments Clifford Mass, Gregory Hakim,

Modification of GFS Land Surface Model Parameters to Mitigate the Near- Surface Cold and Wet Bias in the Midwest CONUS: Analysis of Parallel Test Results.

Upgrades to the GFDL/GFDN Operational Hurricane Models Planned for 2015 (A JHT Funded Project) Morris A. Bender, Matthew Morin, and Timothy Marchok (GFDL/NOAA)

1 Results from Winter Storm Reconnaissance Program 2008 Yucheng SongIMSG/EMC/NCEP Zoltan TothEMC/NCEP/NWS Sharan MajumdarUniv. of Miami Mark ShirleyNCO/NCEP/NWS.

1 Results from Winter Storm Reconnaissance Program 2007 Yucheng SongIMSG/EMC/NCEP Zoltan TothEMC/NCEP/NWS Sharan MajumdarUniv. of Miami Mark ShirleyNCO/NCEP/NWS.

The “Ambrose” (New York Bight) Jet: Climatology and Simulations of Coastally Enhanced Winds Brian A. Colle School of Marine and Atmospheric Sciences, Stony.

Phillip Bothwell Southern Thunder 2011 Workshop July 13, 2011 Multi-Model Lightning Prediction.

Use of Mesoscale Ensemble Weather Predictions to Improve Short-Term Precipitation and Hydrological Forecasts Michael Erickson 1, Brian A. Colle 1, Jeffrey.

A JHT FUNDED PROJECT GFDL PERFORMANCE AND TRANSITION TO HWRF Morris Bender, Timothy Marchok (GFDL) Isaac Ginis, Biju Thomas (URI)

Insights from CMC BAMS, June Short Range The SPC Short-Range Ensemble Forecast (SREF) is constructed by post-processing all 21 members of the NCEP.

Possible North Atlantic extratropical cyclone activity in a warmer climate Lanli Guo William Perrie Zhenxia Long Montreal 2012 Bedford Institute of Oceanography,

Ensemble variability in rainfall forecasts of Hurricane Irene (2011) Molly Smith, Ryan Torn, Kristen Corbosiero, and Philip Pegion NWS Focal Points: Steve.

Predictability of High Impact Weather during the Cool Season over the Eastern U.S: CSTAR Operational Aspects Matthew Sardi and Jeffrey Tongue NOAA/NWS,

Predictability of High Impact Weather during the Cool Season: CSTAR Update and the Development of a New Ensemble Sensitivity Tool for the Forecaster Brian.

An Investigation of the Mesoscale Predictability over the Northeast U.S.        Brian A. Colle, Matthew Jones, and Joseph Olson Institute for Terrestrial.

Dynamic Hurricane Season Prediction Experiment with the NCEP CFS CGCM Lindsey Long and Jae Schemm Climate Prediction Center / Wyle IS NOAA/NWS/NCEP October.

Do the NAM and GFS have displacement biases in their MCS forecasts? Charles Yost Russ Schumacher Department of Atmospheric Sciences Texas A&M University.

Application of T382 CFS Forecasts for Dynamic Hurricane Season Prediction J. Schemm, L. Long, S. Saha and S. Moorthi NOAA/NWS/NCEP October 21, 2008 The.

Dynamic Hurricane Season Prediction Experiment with the NCEP CFS Jae-Kyung E. Schemm January 21, 2009 COLA CTB Seminar Acknowledgements: Lindsey Long Suru.

Impacts of Rossby Wave Packets on Forecast Uncertainties and Errors

Exploring Multi-Model Ensemble Performance in Extratropical Cyclones over Eastern North America and the Western Atlantic Ocean Nathan Korfe and Brian A.

Improved Statistical Intensity Forecast Models: A Joint Hurricane Testbed Year 2 Project Update Mark DeMaria, NOAA/NESDIS, Fort Collins, CO John A. Knaff,

On the Challenges of Identifying the “Best” Ensemble Member in Operational Forecasting David Bright NOAA/Storm Prediction Center Paul Nutter CIMMS/Univ.

The South American Monsoon System: Recent Evolution and Current Status Update prepared by Climate Prediction Center / NCEP 20 December 2010 For more information,

NCEP CMC ECMWF MEAN ANA BRIAN A COLLE MINGHUA ZHENG │ EDMUND K. CHANG Applying Fuzzy Clustering Analysis to Assess Uncertainty and Ensemble System Performance.

Forecasting Oceanic Cyclones at the NOAA Ocean Prediction Center Joseph M. Sienkiewicz, D. Scott Prosise, and Anthony Crutch NOAA/NWS/NCEP/Ocean Prediction.

Forecast Pressure. Pressure Observations ASOS is the best…the gold standard Ships generally the worst.

1 A review of CFS forecast skill for Wanqiu Wang, Arun Kumar and Yan Xue CPC/NCEP/NOAA.

2. WRF model configuration and initial conditions  Three sets of initial and lateral boundary conditions for Katrina are used, including the output from.

Raising the Forecast Bar: Can the Forecast Community Keep Up With Rising Expectations? “Where America’s Climate, Weather and Ocean Services Begin” Dr.

Hemispheric Evolution and Origin of Extra-tropical Cyclone Errors Within NCEP Operational Models Brian A. Colle 1 and Michael Charles 1,2 1 School of Marine.

By Nicholas Leonardo Advisor: Brian Colle

Course Evaluation Now online You should have gotten an with link.

Course Evaluation Now online You should have gotten an with link.

An Analysis of Large Track Error North Atlantic Tropical Cyclones.

High Resolution Simulations of Floyd (1999): Structural Evolution and Responsible Mechanisms for the Heavy Rainfall over the Northeast U.S.   

Development of an Uncertainty Tool to Assess Model Forecast Parameters

A Review of the CSTAR Ensemble Tools Available for Operations

Course Evaluation Now online You should have gotten an with link.

Forecast Pressure.

14th Cyclone Workshop Brian Ancell The University of Washington

Presentation transcript:

An Investigation of Cool Season Extratropical Cyclone Forecast Errors Within Operational Models Brian A. Colle 1 and Michael Charles 1,2 1 School of Marine and Atmospheric Sciences Stony Brook University – SUNY 2 National Centers for Environmental Prediction

Motivation Complete a long-term (5-year) cyclone verification of the operational NCEP GFS and NAM models (several years since the last objective evaluation). What synoptic flow patterns are associated with particular cyclone errors in operational models? What is the impact of using the NCEP Short- Range Ensemble Forecast (SREF) system for cyclone prediction?

Automated Cyclone Verification using NCEP Tracking algorithm (Marchok 2002) fcst mb obs mb fcst mb obs mb fcst mb obs mb

Data Cyclone Events (Oct-Mar ) - GFS (0-120 hr every 6 h) at 80 km grid spacing - Eta/NAM (0-60 h every 6-h) at km grid spacing - Same cyclones and times were used to compare models. Interpolate to common 80-km grid SREF (Oct-Mar ) - 15 members (5 Eta-KF, 5 Eta-BM, 5 RSM) - ~40 km grid spacing (212 grid) - Available at 09 & 21 UTC ( 63 h forecast) - Included 6 SREF WRF members for

NAM-GFS analysis cyclone central pressures for cool seasons Central and Eastern N Amer Western N Amer Pacific W. Atlantic Central and Eastern N Amer Western N Amer Pacific Mean Analysis SLP Error as compared to surface observations for cyclones within 500 km of station Mean Abs Error Mean Error

Cyclone Central Pressure Mean Absolute Errors in mb (18-36 h ) GFS NAM

Cyclone SLP Abs Error versus Fhour By Region NAMGFS E. Pacific Cent N.A. W. Atlantic W. N.A. CP CA

Cyclone Central Pressure Mean Error in mb (48-60 hrs) GFS NAM

Western Atlantic Cyclone Position Errors (42-60 h) NAM GFS All Cyclones Deep (1.5 stnd dev) Cyclones

GFS SLP MAE 12 UTC versus 18 UTC Runs GFS cyclone displacement error (km) for 12 UTC versus 18 UTC Runs E. Pacific W. Atlantic Cent N.A. 18 UTC 12 UTC GFS Atlantic hurricane track error X X X X X X X X GFS Atlantic hurricane track error * * GFS extra-tropical (Mullen and Smith 1993)

Cyclone SLP Abs Error in mb (48 h) NAM GFS E. Pacific E. US. and W Atl Central U.S.

Cyclone Displacement Error in km (48-h) NAM GFS E. Pacific W. Atlantic

GFS Median Range Mean Absolute SLP Error (970 mb) (990 mb) (992 mb) (975 mb) (973 mb) ALL CYCLONES DEEP CYCLONES (> 1.5 stnd dev) E. Pacific W. Atlantic E. N.A. Cent N.A. W. N.A. E. Pacific W. Atlantic E. N.A. W. N.A. Cent N.A.

GFS Median Range Mean SLP Error (Deep storms) ( 970 mb) (990 mb) (992 mb) (975 mb) (973 mb) E. Pacific W. Atlantic E. N.A. W. N.A. Cent N.A.

96-h GFS forecast (12z 16 Jan 2004)

Hour 72 Hour 30 Hour 96 Random Error DaysLarge Error E. Pac (>1.5 std dev)

GFS Large Error Cyclone Events for 48-h (Regions 5,6) GFS negative SLP error (1.5 std dev > mean error, or < -5.1 mb) GFS positive SLP error (1.5 std dev > mean error, or > 4.5 mb) Model pressure tendency error (mb/6h)

SREF and GFS/NAM Displacement Error (W. Atlantic) SREF and GFS/NAM Central Pressures Mean Absolute Error (W. Atl) GFS SREF NAM GFS SREF NAM

51-h SREF (valid ) X X X EKF EBM RSM NAM GFS OBS -10 to 0 mb 0 to 10 mb 10 to 20 mb

Rank Histogram of cyclone central pressure and best member likelihood percentage (W. Atlantic) RSM Eta-KFEta-BM Hours 33-45

Conclusions GFS analysis for cyclones is significantly better than the NAM or NARR, especially over the oceanic regions. The NAM and NARR cyclones are too weak on average. GFS cyclone forecasts have more skill than the NAM in all regions. NAM cyclones are too weak over the E. Pacific on average. By hour 84, W. Atlantic errors become comparable to the E. Pacific and the errors become greater than E. Pacific for deeper cyclones. The 09/21z SREF has larger cyclone MAEs than the deterministic GFS and slightly less than NAM. The SREF pressures tends to be overdispersed in many locations. Some model cyclone biases for the eastern U.S. may favor specific storm tracks. Large cyclone errors over the E. Pacific can impact the western Atlantic 2-3 days later.

EXTRA SLIDES

Cyclone Identification (NCEP Approach) SLP field from grib file Locate grid point with lowest SLP Try to find 2mb closed isobar Mask out cyclone and repeat Same used at NCEP -

Cool Season Cyclone Numbers per 2.5 o grid