JEFS Status Report Department of Atmospheric Sciences University of Washington Cliff Mass, Jeff Baars, David Carey JEFS Workshop, August 28-29.

Slides:



Advertisements
Similar presentations
What is a Synoptic Weather Map?
Advertisements

Mesoscale Probabilistic Prediction over the Northwest: An Overview Cliff Mass Adrian Raftery, Susan Joslyn, Tilmann Gneiting and others University of Washington.
Computer Weather Forecasts for Wind Energy Plants Khanh T. Tran AMI Environmental 206 Black Eagle Ave, Henderson, NV 89015(702) http://
Gridded OCF Probabilistic Forecasting For Australia For more information please contact © Commonwealth of Australia 2011 Shaun Cooper.
2012: Hurricane Sandy 125 dead, 60+ billion dollars damage.
1 Kalman filter, analog and wavelet postprocessing in the NCAR-Xcel operational wind-energy forecasting system Luca Delle Monache Research.
Description and Preliminary Evaluation of the Expanded UW S hort R ange E nsemble F orecast System Maj. Tony Eckel, USAF University of Washington Atmospheric.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Quantitative precipitation forecasts in the Alps – first.
Automated Quality Control of Meteorological Observations for MM5 Model Verification Jeff Baars Cliff Mass University of Washington, Seattle, Washington.
Patrick Tewson University of Washington, Applied Physics Laboratory Local Bayesian Model Averaging for the UW ProbCast Eric P. Grimit, Jeffrey Baars, Clifford.
PERFORMANCE OF NATIONAL WEATHER SERVICE FORECASTS VERSUS MODEL OUTPUT STATISTICS Jeff Baars Cliff Mass Mark Albright University of Washington, Seattle,
Update on the Regional Modeling System NASA Roses Meeting April 13, 2007.
Update on the Regional Modeling System NASA Roses Meeting April 13, 2007.
MOS Developed by and Run at the NWS Meteorological Development Lab (MDL) Full range of products available at:
Update on the Northwest Regional Modeling System Cliff Mass, Dave Ovens, Jeff Baars, Mark Albright, Phil Regulski, Dave Carey University of Washington.
Nesting. Eta Model Hybrid and Eta Coordinates ground MSL ground Pressure domain Sigma domain  = 0  = 1  = 1 Ptop  = 0.
Update on the Regional Modeling System Cliff Mass, David Ovens, Richard Steed, Mark Albright, Phil Regulski, Jeff Baars, David Carey Northwest Weather.
Operational Quality Control in Helsinki Testbed Mesoscale Atmospheric Network Workshop University of Helsinki, 13 February 2007 Hannu Lahtela & Heikki.
Exploring the Use of Object- Oriented Verification at the Hydrometeorological Prediction Center Faye E. Barthold 1,2, Keith F. Brill 1, and David R. Novak.
Brian Ancell, Cliff Mass, Gregory J. Hakim University of Washington
Update on the Regional Modeling System Cliff Mass, David Ovens, Richard Steed, Mark Albright, Phil Regulski, Jeff Baars, Eric Grimit.
Transitioning unique NASA data and research technologies to the NWS 1 Evaluation of WRF Using High-Resolution Soil Initial Conditions from the NASA Land.
Boundary Layer Parameterization Issues in the MM5 and Other Models. Cliff Mass, Eric Grimit, Jeff Baars, David Ovens, University of Washington.
Northwest AIRQUEST 12/4/06 Cliff Mass University of Washington.
MOS Performance MOS significantly improves on the skill of model output. National Weather Service verification statistics have shown a narrowing gap between.
Consortium Meeting June 3, Thanks Mike! Hit Rates.
Ensemble Post-Processing and it’s Potential Benefits for the Operational Forecaster Michael Erickson and Brian A. Colle School of Marine and Atmospheric.
Chapter 13 – Weather Analysis and Forecasting. The National Weather Service The National Weather Service (NWS) is responsible for forecasts several times.
Dr. Sarawut NINSAWAT GEO Grid Research Group/ITRI/AIST GEO Grid Research Group/ITRI/AIST Development of OGC Framework for Estimating Near Real-time Air.
“1995 Sunrise Fire – Long Island” Using an Ensemble Kalman Filter to Explore Model Performance on Northeast U.S. Fire Weather Days Michael Erickson and.
Copyright 2012, University Corporation for Atmospheric Research, all rights reserved Verifying Ensembles & Probability Fcsts with MET Ensemble Stat Tool.
Section 4: Forecasting the Weather
National Weather Service Model Flip-Flops and Forecast Opportunities Bernard N. Meisner Scientific Services Division NWS Southern Region Fort Worth, Texas.
A Statistical Comparison of Weather Stations in Carberry, Manitoba, Canada.
Workshop on QC in Derived Data Products, Las Cruces, NM, 31 January 2007 ClimDB/HydroDB Objectives Don Henshaw Improve access to long-term collections.
NREL is a national laboratory of the U.S. Department of Energy Office of Energy Efficiency and Renewable Energy operated by the Alliance for Sustainable.
Forecasting Streamflow with the UW Hydrometeorological Forecast System Ed Maurer Department of Atmospheric Sciences, University of Washington Pacific Northwest.
NOAA’s National Weather Service National Digital Forecast Database: Status Update LeRoy Spayd Chief, Meteorological Services Division Unidata Policy Committee.
Where the Research Meets the Road: Climate Science, Uncertainties, and Knowledge Gaps First National Expert and Stakeholder Workshop on Water Infrastructure.
Chapter 13 Weather Forecasting and Analysis. Weather forecasting by the U.S. government began in the 1870s when Congress established a National Weather.
June 19, 2007 GRIDDED MOS STARTS WITH POINT (STATION) MOS STARTS WITH POINT (STATION) MOS –Essentially the same MOS that is in text bulletins –Number and.
EUROBRISA WORKSHOP, Paraty March 2008, ECMWF System 3 1 The ECMWF Seasonal Forecast System-3 Magdalena A. Balmaseda Franco Molteni,Tim Stockdale.
Latest results in verification over Poland Katarzyna Starosta, Joanna Linkowska Institute of Meteorology and Water Management, Warsaw 9th COSMO General.
Course Evaluation Closes June 8th.
Model Post Processing. Model Output Can Usually Be Improved with Post Processing Can remove systematic bias Can produce probabilistic information from.
Status and Plans of the Global Precipitation Climatology Centre (GPCC) Bruno Rudolf, Tobias Fuchs and Udo Schneider (GPCC) Overview: Introduction to the.
APPLICATION OF NUMERICAL MODELS IN THE FORECAST PROCESS - FROM NATIONAL CENTERS TO THE LOCAL WFO David W. Reynolds National Weather Service WFO San Francisco.
Are Numerical Weather Prediction Models Getting Better? Cliff Mass, David Ovens, and Jeff Baars University of Washington.
Kris Shrestha James Belanger Judith Curry Jake Mittelman Phillippe Beaucage Jeff Freedman John Zack Medium Range Wind Power Forecasts for Texas.
Fly - Fight - Win 2 d Weather Group Mr. Evan Kuchera HQ AFWA 2 WXG/WEA Template: 28 Feb 06 Approved for Public Release - Distribution Unlimited AFWA Ensemble.
Nathalie Voisin 1, Florian Pappenberger 2, Dennis Lettenmaier 1, Roberto Buizza 2, and John Schaake 3 1 University of Washington 2 ECMWF 3 National Weather.
Winter Weather Forecast How Windy Will in Be? Professor Cliff Mass University of Washington.
Of what use is a statistician in climate modeling? Peter Guttorp University of Washington Norwegian Computing Center
10th COSMO General Meeting, Cracow, Poland Verification of COSMOGR Over Greece 10 th COSMO General Meeting Cracow, Poland.
DOWNSCALING GLOBAL MEDIUM RANGE METEOROLOGICAL PREDICTIONS FOR FLOOD PREDICTION Nathalie Voisin, Andy W. Wood, Dennis P. Lettenmaier University of Washington,
DET Module 1 Ensemble Configuration Linda Wharton 1, Paula McCaslin 1, Tara Jensen 2 1 NOAA/GSD, Boulder, CO 2 NCAR/RAL, Boulder, CO 3/8/2016.
1 NWS Digital Services American Meteorological Society Annual Partners Meeting San Diego, CA January 13, 2005 LeRoy Spayd National Weather Service Office.
June 20, 2005Workshop on Chemical data assimilation and data needs Data Assimilation Methods Experience from operational meteorological assimilation John.
Update on the Northwest Regional Modeling System 2013
University of Washington Ensemble Systems for Probabilistic Analysis and Forecasting Cliff Mass, Atmospheric Sciences University of Washington.
Tom Hopson, Jason Knievel, Yubao Liu, Gregory Roux, Wanli Wu
Consortium October 6, 2016.
A Northwest Consortium for Regional Climate Modelling
Model Post Processing.
Mesoscale Probabilistic Prediction over the Northwest: An Overview
Winter storm forecast at 1-12 h range
MOS Developed by and Run at the NWS Meteorological Development Lab (MDL) Full range of products available at:
Post Processing.
Ensemble-4DWX update: focus on calibration and verification
Cliff Mass and David Ovens University of Washington
Presentation transcript:

JEFS Status Report Department of Atmospheric Sciences University of Washington Cliff Mass, Jeff Baars, David Carey JEFS Workshop, August 28-29

Who is working on JEFS at the UW? Atmospheric Sciences Atmospheric Sciences  Cliff Mass-main faculty lead  Jeff Baars-research scientist  David Carey-research scientist  Some assistance from other staff Statistics Statistics  Tilmann Gneiting-main faculty lead.  McClean Sloughter-grad student working on precip and wind bma  Chris Fraley-staff, software support  Some assistance from Adrian Raftery-Prof--Mr. BMA

The Two Basic Requirements for Post Processing of JEFS Forecasts are: Quality controlled observational data for the region of interest of all necessary parameters Quality controlled observational data for the region of interest of all necessary parameters Reliable JME grids for several months at least. Reliable JME grids for several months at least.

Acquiring and QCing JEFS Obs Data Not in the Statement of Work (SOW), but a critical requirement for JEFS. Not in the Statement of Work (SOW), but a critical requirement for JEFS. Developed a robust QC system at the UW that has been tested over the last year and recently transferred to AFWA. Developed a robust QC system at the UW that has been tested over the last year and recently transferred to AFWA.

UW Observation Quality Control System Range Check   A simple gross error check to make sure the observation is within a reasonable range. Step Check   Looks for "spikes" in an station's time series for a given variable. Persistence Check   Looks for variables that are not changing over extended periods, indicative a failed or frozen sensor. Spatial Check   Compares each observation to those of surrounding stations. Specifically, designed to handle areas of complex terrain-like Korea and the NW U.S.

Quality Control Display and Warning System This system is now working on the UW Northwest test bed for a heterogeneous collection of roughly 70 different networks. This system is now working on the UW Northwest test bed for a heterogeneous collection of roughly 70 different networks. View it in real time at: View it in real time at:

JEFS Observations Recently began receiving observations for 3-, 6-, and 12-hr precipitation. Recently began receiving observations for 3-, 6-, and 12-hr precipitation.  …in addition to temperature, dew point, altimeter, sea level pressure, wind speed and direction. Now receiving Korean Mesonet Data. Now receiving Korean Mesonet Data. Format of obs still being adjusted… Format of obs still being adjusted…

Forecast Verification Another major issue is to have forecast verification code running operationally, since that is essential infrastructure for post- processing. Another major issue is to have forecast verification code running operationally, since that is essential infrastructure for post- processing. UW has developed code called “verobs” which is being transferred to AFWA UW has developed code called “verobs” which is being transferred to AFWA

UW-to-AFWA Code Transfers for QC and forecast verification Observations Quality Control Fortran code transferred to Scott Rentschler at AFWA, March Observations Quality Control Fortran code transferred to Scott Rentschler at AFWA, March  AFWA needs to use this software to flag and remove observations from the collection we are receiving. Forecast verification Fortran code, “verobs,” transferred to Scott Rentschler at AFWA, August Forecast verification Fortran code, “verobs,” transferred to Scott Rentschler at AFWA, August 2007.

Next Item: Bias Correction Software Development and Transfer to AFWA As noted many times in the past, bias correction substantially improves probabilistic prediction since systematic bias does not represent true uncertainty. As noted many times in the past, bias correction substantially improves probabilistic prediction since systematic bias does not represent true uncertainty.

Bias Correction of T2 and TD2 Have bias correction running in real-time for 2-m temperature and 2-m dew point temperature for the UW Mesoscale Ensemble System (UWME). Have bias correction running in real-time for 2-m temperature and 2-m dew point temperature for the UW Mesoscale Ensemble System (UWME).  Uses optimized settings.  Have gotten this running on the JME/WRF output as well, using “older generation” JME model data.  Results shown at JEFS technical meeting, Sep  Ready to transfer code to AFWA.

Bias Correction of PCP12 Have developed bias correction settings for 12-hr precipitation for the UWME. Have developed bias correction settings for 12-hr precipitation for the UWME.  As with T2 and TD2, settings were determined through an optimization process.  Removed land use in gridpoint – to – obs matching; using bins for precipitation amount  Included in Weather and Forecasting paper, along with T2 and TD2.  Results look good…

MetricUncorrected Bias Corrected Mean Absolute Error (inches) Mean Error (inches) Help Fraction N/A0.133 Hurt Fraction N/A0.047 Results: Bias Corrected PCP12, forecast hour 48, 2004-July to June, using UWME system

Daily Domain Averaged ME for PCP12, f48, December 2004 Daily Domain Averaged MAE for PCP12, f48, December 2004

Daily Domain Averaged ME for PCP12, f48, October 2004 Daily Domain Averaged MAE for PCP12, f48, October 2004

Local Bias Correction of DIR10 and SPD10 Currently working on 10-m winds. Currently working on 10-m winds.  As with T2 and TD2, a statistically significant correlation between model error and land use appears to exist, especially for wind speed.

Next Issue: Transferring BMA to AFWA Local BMA for temperature is now working operationally over the Northwest and is ready to be transferred to AFWA. FORTRAN Code. Local BMA for temperature is now working operationally over the Northwest and is ready to be transferred to AFWA. FORTRAN Code. Same approach can be used for dew point temperature. Same approach can be used for dew point temperature. Global BMA is working for precipitation. Currently written in “r” and must be converted to FORTRAN before it can be transferred to AFWA (Jeff Baars is doing this now). Global BMA is working for precipitation. Currently written in “r” and must be converted to FORTRAN before it can be transferred to AFWA (Jeff Baars is doing this now). Local BMA for precipitation and BMA for wind has been an area of active work between atmos sci and statistic and prototypes are working, but still being improved and evaluated. The next talk will describe this more. Local BMA for precipitation and BMA for wind has been an area of active work between atmos sci and statistic and prototypes are working, but still being improved and evaluated. The next talk will describe this more.

We have continued to maintain and improve PROBCAST Probcast is our attempt to package uncertainty data in a form accessible to laymen and less experienced forecasters. Probcast is our attempt to package uncertainty data in a form accessible to laymen and less experienced forecasters. A version of probcast will be adapted for DOD use when the underlying JEFS system is in place. A version of probcast will be adapted for DOD use when the underlying JEFS system is in place. Are now extending the verification of Probcast over the NW. Are now extending the verification of Probcast over the NW.

Before Probcast: The BMA Site

PROBCAST

Verification of Probcast temperatures web tool

Next: McClean Sloughter, UW Statistics