A New Approach to Tornado Warning Guidance Algorithms

Slides:



Advertisements
Similar presentations
The use of Doppler radar products for nowcasting tornadoes DWD workshop on tornado forecasting, February 24th 2005, Langen 1. introduction 2. products.
Advertisements

Chapter 13 – Weather Analysis and Forecasting
V-1 Part V: Collaborative Signal Processing Akbar Sayeed.
Build 10 Tornado Detection Algorithm The Build 9 Tornado Vortex Signature ( TVS ) Detection Algorithm was not very robust, and was designed to be a place.
Radar Climatology of Tornadoes in High Shear, Low CAPE Environments in the Mid-Atlantic and Southeast Jason Davis Matthew Parker North Carolina State University.
Tornado Detection Algorithm (TDA) By: Jeffrey Curtis and Jessica McLaughlin.
Travis Smith (OU/CIMMS) February 25–27, 2015 National Weather Center
Ranga Rodrigo April 5, 2014 Most of the sides are from the Matlab tutorial. 1.
Ensemble Numerical Prediction of the 4 May 2007 Greensburg, Kansas Tornadic Supercell using EnKF Radar Data Assimilation Dr. Daniel T. Dawson II NRC Postdoc,
Toward a 4D Cube of the Atmosphere via Data Assimilation Kelvin Droegemeier University of Oklahoma 13 August 2009.
CSC321: Neural Networks Lecture 2: Learning with linear neurons Geoffrey Hinton.
Data Mining Practical Machine Learning Tools and Techniques Chapter 4: Algorithms: The Basic Methods Section 4.6: Linear Models Rodney Nielsen Many of.
Henry Fuelberg Pete Saunders Pendleton, Oregon Research Region Map Types and Lightning Frequencies.
20 Sep 2002 Storm-scale Vortex Detection and Diagnosis Real-Time Mining of Integrated Weather Information Meeting 20 September 2002 Real-Time.
Exploiting Context Analysis for Combining Multiple Entity Resolution Systems -Ramu Bandaru Zhaoqi Chen Dmitri V.kalashnikov Sharad Mehrotra.
TOP CWA Golf Ball Size Hail Study Bill Gargan WFO TOP, KS.
Doppler Weather Radar Algorithms
NSF Medium ITR Real-Time Mining of Integrated Weather Information Setup meeting (Aug. 30, 2002)
The Ingredients Based Tornado Parameter Matt Onderlinde.
NOAA Hazardous Weather Test Bed (SPC, OUN, NSSL) Objectives – Advance the science of weather forecasting and prediction of severe convective weather –
Convective Storm Forecasting 1-6 Hours Prior to Initiation Dan Lindsey and Louie Grasso NOAA/NESDIS/STAR/RAMMB and CIRA, Fort Collins, CO John Mecikalski,
Object-oriented verification of WRF forecasts from 2005 SPC/NSSL Spring Program Mike Baldwin Purdue University.
NOAA-MDL Seminar 7 May 2008 Bob Rabin NOAA/National Severe Storms Lab Norman. OK CIMSS University of Wisconsin-Madison Challenges in Remote Sensing to.
THE BARON TORNADO INDEX (BTI)
Spatial Verification Methods for Ensemble Forecasts of Low-Level Rotation in Supercells Patrick S. Skinner 1, Louis J. Wicker 1, Dustan M. Wheatley 1,2,
Jidong Gao, Kristin Kuhlman, Travis Smith, David Stensrud 3DVAR Storm-scale assimilation in real- time.
CI VERIFICATION METHODOLOGY & PRELIMINARY RESULTS
Brian Lukoff Stanford University October 13, 2006.
Greg Stumpf Hazardous Weather Forecasts & Warnings Advanced Storm Visualization Techniques.
Test of Supercell Propagation Theory Using Data from VORTEX 95 Huaqing Cai NCAR/ASP/ATD.
Downscaling Global Climate Model Forecasts by Using Neural Networks Mark Bailey, Becca Latto, Dr. Nabin Malakar, Dr. Barry Gross, Pedro Placido The City.
Machine Learning Lecture 1: Intro + Decision Trees Moshe Koppel Slides adapted from Tom Mitchell and from Dan Roth.
The 1 November 2004 tornadic QLCS event over southwest Illinois Ron W. Przybylinski Science and Operations Officer National Weather Service – St. Louis.
Neural networks (2) Reminder Avoiding overfitting Deep neural network Brief summary of supervised learning methods.
11 Short-Range QPF for Flash Flood Prediction and Small Basin Forecasts Prediction Forecasts David Kitzmiller, Yu Zhang, Wanru Wu, Shaorong Wu, Feng Ding.
Travis Smith U. Of Oklahoma & National Severe Storms Laboratory Severe Convection and Climate Workshop 14 Mar 2013 The Multi-Year Reanalysis of Remotely.
Investigations of Using TAMDAR Soundings in the NCAR Auto-Nowcaster H. Cai, C. Mueller, E. Nelson, and N. Rehak NCAR/RAL.
Software Defects Cmpe 550 Fall 2005
Chapter 8 Raster Analysis.
Machine Learning for Computer Security
CAPS Radar QC and Remapping
CSC2535: Computation in Neural Networks Lecture 11 Extracting coherent properties by maximizing mutual information across space or time Geoffrey Hinton.
Deep Feedforward Networks
Lightning Flashes in Alabama Tornadic Supercells on 27 April 2011
CS 9633 Machine Learning Inductive-Analytical Methods
Reading: Pedro Domingos: A Few Useful Things to Know about Machine Learning source: /cacm12.pdf reading.
Classification with Perceptrons Reading:
Presented by Pat McCarthy Prairie and Arctic Storm Prediction Centre
High resolution radar data and products over the Continental United States National Severe Storms Laboratory Norman OK, USA.
Automatic Picking of First Arrivals
A Real-Time Automated Method to Determine Forecast Confidence Associated with Tornado Warnings Using Spring 2008 NWS Tornado Warnings John Cintineo Cornell.
Data Mining Lecture 11.
An overview by: Thomas Jones December 2, 2002
University College London (UCL), UK
Students: Meiling He Advisor: Prof. Brain Armstrong
Baselining PMU Data to Find Patterns and Anomalies
Automated Extraction of Storm Characteristics
Tornado Warning Verification and its Relationship to Storm Type
Analysis of the Wind Resource off New Jersey for Offshore Wind Energy Development Hugh Roarty, Joe Riscica, Laura Palamara, Louis Bowers, Greg Seroka,
Post Processing.
The 2008 Artificial Intelligence Competition
A Real-Time Learning Technique to Predict Cloud-To-Ground Lightning
3.1.1 Introduction to Machine Learning
A Neural Network for Detecting and Diagnosing Tornadic Circulations
Aiding Severe Weather Forecasting
Inferential Statistics
Neural networks (1) Traditional multi-layer perceptrons
Artificial Intelligence 10. Neural Networks
Identifying Severe Weather Radar Characteristics
An introduction to Machine Learning (ML)
Presentation transcript:

A New Approach to Tornado Warning Guidance Algorithms A spatial approach to the prediction of tornadoes. V Lakshmanan, Greg Stumpf, Indra Adrianto 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL) Guidance Algorithms Guidance Algorithms should Alert a NWS forecaster to storms and environments that are likely to produce tornadoes. Synthesize information from a variety of sources (radar, model, surface observations, etc.) to provide concise information. Augment the forecaster’s judgment instead of providing just a single yes/no decision. Current guidance algorithms fail on all three counts to different degrees. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Current guidance algorithms TDA The Tornado-Vortex Detection Algorithm (TDA) attempts to detect tight shear from Doppler radar data. MDA The Mesocyclone detection Algorithm attempts to detection all circulation signatures in Doppler radar data. Surprisingly, the MDA outfitted with a neural network does a better job than the TDA at “detecting” tornadoes. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL) MDA + NSE + NN The MDA detects circulations and finds a number of characteristics of the storm from the radar data. Also from near-storm environment (NSE) data. These characteristics are fed to a NN that is trained to classify circulations as tornadic or non-tornadic. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Problems with current approach Essentially, the MDA and TDA try to detect which circulations are likely to become tornadic. Very hard problem because of radar geometry. Also not exactly what is required in real-life situations. What matters is which town is going to be affected. Doesn’t matter which storm produces the tornado. This also happens to be an easier problem to solve. We need to start out with the aim of predicting tornadoes 30 minutes in advance and develop statistical techniques to do this. Right now, the approach is to develop algorithms and hope it works in a forecasting context. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Why will our approach work? A geographic threat-level is easier to assess. There are many circulations with a storm. Only one of them might produce a tornado. Not important to guess which one will. Classifying detections is hard. This is why the current guidance algorithms perform so poorly. Can make much better use of near storm environment (NSE) information (which is at a more coarse resolution). 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Geographic Threat Level We need to create a grid (of 1km by 1km, maybe coarser) with each point on the grid receiving a threat score that reflects the probability that there will be a tornado at that location in the next 30 minutes. Current tornado warning lead times are only 11 minutes. We could double or triple this by solving this geographic threat problem. It helps that this new formulation is actually more realistic. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

What is a geographic threat field? An interest field that models the threat of a tornado at a particular location within the next 30 minutes. Could look like the picture on the right. Perfect guidance either for county-based or polygon-based warnings. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL) What will go into it? We will develop this threat field using statistically valid principles. Use fields derived from multiple radars, models and surface observations to come up with a single threat field. Azimuthal shear Divergence Time-continuity of high shear Radar reflectivity CAPE level Reflectivity at the freezing level Surface temperature, etc. Advect all these values based on storm movement at that location. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Tornado Density (truth field) Use a storm database that has been built at NSSL of tornado ground truth to build a “tornado density” plot. All reported tornadoes in the past 30 minutes advected to location on grid at the current time. With a radius of influence (probably around 5km). What’s shown is actually a lightning source density plot created using the same principles. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL) Training inputs Use information from various WDSS-II algorithms as inputs to this training. A few potential inputs are shown in the following slides. Do this for about 30 different storm cases, and we will have training data (a set of inputs, with the tornado density field providing the desired output). Initially simply devise a linear regression mapping from one to the other. If promising, we can use more sophisticated methods such as neural networks or support vector machines. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Potential input: low-level shear Azimuthal shear Find shear on individual radars. Combine shear from multiple radars Gets around radar geometry problems. Covers entire grid. Already do-able. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Potential input: reflectivity at isotherm level Reflectivity at freezing level. Combine reflectivity from multiple radars. Ingest model data to find isotherm height. Find reflectivity at height of isotherm at each point in grid. Already do-able. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Potential input: time-continuity of rotation Compute shear from multiple radars as before. Track regions of high shear across time. Already do-able – it’s already being used to direct damage surveys. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL) In real-time After training the system on the archived data base, compute the same inputs in real-time. Use it to create a tornado threat product. Can be used as tornado warning guidance. Long-term goal: Use after-the-fact damage surveys to continuously train the system to predict tornadoes better. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL) Our approach Combine radar data from multiple radars into a uniform spatial grid (lat-lon). Create a candidate field by combining this information. Use this candidate field, along with features derived from all inputs to predict tornado activity in that area. Train using 30-minute truth to get a 30-minute lead-time. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL) Tornado Ground Truth Use ground truth data base that has been corrected in time and space. Map the tornado reports to the earth’s surface, with a 5km radius. Put all tornado reports and radar signatures leading to reports (?) between T and T+30 This is the target for the prediction technique. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Inputs to candidate field Azimuthal shear: a least-squares minimization technique on Velocity. ReflectivityQC: a neural network on Reflectivity. The candidate field is based on this idea: Tornadoes are possible when radar shows tight reflectivity gradients, changes in the directionality of shear and high-reflectivity cores nearby. OU Master’s students found high correlation between areas having all of high reflectivity, high positive shear and high negative shear and tornado activity (23 cases). 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Reflectivity Morphology Reflectivity field dilated and eroded. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Reflectivity gradient Left: Sobel operation on reflectivity (local gradient operation). Right: Large changes in reflectivity (morphological operation) 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL) Shear morphology Morphological operations on the shear field. Left: Areas close to high negative shear Right: Areas close to high positive shear 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Tornado Possibility Field Left: Resulting tornado possibility field: a weighted combination of the morphological fields. Right: Comparison with ground truth field. Finds all the tornadoes. Relatively high false-alarm rate – can not be used directly for prediction. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Simulation of the Algorithm, May 4, 1999, from KTLX Radar Datacase (1) Tornado Density Plot and Tornado Possibility Algorithm at 01:11:00 UTC Reflectivity (0.5 deg) at 01:06:58 UTC 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Simulation of the Algorithm, May 4, 1999, from KTLX Radar Datacase (2) Tornado Density Plot and Tornado Possibility Algorithm at 01:41:00 UTC Reflectivity (0.5 deg) at 01:36:45 UTC 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Simulation of the Algorithm, May 4, 1999, from KTLX Radar Datacase (3) Tornado Density Plot and Tornado Possibility Algorithm at 02:11:00 UTC Reflectivity (0.5 deg) at 02:06:29 UTC 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Simulation of the Algorithm, May 4, 1999, from KTLX Radar Datacase (4) Tornado Density Plot and Tornado Possibility Algorithm at 02:45:00 UTC Reflectivity (0.5 deg) at 02:41:10 UTC 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Simulation of the Algorithm, May 4, 1999, from KTLX Radar Datacase (5) Tornado Density Plot and Tornado Possibility Algorithm at 03:15:00 UTC Reflectivity (0.5 deg) at 03:10:55 UTC 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)

Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL) Where do we go from here? Question: How to get past history? Project backwards, and use local neighborhood measures. Question: How to get past/future spatial location? A linear extrapolation suffices for the 30-minute problem. Clustering and Kalman filter technique already available. Research Areas: Extract candidates field (can be improved). Devise features to be presented to classification engine. Training of classification engine. Can we perform classification spatially? Question: How to predict? Predict directly on spatial field (grid-point by grid-point) Predict cluster-by-cluster. 5/1/2019 Valliappa.Lakshmanan@noaa.gov (NSSL); Gregory Stumpf (MDL)