Eye-tracking during the Forecaster Warning Decision Process: A Pilot Experiment Katie Bowden OU CIMMS/School of Meteorology, Ph.D. Student Pam Heinselman.

Slides:

Advertisements

Similar presentations

The use of Doppler radar products for nowcasting tornadoes DWD workshop on tornado forecasting, February 24th 2005, Langen 1. introduction 2. products.

Advertisements

1 Ground Based Meteorological Radars Presented By: David Franc NOAAs National Weather Service September 2005.

Summary Human Dimensions Panel John Gaynor NOAA August 12,

Pam Heinselman NOAA National Severe Storms Laboratory Warn on Forecast Workshop 8 Feb 2012 Exploring the Impact of Rapid-scan Radar Data on NWS Warnings.

National Weather Association 31 st Annual Meeting 18 October 2006 Cleveland, Ohio Kevin Scharfenberg University of Oklahoma Cooperative Institute for Mesoscale.

The Areal Mean Basin Estimated Rainfall (AMBER) Program A Tool to Assist in Flash Flood Forecasting Ami Arthur Cooperative Institute for Mesoscale Meteorological.

Collaborative Adaptive Sensing of the Atmosphere: End User and Social Integration 2009 American Meteorological Association Summer Community Meeting Walter.

February 17-19, 2009 National Weather Center Norman, Oklahoma February 17-19, 2009 National Weather Center Norman, Oklahoma National Severe Storms Laboratory.

© Crown copyright Met Office Enhanced rainfall services Paul Davies.

CS CS 5150 Software Engineering Lecture 12 Usability 2.

Update On The NEXRAD Agency Plans For Near Real-Time WSR-88D Base Data Collection And Distribution Tim Crum, Ph.D. Radar Operations Center (ROC) NWS Focal.

Mesoscale Observations in Hurricanes Robert Houze University of Washington First US-China Symposium on Meteorology, Norman, Oklahoma, 26 February 2008.

FORECASTING EASTERN US WINTER STORMS Are We Getting Better and Why? Jeff S. Waldstreicher NOAA/NWS Eastern Region Scientific Services Division – Bohemia,

Travis Smith (OU/CIMMS) February 25–27, 2015 National Weather Center

World Meteorological Organization Working together in weather, climate and water NextGen Update WMO; CAeMwww.wmo.int WMO.

CASA – Collaborative Adaptive Sensing of the Atmosphere NWRT/PAR – National Weather Radar Testbed / Phased Array Radar Kurt D. Hondl DOC/NOAA/OAR National.

Surveillance Weather Radar 2000 AD. Weather Radar Technology- Merits in Chronological Order WSR-57 WSR-88D WSR-07PD.

The National Severe Storms Laboratory Jeff Kimpel, Director NSSL NOAA Science Advisory Board Norman, Oklahoma November 5, 2002.

Sebastián Torres Weather Radar Research Innovative Techniques to Improve Weather Observations.

Mr. Samuel P. Williamson Federal Coordinator for Meteorology Sponsored by: The Office of the Federal Coordinator for Meteorological Services and Supporting.

Challenges in Urban Meteorology: A Forum for Users and Providers OFCM Panel Summaries Bob Dumont Senior Staff Meteorologist OFCM.

Warn on Forecast Briefing September 2014 Warn on Forecast Brief for NCEP planning NSSL and GSD September 2014.

WSR‐88D Dynamic Scanning

Cognitive demands of hands-free- phone conversation while driving Professor : Liu Student: Ruby.

Forecasting in a Changing Climate Harold E. Brooks NOAA/National Severe Storms Laboratory (Thanks to Andy Dean, Dave Stensrud, Tara Jensen, J J Gourley,

David Hotz and Anthony Cavallucci National Weather Service, Knoxville/Tri-Cities, Tennessee Geoffrey Stano ENSCO/SPoRT, Huntsville, Alabama Tony Reavley.

Charleston, SC Weather Forecast Office Frank Alsheimer Science and Operations Officer NWS Charleston, SC.

25 Sept. 2006ERAD2006 Crossbeam Wind Measurements with Phased-Array Doppler Weather Radar Richard J. Doviak National Severe Storms Laboratory Guifu Zhang.

Douglas Forsyth Chief, Radar Research & Development Division, NSSL Critical Skill Shortages Radar Meteorology.

A. FY12-13 GIMPAP Project Proposal Title Page version 27 October 2011 Title: Probabilistic Nearcasting of Severe Convection Status: New Duration: 2 years.

Collaborating on the Development of Warn-On-Forecast Mike Foster / David Andra WFO Norman OK Feb. 18, 2010 Mike Foster / David Andra WFO Norman OK Feb.

Survey of Traffic and Radar Controller Communication and Workload

AWIPS Tracking Point Meteogram Tool Ken Sperow 1,2, Mamoudou Ba 1, and Chris Darden 3 1 NOAA/NWS, Office of Science and Technology, Meteorological Development.

BTV Severe Weather Workshop May 2,  35 minutes – Moving 19kts – 485 km 2.

HWT Spring Forecasting Experiment: History and Success Dr. Adam Clark February 25, 2015 National Weather Center Norman, Oklahoma.

Enhanced Lightning Products and Services for Incident Support Operations through Improved Short Term Forecast Techniques Ben Herzog 1, Matthew Volkmer.

Infrastructure Planning Presentations Summary Determine climate and weather extremes that are crucial in resource management and policy making Intense.

RAdio Detection And Ranging. Was originally for military use 1.Sent out electromagnetic radiation (Active) 2.Bounced off an object and returned to a listening.

1 RADAR OPERATIONS CENTER (ROC) EVALUATION OF THE WSR-88D OPEN RADAR DATA ACQUISITION (ORDA) SYSTEM SIGNAL PROCESSING WSR-88D Radar Operations Center Engineering.

Storm Based Warnings A New Direction in the Warning Process Add Name National Weather Service Add Office.

NSSL’s Warn-on-Forecast Project Dr. Lou Wicker February 25–27, 2015 National Weather Center Norman, Oklahoma.

1 John Ferree Severe Storms Services NOAA National Weather Service NWS Partners Meeting AMS 2009 Annual Meeting Phoenix, AZ January 15, 2009 National Weather.

Weather Event Simulator Best Practices John Ferree Warning Decision Training Branch Norman, OK John Ferree Warning Decision Training Branch Norman, OK.

Geoffrey Stano – ENSCO / SPoRT David Hotz and Anthony Cavalluci– WFO Morristown, TN Tony Reavley – Director of Emergency Services & Homeland Security of.

NOAA Hazardous Weather Test Bed (SPC, OUN, NSSL) Objectives – Advance the science of weather forecasting and prediction of severe convective weather –

1 Spectral identification & suppression of ground clutter contributions for phased array radar Spectral identification of ground clutter Spectral identification.

TWO-YEAR ASSESSMENT OF NOWCASTING PERFORMANCE IN THE CASA SYSTEM Evan Ruzanski 1, V. Chandrasekar 2, and Delbert Willie 2 1 Vaisala, Inc., Louisville,

Matthew A. Dux* Philip N. Schumacher* Ray Wolf+ * National Weather Service – Sioux Falls, SD + National Weather Service – Quad Cities, IA/IL October 21,

Training Framework for Satellite User Readiness in NOAA AMS th Conference on Satellite Meteorology & Oceanography LeRoy Spayd & Anthony Mostek.

Travis Smith Hazardous Weather Forecasts & Warnings Nowcasting Applications.

Applied Meteorology Unit 1 High Resolution Analysis Products to Support Severe Weather and Cloud-to-Ground Lightning Threat Assessments over Florida 31.

1 KURT HONDL, NSSL MPAR PROJECT MANAGER OFCM MPAR WORKING GROUP MEETING 19 JUNE 2012 NOAA/NSSL Activities.

Pam Heinselman Weather Radar Research Evaluation of Phased Array Radar Data via Comparisons to the WSR-88D.

Sarah Callaghan British Atmospheric Data Centre, UK, The effects of climate change on rain The consensus in the climate change.

HWT Experimental Warning Program: History & Successes Darrel Kingfield (CIMMS) February 25–27, 2015 National Weather Center Norman, Oklahoma.

Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Combining GOES Observations with Other Data to Improve Severe Weather Forecasts.

Overview of CBRFC Flood Operations Arizona WFOs – May 19, 2011 Kevin Werner, SCH.

Operational Use of Lightning Mapping Array Data Fifth Meeting of the Science Advisory Committee November, 2009 Geoffrey Stano, Dennis Buechler, and.

CGMS-43-NOAA-WP-04 Coordination Group for Meteorological Satellites - CGMS Status report of the CGMS Socioeconomic Benefits Tiger Team (SETT) Presented.

1 Application of MET for the Verification of the NWP Cloud and Precipitation Products using A-Train Satellite Observations Paul A. Kucera, Courtney Weeks,

AOML Research Review Postmortem Robert Atlas Atlantic Oceanographic and Meteorological Laboratory May 1, 2012 Welcome and introduction.

Travis Smith U. Of Oklahoma & National Severe Storms Laboratory Severe Convection and Climate Workshop 14 Mar 2013 The Multi-Year Reanalysis of Remotely.

Investigations of Using TAMDAR Soundings in the NCAR Auto-Nowcaster H. Cai, C. Mueller, E. Nelson, and N. Rehak NCAR/RAL.

High Resolution Weather Radar Through Pulse Compression

Hydrologic Considerations in Global Precipitation Mission Planning

Radar Observation of Severe Weather

Keith A. Brewster1 Jerry Brotzge1, Kevin W

FORECASTING EASTERN US WINTER STORMS Are We Getting Better and Why?

AGENDA ITEM 4.6: DATA-PROCESSING, MODELLING AND FORECASTING

Aiding Severe Weather Forecasting

Presentation transcript:

Eye-tracking during the Forecaster Warning Decision Process: A Pilot Experiment Katie Bowden OU CIMMS/School of Meteorology, Ph.D. Student Pam Heinselman NOAA/OAR/National Severe Storms Laboratory, Norman, Oklahoma Ziho Kang OU School of Industrial and Systems Engineering Monday 19 October 2015

The Phased Array Radar Innovative Sensing Experiment (PARISE) How will rapidly-updating phased array radar data impact forecasters during their warning decision processes? Current technology: WSR-88D (Weather Surveillance Radar – 1988 Doppler) Radar update time: 4-6 min Potential Future technology: PAR (Phased Array Radar) Radar update time: 1 min

The Phased Array Radar Innovative Sensing Experiment (PARISE) How will rapidly-updating phased array radar data impact forecasters during their warning decision processes? Performance Measures -Accuracy (e.g., POD, FAR) -Lead time Cognitive Process - How temporal resolution affects conceptual models, ability to discern radar signatures, mental effort in interpreting radar data Our focus today

1) View weather briefing and work the case using AWIPS-2 2) Review recorded simulation, produce timeline of decision process (Hoffman 2005) and answer questions on:  Warning decisions  Noticeable impacts of temporal resolution  Cognitive workload Simulated Warning Operations and Retrospective Recall  From the most recent experiment, we collected ~2000 pages of qualitative data from forecasters. But, is there a way to quantify forecasters’ cognitive processes?

Eye-Tracking Experiment Incorporate eye-tracking technology to further develop our understanding of forecasters’ cognitive processes “There is no appreciable lag between what is fixated and what is processed.” (Just and Carpenter 1980)

Pilot Study Goal: Run a short study with one forecaster to see what their eye-tracking data looks like. Does the data make sense?

Eye Tracker Warning Decision Support System Integrated Information Display Reflectivity Velocity Control Panel

Example of Eye Tracking Data Output

Fixation Heatmaps and Distributions Count Duration

As the weather event evolved, how did the forecaster’s cognitive processes change, and was a response to these changes observed in the eye-tracking data?

Comparing Retrospective Recall and Trends

2015 PARISE: Eye-tracking Experiment Experimental Group n=15 Control Group n=15 Work One Case (1 hour duration) 1-min updates5-min updates All participants completed a retrospective recall using a playback video Successful data collections: 12 experimental and 12 control cases

Summary Eye-tracking research is a brand new avenue for PARISE, bringing together the fields of meteorology and human factors. Our pilot study demonstrated capability to obtain eye-tracking data and that such data was useful for understanding forecaster cognitive activity. First presentation of results from our recent experiment will be shared at the AMS Annual Meeting in January Thank you for your time. Any questions?