Analysis of Eye Movement Data Frank M. Marchak, Ph.D. Veridical Research and Design Corporation www.vradc.com.

Slides:



Advertisements
Similar presentations
BARRY DAUPHIN, PH.D. HAROLD GREENE, PH.D. MINDEE JUVE, M.A. Cognitive Mediation and Information Processing on the Rorschach.
Advertisements

Introduction to Eye Tracking
Why do we move our eyes? - Image stabilization
Visual Attention Attention is the ability to select objects of interest from the surrounding environment A reliable measure of attention is eye movement.
Chapter 6: Visual Attention. Overview of Questions Why do we pay attention to some parts of a scene but not to others? Do we have to pay attention to.
Voluntary attention increases the phenomenal length of briefly flashed lines Masin S. C. University of Padua.
Eye Movements of Younger and Older Drivers Professor: Liu Student: Ruby.
Probabilistic Modeling of Molecular Evolution Using Excel, AgentSheets, and R Jeff Krause (Shodor)
Saccadic eye movements cause compression of time as well as space Concetta Morrone, Ross & Burr.
Toward Fully Automated Person- Independent Detection of Mind Wandering Robert Bixler & Sidney D’Mello University of Notre Dame July 10,
Spring 2003Data Mining by H. Liu, ASU1 7. Sequence Mining Sequences and Strings Recognition with Strings MM & HMM Sequence Association Rules.
PS: Introduction to Psycholinguistics Winter Term 2005/06 Instructor: Daniel Wiechmann Office hours: Mon 2-3 pm Phone:
Image Retrieval Using Eye Movements Fred Stentiford & Wole Oyekoya University College London.
Gazing the screens Using eye-tracking for evaluating visually complex TV programming Author: Amund Berg Supervisor: Frode Volden Gjøvik University College.
Representation of statistical properties 作 者: Sang Chul Chong, Anne Treisman 報告者:李正彥 日 期: 2006/3/23.
Distance Functions for Sequence Data and Time Series
Baysian Approaches Kun Guo, PhD Reader in Cognitive Neuroscience School of Psychology University of Lincoln Quantitative Methods 2011.
Towards a stochastic theory of saccadic eye movement GURU Oct 1, 2001 Jonathan Nelson.
A String Matching Approach for Visual Retrieval and Classification Mei-Chen Yeh* and Kwang-Ting Cheng Learning-Based Multimedia Lab Department of Electrical.
Introduction To know how perceptual and attentional processes and properties of words guide the eyes through a sentence, the following issues are particularly.
The Detection of Driver Cognitive Distraction Using Data Mining Methods Presenter: Yulan Liang Department of Mechanical and Industrial Engineering The.
Dr. Neil H. Schwartz.  Visualization refer to the 2D and 3D static and animated visual displays that depict conditions, situations, processes, places.
Eyes Alive Sooha Park - Lee Jeremy B. Badler - Norman I. Badler University of Pennsylvania - The Smith-Kettlewell Eye Research Institute Presentation Prepared.
Chapter 5 Human Stereopsis, Fusion, and Stereoscopic Virtual Environments.
Eye movements: Lab # 1 - Catching a ball. How do we use our eyes to catch balls? What information does the brain need? Most experiments look at simple.
1 Perception and VR MONT 104S, Fall 2008 Session 13 Visual Attention.
7/03Data Mining – Sequences H. Liu (ASU) & G Dong (WSU) 1 7. Sequence Mining Sequences and Strings Recognition with Strings MM & HMM Sequence Association.
TAUCHI – Tampere Unit for Computer-Human Interaction Visualizing gaze path for analysis Oleg Špakov MUMIN workshop 2002, Tampere.
산업경영공학과 IMEN 315 인간공학 4. Visual Sensory Systems THE STIMULUS: LIGHT  the visual stimuli as a wave of electromagnetic energy (fig 4.1a)fig 4.1a  visible.
Comparing Eye Movements Sampled At Different Rates Abstract Eye movement data is often used as a means of corroborating performance metrics (e.g. time.
A Viable Implementation of a Comparison Algorithm for Regions of Interest John P. Heminghous Computer Science Clemson University
Change detection and occlusion modes in road-traffic scenarios Professor: Liu Student: Ruby.
Soft Computing Lecture 14 Clustering and model ART.
Queuing Network Modeling of Transcription Typing.
Introduction ATTENTION SPANS MULTIPLE STIMULUS DIMENSIONS IN MACAQUE VISUAL CORTEX Jitendra Sharma*, James Schummers, Hiroki Sugihara, Paymon Hosseini.
Society for Psychophysiological Research
The Duration of Eyelid Movements During Blinks: Changes with Drowsiness Tucker, AJ, Johns, MW Sleep Diagnostics Pty Ltd Melbourne, Australia Introduction.
Non-Photorealistic Rendering and Content- Based Image Retrieval Yuan-Hao Lai Pacific Graphics (2003)
Summary of results. Reiterate goal of investigation: How general is anticipatory behavior observed by Land & McCleod? Found: Untrained subjects exhibit.
The geometry of the system consisting of the hyperbolic mirror and the CCD camera is shown to the right. The points on the mirror surface can be expressed.
Perceptual attention Theories of attention Early selection Late selection Resource theories Repetition blindness and the attentional blink.
Counting How Many Words You Read
CS 121 – Quiz Feb 17 th. Question 2 We want to count how many days there were such that the temperature is at least degrees lower than the.
Remote Sensing Unsupervised Image Classification.
“Nothing average ever stood as a monument to progress. When progress is looking for a partner it doesn't turn to those who believe they are only average.
Analyzing Visual Scan Paths of Professionals and Novices using Levenshtein Distance Zach Belou, Justin Clemmons, Rebecca Gravois, Norwood Hingle, Jessica.
8. What are the advantages and disadvantages of using a virtual reality environment to study the brain and behavior? 9.Give examples of the way that virtual.
Optimal Eye Movement Strategies In Visual Search.
Describe how reaching and grasping abilities develop in the first year of life.
Eye Movements and Working Memory Marc Pomplun Department of Computer Science University of Massachusetts at Boston Homepage:
Introduction Processing Verbal Information in Concept Maps How people read concept maps in the context of a semantically meaningful task?
Character legibility: which details are important, and how might it be measured? John Hayes, Jim Sheedy, Yu-Chi Tai, Vinsunt Donato, David Glabe.
The effect of inter-letter spacing on reading Yu-Chi Tai, John Hayes, James Sheedy College of Optometry Pacific University, Forest Grove, Oregon ABSTRACT.
Visual Attention (neural mechanisms) Arash Afraz.
Blink Is Not A Random Event In Reading Yu-Chi Tai, James Sheedy, & John Hayes Pacific University, College of Optometry.
Splash Screen.
Investigating the combined effects of word frequency and contextual predictability on eye movements during reading Christopher J. Hand Glasgow Language.
The Effect of Inter-letter Spacing on Reading Yu-Chi Tai, PhD James E
Approximate Matching of Run-Length Compressed Strings
Jian-Zhong Xiang, Malcolm W Brown  Neuron 
Splash Screen.
Signals and Systems Networks and Communication Department Chapter (1)
String matching.
Cognitive Processes PSY 334
Dynamic Programming Computation of Edit Distance
Goal-Related Activity in V4 during Free Viewing Visual Search
Cognitive Processes PSY 334
Huihui Zhou, Robert Desimone  Neuron 
Chapter 7 - Visual Attention
Unit 4 – Energy Learning target 4.3 – Define and relate wavelength, frequency, amplitude, period, and wave speed.
Presentation transcript:

Analysis of Eye Movement Data Frank M. Marchak, Ph.D. Veridical Research and Design Corporation

Analysis of Eye Movement Data Basic Measurement Units Fixations Saccades Blinks

Basic Measurement Units Fixations Relatively stable eye-in-head position: -Spatial dispersion : < 2° -Minimal duration : 100 – 200 msec -Threshold velocity : < 15 – 100° /msec

Fixations Calculation Methods* Velocity-based -Based on point-to-point velocities- (threshold : 20°/sec) -Fixations (< 100° /sec) -Saccades (> 300° /sec) -Velocity Threshold Identification -Approximated from angular velocity threshold distance from stimulus is known (20°/sec – Sen & Megaw, 1984) Dispersion-based -Based on groups of consecutive points within a maximum separation -Moving window spans minimum number of points based on duration threshold and sampling frequency -Checks dispersion of points in window by summing max and min x and y values * Salvucci & Goldberg, 2000

Fixations Calculation Methods* (cont.) Area-of-Interest (AOI) -Identifies only fixations that occur only within specific target areas -Uses duration threshold to distinguish fixations from passing saccades * Salvucci & Goldberg, 2000 MethodAccuracySpeedRobustness Impl. Ease Parameters VT *** o 1 DT *** * 2 AOI **** 1 + b Comparison

Basic Measurement Units Saccades Involuntary, abrupt, rapid, small movements or jerks of both eyes simultaneously in changing the point of fixation Duration: 30 – 120 msec Amplitude : °/sec Latency : 100 – 30 msec Refractory period : 100 – 300 msec

Basic Measurement Units Mean Fixation Durations and Saccade Lengths Task Mean Fixation Duration (ms) Saccade Length (degrees) Silent Reading2252 ( ~ 8 letters) Oral Reading (~ 6 letters) Visual search2753 Scene Perception3304 Music Reading3751 Typing4001 (~ 4 letters) Rayner & Castelhano, 2007

Analysis of Eye Movement Data Types of Analyses* Measures of Processing Measures of Search Measures of Scanpaths * Goldberg & Kotval, 1999

Types of Analyses Measures of Processing Number of Fixations Location of Fixations Fixation Duration Cumulative Fixation Time Cluster Analysis (AOI)

Types of Analyses Measures of Search Number of Saccades Saccade Amplitude Saccade Velocity Scanpath Length Scanpath Sequence Scanpath Duration

Types of Analyses Scanpaths When a particular visual pattern is viewed, a particular sequence of eye movements is executed, and furthermore that this sequence is very important in accessing the visual memory for this pattern –Noton and Stark, 1971 Theory disputed, but evidence that viewers attend to informative details

Scanpaths Quantification – Markov Measures Region eye lands Region eye leaves12345Row totals Column totals0.20 Grand Total: 1.00 Random

Scanpaths Quantification – Markov Measures Region eye lands Region eye leaves12345Row totals Column totals0.20 Grand Total: 1.00 Constrained

Scanpaths Quantification – Levenshtein Distance Metric for measuring the amount of difference between two sequences Defined as the minimum number of edits needed to transform one string into the other, with the allowable edit operations being insertion, deletion, or substitution of a single character en.wikipedia.org/wiki/Levenshtein_distance Josephson and Holmes, 2002

Analysis of Eye Movement Data Applications of Measures Reading Visual Search Scene Perception

Measures of Processing Example –Number of fixations Σ x + Σ x + Σ x + Σ x = 11 –Number of regions sampled = 4 –First return fixation * –Proportion of fixations to left side of image 6/11 =.55 –First-order Markov measures p(x x) –Second-order Markov measures p(x x x) x x x x x x x x x * x x

Basic Measurement Units Blinks Rapid bilateral eyelid closure and co- occurring eye movement Blink types and initiators* * Smit, 2008

Applications of Measures Reading Variables -First Fixation Duration -Single Fixation Duration -Gaze Duration -Total Fixation Duration -Go-Past Time -Skipping -Regressions (in and out) Rayner & Castelhano, 2007

Reading Characteristics Character spaces used rather than visual angle Global measures influenced by text properties -Saccade size -Fixation duration -Regression to previously read material(10-15%) -Local effects on processing target words -First fixation duration -Single fixation duration -Gaze duration (sum of all fixations on word)

Applications of Measures Visual Search Variables - Number of Saccades - Saccade Amplitude - Saccade Velocity - Scanpath Length - Scanpath Sequence - Scanpath Duration Rayner & Castelhano, 2007

Applications of Measures Scene Perception Variables - Number of Fixations - First Return Fixation - Number of Regions - 1 st order Markov - 2 nd order Markov Rayner & Castelhano, 2007

Scene Perception Scene Manipulation 60 Stimuli –15 Addition/15 Subtraction –15 Left/right shift –15 Feature change Detail Color Object