Visual Processing in Fingerprint Experts and Novices Tom Busey Indiana University, Bloomington John Vanderkolk Indiana State Police, Fort Wayne Expertise.

Slides:

Advertisements

Similar presentations

All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.

Advertisements

Electrophysiology of Visual Attention. Does Visual Attention Modulate Visual Evoked Potentials? The theory is that Visual Attention modulates visual information.

Electroencephalogram (EEG) and Event Related Potentials (ERP) Lucy J. Troup 28 th January 2008 CSU Symposium on Imaging.

Reversal of Interlaminar Signal Between Sensory and Memory Processing in Monkey Temporal Cortex Daigo Takeuchi, Toshiyuki Hirabayashi, Keita Tamura, Yasushi.

Visual Attention Attention is the ability to select objects of interest from the surrounding environment A reliable measure of attention is eye movement.

MEG/EEG Module Trainees Kai Hwang Tina Rasmussen TA Gus Sudre Bronwyn Woods Instructor Bill Eddy, Ph.D. Anna Haridis Thanks to:

Psychological studies of face recognition:

Experiment 2: MEG Study Materials and Methods: 11 right-handed subjects with 20:20 vision were run. 3 subjects’ data was discarded because of poor performance.

SPECIFICITY OF ERP TO CHANGE OF EMOTIONAL FACIAL EXPRESSION. Michael Wright Centre for Cognition and Neuroimaging, Brunel University, Uxbridge, UB8 3PH,

Neuroscience & Behavior Program Robert J. Polewan & John W. Moore* University of Massachusetts Amherst COMPOUND CONDITIONING UNDER TEMPORAL UNCERTAINTY.

Visual Processing in Fingerprint Experts and Novices

Comparing Thompson’s Thatcher effect with faces and non-face objects Elyssa Twedt 1, David Sheinberg 2 & Isabel Gauthier 1 Vanderbilt University 1, Brown.

Subdural Grid Intracranial electrodes typically cannot be used in human studies It is possible to record from the cortical surface Subdural grid on surface.

Electroencephalography The field generated by a patch of cortex can be modeled as a single equivalent dipolar current source with some orientation (assumed.

The Event-Related Potential (ERP) Embedded in the EEG signal is the small electrical response due to specific events such as stimulus or task onsets, motor.

Electroencephalography Electrical potential is usually measured at many sites on the head surface.

I. Face Perception II. Visual Imagery. Is Face Recognition Special? Arguments have been made for both functional and neuroanatomical specialization for.

Visual Cognition II Object Perception. Theories of Object Recognition Template matching models Feature matching Models Recognition-by-components Configural.

Business Minor grade adjustments on Midterm 2 Opportunity to participate in Cognitive Neuroscience and Perception experiment - sign up for Tuesday, Wednesday.

The auditory cortex mediates the perceptual effects of acoustic temporal expectation Santiago Jaramillo & Anthony M Zador Cold Spring Harbor Laboratory,

Motion and Ambiguity Russ DuBois. Ambiguity = the possibility to interpret a stimulus in two or more ways Q: Can motion play a part in our interpretation.

Pattern Recognition Pattern - complex composition of sensory stimuli that the human observer may recognize as being a member of a class of objects Issue.

The Decisive Commanding Neural Network In the Parietal Cortex By Hsiu-Ming Chang ( 張修明 )

DDMLab – September 27, ACT-R models of training Cleotilde Gonzalez and Brad Best Dynamic Decision Making Laboratory (DDMLab)

Experimental Design Tali Sharot & Christian Kaul With slides taken from presentations by: Tor Wager Christian Ruff.

Closed and Open Electrical Fields

Neuromagnetic Evidence for the Timing of Lexical Activation: An MEG Component Sensitive to Phonotactic Probability but Not to Neighborhood Density Sarah.

Theory of Decision Time Dynamics, with Applications to Memory.

Measuring the brain’s response to temporally modulated sound stimuli Chloe Rose Institute of Digital Healthcare, WMG, University of Warwick, INTRODUCTION.

Methods in Cognitive Neuroscience I. The Emergence of Cognitive Neuroscience Fueled by the development of powerful new imaging instruments and techniques.

Change blindness and time to consciousness Professor: Liu Student: Ruby.

Pattern recognition = perception Template theory  has problems Prototype theory  better Distinctive features theory  better.

Fundamentals of Information Systems, Third Edition2 Principles and Learning Objectives Artificial intelligence systems form a broad and diverse set of.

Lecture 2b Readings: Kandell Schwartz et al Ch 27 Wolfe et al Chs 3 and 4.

Attention Loads program into working memory (more about that later) Vast amount of perceptual information available at one Moment How much can be retained.

Chapter 9: Goldstone, R. L., Gerganov, A., Landry, D. & Roberts, M. E. Learning to see and conceive (pp ). Interactive relationship between conception.

Distributed Representative Reading Group. Research Highlights 1Support vector machines can robustly decode semantic information from EEG and MEG 2Multivariate.

The ERP Boot Camp Isolating Components with Difference Waves and

Neural Basis of the Ventriloquist Illusion Bonath, Noesselt, Martinez, Mishra, Schwiecker, Heinze, and Hillyard.

Expertise, Millisecond by Millisecond Tim Curran, University of Colorado Boulder 1.

Evaluating Perceptual Cue Reliabilities Robert Jacobs Department of Brain and Cognitive Sciences University of Rochester.

Acquisition & Retention of Basic Components of Skill Robert W. Proctor and Motonori Yamaguchi Army Research Office Grant W9112NF Training Knowledge.

Effects of the Hippopotamus on Explicit and Implicit Memory.

Orienting Attention to Semantic Categories T Cristescu, JT Devlin, AC Nobre Dept. Experimental Psychology and FMRIB Centre, University of Oxford, Oxford,

Introduction Ruth Adam & Uta Noppeney Max Planck Institute for Biological Cybernetics, Tübingen Scientific Aim Experimental.

Visual Processing in Fingerprint Experts and Novices Tom Busey Indiana University, Bloomington John Vanderkolk Indiana State Police, Fort Wayne.

Effect of laterality-specific training on visual learning Jenna Kelly & Nestor Matthews Department of Psychology, Denison University, Granville OH

FMRI and Behavioral Studies of Human Face Perception Ronnie Bryan Vision Lab

How we actively interpret our environment..  Perception: The process in which we understand sensory information.  Illusions are powerful examples of.

Signal Processing: EEG to ERP A Darren Parker Presentation.

Memory Systems: Implicit and Explicit M. Jay Polsgrove and Shannon Walden Q301, Fall 2000, Indiana University.

Topographic mapping on memory test of verbal/spatial information assessed by event related potentials (ERPs) Petrini L¹², De Pascalis V², Arendt-Nielsen.

Does the brain compute confidence estimates about decisions?

Neural Correlates of Degraded Picture Perception Tom Busey, Rob Goldstone and Bethany Knapp.

Preserved face inversion effects in adults with autism spectrum disorder (ASD): an event related potential study Paula P. Tavares 1, Susana S. Mouga 1,2,

Methods used for studying brain development

What made you respond face (or word)? Something in your brain made you decide face or word. Can we determine where this decision.

Evoked Response Potential (ERP) and Face Stimuli N170: negative-going potential at 170 ms Largest over the right parietal lobe,

Feature based vs. holistic processing

Roger Ratcliff, Marios G. Philiastide, and Paul Sajda

Caspar M. Schwiedrzik, Winrich A. Freiwald Neuron

Choice Certainty Is Informed by Both Evidence and Decision Time

Visual Processing in Fingerprint Experts and Novices

Jason Samaha, Bradley R. Postle Current Biology

Caspar M. Schwiedrzik, Winrich A. Freiwald Neuron

Attentional Modulations Related to Spatial Gating but Not to Allocation of Limited Resources in Primate V1 Yuzhi Chen, Eyal Seidemann Neuron Volume.

Selective Entrainment of Theta Oscillations in the Dorsal Stream Causally Enhances Auditory Working Memory Performance Philippe Albouy, Aurélien Weiss,

Volume 97, Issue 1, Pages e3 (January 2018)

Encoding of Stimulus Probability in Macaque Inferior Temporal Cortex

Volume 50, Issue 1, Pages (April 2006)

Presentation transcript:

Visual Processing in Fingerprint Experts and Novices Tom Busey Indiana University, Bloomington John Vanderkolk Indiana State Police, Fort Wayne Expertise with fingerprint examiners was tested in behavioral and EEG studies. Experts show greater tolerance for noise, are unaffected by longer memory delays, and show evidence of configural processing. This last finding was confirmed in an EEG study where experts show a reliable delay of the N170 component when fingerprints were inverted, while novices did not. Configural processing may be one element that underlies perceptual expertise.

How Do Experts Make Identifications? Easy Match Hard Match

An Experiment

Study Fragment About a second

Mask Either about a second or 3 seconds

Test Images Until Response

Testing Fingerprint Expertise: X-AB Sequential Matching Task example stimulus pairs:

Reduce Matching based on Low- Level Features Overall Brightness change Study image is rotated up to 90° in either direction Two image manipulations designed to simulate latent prints –Added noise –Partial masking

Added Noise

Partial Masking

Semi-Transparent Masks FingerprintPartially Masked Fingerprints Logical Combination Recovers Original Fingerprint original inverse

Includes combinations:

Image Degradations at Test

Partial Masking Semi-Transparent Masks FingerprintPartially Masked Fingerprints Summation Recovers Original Fingerprint original inverse

Behavioral Data Full ImagesPartial Images Full Images in Noise Partial Images in Noise Experts: No effect of delay, interaction between noise and partial masking.

Evidence for Configural Processing Full Image (Both Halves)Partial Image (One Half) Question: What is the relation between d b and d o ? if d b = d o : One half doesn't influence information acquired from other half if d b < d o : Get less information from one half when second is present if d b > d o : Get more information from one half when second is present (consistent with configural or gestalt processing) info from first half? no (1-d b ) yes (d b ) no (1-d b ) yes (d b ) info from second half? no (1-g) yes (g) info from guessing? Correct DecisionWrong Decision no (1-d o ) yes (d o ) info from first half? no (1-g) yes (g) info from guessing? Correct DecisionWrong Decision

Multinomial Modeling Conclusions To test for configural processing, fit a reduced model with d b = d o. If we can reject this model, then we know that the two are not the same. Fit the full model to see the relation between d b and d o. Experts: No noise: we reject reduced model, so d b and d o are significantly different Full model: d b =.841, d o =.944 wrong direction for configural processing In noise: we reject reduced model, so d b and d o are significantly different Full model: d b =.50, d o =.30 Consistent with configural processing Novices: No noise: we reject reduced model, so d b and d o are significantly different Full model: d b =.40, d o =.54 wrong direction for configural processing In noise: we can't reject reduced model, so d b and d o are not significantly different Full model: d b =.19, d o =.13 No evidence for configural processing

Evidence for Configural Processing: Multinomial Modeling To test for configural processing, we can use the accuracy rate in the partial image condition to make a prediction for the full image condition, assuming no configural processing. If performance in the full image condition exceeds the prediction, we have evidence that is consistent with configural processing.

Evidence for Configural Processing: Multinomial Modeling To test for configural processing, we can use the accuracy rate in the partial image condition to make a prediction for the full image condition, assuming no configural processing. If performance in the full image condition exceeds the prediction, we have evidence that is consistent with configural processing. Experts in noise: We predict performance in the full image condition to be about 75% correct. Instead it is around 90%. Experts are doing better with the whole image than we predict they would do based on partial- image performance. This is configural processing at work.

Evidence for Configural Processing: Multinomial Modeling To test for configural processing, we can use the accuracy rate in the partial image condition to make a prediction for the full image condition, assuming no configural processing. If performance in the full image condition exceeds the prediction, we have evidence that is consistent with configural processing. Experts: No noise: No evidence for configural processing In noise: Consistent with configural processing Novices: No noise: No evidence for configural processing In noise: No evidence for configural processing

Configural Processing in Faces: The ‘Thatcher Illusion’ (Thomson, 1980) Features are perceived individually, image looks ok. Features are perceived in context, image looks grotesque.

EEG Recording Basics Record from the surface of the scalp Amplify 20,000 times Electrical signals are related to neuronal firing, mainly in post- synaptic potentials in cortex. Very small signals, very noisy data.

EEG Recording Basics Average over lots of trials (200 trials per condition)

EEG and Configural Processing Faces produce a strong component over the right hemisphere at about 170 ms after stimulus onset, which is called the N170. Inverted faces cause a delay of ms in the N170. Trained objects (Greebles) show a delay in the N170 component with inversion, but only in the left hemisphere (channel T5). Data from Rossion, Gauthier, Goffaux, Tarr & Crommelinck (2002) Data from Rossion, Gauthier, Tarr, Despland, Bruyer, Linotte & Crommelinck (2000) Coupled with behavioral data suggesting configural processing with faces, an advanced N170 to an upright stimulus suggests that the N170 latency differences indicate configural processing.

An Obvious Experiment: Show upright and inverted fingerprints to Fingerprint examiners and novices. If experts process fingerprints configurally, we should see a delayed N170 to inverted fingerprints. Also test faces to replicate the face inversion effect in our subjects. Test both identification and categorization tasks.

Expert Data- Identification Task Amplitude (µV) Time (ms) Upright Fingerprint Inverted Fingerprint Upright Face Inverted Face Delayed Experts: delayed N170 with inverted fingerprints and inverted faces. Electrode T6

Novice Data- Identification Task Upright Fingerprint Inverted Fingerprint Upright Face Inverted Face Amplitude (µV) Time (ms) Delayed No Delay Novices: no delayed N170 with inverted fingerprints, but see with faces. Electrode T6

Expert Data- Categorization Task Amplitude (µV) Time (ms) Upright Fingerprint Inverted Fingerprint Upright Face Inverted Face Delayed Experts: delayed N170 with inverted fingerprints and inverted faces. Electrode T6

Novice Data- Categorization Task Upright Fingerprint Inverted Fingerprint Upright Face Inverted Face Amplitude (µV) Time (ms) Delayed No Delay Novices: no delayed N170 with inverted fingerprints, but see with faces. Electrode T6

Summary and Conclusions Fingerprint experts demonstrate strong performance in an X-AB matching task, robustness to noise and evidence for configural processing when stimuli are presented in noise. This latter finding was confirmed using upright and inverted fingerprints in an EEG experiment. Experts showed a delayed N170 component for inverted fingerprints in the same channel that they show a delayed N170 for inverted faces. Thus they appear to be processing upright fingerprints in part using configural or holistic processing, which stresses relational information and implies dependencies between individual features. In the case of fingerprints, this may come from idiosyncratic feature elements instead of well-defined features such as eyes and mouths.