Decoding Successive Computational Stages of Saliency Processing

Slides:



Advertisements
Similar presentations
Davide Nardo, Valerio Santangelo, Emiliano Macaluso  Neuron 
Advertisements

Volume 60, Issue 4, Pages (November 2008)
Lior Shmuelof, Ehud Zohary  Neuron 
Visual Maps: To Merge or Not To Merge
Volume 27, Issue 7, Pages (April 2017)
Araceli Ramirez-Cardenas, Maria Moskaleva, Andreas Nieder 
Pre-constancy Vision in Infants
Two Cortical Systems for Reaching in Central and Peripheral Vision
Volume 26, Issue 14, Pages (July 2016)
Volume 23, Issue 18, Pages (September 2013)
Developmental dyslexia is characterized by the co-existence of visuospatial and phonological disorders in Chinese children  Wai Ting Siok, John A. Spinks,
Representation of Object Weight in Human Ventral Visual Cortex
Sing-Hang Cheung, Fang Fang, Sheng He, Gordon E. Legge  Current Biology 
Clayton P. Mosher, Prisca E. Zimmerman, Katalin M. Gothard 
Volume 27, Issue 2, Pages (January 2017)
Perceptual Learning and Decision-Making in Human Medial Frontal Cortex
Theta-Coupled Periodic Replay in Working Memory
Attention Modulates Spinal Cord Responses to Pain
Volume 17, Issue 13, Pages (July 2007)
Volume 21, Issue 2, Pages (January 2011)
Jason Samaha, Bradley R. Postle  Current Biology 
Face Perception: Broken into Parts
Liping Wang, Lynn Uhrig, Bechir Jarraya, Stanislas Dehaene 
Neural Correlates of Visual Working Memory
Deciphering Cortical Number Coding from Human Brain Activity Patterns
The Generality of Parietal Involvement in Visual Attention
Volume 26, Issue 7, Pages (April 2016)
Cultural Confusions Show that Facial Expressions Are Not Universal
Empathy and the Somatotopic Auditory Mirror System in Humans
Children, but Not Chimpanzees, Prefer to Collaborate
Jack Grinband, Joy Hirsch, Vincent P. Ferrera  Neuron 
Attention Reduces Spatial Uncertainty in Human Ventral Temporal Cortex
Volume 25, Issue 11, Pages (June 2015)
Volume 45, Issue 4, Pages (February 2005)
Modality-Independent Coding of Spatial Layout in the Human Brain
Distributed Neural Systems for the Generation of Visual Images
Dharshan Kumaran, Eleanor A. Maguire  Neuron 
The Functional Neuroanatomy of Object Agnosia: A Case Study
Mathilde Bonnefond, Ole Jensen  Current Biology 
Lior Shmuelof, Ehud Zohary  Neuron 
Acetylcholine Mediates Behavioral and Neural Post-Error Control
Volume 22, Issue 18, Pages (September 2012)
Decoding the Yellow of a Gray Banana
Volume 19, Issue 6, Pages (March 2009)
Perception Matches Selectivity in the Human Anterior Color Center
Neural Mechanisms Underlying Human Consensus Decision-Making
Spatiotopic Visual Maps Revealed by Saccadic Adaptation in Humans
Visual Maps: To Merge or Not To Merge
Visual Sensitivity Can Scale with Illusory Size Changes
Volume 19, Issue 3, Pages (February 2009)
Direct Two-Dimensional Access to the Spatial Location of Covert Attention in Macaque Prefrontal Cortex  Elaine Astrand, Claire Wardak, Pierre Baraduc,
The sound of change: visually-induced auditory synesthesia
Cerebral Responses to Change in Spatial Location of Unattended Sounds
Dissociable Effects of Salience on Attention and Goal-Directed Action
Martijn Barendregt, Ben M. Harvey, Bas Rokers, Serge O. Dumoulin 
Neural and Computational Mechanisms of Action Processing: Interaction between Visual and Motor Representations  Martin A. Giese, Giacomo Rizzolatti  Neuron 
Repeating Spatial Activations in Human Entorhinal Cortex
Volume 18, Issue 19, Pages (October 2008)
Category Selectivity in the Ventral Visual Pathway Confers Robustness to Clutter and Diverted Attention  Leila Reddy, Nancy Kanwisher  Current Biology 
Volume 21, Issue 11, Pages (June 2011)
Volume 17, Issue 1, Pages (January 2007)
Social Attention and the Brain
Response to Visual Threat Following Damage to the Pulvinar
Volume 16, Issue 15, Pages (August 2006)
Søren K. Andersen, Steven A. Hillyard, Matthias M. Müller 
Two Cortical Systems for Reaching in Central and Peripheral Vision
Human Posterior Parietal Cortex Flexibly Determines Reference Frames for Reaching Based on Sensory Context  Pierre-Michel Bernier, Scott T. Grafton  Neuron 
Yuko Yotsumoto, Takeo Watanabe, Yuka Sasaki  Neuron 
Vision: Attending the Invisible
Visual Crowding Is Correlated with Awareness
Presentation transcript:

Decoding Successive Computational Stages of Saliency Processing Carsten Bogler, Stefan Bode, John-Dylan Haynes  Current Biology  Volume 21, Issue 19, Pages 1667-1671 (October 2011) DOI: 10.1016/j.cub.2011.08.039 Copyright © 2011 Elsevier Ltd Terms and Conditions

Figure 1 Visual Stimulation In each trial, one image was presented repeatedly for 200 ms with a 200 ms gap. Between successive trials there was a variable interstimulus interval of 1.4 to 6.2 s. Subjects fixated on a demanding task at the center of the screen. Every 1,200 ms, the left or right bar of the square at the center of the screen was removed, and subjects had to indicate whether the square opened up to the left- or right-hand side. Current Biology 2011 21, 1667-1671DOI: (10.1016/j.cub.2011.08.039) Copyright © 2011 Elsevier Ltd Terms and Conditions

Figure 2 Extracting the Saliency Representation for Natural Visual Stimuli (A) One hundred different images of natural scenes were presented during the experiment. (B) For each image, the saliency map was calculated based on an implementation of Itti and Koch's saliency map model [2, 15]. (C) The saliency was then averaged across individual four sectors, defined by screening central and peripheral regions out of each visual field quadrant. (D–F) The average saliency for each quadrant (D) was then used to define four parameters for each image, which encode the graded saliency (E), and a winner-take-all (WTA) mechanism thresholded the four saliency values so that only the most salient quadrant remained (F). Current Biology 2011 21, 1667-1671DOI: (10.1016/j.cub.2011.08.039) Copyright © 2011 Elsevier Ltd Terms and Conditions

Figure 3 Two Stages of Saliency Representation Regions in visual cortex and posterior intraparietal sulcus (pIPS) that correlated with the graded saliency map (red) and regions in the anterior IPS and frontal eye fields (FEF) that encoded the output of the WTA stage, i.e., the most salient quadrant (blue). In IPS, the WTA type of code could be found more anterior compared to the graded saliency representation (both p < 0.05, family-wise error corrected). Current Biology 2011 21, 1667-1671DOI: (10.1016/j.cub.2011.08.039) Copyright © 2011 Elsevier Ltd Terms and Conditions

Figure 4 Quadrant-Specific Saliency Among the regions that correlated with graded saliency (Figure 3), only visual cortex responded in a selective fashion to the saliency in only one of the quadrants (F test p < 0.0005, minimum cluster size ten voxels). Current Biology 2011 21, 1667-1671DOI: (10.1016/j.cub.2011.08.039) Copyright © 2011 Elsevier Ltd Terms and Conditions