Stereopsis Current Biology

Slides:



Advertisements
Similar presentations
1 Perception, Illusion and VR HNRS 299, Spring 2008 Lecture 8 Seeing Depth.
Advertisements

1 Computational Vision CSCI 363, Fall 2012 Lecture 16 Stereopsis.
Bram-Ernst Verhoef, Rufin Vogels, Peter Janssen  Neuron 
Interacting Roles of Attention and Visual Salience in V4
Stereopsis: How the brain sees depth
“What Not” Detectors Help the Brain See in Depth
Volume 73, Issue 3, Pages (February 2012)
Bram-Ernst Verhoef, Rufin Vogels, Peter Janssen  Neuron 
Volume 19, Issue 22, Pages R1022-R1023 (December 2009)
Araceli Ramirez-Cardenas, Maria Moskaleva, Andreas Nieder 
Responses to Spatial Contrast in the Mouse Suprachiasmatic Nuclei
Shape representation in the inferior temporal cortex of monkeys
Christopher C. Pack, Richard T. Born, Margaret S. Livingstone  Neuron 
Perceptual Echoes at 10 Hz in the Human Brain
Ji Dai, Daniel I. Brooks, David L. Sheinberg  Current Biology 
Vision: In the Brain of the Beholder
Choice Certainty Is Informed by Both Evidence and Decision Time
Two-Dimensional Substructure of MT Receptive Fields
Selective Attention in an Insect Visual Neuron
Volume 87, Issue 1, Pages (July 2015)
First-Pass Processing of Value Cues in the Ventral Visual Pathway
Minami Ito, Charles D. Gilbert  Neuron 
Vincent B. McGinty, Antonio Rangel, William T. Newsome  Neuron 
Binocular Disparity and the Perception of Depth
Attentional Modulations Related to Spatial Gating but Not to Allocation of Limited Resources in Primate V1  Yuzhi Chen, Eyal Seidemann  Neuron  Volume.
Volume 66, Issue 4, Pages (May 2010)
Volume 71, Issue 4, Pages (August 2011)
A Map for Horizontal Disparity in Monkey V2
Volume 66, Issue 4, Pages (May 2010)
Syed A. Chowdhury, Gregory C. DeAngelis  Neuron 
Volume 73, Issue 3, Pages (February 2012)
Volume 24, Issue 13, Pages (July 2014)
Volume 95, Issue 1, Pages e3 (July 2017)
Learning to Link Visual Contours
Dynamic Coding for Cognitive Control in Prefrontal Cortex
Nicholas J. Priebe, David Ferster  Neuron 
Pieter R. Roelfsema, Henk Spekreijse  Neuron 
Serial Dependence in the Perception of Faces
Directional Selectivity Is Formed at Multiple Levels by Laterally Offset Inhibition in the Rabbit Retina  Shelley I. Fried, Thomas A. Mu¨nch, Frank S.
Neural Mechanisms of Visual Motion Perception in Primates
Integration Trumps Selection in Object Recognition
Fangtu T. Qiu, Rüdiger von der Heydt  Neuron 
Origin and Function of Tuning Diversity in Macaque Visual Cortex
Opposite Effects of Recent History on Perception and Decision
Ryo Sasaki, Takanori Uka  Neuron  Volume 62, Issue 1, Pages (April 2009)
Perception Matches Selectivity in the Human Anterior Color Center
Segregation of Object and Background Motion in Visual Area MT
Volume 75, Issue 5, Pages (September 2012)
Dynamics of Eye-Position Signals in the Dorsal Visual System
Origin and Dynamics of Extraclassical Suppression in the Lateral Geniculate Nucleus of the Macaque Monkey  Henry J. Alitto, W. Martin Usrey  Neuron  Volume.
Stephen V. David, Benjamin Y. Hayden, James A. Mazer, Jack L. Gallant 
The Normalization Model of Attention
Volume 14, Issue 3, Pages (February 2004)
Representation of Color Stimuli in Awake Macaque Primary Visual Cortex
Receptive Fields of Disparity-Tuned Simple Cells in Macaque V1
Martijn Barendregt, Ben M. Harvey, Bas Rokers, Serge O. Dumoulin 
Short-Term Memory for Figure-Ground Organization in the Visual Cortex
MT Neurons Combine Visual Motion with a Smooth Eye Movement Signal to Code Depth-Sign from Motion Parallax  Jacob W. Nadler, Mark Nawrot, Dora E. Angelaki,
Encoding of Stimulus Probability in Macaque Inferior Temporal Cortex
Visual selection: Neurons that make up their minds
Keith A. May, Li Zhaoping, Paul B. Hibbard  Current Biology 
Binocular Vision: The Eyes Add and Subtract
End-Stopping and the Aperture Problem
Volume 75, Issue 5, Pages (September 2012)
Insect Vision: Judging Distance with Binocular Motion Disparities
Volume 66, Issue 4, Pages (May 2010)
Supratim Ray, John H.R. Maunsell  Neuron 
Volume 22, Issue 5, Pages (March 2012)
Visual Perception: One World from Two Eyes
Maxwell H. Turner, Fred Rieke  Neuron 
Presentation transcript:

Stereopsis Current Biology Carlos R. Ponce, Richard T. Born  Current Biology  Volume 18, Issue 18, Pages R845-R850 (September 2008) DOI: 10.1016/j.cub.2008.07.006 Copyright © 2008 Elsevier Ltd Terms and Conditions

Figure 1 The geometry of stereopsis. Each diagram represents a section through the horizontal equator of the eye as viewed from above. (A) Points along the horopter produce images on corresponding points of the two retinas. (B) Points on the arrow at different distances from the observer produce images at different distance from the fovea on the two retinas. This difference, called ‘binocular disparity’, is the basis for the classical variety of depth perception referred to as ‘Wheatstone stereopsis’. (C) The basis of ‘da Vinci stereopsis’. The presence of an object in the foreground creates regions of the background that can be seen by one eye only. These unpaired image points provide potent cues for depth and occlusion. (A,B) Adapted from Tyler 2004; (C) adapted from Nakayama and Shimojo 1990. Current Biology 2008 18, R845-R850DOI: (10.1016/j.cub.2008.07.006) Copyright © 2008 Elsevier Ltd Terms and Conditions

Figure 2 Binocular disparity tuning functions. Spike rates evoked by visual stimuli of differing binocular disparity. For the ‘near’ cell (C), actual data are shown — each filled circle represents the spike rate evoked during a single stimulus presentation. Solid lines show the mathematical function (called a ‘Gabor function’) that best fit the data. The other panels represent idealized versions of their respective cell types. (A) The most common type of disparity tuning curve found in V1 peaks at binocular disparity values near zero, corresponding to a visual stimulus on the horopter, and such neurons are termed ‘tuned excitatory’. The hallmark of these disparity tuning functions is that they are symmetric around zero (responding equally well to very small near or far disparities). (B) Another type of symmetric curve belongs to ‘tuned inhibitory’ cells, which are suppressed by a small range of disparities around zero and thus appear to be an inverted version of the tuned excitatory cells. (C,D) The third and fourth types of disparity tuning functions have their response peaks at either near or far (crossed or uncrossed, respectively) disparities. These tuning curves are generally asymmetric about zero. While it is convenient to think in terms of these four different classes, in reality one finds a continuum of different tuning curves spanning the gamut from near-, to zero-, to far-tuned neurons. Current Biology 2008 18, R845-R850DOI: (10.1016/j.cub.2008.07.006) Copyright © 2008 Elsevier Ltd Terms and Conditions

Figure 3 Encoding of binocular disparity by cells in the primary visual cortex. (A) Typical structure of a V1 simple cell receptive field. The blue region shows an area of ON responses (+); magenta indicates regions eliciting OFF responses (−). The white line shows the level of a cross-section of this two-dimensional map shown below. (B) Complex cells respond to orientation and binocular disparity signals everywhere in their receptive fields. The energy model proposes that each complex cell (Cx) receives inputs from a number of simple cells (s), each having the same orientation and disparity preference (left and right receptive field profiles shown in black squares), but differing in the position of the excitatory domains within their own receptive fields. To make sure that the outputs of the different simple cells do not cancel each other, a rectification stage (to make all responses excitatory) is added between the simple complex cell stages. Adapted from Cumming and DeAngelis (2001). Current Biology 2008 18, R845-R850DOI: (10.1016/j.cub.2008.07.006) Copyright © 2008 Elsevier Ltd Terms and Conditions

Figure 4 Microstimulation of disparity-tuned neurons can bias a monkey's perceptual decisions. (A) Depth discrimination task. The monkey must report whether the dots appear in front of (near) or behind (far) the plane of fixation. The difficulty of the task is varied by adjusting the proportion of binocularly correlated dots. In the 100% condition (left), all of the dots appear at a single depth, making the task very easy. By adjusting the proportion (% binocular correlation) of dots that have random binocular disparities (noise dots), the task is made progressively more difficult. In the limit, all of the dots appear at random depths (0% binocular correlation) and there is no correct answer. In this case, the monkey must guess, and he is rewarded randomly on half of the trials. (B) In this microstimulation experiment, the pool of neurons being stimulated prefers near (negative) binocular disparities. Based on this tuning curve, two binocular disparities are chosen for the behavioral task (arrows): the near stimulus is a crossed binocular disparity of −0.4° and the far stimulus is an uncrossed binocular disparity of +0.4°. While the animal is performing the task shown in (A), on half of the trials the neurons are electrically stimulated during the period when the animal is viewing the visual stimulus. (C) Psychometric functions. The x-axis shows the signal strength for near (negative) vs. far (positive) binocular disparities, and the y-axis is the percentage of trials on which the monkey reported a near stimulus. On stimulated trials, the animal is much more likely to report a near depth, as shown by the upward shift of the filled circles (trials with microstimulation) compared to the open circles (no microstimulation). Since the animal is only rewarded for making correct decisions, the most reasonable interpretation is that the stimulated neurons play a causal role in the decision process. It is as if stimulating neurons tuned to near binocular disparities causes the monkey to see more near dots. (A) Adapted from Uka and DeAngelis (2004); (B,C) adapted from DeAngelis et al. (1998). Current Biology 2008 18, R845-R850DOI: (10.1016/j.cub.2008.07.006) Copyright © 2008 Elsevier Ltd Terms and Conditions

Figure 5 Binocular comparisons are not just for computing depth. (A) An autostereogram. The figure of the shark is visible only when the image is binocularly ‘free fused’ to make the shape stand out in depth. In the absence of stereopsis, the shark is perfectly camouflaged. (B) The face is much more easily recognized when the parts appear to be behind the occluding strips. This is even more apparent when binocular disparity is used to define the relative depths of the face and the strips. (A) from http://en.wikipedia.org/wiki/Image:Stereogram_Tut_Random_Dot_Shark.png; (B) adapted from Nakayama, Shimojo and Silverman (1989). Current Biology 2008 18, R845-R850DOI: (10.1016/j.cub.2008.07.006) Copyright © 2008 Elsevier Ltd Terms and Conditions