Binocular Disparity and the Perception of Depth

Slides:



Advertisements
Similar presentations
1 Perception, Illusion and VR HNRS 299, Spring 2008 Lecture 8 Seeing Depth.
Advertisements

CS332 Visual Processing Department of Computer Science Wellesley College Binocular Stereo Vision Region-based stereo matching algorithms Properties of.
1 Computational Vision CSCI 363, Fall 2012 Lecture 16 Stereopsis.
Understanding Psychophysics: Spatial Frequency & Contrast
1 Computational Vision CSCI 363, Fall 2012 Lecture 18 Stereopsis III.
Bram-Ernst Verhoef, Rufin Vogels, Peter Janssen  Neuron 
Early Processing in Biological Vision
Volume 32, Issue 2, Pages (October 2001)
Interacting Roles of Attention and Visual Salience in V4
Binocular Stereo Vision
Stereopsis: How the brain sees depth
Volume 20, Issue 5, Pages (May 1998)
A Source for Feature-Based Attention in the Prefrontal Cortex
Bram-Ernst Verhoef, Rufin Vogels, Peter Janssen  Neuron 
Binocular Stereo Vision
Satoru Suzuki, Marcia Grabowecky  Neuron 
Efficient Receptive Field Tiling in Primate V1
Responses to Spatial Contrast in the Mouse Suprachiasmatic Nuclei
Shape representation in the inferior temporal cortex of monkeys
Christopher C. Pack, Richard T. Born, Margaret S. Livingstone  Neuron 
Soumya Chatterjee, Edward M. Callaway  Neuron 
Volume 36, Issue 5, Pages (December 2002)
Two-Dimensional Substructure of MT Receptive Fields
Volume 20, Issue 5, Pages (May 1998)
Stereopsis Current Biology
Volume 87, Issue 1, Pages (July 2015)
Andrea Benucci, Robert A. Frazor, Matteo Carandini  Neuron 
Dynamic Processes Shape Spatiotemporal Properties of Retinal Waves
Visual Search and Attention
Volume 55, Issue 3, Pages (August 2007)
Motion-Based Analysis of Spatial Patterns by the Human Visual System
Robert O. Duncan, Geoffrey M. Boynton  Neuron 
Cascaded Effects of Spatial Adaptation in the Early Visual System
Attentional Modulations Related to Spatial Gating but Not to Allocation of Limited Resources in Primate V1  Yuzhi Chen, Eyal Seidemann  Neuron  Volume.
Volume 49, Issue 3, Pages (February 2006)
Cortical Mechanisms of Smooth Eye Movements Revealed by Dynamic Covariations of Neural and Behavioral Responses  David Schoppik, Katherine I. Nagel, Stephen.
Satoru Suzuki, Marcia Grabowecky  Neuron 
Gamma and the Coordination of Spiking Activity in Early Visual Cortex
A Map for Horizontal Disparity in Monkey V2
Syed A. Chowdhury, Gregory C. DeAngelis  Neuron 
Directional Selectivity Is Formed at Multiple Levels by Laterally Offset Inhibition in the Rabbit Retina  Shelley I. Fried, Thomas A. Mu¨nch, Frank S.
Volume 88, Issue 3, Pages (November 2015)
Neural Mechanisms of Visual Motion Perception in Primates
Fangtu T. Qiu, Rüdiger von der Heydt  Neuron 
Benjamin Scholl, Daniel E. Wilson, David Fitzpatrick  Neuron 
Neuronal Selectivity and Local Map Structure in Visual Cortex
Prediction of Orientation Selectivity from Receptive Field Architecture in Simple Cells of Cat Visual Cortex  Ilan Lampl, Jeffrey S. Anderson, Deda C.
Segregation of Object and Background Motion in Visual Area MT
Greg Schwartz, Sam Taylor, Clark Fisher, Rob Harris, Michael J. Berry 
Volume 64, Issue 6, Pages (December 2009)
Stephen V. David, Benjamin Y. Hayden, James A. Mazer, Jack L. Gallant 
The Normalization Model of Attention
Benjamin Scholl, Daniel E. Wilson, David Fitzpatrick  Neuron 
Representation of Color Stimuli in Awake Macaque Primary Visual Cortex
Receptive Fields of Disparity-Tuned Simple Cells in Macaque V1
Short-Term Memory for Figure-Ground Organization in the Visual Cortex
Stability of Cortical Responses and the Statistics of Natural Scenes
From Functional Architecture to Functional Connectomics
MT Neurons Combine Visual Motion with a Smooth Eye Movement Signal to Code Depth-Sign from Motion Parallax  Jacob W. Nadler, Mark Nawrot, Dora E. Angelaki,
Volume 24, Issue 8, Pages e6 (August 2018)
Visual selection: Neurons that make up their minds
Opponent Inhibition Neuron
John B Reppas, W.Martin Usrey, R.Clay Reid  Neuron 
Multineuronal Firing Patterns in the Signal from Eye to Brain
Volume 27, Issue 2, Pages (August 2000)
Visual Perception: One World from Two Eyes
Valerio Mante, Vincent Bonin, Matteo Carandini  Neuron 
Maxwell H. Turner, Fred Rieke  Neuron 
Efficient Receptive Field Tiling in Primate V1
Dynamics of Orientation Selectivity in the Primary Visual Cortex and the Importance of Cortical Inhibition  Robert Shapley, Michael Hawken, Dario L. Ringach 
Presentation transcript:

Binocular Disparity and the Perception of Depth Ning Qian  Neuron  Volume 18, Issue 3, Pages 359-368 (March 1997) DOI: 10.1016/S0896-6273(00)81238-6

Figure 1 The Geometry of Binocular Projection (Top) and the Definition of Binocular Disparity (Bottom) The fixation point projects to the two corresponding foveas (fs) and has zero disparity by definition. It can be shown that all zero disparity points in the plane fall on the circle passing through the fixation point and the two eyes (or more accurately, the nodal points of the two lens systems). All other points do not project to corresponding locations on the two retinas and have non-zero disparities. The magnitude of disparity is usually expressed in terms of visual angle. Neuron 1997 18, 359-368DOI: (10.1016/S0896-6273(00)81238-6)

Figure 6 Disparity Computation with Binocular Cells (a) A 110 × 110 random dot stereogram with a dot density of 50% and dot size of 1 pixel. The central 50 × 50 area and the surround have disparities of 2 and −2 pixels, respectively. When fused with uncrossed eyes, the central square appears further away than the surround. (b) The disparity map of the stereogram computed with eight complex cells at each location using the method outlined in the text. The distance between two adjacent sampling lines represents a distance of two pixels in (a). Negative and positive values indicate near and far disparities, respectively. The eight complex cells have the same preferred spatial frequency of 0.125 cycles/pixel and receptive field Gaussian width of 4 pixels. Similar disparity maps can be obtained by using complex cells at different spatial scales or by averaging results across several scales. The results obtained with either of the two receptive field models shown in Figure 3 are also very similar (Qian and Zhu 1997). Neuron 1997 18, 359-368DOI: (10.1016/S0896-6273(00)81238-6)

Figure 3 Schematic Drawings Illustrate the Left–Right Receptive Field (RF) Shift of Binocular Simple Cells The + and − signs represent the on and off subregions within the receptive fields, respectively. Two different models for achieving the shift have been suggested by physiological experiments. (a) Position-shift model. According to this model, the left and right receptive fields of a simple cell have identical shapes but have an overall horizontal shift between them (Bishop and Pettigrew 1986). (b) Phase-difference model. This model assumes that the shift is between the on–off subregions within the left and right receptive field envelopes that spatially align (Ohzawa et al. 1990; Ohzawa et al. 1996). The fovea locations on the left and right retinas are drawn as a reference point for vertically aligning the left and right receptive fields of the simple cell. Neuron 1997 18, 359-368DOI: (10.1016/S0896-6273(00)81238-6)

Figure 2 A Schematic Drawing of a Disparity Tuning Curve for a Binocular Cell in the Visual Cortex Three representative retinal stimulus configurations are shown at the bottom. They correspond to a point in space that is nearer than, at, or further away from the fixation point. Neuron 1997 18, 359-368DOI: (10.1016/S0896-6273(00)81238-6)

Figure 4 A Hubel–Wiesel Type of Model Shows How the Receptive Field Structure of the Binocular Simple Cell in Figure 3a Could Arise from the Orderly LGN Projections to the Cell On-center and off-center LGN cells are assumed to project to the on and off subregions of the simple cell, respectively (only on-center LGN cells are shown for clarity). A similar scheme may be proposed for the cell in Figure 3b. Recent studies support Hubel and Wiesel's idea but indicate the importance of intracortical interactions in shaping cortical receptive field properties (see, for example,Somers et al. 1995). Neuron 1997 18, 359-368DOI: (10.1016/S0896-6273(00)81238-6)

Figure 5 The Model Proposed by Ohzawa et al. 1990 for Simulating Real Binocular Complex Cell Responses The complex cell (labeled C) sums squared outputs of a quadrature pair of simple cells (labeled S1 and S2). Each simple cell in turn sums the contributions from its two receptive fields on the left and right retinas. The squaring operation could presumably be performed by a multiplication-like operation on the dendritic tree of the complex cell (Mel 1993). Ohzawa et al. 1990 pointed out that to consider the fact that cells cannot fire negatively, each simple cell should be split into two with inverted receptive field profiles, so that they can carry the positive and negative parts of the firing, respectively. The resulting complex cell model will contain four half-wave rectified simple cells. It is, however, exactly equivalent to the model shown here with two simple cells. Neuron 1997 18, 359-368DOI: (10.1016/S0896-6273(00)81238-6)

Figure 7 The Computed Disparity of One Line (Test Line) Plotted as a Function of Its Separation from the Second Line (Inducing Line) The actual disparities of the test and the inducing lines are fixed at 0 and 0.5 min, respectively. Positive computed disparities indicate attractive interaction while negative values indicate repulsion between the two lines. The result was obtained by averaging across cell families with different preferred spatial frequencies and frequency tuning bandwidths using physiologically determined distributions for these parameters (DeValois et al. 1982). Neuron 1997 18, 359-368DOI: (10.1016/S0896-6273(00)81238-6)

Figure 8 Pulfrich's Pendulum (a) A schematic drawing of the classical Pulfrich effect (top view). A pendulum is oscillating in the frontoparallel plane indicated by the solid line. When a neutral density filter is placed in front of the right eye, the pendulum appears to move in an elliptical path in depth as indicated by the dashed line. (b) The horizontal position of the pendulum as a function of time for one full cycle of oscillation. (c) The computed equivalent disparity as a function of horizontal position and time. The data points from the simulation are shown as small closed circles. Lines are drawn from the data points to the x–t plane in order to indicate the spatiotemporal location of each data point. A time delay of 4 pixels is assumed for the right receptive fields of all the model cells. The pendulum has negative equivalent disparity (and therefore is seen as closer to the observer) when it is moving to the right and has positive equivalent disparity (further away from the observer) when it is moving to the left. The projection of the 3-D plot onto the d–x plane forms a closed path similar to the ellipse in (a). Neuron 1997 18, 359-368DOI: (10.1016/S0896-6273(00)81238-6)