Phenomenal Coherence of Moving Visual Patterns

Slides:



Advertisements
Similar presentations
Chapter 3.3 Gabor Patches.
Advertisements

Chapter 5: Space and Form Form & Pattern Perception: Humans are second to none in processing visual form and pattern information. Our ability to see patterns.
Analysis of Contour Motions Ce Liu William T. Freeman Edward H. Adelson Computer Science and Artificial Intelligence Laboratory Massachusetts Institute.
Motion Illusions As Optimal Percepts. What’s Special About Perception? Arguably, visual perception is better optimized by evolution than other cognitive.
Chapter 6: Visual Attention. Scanning a Scene Visual scanning – looking from place to place –Fixation –Saccadic eye movement Overt attention involves.
RESOLVING PERCEPTUAL AMBIGUITY Tim Andrews University of Durham.
What happens when no correspondence is possible? Highly mismatched stereo-pairs lead to ‘binocular rivalry’ TANGENT ALERT! Open question: Can rivalry and.
Searching for the NCC We can measure all sorts of neural correlates of these processes…so we can see the neural correlates of consciousness right? So what’s.
Decision making as a model 7. Visual perception as Bayesian decision making.
Stochastic Interactive Activation and Interactive Activation in the Brain PDP Class January 20, 2010.
Motion detection with movement detectors. It is a non-linear device: response to velocity a and velocity b is not equal to velocity a+b movement detection.
Orthographic Projection Chapter 4. 2 Technical Drawing 13 th Edition Giesecke, Mitchell, Spencer, Hill Dygdon, Novak, Lockhart © 2009 Pearson Education,
1 Computational Vision CSCI 363, Fall 2012 Lecture 26 Review for Exam 2.
1 Computational Vision CSCI 363, Fall 2012 Lecture 31 Heading Models.
Lecture 2b Readings: Kandell Schwartz et al Ch 27 Wolfe et al Chs 3 and 4.
1 Computational Vision CSCI 363, Fall 2012 Lecture 20 Stereo, Motion.
Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain  Pack & Born Nature (2001) Harvard Medical School.
Chapter 8: Perceiving Motion
1 Computational Vision CSCI 363, Fall 2012 Lecture 21 Motion II.
EFFECTS OF STIMULUS WIDTH AND LENGTH ON THE DETECTION THRESHOLDS FOR II-nd ORDER GRATINGS D. Mitov, Ts. Totev, K. Racheva, I. Hristov Institute of Neurobiology,
How MT cells analyze the motion of visual patterns Nicole C Rust1, 2, 4, Valerio Mante2, 3, 4, Eero P Simoncelli1, 2, 5 & J Anthony Movshon2, 5 Neurons.
1 Computational Vision CSCI 363, Fall 2012 Lecture 24 Computing Motion.
Motion Illusions As Optimal Percepts. What’s Special About Perception? Visual perception important for survival  Likely optimized by evolution  at least.
Computational Vision CSCI 363, Fall 2012 Lecture 22 Motion III
Outline Of Today’s Discussion 1.Review of Wave Properties, and Fourier Analysis 2.The Contrast Sensitivity Function 3.Metamers 4.Selective Adaptation And.
Keith May Advanced Motion.
Bayesian Perception.
From: Motion processing with two eyes in three dimensions
Kosslyn, S. M. , Pick, H. L. , Fariello, G. R
Journal of Vision. 2008;8(11):18. doi: / Figure Legend:
Requirements Analysis and Specification
From: Motion processing with two eyes in three dimensions
Measuring motion in biological vision systems
Brain States: Top-Down Influences in Sensory Processing
Spring 2018 Professor Michael Mozer
Binocular Stereo Vision
A Human Extrastriate Area Functionally Homologous to Macaque V4
Critical Thinking Skills
7 Motion Perception.
Measuring motion in biological vision systems
Neuronal Synchrony: A Versatile Code for the Definition of Relations?
Pattern and Component Motion Responses in Mouse Visual Cortical Areas
Christopher C. Pack, Richard T. Born, Margaret S. Livingstone  Neuron 
Pattern Recognition Binding Edge Detection
Independent Aftereffects of Attention and Motion
Minami Ito, Gerald Westheimer, Charles D Gilbert  Neuron 
Analysis of Contour Motions
Yu-Cheng Pei, Steven S. Hsiao, James C. Craig, Sliman J. Bensmaia 
Vagaries of Visual Perception in Autism
Adaptation Disrupts Motion Integration in the Primate Dorsal Stream
Orthographic Projection
Liu D. Liu, Christopher C. Pack  Neuron 
Brain States: Top-Down Influences in Sensory Processing
Orthographic Projection
Georgia G. Gregoriou, Stephen J. Gotts, Robert Desimone  Neuron 
Pattern and Component Motion Responses in Mouse Visual Cortical Areas
Value-Based Modulations in Human Visual Cortex
Normalization Regulates Competition for Visual Awareness
The Normalization Model of Attention
Albert V. van den Berg, Jaap A. Beintema  Neuron 
Stereoscopic Surface Perception
Higher-Order Figure Discrimination in Fly and Human Vision
Experience-Driven Plasticity in Binocular Vision
Volume 21, Issue 23, Pages (December 2011)
Neuronal Adaptation to Visual Motion in Area MT of the Macaque
Kazumichi Matsumiya, Satoshi Shioiri  Current Biology 
Detection of image intensity changes
Optimizing Visual Motion Perception during Eye Movements
Visual Motion Induces a Forward Prediction of Spatial Pattern
Critical Thinking Skills
Presentation transcript:

Phenomenal Coherence of Moving Visual Patterns Edward Adelson & Anthony Movshon

Question Is the aperture problem solved by a two-step system of motion detection?

Alternatives Yes, the two-step model is the solution. No: Its somehow solved otherwise No: Its not a problem to begin with

Logic If there are two levels of motion detection, we might be able to create some stimuli in which the second level is active and some in which it is not. The activity of the second level is apparent in stimuli where the aperture problem is resolved. By studying the properties of the stimuli that are perceived as resolved vs. nonresolved, we can infer the properties of the second level.

Methods Subjects were presented with “plaid” stimuli that consisted of two moving sinusoidal gratings. One of the gratings varied systematically in contrast and spatial frequency. Subjects were asked to indicate if the percept was coherent or transparent.

Methods – details Subjects were asked to not make a judgment unless their eyes were fixated on a small black circle in the middle of the display. After each 1.5-s exposure, the observer indicated whether the pattern appeared ‘coherent’ or ‘incoherent’. Stimuli were 5 deg, presented on a CRT, controlled by a PDP11

Results Two gratings that are sliding over each other are often seen as moving coherently in one, not two directions (b). This common direction is best described as the “intersection of constraints” not the vector average (c).

Results Increasing the contrast of one of the gratings makes it more likely that it is perceived (open circles) Increasing the contrast further makes the percept monotonically more and more coherent.  Contrast affects coherence beyond mere visibility.

Results Utilizing this contrast dependence, the authors recorded under which conditions of “added” contrast, they could get 50% coherence. As it turns out, the larger the difference in spatial frequency between the gratings is, the more contrast needs to be added.  Mechanism of coherence detection is SF dependent.

Interpretation This leads to a two-step model: At a first level, oriented and SF-dependent neurons in V1 sample the local motion of an object, extracting the motion perpendicular to the contours. At a second level, this information is integrated by MT neurons that perform a Intersection of Contraints computation on the component vectors.

Problems The data is consistent with this notion, but is so indirect that it does not offer concrete proof that MT plays a part in second stage processing. Experiments done in human whereas all physiology on MT done in monkeys (as of 1982). There were only two subjects