Motion detection with movement detectors. It is a non-linear device: response to velocity a and velocity b is not equal to velocity a+b movement detection.

Slides:



Advertisements
Similar presentations
Chapter 4: The Visual Cortex and Beyond
Advertisements

Ter Haar Romeny, EMBS Berder 2004 How can we find a dense optic flow field from a motion sequence in 2D and 3D? Many approaches are taken: - gradient based.
What do we know about Primary Visual Cortex (V1)
Higher Visual Areas Anatomy of higher visual areas
Visual Sensation & Perception How do we see?. Structure of the eye.
A Neural Model for Detecting and Labeling Motion Patterns in Image Sequences Marc Pomplun 1 Julio Martinez-Trujillo 2 Yueju Liu 2 Evgueni Simine 2 John.
The Central Visual System
Perception Chapter 9: Event Perception Event Perception: an event is defined as a change in both time and space. Thus far we have discussed how our visual.
Chapter 4: Cortical Organization
MOTION PERCEPTION Types of Motion Perception Corollary Discharge Theory Movement Detectors Motion Perception and Object Perception Ecological Perception.
What is vision Aristotle - vision is knowing what is where by looking.
2002/02/05PSYC , Term 2, Copyright Jason Harrison, Visual pathways from here to there to everywhere.
$ recognition & localization of predators & prey $ feature analyzers in the brain $ from recognition to response $ summary PART 2: SENSORY WORLDS #09:
Perception Chapter 3 Light is necessary but not sufficient for vision Ganzfeld: a visual field completely lacking in contour, or luminance changes. Prolonged.
Higher Processing of Visual Information: Lecture III
1/29/2002PSYC , Term 2, Copyright 2002 Jason Harrison1 Perception of Motion and Movement.
Blue= rods Green = Cones Pathways from the Retina In the brain, retinal ganglion axons travel to… –the hypothalamus: control bodily rhythms.
Human eye, horizontal section. “V1” Lateral Geniculate Nucleus The retinal bipolar cells send impulses to the.
M.Sc. CNS Visual Perception Optic Flow Stan Gielen Dept. of Biophysics.
Cognitive Processes PSY 334 Chapter 2 – Perception June 30, 2003.
The Human Visual System Short Overview. Terms: LGN, cortex, primary visual cortex, V1.
Visual Cognition I basic processes. What is perception good for? We often receive incomplete information through our senses. Information can be highly.
Color vision Different cone photo- receptors have opsin molecules which are differentially sensitive to certain wavelengths of light – these are the physical.
Overview 1.The Structure of the Visual Cortex 2.Using Selective Tuning to Model Visual Attention 3.The Motion Hierarchy Model 4.Simulation Results 5.Conclusions.
Motion Computation and Visual Orientation In Flies MSc Evolutionary and Adaptive Systems Computer Vision Juan Pablo Calderon.
Motion Field and Optical Flow. Outline Motion Field and Optical Flow Definition, Example, Relation Optical Flow Constraint Equation Assumptions & Derivation,
Computational Architectures in Biological Vision, USC, Spring 2001
Basic Processes in Visual Perception
Laurent Itti: CS599 – Computational Architectures in Biological Vision, USC Lecture 5: Introduction to Vision 2 1 Computational Architectures in.
1B50 – Percepts and Concepts Daniel J Hulme. Outline Cognitive Vision –Why do we want computers to see? –Why can’t computers see? –Introducing percepts.
Sensation and Perception Part 1: Intro and Vision.
1 Computational Vision CSCI 363, Fall 2012 Lecture 26 Review for Exam 2.
Active Vision Key points: Acting to obtain information Eye movements Depth from motion parallax Extracting motion information from a spatio-temporal pattern.
Besides human's not being able to detect UV wavelengths, I understand they also can damage our eyes upon excessive exposure (like during arc welding).
1 Computational Vision CSCI 363, Fall 2012 Lecture 3 Neurons Central Visual Pathways See Reading Assignment on "Assignments page"
1-1 Measuring image motion velocity field “local” motion detectors only measure component of motion perpendicular to moving edge “aperture problem” 2D.
1 Computational Vision CSCI 363, Fall 2012 Lecture 31 Heading Models.
THE VISUAL SYSTEM: EYE TO CORTEX Outline 1. The Eyes a. Structure b. Accommodation c. Binocular Disparity 2. The Retina a. Structure b. Completion c. Cone.
Occipital Lobe Videos: –Brain modules 8,9,10, 11 –Consciousness- Blindsight.
1 Computational Vision CSCI 363, Fall 2012 Lecture 20 Stereo, Motion.
Speed vs.Velocity Speed (s) is the distance an object travels per unit of time (rate). Speed (s) is the distance an object travels per unit of time (rate).
Acceleration Physics 1 Dimensional Motion Chapter 2 Section 2 – pages
The primate visual systemHelmuth Radrich, The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception.
Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain  Pack & Born Nature (2001) Harvard Medical School.
Chapter 8: Perceiving Motion
1 Computational Vision CSCI 363, Fall 2012 Lecture 21 Motion II.
CS332 Visual Processing Department of Computer Science Wellesley College Analysis of Motion Measuring image motion.
3D Imaging Motion.
Vision Photoreceptor cells Rod & Cone cells Bipolar Cells Connect in between Ganglion Cells Go to the brain.
Acceleration “lets go faster!”. Some background Before we start acceleration lets review velocity. Velocity is the change in position over the change.
Higher Visual Areas 1.Anatomy of higher visual areas 2.Two processing pathways - “ Where ” pathway for motion and depth - “ What ” pathway for form and.
1 Perception and VR MONT 104S, Fall 2008 Lecture 6 Seeing Motion.
Visual Computation I. Physiological Foundations
Computational Vision CSCI 363, Fall 2012 Lecture 22 Motion III
Week 4 Motion, Depth, Form: Cormack Wolfe Ch 6, 8 Kandell Ch 27, 28 Advanced readings: Werner and Chalupa Chs 49, 54, 57.
Sensation & Perception. Motion Vision I: Basic Motion Vision.
From cortical anisotropy to failures of 3-D shape constancy Qasim Zaidi Elias H. Cohen State University of New York College of Optometry.
Object and face recognition
Understanding Psychophysics: Spatial Frequency & Contrast
Sensation and Perception. Transformation of stimulus energy into a meaningful understanding –Each sense converts energy into awareness.
Cogs1 mapping space in the brain Douglas Nitz – Feb. 19, 2009 any point in space is defined relative to other points in space.
Chapter 4: Cortical Organization
1 Computational Vision CSCI 363, Fall 2012 Lecture 32 Biological Heading, Color.
Vision is created by utilizing two properties of light, energy(intensity) and frequency (wavelength) of stimulus.
1 Perception and VR MONT 104S, Spring 2008 Lecture 3 Central Visual Pathways.
The Visual System: Higher Cortical Mechanisms
The visual perception of motion
Measuring image motion
Maximum Response Experimentation
Detecting Motion Pattern in Optical Flow Fields
Presentation transcript:

Motion detection with movement detectors

It is a non-linear device: response to velocity a and velocity b is not equal to velocity a+b movement detection may be asymmetric (response to velocity a is not opposite to response to velocity -a) or symmetric Requirements on movement detectors a b a+b

Asymmetric movement detector V = Δx/Δt

Movement detector V = Δx/Δt Note: the same velocity v is detected for various Δx and Δt as long as Δx/Δt = constant

Velocity dependence of movement detector v v response

Relation between temporal and spatial gradients Δx

Movement detector Step-like response functions are not very likely

Movement detector responsie Δt

Movement detector

Movement detector in fly visual system Response to spatial sinewave pattern with wavelength 16 o and τ = 50 ms.

The aperture problem

Receptive field of movement detector Δx

The aperture problem

Identical responses for v=v 0 /cosα α v0v0

The aperture problem A single cell cannot solve the aperture problem; only an ensemble of cells can under the assumption of a rigid body

Example 1

Example 2

Various types of cells End-stop cell

Example 3

Hypothetical solution

Optic/flow detectors

Divergence operator

Rotation operator

Deformation operator

Schematic overview of monkey brain

Responses of neurons in VIP to various optic-flow patterns

Be aware : position of receptive field relative to stimulus !

Retinal motion Due to object motion due to eye movements

Schematic overview of monkey brain

Responses of MST neurons to active vs passive optic flow

Perceptual responses to moving stimuli

Movement detector V = Δx/Δt Detectors have all orientations

Transparent motion Percept ?

Movement detector V = Δx/Δt Variation in v is achieved by both: larger Δx smaller Δt

Transparent motion Percept : two different separately moving patterns

References