Independence of luminance and contrast in natural scenes and in the early visual system Valerio Mante, Robert A Frazor, Vincent Bonin, Wilson S Geisler,

Slides:



Advertisements
Similar presentations
V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.
Advertisements

Chapter 2.
Gabor Filter: A model of visual processing in primary visual cortex (V1) Presented by: CHEN Wei (Rosary) Supervisor: Dr. Richard So.
by Michael Anthony Repucci
E ffi cient Coding: From Retina Ganglion Cells To V2 Cells Honghao Shan Garrison W. Cottrell The Temporal Dynamics of Learning Center Gary's Unbelievable.
Chapter 6 Spatial Vision. The visual system recognizes objects from patterns of light and dark. We will focus on the mechanisms the visual system uses.
Prediction, Correlation, and Lack of Fit in Regression (§11. 4, 11
Digital Image Processing
776 Computer Vision Jan-Michael Frahm, Enrique Dunn Fall 2014.
Chap 4-2. Frequency domain processing Jen-Chang Liu, 2006.
Spike-triggering stimulus features stimulus X(t) multidimensional decision function spike output Y(t) x1x1 x2x2 x3x3 f1f1 f2f2 f3f3 Functional models of.
TESTING MODELS OF SIGNAL INTEGRATION IN MT Valerio Mante, Najib Majaj, Matteo Carandini, J. Anthony Movshon ETH and University of Zurich Howard Hughes.
Introduction to Image Quality Assessment
M.Sc. CNS Visual Perception Concept of receptive field Stan Gielen Dept. of Biophysics.
FMRI: Biological Basis and Experiment Design Lecture 26: Significance Review of GLM results Baseline trends Block designs; Fourier analysis (correlation)
SOMTIME: AN ARTIFICIAL NEURAL NETWORK FOR TOPOLOGICAL AND TEMPORAL CORRELATION FOR SPATIOTEMPORAL PATTERN LEARNING.
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean Hall 5409 T-R 10:30am – 11:50am.
Introduction to Image Processing Grass Sky Tree ? ? Review.
Another viewpoint: V1 cells are spatial frequency filters
Low Level Visual Processing. Information Maximization in the Retina Hypothesis: ganglion cells try to transmit as much information as possible about the.
2 2  Background  Vision in Human Brain  Efficient Coding Theory  Motivation  Natural Pictures  Methodology  Statistical Characteristics  Models.
BMME 560 & BME 590I Medical Imaging: X-ray, CT, and Nuclear Methods Introductory Topics Part 2.
Digital Image Processing
How natural scenes might shape neural machinery for computing shape from texture? Qiaochu Li (Blaine) Advisor: Tai Sing Lee.
Computer Vision – Enhancement(Part III) Hanyang University Jong-Il Park.
On Natural Scenes Analysis, Sparsity and Coding Efficiency Redwood Center for Theoretical Neuroscience University of California, Berkeley Mind, Brain.
Just Noticeable Difference Estimation For Images with Structural Uncertainty WU Jinjian Xidian University.
BCS547 Neural Decoding. Population Code Tuning CurvesPattern of activity (r) Direction (deg) Activity
How MT cells analyze the motion of visual patterns Nicole C Rust1, 2, 4, Valerio Mante2, 3, 4, Eero P Simoncelli1, 2, 5 & J Anthony Movshon2, 5 Neurons.
7- 1 Chapter 7: Fourier Analysis Fourier analysis = Series + Transform ◎ Fourier Series -- A periodic (T) function f(x) can be written as the sum of sines.
Autonomous Robots Vision © Manfred Huber 2014.
Sampling Pixel is an area!! – Square, Rectangular, or Circular? How do we approximate the area? – Why bother? Color of one pixel Image Plane Areas represented.
Visual Computing Computer Vision 2 INFO410 & INFO350 S2 2015
Activity Dependent Conductances: An “Emergent” Separation of Time-Scales David McLaughlin Courant Institute & Center for Neural Science New York University.
The General Linear Model (for dummies…) Carmen Tur and Ashwani Jha 2009.
6. Population Codes Presented by Rhee, Je-Keun © 2008, SNU Biointelligence Lab,
Non-Linear Transformations Michael J. Watts
The linear systems model of fMRI: Strengths and Weaknesses Stephen Engel UCLA Dept. of Psychology.
Gholamreza Anbarjafari, PhD Video Lecturers on Digital Image Processing Digital Image Processing Spatial Domain Filtering: Part I.
Image Quality Measures Omar Javed, Sohaib Khan Dr. Mubarak Shah.
1 Nonlinear models for Natural Image Statistics Urs Köster & Aapo Hyvärinen University of Helsinki.
Stephen V David, William E Vinje, Jack L Gallant J Neurosci, Aug 2004
Authors: Peter W. Battaglia, Robert A. Jacobs, and Richard N. Aslin
Sampling Theorem told us …
Nonlinear processing in LGN neurons
A Review in Quality Measures for Halftoned Images
Lecture 3 (2.5.07) Image Enhancement in Spatial Domain
Signal, Noise, and Variation in Neural and Sensory-Motor Latency
the statistics of the environment
Contrast Gain Control in Auditory Cortex
Soumya Chatterjee, Edward M. Callaway  Neuron 
Goal-Related Activity in V4 during Free Viewing Visual Search
Spatiotemporal Response Properties of Optic-Flow Processing Neurons
Volume 66, Issue 6, Pages (June 2010)
Andrea Benucci, Robert A. Frazor, Matteo Carandini  Neuron 
Volume 55, Issue 3, Pages (August 2007)
Motion-Based Analysis of Spatial Patterns by the Human Visual System
Cascaded Effects of Spatial Adaptation in the Early Visual System
Saccadic suppression precedes visual motion analysis
Profound Contrast Adaptation Early in the Visual Pathway
The Challenges Natural Images Pose for Visual Adaptation
Consequences of the Oculomotor Cycle for the Dynamics of Perception
Neuronal Selectivity and Local Map Structure in Visual Cortex
Origin and Function of Tuning Diversity in Macaque Visual Cortex
Consequences of the Oculomotor Cycle for the Dynamics of Perception
Volume 64, Issue 6, Pages (December 2009)
Origin and Dynamics of Extraclassical Suppression in the Lateral Geniculate Nucleus of the Macaque Monkey  Henry J. Alitto, W. Martin Usrey  Neuron  Volume.
Lecture 12 Figures from Gonzalez and Woods, Digital Image Processing, Second Edition, 2002.
Valerio Mante, Vincent Bonin, Matteo Carandini  Neuron 
Maxwell H. Turner, Fred Rieke  Neuron 
Presentation transcript:

Independence of luminance and contrast in natural scenes and in the early visual system Valerio Mante, Robert A Frazor, Vincent Bonin, Wilson S Geisler, and Matteo Carandini Nature Neuroscience dec2005

Independence of luminance and contrast in natural scenes and in the early visual system Valerio Mante, Robert A Frazor, Vincent Bonin, Wilson S Geisler, and Matteo Carandini Nature Neuroscience dec2005 measured natural statistics of local luminance, contrast modeled changing temporal kernel in cat LGN cells results: luminance independent of contrast kernel is separable, too implications?

statistics of natural scenes simulated saccade sequence luminance contrast weighted local patch movements sampled from measured distributions (uniform gave same results)

statistics of natural scenes large dynamic range little correlation from fixation to fixation

statistics of natural scenes

what causes these distributions? 1/f statistics phase alignment natural scene structure: illumination, reflectance, areas of high-luminance/high- contrast what are the implications for neural coding? large dynamic range requires adaptation expect independent coding of independent quantities

neural sensitivity to luminance/contrast luminance: 56 → 32 cdmluminance: 32 → 56 cdm linear prediction

neural sensitivity to luminance/contrast luminance: 100 → 31%contrast: 31 → 100% linear prediction

measured response at fixed luminance, contrast spiking rate varies with temporal frequency, contrast, luminance

model of neural response linear filtering by convolution with spatio-temporal kernel additive noise thresholding non-linearity

the spatio-temporal kernel

spatial components

the spatio-temporal kernel spatial components temporal kernel (impulse response) fitted params:

fitting the temporal kernel descriptive model fit parameters for each luminance/contrast setting

fitting the temporal kernel descriptive model fit parameters for each luminance/contrast setting

model each temporal kernel as a convolution of contrast, luminance, and base kernel (product in the freq domain) separable model fitting the temporal kernel descriptive model fit parameters for each luminance/contrast setting

results - % variance of neural response explained both kernels work equally well separabledescriptive

results - adaptation effects modeled with separable kernel circles: neural responselines: predictions of model luminance = 10% luminance = 84% contrast = 10% contrast = 100%

discussion dynamic range, speed of adaptation stimuli what about other non-linear response properties? (cross-orientation, surround suppresion, etc) separate underlying mechanisms? what about responses to more complex images? relationship to normalization models? what are the neural mechanisms? what are the functional implications?

end