Maps in the Brain – Introduction

Slides:



Advertisements
Similar presentations
TESS MATTSON, CAITLIN SKLUZACEK, BLAINE FEIA, PENG JIAO LI, LUCAS MENDEN, JAMES LOONEN, CHAARISSA ROMERO Striate Receptive Fields.
Advertisements

The Primary Visual Cortex
The Visual System: Feature Detection Model Lesson 17.
Chapter 2.
Chapter 3: Neural Processing and Perception. Lateral Inhibition and Perception Experiments with eye of Limulus –Ommatidia allow recordings from a single.
1 Maps in the Brain – Introduction. 2 Overview A few words about Maps Cortical Maps: Development and (Re-)Structuring Auditory Maps Visual Maps Place.
Maps of More Abstract Spaces. Auditory Maps Auditory information (air pressure fluctuation) undergo a complex cascade or transformation before it reaches.
Chapter 6 The Visual System
Move Retinal Position: Allows you to view different regions of the retina. Location refers to the center of screen in arbitrary units Retinal region that.
ניורוביולוגיה ומדעי המח חלק 2 – מערכת הראייה Introduction to Neurobiology Part 2 – The Visual System Shaul Hochstein.
Color vision Different cone photo- receptors have opsin molecules which are differentially sensitive to certain wavelengths of light – these are the physical.
Maps in the Brain – Introduction. Overview A few words about Maps Cortical Maps: Development and (Re-)Structuring Auditory Maps Visual Maps Place Fields.
Higher Processing of Visual Information: Lecture II
Maps in the Brain and their models. Where are things happening in the brain. Is the information represented locally ? The Phrenologists view at the brain.
1 Maps in the Brain – Introduction. 2 Cortical Maps Cortical Maps map the environment onto the brain. This includes sensory input as well as motor and.
Maps in the Brain – Introduction. Overview A few words about Maps Cortical Maps: Development and (Re-)Structuring Auditory Maps Visual Maps Place Fields.
1 Computational Vision CSCI 363, Fall 2012 Lecture 3 Neurons Central Visual Pathways See Reading Assignment on "Assignments page"
THE VISUAL SYSTEM: EYE TO CORTEX Outline 1. The Eyes a. Structure b. Accommodation c. Binocular Disparity 2. The Retina a. Structure b. Completion c. Cone.
The Visual Cortex: Anatomy
Chapter 3: Neural Processing and Perception. Neural Processing and Perception Neural processing is the interaction of signals in many neurons.
Topological Neural Networks Bear, Connors & Paradiso (2001). Neuroscience: Exploring The Brain. Pg. 474.
1 30 Verschiedene Körperteile werden unterschiedlich im motorischen bzw. somatosens. Cortex repräsentiert. Erklären Sie welche Auswirkung dies auf die.
Self Organizing Maps: Clustering With unsupervised learning there is no instruction and the network is left to cluster patterns. All of the patterns within.
Understanding Psychophysics: Spatial Frequency & Contrast
Biological Modeling of Neural Networks: Week 10 – Neuronal Populations Wulfram Gerstner EPFL, Lausanne, Switzerland 10.1 Cortical Populations - columns.
Cogs1 mapping space in the brain Douglas Nitz – Feb. 19, 2009 any point in space is defined relative to other points in space.
1 Perception and VR MONT 104S, Spring 2008 Lecture 3 Central Visual Pathways.
Maps in the Brain – Introduction
Processing visual information - pathways
Maps of More Abstract Spaces
Brodmann’s Areas. Brodmann’s Areas The Primary Visual Cortex Hubel and Weisel discovered simple, complex and hypercomplex cells in the striate.
Neuroscience: Exploring the Brain, 3e
Dmitriy Aronov, David W. Tank  Neuron 
The Geometry of Visual Cortical Maps
Early Processing in Biological Vision
Optic Nerve Projections
A Motion Direction Map in Macaque V2
Christopher C. Pack, Richard T. Born, Margaret S. Livingstone  Neuron 
Soumya Chatterjee, Edward M. Callaway  Neuron 
Volume 19, Issue 2, Pages (August 1997)
Orientation tuning: strongest response to one orientation
Two-Dimensional Substructure of MT Receptive Fields
Retinal Representation of the Elementary Visual Signal
Binocular Disparity and the Perception of Depth
CA3 Retrieves Coherent Representations from Degraded Input: Direct Evidence for CA3 Pattern Completion and Dentate Gyrus Pattern Separation  Joshua P.
Relationship of Correlated Spontaneous Activity to Functional Ocular Dominance Columns in the Developing Visual Cortex  Chiayu Chiu, Michael Weliky  Neuron 
The Visual System: Feature Detection Model
Fundamentals of Sensation and Perception
Sleep Enhances Plasticity in the Developing Visual Cortex
Neural Mechanisms of Visual Motion Perception in Primates
Fangtu T. Qiu, Rüdiger von der Heydt  Neuron 
What do grid cells contribute to place cell firing?
Greg Schwartz, Sam Taylor, Clark Fisher, Rob Harris, Michael J. Berry 
Xiaomo Chen, Marc Zirnsak, Tirin Moore  Cell Reports 
The Temporal Correlation Hypothesis of Visual Feature Integration
Volume 64, Issue 6, Pages (December 2009)
Ingrid Bureau, Gordon M.G Shepherd, Karel Svoboda  Neuron 
The Normalization Model of Attention
Representation of Color Stimuli in Awake Macaque Primary Visual Cortex
Receptive Fields of Disparity-Tuned Simple Cells in Macaque V1
Volume 35, Issue 3, Pages (August 2002)
Short-Term Memory for Figure-Ground Organization in the Visual Cortex
Volume 48, Issue 2, Pages (October 2005)
Dynamic Shape Synthesis in Posterior Inferotemporal Cortex
Opponent Inhibition Neuron
Visual development: Making maps in the dark
Construction of Complex Receptive Fields in Cat Primary Visual Cortex
End-Stopping and the Aperture Problem
Multineuronal Firing Patterns in the Signal from Eye to Brain
Pairing-Induced Changes of Orientation Maps in Cat Visual Cortex
Presentation transcript:

Maps in the Brain – Introduction

Overview Cortical Maps: Development and (Re-)Structuring Auditory Maps A few words about Maps Cortical Maps: Development and (Re-)Structuring Auditory Maps Visual Maps Place Fields

What are Maps I Intuitive Definition: Maps are a (scaled) depiction of a certain area. Location (x,y) is directly mapped to a piece of paper. Additional information such as topographical, geographical, political can be added as colors or symbols.

What are Maps I Intuitive Definition: Maps are a (scaled) depiction of a certain area. Location (x,y) is directly mapped to a piece of paper. Additional information such as topographical, geographical, political can be added as colors or symbols. Important: A map is always a reduction in complexity. It is a REDUCED picture of reality that contains IMPORTANT aspects of it. What is important? That is in the eye of the beholder...

What are Maps II Mathematical Definition: Let W be a set, U a subset of W and A metric space (distances are defined). Then we call f a map if it is a one-to-one mapping from U to A. f: U -> A Example: The surface of the world (W) is a 2D structure embedded in 3D space. It can be mapped to a 2D euclidean space. In a mathematical sense a map is an equivalent representation of a complex structure (W) in a metric space (A), i.e. it is not a reduction – the entire information is preserved.

Cortical Maps Cortical Maps map the environment onto the brain. This includes sensory input as well as motor and mental activity. Example: Map of sensory and motor representations of the body (homunculus).The more important a region, the bigger its map representation. Scaled “remapping” to real space

Spatial Maps Place Cells

What are place cells? Place cells are the principal neurons found in a special area of the mammal brain, the hippocampus. They fire strongly when an animal (a rat) is in a specific location of an environment. Place cells were first described in 1971 by O'Keefe and Dostrovsky during experiments with rats. View sensitive cells have been found in monkeys (Araujo et al, 2001) and humans (Ekstrom et al, 2003) that may be related to the place cells of rats.

The Hippocampus Human hippocampus

The Hippocampus Human hippocampus Rat hippocampus

Two old slides

Hippocampus Hippocampus involved in learning and memory Place cells Visual Olfactory Auditory Taste Somatosensory Self-motion Hippocampus involved in learning and memory All sensory input into hippocampus Place cells in hippocampus get all sensory information Information processing via trisynaptic loop How place are exactly used for navigation is unknown

Place cell recordings 1. Electrode array is inserted to the brain for simultaneous recording of several neurons. Wilson and McNaughton, 1993

Place cell recordings 1. 2. Electrode array is inserted to the brain for simultaneous recording of several neurons. The rat moves around in a known/unknown environment. Wilson and McNaughton, 1993

Place cell recordings 1. 2. 3. Electrode array is inserted to the brain for simultaneous recording of several neurons. The rat moves around in a known/unknown environment. Walking path and firing activity (cyan dots). Wilson and McNaughton, 1993

Place Field Recordings Terrain: 40x40cm Single cell firing activity y x y x Map firing activity to position within terrain Place cell is only firing around a certain position (red area)‏ Cell is like a “Position Detector”

Place fields 40x40cm O’Keefe, 1999 Array of cells Ordered for position of activity peak (top left to bottom right)‏ O’Keefe, 1999

Place fields 40x40cm O’Keefe, 1999 Array of cells Ordered for position of activity peak (top left to bottom right)‏ Different shapes: Circular Islands O’Keefe, 1999

Place fields 40x40cm O’Keefe, 1999 Array of cells Ordered for position of activity peak (top left to bottom right)‏ Different shapes: Circular Islands Twin Peaks O’Keefe, 1999

Place fields 40x40cm O’Keefe, 1999 Array of cells Ordered for position of activity peak (top left to bottom right)‏ Different shapes: Circular Islands Twin Peaks Elongated O’Keefe, 1999

Place fields 40x40cm O’Keefe, 1999 Array of cells Ordered for position of activity peak (top left to bottom right)‏ Different shapes: Circular Islands Twin Peaks Elongated Not Simple (=> not published)‏ O’Keefe, 1999

How do place cells develop? Allothetic (external) sensory input Visual Olfactory (around 1000 receptors in rat, whereas humans have 350)‏ Somatosensory (via whiskers)‏ Auditory (rat range 200Hz-90KHz, human range 16Hz-20KHz)‏ Idiothetic (internal) sensory input Self motion (path integration, mostly used then allothetic information is not available)‏ Not so reliable by itself since no feedback

Importance of visual cues Experiment: Environment with landmark (marked area) => record activity from cell 1 and 2 Observation: Place fields develop Knierim, 1995

Importance of visual cues Experiment: Environment with landmark (marked area) => record activity from cell 1 and 2 Observation: Place fields develop Step 2: Rotate landmark => place fields rotate respectively Conclusion: Visual cues are used for formation of place fields Knierim, 1995

Place Cell Remapping Brown plastic square box and white wooden circle box was used to show place cell remapping phenomena: Cells 1-5 show increasing divergence between the square and circle box; Cells 6-10 show differentiation from the beginning; Some cells chow common representation or do not remap at all (not shown). Wills et al, 2005, Science

Importance of olfactory cues Fact: Rats use their urine to mark environment Experiment: Two sets, one in light and one in darkness; remove self-induced olfactory cues and landmarks (S2-S4)‏ Result: Without olfactory cues stable place fields (control S1) change or in darkness even deteriorate. When olfactory cues are allowed again (control S5), place fields reemerge. Dark/Cleaning Light/Cleaning Save, 2000

Place cell model Use neuronal network to model formation of place cells

Place cell model Use neuronal network to model formation of place cells Input layer for allothetic sensory input depending on position in simulated world 4 Visual cues (landmarks)‏

Place cell model Use neuronal network to model formation of place cells Input layer for allothetic sensory input depending on position in simulated world 4 Visual cues (landmarks)‏ 4 Olfactory cues (environmental)‏

Place cell model Use neuronal network to model formation of place cells Input layer for allothetic sensory input depending on position in simulated world 4 Visual cues (landmarks)‏ 4 Olfactory cues (environmental)‏ Output layer, n x n simulated neurons, each of which is connected to all input neurons (fully connected feed-forward)‏

Place cell model Use neuronal network to model formation of place cells Input layer for allothetic sensory input depending on position in simulated world 4 Visual cues (landmarks)‏ 4 Olfactory cues (environmental)‏ Output layer, nxn simulated neurons, each of which is connected to all input neurons (fully connected feed-forward)‏ After learning => formation of place fields

Place cell model Use neuronal network to model formation of place cells Input layer for allothetic sensory input depending on position in simulated world 4 Visual cues (landmarks)‏ 4 Olfactory cues (environmental)‏ Output layer, nxn simulated neurons, each of which is connected to all input neurons (fully connected feed-forward)‏ After learning => formation of place fields The know-how is in the change of the connection weights W ...

Mathematics of the model Firing rate r of Place Cell i at time t is modeled as Gaussian function: σf is width of the Gaussian function, X and W are vectors of length n, ||* || is the euclidean distance

Mathematics of the model Firing rate r of Place Cell i at time t is modeled as Gaussian function: σf is width of the Gaussian function, X and W are vectors of length n, ||* || is the euclidean distance At every time step only on weight W is changed (Winner-Takes-All), i.e. the neuron with the strongest response is changed:

Place fields Visual input => unique round place fields, because the distances to the walls are unique (no multipeaks)‏ Olfactory input => place fields not round, because input is complex (gradients not well structured)‏ Combined input is a mixture of both

Place field remapping

Maps of More Abstract Spaces

Visual cortex

Visual cortex

Retinal (x,y) to complex log coordinates Cortical Mapping Retinal (x,y) to complex log coordinates Retinal Space Complex log Concentric Circles Vertical Lines (expon. Spaced) (equally spaced) Radial Lines Horizontal Lines (equal angular spacing) (equally spaced) The complex logarithmic transform a = c + ib log(a) = log(c + ib) a = r exp(if) In Polar Coordinates c b r = ||a|| f

Thus we have obtained scale and rotation invariance ! Cortical Mapping retinal (x,y) to log Z Coordinates On „Invariance“ A major problem is how the brain can recognize object in spite of size and rotation changes! Real Space log Z Space Concentric Circles Vertical Lines (expon. Spaced) (equally spaced) Radial Lines Horizontal Lines (equal angular spacing) (equally spaced) Scaling and Rotation defined in Polar Coordinates: Scaling A = k r exp(if) = k a a = r exp(if) Rotation Scaling constant A = exp(ig) r exp(if) = r exp(i[f+g]) = a exp(ig) Rotation angle After log Z transform we get: Scaling: log(ka) = log(k) + log(a) Rotation: log(a exp(ig)) = ig + log(a) Thus we have obtained scale and rotation invariance !

Some more details z+a G(z) = log z=x + iy z+b a and b take the values 0.333 and 6.66 respectively.

Visual cortex

Visual Cortex Primary visual cortex or striate cortex or V1. Well defined spacial representation of retina (retinotopy).

Visual Cortex Primary visual cortex or striate cortex or V1. Well defined spacial representation of retina (retinotopy). Prestriate visual cortical area or V2 gets strong feedforward connection from V1, but also strongly projects back to V1 (feedback)‏ Extrastriate visual cortical areas V3 – V5. More complex representation of visual stimulus with feedback from other cortical areas (eg. attention).

Receptive fields Cells in the visual cortex have receptive fields (RF). These cells react when a stimulus is presented to a certain area on the retina, i.e. the RF. Simple cells react to an illuminated bar in their RF, but they are sensitive to its orientation (see classical results of Hubel and Wiesel, 1959). Bars of different length are presented with the RF of a simple cell for a certain time (black bar on top). The cell's response is sensitive to the orientation of the bar.

On-Off responses Experiment: A light bar is flashed within the RF of a simple cell in V1 that is recorded from. Observation: Depending on the position of the bar within the RF the cell responds strongly (ON response) or not at all (OFF response).

On-Off responses Experiment: A light bar is flashed within the RF of a simple cell in V1 that is recorded from. Observation: Depending on the position of the bar within the RF the cell responds strongly (ON response) or not at all (OFF response). Explanation: Simple cell RF emerges from the overlap of several LGN cells with center surround RF.

Columns Experiment: Electrode is moved through the visual cortex and the preference orientation is recorded. Observation 1: Preferred orientation changes continuously within neighboring cells.

Columns Experiment: Electrode is moved through the visual cortex and the preference orientation is recorded. Observation 1: Preferred orientation changes continuously within neighboring cells. Observation 2: There are discontinuities in the preferred orientation.

2d Map Colormap of preferred orientation in the visual cortex of a cat. One dimensional experiments like in the previous slide correspond to an electrode trace indicated by the black arrow. Small white arrows are VERTICES where all orientations meet.

Ocular Dominance Columns The signals from the left and the right eye remain separated in the LGN. From there they are projected to the primary visual cortex where the cells can either be dominated by one eye (ocular dominance L/R) or have equal input (binocular cells).

Ocular Dominance Columns The signals from the left and the right eye remain separated in the LGN. From there they are projected to the primary visual cortex where the cells can either be dominated by one eye (ocular dominance L/R) or have equal input (binocular cells). White stripes indicate left and black stripes right ocular dominance (coloring with desoxyglucose).

Ice Cube Model Columns with orthogonal directions for ocularity and orientation. Hubel and Wiesel, J. of Comp. Neurol., 1972

Ice Cube Model Columns with orthogonal directions for ocularity and orientation. Problem: Cannot explain the reversal of the preferred orientation changes and areas of smooth transitions are overestimated (see data). Hubel and Wiesel, J. of Comp. Neurol., 1972

Graphical Models Preferred orientations are identical to the tangents of the circles/lines. Both depicted models are equivalent. Vortex: All possible directions meet at one point, the vortex. Problem: In these models vortices are of order 1, i.e. all directions meet in one point, but 0° and 180° are indistinguishable. Braitenberg and Braitenberg, Biol.Cybern., 1979

Graphical Models Preferred orientations are identical to the tangents of the circles/lines. Both depicted models are equivalent. Vortex: All possible directions meet at one point, the vortex. Problem: In these models vortices are of order 1, i.e. all directions meet in one point, but 0° and 180° are indistinguishable. From data: Vortex of order 1/2. Braitenberg and Braitenberg, Biol.Cybern., 1979

Graphical Models cont'd In this model all vertices are of order 1/2, or more precise -1/2 (d-blob) and +1/2 (l-blob). Positive values mean that the preferred orientation changes in the same way as the path around the vertex and negative values mean that they change in the opposite way. Götz, Biol.Cybern., 1988

Developmental Models Start from an equal orientation distribution and develop a map by ways of a developmental algorithm. Are therefore related to learning and self-organization methods.

Model based on differences in On-Off responses KD Miller, J Neurosci. 1994

Resulting receptive fields Resulting orientation map Difference Corre- lation Function