How Neurons Do Integrals

Slides:



Advertisements
Similar presentations
Lecture 20 Dimitar Stefanov. Microprocessor control of Powered Wheelchairs Flexible control; speed synchronization of both driving wheels, flexible control.
Advertisements

NEU Neural Computing MSc Natural Computation Department of Computer Science University of York.
WINNERLESS COMPETITION PRINCIPLE IN NEUROSCIENCE Mikhail Rabinovich INLS University of California, San Diego ’
Compensatory Eye Movements John Simpson. Functional Classification of Eye Movements Vestibulo-ocular Optokinetic Uses vestibular input to hold images.
Michale Fee McGovern Institute for Brain Research Department of Brain and Cognitive Sciences MIT Jerusalem in Motion Workshop Jerusalem, Israel December.
Stable Propagation of Synchronous Spiking in Cortical Neural Networks Markus Diesmann, Marc-Oliver Gewaltig, Ad Aertsen Nature 402: Flavio Frohlich.
Levels in Computational Neuroscience Reasonably good understanding (for our purposes!) Poor understanding Poorer understanding Very poorer understanding.
Motor systems III: Cerebellum April 16, 2007 Mu-ming Poo Population coding in the motor cortex Overview and structure of cerebellum Microcircuitry of cerebellum.
A Theory of Cerebral Cortex (or, “How Your Brain Works”) Andrew Smith (CSE)
Laurent Itti: CS599 – Computational Architectures in Biological Vision, USC Lecture 7: Coding and Representation 1 Computational Architectures in.
Unsupervised learning
What are we trying to explain? Multiple facets of a simple behavior Stephen G. Lisberger Howard Hughes Medical Institute W.M. Keck Center for Integrative.
Bump attractors and the homogeneity assumption Kevin Rio NEUR April 2011.
Sensing self motion Key points: Why robots need self-sensing Sensors for proprioception in biological systems in robot systems Position sensing Velocity.
Neural mechanisms of Spatial Learning. Spatial Learning Materials covered in previous lectures Historical development –Tolman and cognitive maps the classic.
Advances in Modeling Neocortex and its impact on machine intelligence Jeff Hawkins Numenta Inc. VS265 Neural Computation December 2, 2010 Documentation.
Cognition, Brain and Consciousness: An Introduction to Cognitive Neuroscience Edited by Bernard J. Baars and Nicole M. Gage 2007 Academic Press Chapter.
Chapter 7. Network models Firing rate model for neuron as a simplification for network analysis Neural coordinate transformation as an example of feed-forward.
Balancing at the border of instability Luc Moreau, Ghent University Eduardo Sontag, The State University of New Jersey (2003) presented by Helmut Hauser.
Motor Control. Beyond babbling Three problems with motor babbling: –Random exploration is slow –Error-based learning algorithms are faster but error signals.
Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall Lecture 19. Systems Concepts 1 Michael Arbib: CS564 - Brain Theory and.
Control systems KON-C2004 Mechatronics Basics Tapio Lantela, Nov 5th, 2015.
Neural Networks with Short-Term Synaptic Dynamics (Leiden, May ) Misha Tsodyks, Weizmann Institute Mathematical Models of Short-Term Synaptic plasticity.
Mechanisms and Models of Persistent Neural Activity:
Mechanisms and Models of Persistent Neural Activity:
Keeping the neurons cool Homeostatic Plasticity Processes in the Brain.
Network Models (2) LECTURE 7. I.Introduction − Basic concepts of neural networks II.Realistic neural networks − Homogeneous excitatory and inhibitory.
Memory. Hopfield Network Content addressable Attractor network.
Ch 7. Computing with Population Coding Summarized by Kim, Kwonill Bayesian Brain: Probabilistic Approaches to Neural Coding P. Latham & A. Pouget.
Symbolic Reasoning in Spiking Neurons: A Model of the Cortex/Basal Ganglia/Thalamus Loop Terrence C. Stewart Xuan Choo Chris Eliasmith Centre for Theoretical.
Cogs 160: Neural Coding in Sensory Systems Spring, 2011 Angela Yu
Mechanisms and Models of Persistent Neural Activity:
Neural Networks.
Effective Connectivity
Robustness in Neurons & Networks
Transformers A transformer changes the high voltage from the main power lines to the 120 volts your appliances use.
One-Dimensional Dynamics of Attention and Decision Making in LIP
Lecture 22. Saccades 2 Reading Assignments: Reprint
Covariation Learning and Auto-Associative Memory
Design for Simple Spiking Neuron Model
Digital Control Systems Waseem Gulsher
Volume 79, Issue 5, Pages (September 2013)
Spatial Patterns of Persistent Neural Activity Vary with the Behavioral Context of Short- Term Memory  Kayvon Daie, Mark S. Goldman, Emre R.F. Aksay  Neuron 
Shaul Druckmann, Dmitri B. Chklovskii  Current Biology 
Brendan K. Murphy, Kenneth D. Miller  Neuron 
Confidence as Bayesian Probability: From Neural Origins to Behavior
Posterior parietal cortex
Volume 66, Issue 4, Pages (May 2010)
Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque  Matthew I. Leon, Michael N. Shadlen 
Volume 36, Issue 5, Pages (December 2002)
Dynamic Coding for Cognitive Control in Prefrontal Cortex
Memory without Feedback in a Neural Network
Neuroscience: Out of Sight but Not Out of Mind
Effective Connectivity
Neural Mechanisms of Visual Motion Perception in Primates
H.Sebastian Seung, Daniel D. Lee, Ben Y. Reis, David W. Tank  Neuron 
Wallis, JD Helen Wills Neuroscience Institute UC, Berkeley
Patrick Kaifosh, Attila Losonczy  Neuron 
Xiaomo Chen, Marc Zirnsak, Tirin Moore  Cell Reports 
The Timing Is Right for Cerebellar Learning
Encoding of Stimulus Probability in Macaque Inferior Temporal Cortex
Reading Assignments: Lecture 16. Saccades 2 The NSL Book
Eye Movements.
Teaching Recurrent NN to be Dynamical Systems
Volume 99, Issue 1, Pages e4 (July 2018)
Rapid Neocortical Dynamics: Cellular and Network Mechanisms
Mark G. Stokes  Trends in Cognitive Sciences 
Edge Detection via Lateral Inhibition
Patrick Kaifosh, Attila Losonczy  Neuron 
Presentation transcript:

How Neurons Do Integrals Mark Goldman

Outline What is the neural basis of short-term memory? A model system: the Oculomotor Neural Integrator Neural mechanisms of integration: Linear network theory [4. Next lecture: Model critique – robustness in integrators and other neural systems]

=10 Add up the following numbers: 3 +5 +4 -2 8 10 12 input ∫ input = running total This task involves: 1. Addition 2. Memory

Record voltage in prefrontal cortex Sample Memory period (delay) Match Voltage Voltage “spike” time Firing rate (spikes/sec) time Persistent neural activity is the neural correlate of short-term memory

Characteristics of Persistent Neural Activity Sustained elevated (or reduced) firing rates lasting up to ~10’s of seconds, long outlasting the stimulus Rapid onset, offset Mean firing rate an analog variable – a neuron can sustain any of many different levels of activity Stable pattern of activity among many neurons

Model system: eye fixation during spontaneous horizontal eye movements Carassius auratus (goldfish)

The Oculomotor Neural Integrator Lateral (+) Medial Lateral Eye position E (degrees) Medial (-) time Motor neurons (position signal) readout Integrator neurons (+) direction Eye movement “burst” neurons (velocity signal) (-) direction Other side neurons control opposite half of oculomotor range

Neural Recording from the Oculomotor Integrator persistent neural activity On/off burst input (memory of eye position) +

Integrator Neurons: Firing Rate is Proportional to Eye Position

Many-neuron Patterns of Activity Represent Eye Position Activity of 2 neurons saccade eye position represented by location along a low dimensional manifold (“line attractor”) (H.S. Seung, D. Lee)

General Principle? Neural integrators operate by using their input to shift internally-generated patterns of activity along a coordinate (coding) axis. Persistent activity patterns are the integrator “memory” of previous inputs Activity Pattern= point on a line

Mechanisms and Models of Persistent Neural Activity

Line Attractor Picture of the Neural Integrator Geometrical picture of eigenvectors: Axes = firing rates of 2 neurons r2 r1 Decay along direction of decaying eigenvectors No decay or growth along direction of eigenvector with eigenvalue = 1 “Line Attractor” or “Line of Fixed Points”

Effect of Bilateral Network Lesion Bilateral Lidocaine: Remove Positive Feedback Control

Human with unstable integrator:

Weakness: Robustness to Perturbations Imprecision in accuracy of feedback connections severely compromises performance (memory drifts: leaky or unstable) 10% decrease in synaptic feedback

Learning to Integrate How accomplish fine tuning of synaptic weights? IDEA: Synaptic weights w learned from “image slip” (Arnold & Robinson, 1992) E.g. leaky integrator: Image slip = Eye slip Need to turn up feedback w

Experiment: Give Feedback as if Eye is Leaky or Unstable Compute image slip - that would result if eye were leaky/unstable = E E(t) Magnetic coil measures eye position

Integrator Learns to Compensate for Leak/Instability! Control (in dark): Give feedback as if unstable Leaky: Give feedback as if leaky Unstable:

Summary Persistent neural activity: activity which outlasts a transient stimulus Neural integrator: outputs the mathematical integral of its inputs -in the absence of input, maintains persistent neural activity Oculomotor neural integrator: -converts eye-velocity encoding inputs to eye position outputs -Mechanism: -Anatomy and physiology suggest network contribution -Issue of Robustness: Simple models are less robust to perturbations than the real system -Plasticity may keep the system tuned on slow time scales -On faster time scales, intrinsic cellular processes may provide a “friction-like” slowing of network decay But: