Learning sensorimotor transformations Maurice J. Chacron.

Slides:



Advertisements
Similar presentations
Chapter 31 Cerebellum Copyright © 2014 Elsevier Inc. All rights reserved.
Advertisements

Introduction to Neural Networks
What is the neural code? Puchalla et al., What is the neural code? Encoding: how does a stimulus cause the pattern of responses? what are the responses.
Sensorimotor Transformations Maurice J. Chacron and Kathleen E. Cullen.
Neural Network of the Cerebellum: Temporal Discrimination and the Timing of Responses Michael D. Mauk Dean V. Buonomano.
Spike Train Statistics Sabri IPM. Review of spike train  Extracting information from spike trains  Noisy environment:  in vitro  in vivo  measurement.
Computational neuroethology: linking neurons, networks and behavior Mark E. Nelson Beckman Institute Univ. of Illinois, Urbana-Champaign.
Spike Trains Kenneth D. Harris 3/2/2015. You have recorded one neuron How do you analyse the data? Different types of experiment: Controlled presentation.
Electrosensory data acquisition and signal processing strategies in electric fish Mark E. Nelson Beckman Institute Univ. of Illinois, Urbana-Champaign.
Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons.
Introduction: Neurons and the Problem of Neural Coding Laboratory of Computational Neuroscience, LCN, CH 1015 Lausanne Swiss Federal Institute of Technology.
Spike timing-dependent plasticity Guoqiang Bi Department of Neurobiology University of Pittsburgh School of Medicine.
Artificial Neural Networks - Introduction -
Electrophysiology.
Cognitive Computing…. Computational Neuroscience Jerome Swartz The Swartz Foundation May 10, 2006.
Cerebellar Spiking Engine: EDLUT simulator UGR with input from other partners.  Motivation 1. Simulation of biologically plausible spiking neural structures.
Artificial Neural Networks - Introduction -
Computational Analysis of Motor Learning. Three paradigms Force field adaptation Visuomotor transformations Sequence learning Does one term (motor learning)
Gain Modulation Huei-Ju Chen Papers: Chance, Abbott, and Reyes(2002) E. Salinas & T. Sejnowski(2001) E. Salinas & L.G. Abbott (1997, 1996) Pouget & T.
Electrophysiology. Neurons are Electrical Remember that Neurons have electrically charged membranes they also rapidly discharge and recharge those membranes.
Participate in Cognitive Neuroscience Experiments for extra credit!
Robustness the ability of a system to perform consistently under a variety of conditions.
Competition degeneracy modularity feedback Elements of robustness:
H CH7: escape behavior in crayfish H behavior features & functional anatomy H neuronal architecture H adaptive modulation H summary: chapter 7 PART 3:
Motor systems III: Cerebellum April 16, 2007 Mu-ming Poo Population coding in the motor cortex Overview and structure of cerebellum Microcircuitry of cerebellum.
Neuronal Computation in the Auditory System Matthew A. Xu-Friedman 641 Cooke Hall x202.
Jacques Wadiche, PhD Assistant Professor Neurobiology Department 1/25/08 Cerebellum.
Copyright © 2007 Wolters Kluwer Health | Lippincott Williams & Wilkins Neuroscience: Exploring the Brain, 3e Chapter 25: Molecular Mechanisms of Learning.
Optimality in Motor Control By : Shahab Vahdat Seminar of Human Motor Control Spring 2007.
Multi-scale Models of the Cerebellum: Role of the Adaptive Filter Model Paul Dean, Christian Rössert & John Porrill University of Sheffield REALNET.
Getting on your Nerves. What a lot of nerve! There are about 100,000,000,000 neurons in an adult human. These form 10,000,000,000,000 synapses, or connections.
Voluntary Movement II. Cortical representation of movements and parameters. Claude Ghez, M.D.
Lecture #8 Intro. Sensory Receptors 1) Types Chemoreceptors (smell, taste) Mechanoreceptors (touch, hearing, balance) Photoreceptors (vision) Electroreceptors.
A Gentle Introduction to..... Frith, Rees, and Friston's (1998) "Forward Model" of Self Derek J. SMITH High Tower Consultants Limited
Cognition, Brain and Consciousness: An Introduction to Cognitive Neuroscience Edited by Bernard J. Baars and Nicole M. Gage 2007 Academic Press Chapter.
Sensorimotor functions of the cerebellum
Lecture 2b Readings: Kandell Schwartz et al Ch 27 Wolfe et al Chs 3 and 4.
Correlation-Induced Oscillations in Spatio-Temporal Excitable Systems Andre Longtin Physics Department, University of Ottawa Ottawa, Canada.
Design constraints for an active sensing system Insights from the Electric Sense Mark E. Nelson Beckman Institute Univ. of Illinois, Urbana-Champaign.
Projects: 1.Predictive coding in balanced spiking networks (Erwan Ledoux). 2.Using Canonical Correlation Analysis (CCA) to analyse neural data (David Schulz).
Cerebellum Overview and structure of cerebellum Microcircuitry of cerebellum Motor learning.
Biomedical Sciences BI20B2 Sensory Systems Human Physiology - The basis of medicine Pocock & Richards,Chapter 8 Human Physiology - An integrated approach.
Dana Ballard - University of Rochester1 Distributed Synchrony: a model for cortical communication Madhur Ambastha Jonathan Shaw Zuohua Zhang Dana H. Ballard.
Summary of Lecture 3 VETS2011 Cerebellum Demo of VOR in owl: VOR plasticity World record cerebellum: Electric fish: nanosecond timing Summary of structure.
Brain Rhythms: key questions  Coordination of processing across space  Coherence in perception, e.g. synchrony & binding, cognitive moment, causation/objects.
MSc CogNeuro Lecture 1-2: Intro + Primary Motor Cortex (MI)
Andre Longtin Physics Department University of Ottawa Ottawa, Canada Effects of Non-Renewal Firing on Information Transfer in Neurons.
Artificial Neural Networks Students: Albu Alexandru Deaconescu Ionu.
COSC 460 – Neural Networks Gregory Caza 17 August 2007.
Nervous System Controls and coordinates your body's activities and helps you sense and respond to changes in your environment.
Slide 1 Neuroscience: Exploring the Brain, 3rd Ed, Bear, Connors, and Paradiso Copyright © 2007 Lippincott Williams & Wilkins Bear: Neuroscience: Exploring.
Copyright © 2004 Allyn and Bacon 1 Chapter 13 Learning and Memory: Basic Mechanisms This multimedia product and its contents are protected under copyright.
(Example) Class Presentation: John Desmond
Electrophysiology & fMRI. Neurons Neural computation Neural selectivity Hierarchy of neural processing.
THE NERVOUS SYSTEM 35-2 BIO 1004 Flora. NERVOUS SYSTEM  Nervous system – controls and coordinates functions throughout the body and responds to internal.
Biological Modeling of Neural Networks: Week 10 – Neuronal Populations Wulfram Gerstner EPFL, Lausanne, Switzerland 10.1 Cortical Populations - columns.
Sensorimotor Neurophysiology of Active Sensing
Synaptic Plasticity Synaptic efficacy (strength) is changing with time. Many of these changes are activity-dependent, i.e. the magnitude and direction.
LECTURE 8: SYNAPTIC TRANSMISSION OVERVIEW AND NMJ REQUIRED READING: Kandel text, Chapters 10,11 In humans, neurons, each receiving average of
Cognitive Computing…. Computational Neuroscience
Rate coding After mastering this material, you should be able to:
Neuroethology Neuron Volume 21, Issue 5, Pages (November 1998)
Emre O. Neftci  iScience  Volume 5, Pages (July 2018) DOI: /j.isci
Introduction (2/2) in Adaptive Cooperative Systems by Martine Beckerman, ’ 7.10 B.-W. Ku.
Timing Rules for Synaptic Plasticity Matched to Behavioral Function
A Gentle Introduction to
The Timing Is Right for Cerebellar Learning
Tim Requarth, Nathaniel B. Sawtell  Neuron 
Neuroscience: Exploring the Brain, 3e
Cerebellar LTD: A Molecular Mechanism of Behavioral Learning?
Presentation transcript:

Learning sensorimotor transformations Maurice J. Chacron

The principle of sensory reafference: Von Holst and Mittelstaedt, 1950

Movements can lead to sensory reafference (e.g. body movements) An efference copy and the reafferent stimulus are combined and give rise to the perceived stimulus. Question: how is the efference copy combined with the reafferent stimulus to give rise to the perceived stimulus?

Mechanical tickling experiment: Blakemore, Frith, and Wolpert, J. Cogn. Neurosci. (1999)

Motor command  arm movement Reafference  tactile stimulus Perceived stimulus  tickling sensation

Wolpert and Flanagan, 2001

The predicted sensory stimulus (efference copy) is compared to the actual stimulus If there is a discrepancy, then the subject perceives the stimulus as causing a tickling sensation. The efference copy contains both temporal and spatial information about the reafferent stimulus.

Adaptive cancellation of sensory reafference

Motor learning: Martin et al. 1996

Sensorimotor coordination does not require the cerebellum. Adaptation to novel conditions does require cerebellar function. Adaptation is an error driven process.

Cerebellar Plasticity:

Co-activation of parallel and climbing fiber input gives rise to LTD

How does cerebellar LTD help achieve cancellation of expected stimuli?

Weakly electric Fish Electric fish emit electric fields through an electric organ in their tail.

Trout Electric Fish Anatomy

The cerebellum of electric fish is very developed. Cerebellar anatomy is conserved across vertebrates. Electric fish have “simple” anatomy and behaviors. Electric fish are a good model system to study cancellation of reafferent input.

Electrolocation

Electric fish use perturbations of their self- generated electric field to interact with their environment. Pulses generated by the animal can activate their own electrosensory system. Are there mechanisms by which sensory neurons can “ignore” these reafferent stimuli?

Cerebellar-like anatomy: Bell, 2001

Changes in the reafferent stimulus cause changes in the efference copy What mechanisms underlie these changes?

Plasticity experiment: Parallel fiber granule cell sensory input

Anti-Hebbian STDP: postsynapticpresynaptic

Cancellation of unwanted stimuli requires precise timing. Anti-Hebbian STDP underlies the adaptive cancellation of reafferent input.

How?

Adaptive cancellation of tail bends

Cerebellar-like anatomy

Anatomy

Burst firing in pyramidal cells Burst-timing dependent plasticity

Model of adaptive cancellation in the electrosensory system

Model Assumptions: How to “carve out” a negative image A subset of cerebellar granule cells fires at every phase of the stimulus Probability to fire a burst is largest/smallest at a local stimulus maximum/minimum Weights from synapses near the local maximum/ minimum will be most/least depressed

Graphically… Phase (rad) 0 2π π stimulus Most depression Least depression Synaptic weights

Extra assumptions Non-associative potentiation (in order to prevent the weights from going to zero).

Does the model work?

Bursting is frequency dependent

Bursts and isolated spikes code for different features of a stimulus Oswald et al. 2004

Adaptive learning

Summary Sensorimotor transformations require learning. This learning must be adaptive (e.g. adapt to changes during development, etc…) Anti-Hebbian plasticity provides a mechanism for adaptive cancellation of reafferent stimuli