Motor Learning with Unstable Neural Representations

Slides:



Advertisements
Similar presentations
Sensing with the Motor Cortex
Advertisements

Heather L. Dean, Maureen A. Hagan, Bijan Pesaran  Neuron 
Volume 86, Issue 3, Pages (May 2015)
A Source for Feature-Based Attention in the Prefrontal Cortex
Signal, Noise, and Variation in Neural and Sensory-Motor Latency
Araceli Ramirez-Cardenas, Maria Moskaleva, Andreas Nieder 
Volume 82, Issue 1, Pages (April 2014)
Timing Rules for Synaptic Plasticity Matched to Behavioral Function
Two-Dimensional Substructure of MT Receptive Fields
Heather L. Dean, Maureen A. Hagan, Bijan Pesaran  Neuron 
Cristopher M. Niell, Michael P. Stryker  Neuron 
Volume 94, Issue 2, Pages e6 (April 2017)
Volume 66, Issue 6, Pages (June 2010)
Braden A. Purcell, Roozbeh Kiani  Neuron 
Retinal Representation of the Elementary Visual Signal
Volume 87, Issue 1, Pages (July 2015)
Sheng Li, Stephen D. Mayhew, Zoe Kourtzi  Neuron 
Volume 81, Issue 6, Pages (March 2014)
An Optimal Decision Population Code that Accounts for Correlated Variability Unambiguously Predicts a Subject’s Choice  Federico Carnevale, Victor de Lafuente,
Hannah M. Bayer, Paul W. Glimcher  Neuron 
A Switching Observer for Human Perceptual Estimation
Cascade Models of Synaptically Stored Memories
Responses of Collicular Fixation Neurons to Gaze Shift Perturbations in Head- Unrestrained Monkey Reveal Gaze Feedback Control  Woo Young Choi, Daniel.
Volume 49, Issue 3, Pages (February 2006)
Decision Making as a Window on Cognition
Cortical Mechanisms of Smooth Eye Movements Revealed by Dynamic Covariations of Neural and Behavioral Responses  David Schoppik, Katherine I. Nagel, Stephen.
Volume 71, Issue 4, Pages (August 2011)
Volume 66, Issue 4, Pages (May 2010)
New Experiences Enhance Coordinated Neural Activity in the Hippocampus
José Vergara, Natsuko Rivera, Román Rossi-Pool, Ranulfo Romo  Neuron 
Volume 94, Issue 2, Pages e6 (April 2017)
Volume 86, Issue 4, Pages (May 2015)
Adaptation without Plasticity
K. Cora Ames, Stephen I. Ryu, Krishna V. Shenoy  Neuron 
Adaptation Disrupts Motion Integration in the Primate Dorsal Stream
Contour Saliency in Primary Visual Cortex
Multiple Timescales of Memory in Lateral Habenula and Dopamine Neurons
Volume 88, Issue 3, Pages (November 2015)
Sparseness and Expansion in Sensory Representations
Anubhuti Goel, Dean V. Buonomano  Neuron 
Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action  Paul Cisek,
Differences between Neural Activity in Prefrontal Cortex and Striatum during Learning of Novel Abstract Categories  Evan G. Antzoulatos, Earl K. Miller 
Franco Pestilli, Marisa Carrasco, David J. Heeger, Justin L. Gardner 
Rethinking Motor Learning and Savings in Adaptation Paradigms: Model-Free Memory for Successful Actions Combines with Internal Models  Vincent S. Huang,
Volume 82, Issue 6, Pages (June 2014)
Independent Category and Spatial Encoding in Parietal Cortex
A Switching Observer for Human Perceptual Estimation
Origin and Function of Tuning Diversity in Macaque Visual Cortex
Volume 95, Issue 5, Pages e5 (August 2017)
Suppression without Inhibition in Visual Cortex
James M. Jeanne, Tatyana O. Sharpee, Timothy Q. Gentner  Neuron 
Cian O’Donnell, Terrence J. Sejnowski  Neuron 
Greg Schwartz, Sam Taylor, Clark Fisher, Rob Harris, Michael J. Berry 
Volume 54, Issue 2, Pages (April 2007)
Guilhem Ibos, David J. Freedman  Neuron 
Volume 86, Issue 3, Pages (May 2015)
Xiaomo Chen, Marc Zirnsak, Tirin Moore  Cell Reports 
Franco Pestilli, Marisa Carrasco, David J. Heeger, Justin L. Gardner 
Normal Movement Selectivity in Autism
Daniel E. Winkowski, Eric I. Knudsen  Neuron 
The Normalization Model of Attention
Adaptation without Plasticity
Ethan S. Bromberg-Martin, Okihide Hikosaka  Neuron 
Posterior Parietal Cortex Encodes Autonomously Selected Motor Plans
Encoding of Stimulus Probability in Macaque Inferior Temporal Cortex
Differential Effects of Excitatory and Inhibitory Plasticity on Synaptically Driven Neuronal Input-Output Functions  Tiago P. Carvalho, Dean V. Buonomano 
Volume 67, Issue 6, Pages (September 2010)
Anubhuti Goel, Dean V. Buonomano  Neuron 
Supratim Ray, John H.R. Maunsell  Neuron 
Speed-Accuracy Tradeoff in Olfaction
Presentation transcript:

Motor Learning with Unstable Neural Representations Uri Rokni, Andrew G. Richardson, Emilio Bizzi, H. Sebastian Seung  Neuron  Volume 54, Issue 4, Pages 653-666 (May 2007) DOI: 10.1016/j.neuron.2007.04.030 Copyright © 2007 Elsevier Inc. Terms and Conditions

Figure 1 Examples of Behavior in Control and Learning Sessions of the Monkey from Which the M1 Recordings Were Obtained (i) Trials 121–160, (ii) trials 161–200, (iii) trials 281–320, (iv) trials 321–360, (v) trials 441–480. (A) Hand trajectories from a control session. (B) Hand trajectories from a learning session. (C) Performance during the control session in (A), quantified by the area between the trajectory and a straight line path (40 trial moving average shown with 95% Student's t confidence intervals). (D) Performance during the learning session shown in (B). Neuron 2007 54, 653-666DOI: (10.1016/j.neuron.2007.04.030) Copyright © 2007 Elsevier Inc. Terms and Conditions

Figure 2 Changes in Tuning Curves in Control Experiment Each row corresponds to a sample cell. (Left) Mean firing rates in block 1 (crosses) and block 3 (circles) as a function of movement direction, and fitted cosine tuning curves (lines). Error bars correspond to standard errors, and arrows in second row designate the PDs. (Middle and right) Random sample of 1000 spike waveforms in block 1 (middle) and block 3 (right). Neuron 2007 54, 653-666DOI: (10.1016/j.neuron.2007.04.030) Copyright © 2007 Elsevier Inc. Terms and Conditions

Figure 3 Statistics of Changes in PDs in Control and Learning Experiments (A) Distribution across cells of PD changes from block 1 to 3 in control experiment. (B) PD change from block 1 to 3 of one cell versus PD change from block 1 to 3 of another cell recorded simultaneously, across all simultaneously recorded pairs. Each pair is represented by two points symmetrically positioned around the y=x diagonal (solid line). (C) PD change from block 1 to 2 versus PD change from block 2 to 3, across cells in control experiment. (D) Autocorrelation of population of PDs and linear fit (solid line). (E) Adaptation PD changes versus washout PD changes, across cells in learning experiment. Solid line represents the y=−x diagonal. (F) Distribution across cells of baseline-to-washout PD changes in learning experiment. Neuron 2007 54, 653-666DOI: (10.1016/j.neuron.2007.04.030) Copyright © 2007 Elsevier Inc. Terms and Conditions

Figure 4 Theory for Cause of Background Changes (A) Learning pushes the synaptic strengths down an error landscape which has a valley of minima at the optimal manifold, and noise causes the synaptic strengths to drift along this valley. (B) Model of motor cortical network which generates reaching movements. Tuning curves of model cells are cosine shaped (inset). Neuron 2007 54, 653-666DOI: (10.1016/j.neuron.2007.04.030) Copyright © 2007 Elsevier Inc. Terms and Conditions

Figure 5 Behavior and Neural Representation in Simulations of Control Experiment (A) Simulation with noisy learning rule, σ=0.025,τforget=1500,τlearn=50. (Left) Error in movement direction (black), error in movement amplitude as percentage of desired movement amplitude (gray), and PDs of three sample cells whose PDs started close to zero (inset). (Right) PD (computed from the firing rate ri) versus force direction (denoted αi in the Experimental Procedures) from last trial of simulation shown on left. (B) Same as (A) but without a learning signal σ=0.025,τforget=1500,τlearn=106. In both simulations N=10000, but only 500 randomly sampled cells are shown on right panels. Neuron 2007 54, 653-666DOI: (10.1016/j.neuron.2007.04.030) Copyright © 2007 Elsevier Inc. Terms and Conditions

Figure 6 Statistics of Changes in Tuning Curves in Simulations of Control and Learning Experiments (A) Distribution across cells of PD changes from block 1 to 3 in control simulation. (B) PD changes from block 1 to 3 of pairs of cells. Each pair is represented by two points symmetrically positioned around the y=x diagonal (solid line). (C) PD change from block 1 to 2 versus PD change from block 2 to 3, across cells in control simulation. (D) Autocorrelation of population of PDs. (D, inset) Autocorrelation over long times. (E) Adaptation PD changes versus washout PD changes, across cells in learning simulation. Solid line represents the y=−x diagonal. (F) Distribution across cells of baseline-to-washout PD changes in learning simulation. To facilitate the comparison with the experimental results, we show in (B), (C), and (E) samples of cells of the same size as in the corresponding subplots in Figure 3. Model parameter values are τlearn=50,τforget=1500,σ=0.025,φ=60°,N=10000. Neuron 2007 54, 653-666DOI: (10.1016/j.neuron.2007.04.030) Copyright © 2007 Elsevier Inc. Terms and Conditions

Figure 7 Model's Error in Direction of Movement in Simulation of Learning Experiment τlearn=50,τforget=1500,σ=0.025,φ=60°,N=10000 Neuron 2007 54, 653-666DOI: (10.1016/j.neuron.2007.04.030) Copyright © 2007 Elsevier Inc. Terms and Conditions

Figure 8 Optimal Manifolds of Multiple Tasks (A) Changes in tuning curves in the learning experiment are a combination of behaviorally relevant changes created by the learning signal and irrelevant changes created by plasticity noise. After washout, synapses return to the manifold optimal for the no-force task at a configuration different from baseline. (B) Learning several tasks with the same neural circuitry can be described as moving synaptic strengths to a configuration in the intersection of the manifolds optimal for these tasks. Neuron 2007 54, 653-666DOI: (10.1016/j.neuron.2007.04.030) Copyright © 2007 Elsevier Inc. Terms and Conditions