A brain-machine interface instructed by direct intracortical microstimulation Joseph E. O’Doherty, Mikhail A. Lebedev, Timothy L. Hanson, Nathan A. Fitzsimmons.

Slides:



Advertisements
Similar presentations
What is the neural code? Puchalla et al., What is the neural code? Encoding: how does a stimulus cause the pattern of responses? what are the responses.
Advertisements

What is the neural code?. Alan Litke, UCSD Reading out the neural code.
RESEARCHERS ARE DEVELOPING NEW METHODS OF TESTING THE OPERABILITY OF PROSTHETICS VIA THE BRAIN. Controlling a Computer With Thought.
Chapter 4: Local integration 2: Neural correlates of the BOLD signal
All materials are based on the following paper Meel Velliste, Sagi Perel, M. Chance Spalding, Andrew S. Whitford and Andrew B. Schwartz, Cortical control.
1 1 MPI for Biological Cybernetics 2 Stanford University 3 Werner Reichardt Centre for Integrative Neuroscience Eberhard Karls University Tuebingen Epidural.
1 Decoding Neural Activity from an Intracortical Implant in Humans with Tetraplegia Chad E. Bouton Battelle Health and Life Sciences Division.
Spike Train Statistics Sabri IPM. Review of spike train  Extracting information from spike trains  Noisy environment:  in vitro  in vivo  measurement.
Cross-cortical Coherence during Effector Decision Making Chess Stetson Andersen Laboratory Caltech Sloan-Swartz Meeting 2009/07/28.
Covert Attention Mariel Velez What is attention? Attention is the ability to select objects of interest from the surrounding environment Involuntary.
Population vector algorithm
Inferring Hand Motion from Multi-Cell Recordings in Motor Cortex using a Kalman Filter Wei Wu*, Michael Black †, Yun Gao*, Elie Bienenstock* §, Mijail.
Copyright © 2006 by Allyn and Bacon Chapter 8 The Sensorimotor System How You Do What You Do This multimedia product and its contents are protected under.
Mirror Neurons.
Electrophysiology of Visual Attention. Moran and Desimone (1985) “Classical” RF prediction: there should be no difference in responses in these two conditions.
Attention as Information Selection. Early Selection Early Selection model postulated that attention acted as a strict gate at the lowest levels of sensory.
From Ch. 38 “Principles of Neural Science”, 4th Ed. Kandel et al
Chapter 14 Brain Control of Movement. Introduction The brain influences activity of the spinal cord –Voluntary movements Hierarchy of controls –Highest.
From Ch. 38 “Principles of Neural Science”, 4th Ed. Kandel et al
Motor cortex Organization of motor cortex Motor cortical map Effect of cortical motor neuron activation on muscle contraction Population coding.
Motor cortical areas: the homunculus The motor system.
Consequences of Attentional Selection Single unit recordings.
Cortical motor structures. Hierarchical Organization of Motor System.
Photo, p. 476 Ranulfo Romo. Figure 23.1 Vibration Discrimination Task and Performance.
Neural circuits for bias and sensitivity in decision-making Jan Lauwereyns Associate Professor, Victoria University of Wellington, New Zealand Long-term.
Voluntary Movement II. Cortical representation of movements and parameters. Claude Ghez, M.D.
STUDY, MODEL & INTERFACE WITH MOTOR CORTEX Presented by - Waseem Khatri.
Sensorimotor systems Chapters 8.
Encoding & Decoding of Neuronal Ensembles in Motor Cortex Nicholas Hatsopoulos Dept. of Organismal Biology & Anatomy Committees on Computational Neuroscience.
Operant Conditioning of Cortical Activity E Fetz, 1969.
Chapter 8: Perceiving Motion
BCI-based Robot Rehabilitation Framework for Stroke Patients M. Gomez-Rodriguez 1,2 J. Peters 1 J.. Hill 1 A. Gharabaghi 3 B. Schölkopf 1 M.. Grosse-Wentrup.
Chapter 50 The Prefrontal Cortex and Executive Brain Functions Copyright © 2014 Elsevier Inc. All rights reserved.
MSc CogNeuro Lecture 1-2: Intro + Primary Motor Cortex (MI)
A High-Performance Brain- Computer Interface
Restoring neural function through neural prosthetic “bypass” Ziv Williams, MD Associate Professor in Neurosurgery Faculty, Harvard-MIT Health Sciences.
Voluntary Movement I. Psychophysical principles & Neural control of reaching and grasping Claude Ghez, M.D.
4. For each unit one lag, one polynomial, and one axis were selected based on the quality of fit of the posterior. Thus, the firing rate of each unit is.
Brain-Machine Interface (BMI) System Identification Siddharth Dangi and Suraj Gowda BMIs decode neural activity into control signals for prosthetic limbs.
Lateral habenula as a source of negative reward signals in dopamine neurons Masayuki Matsumoto & Okihide Hikosaka (2007) Presented by Miranda Stewart.
Naïve Coadaptive Cortical Control Gregory J Gage, Kip A Ludwig, Kevin J Otto, Edward L Ionides and Daryl R Kipke. Journal of Neural Engineering 2 (2005)
A B SAMPLE DELAY CHOICE A B A B 1st Reversal2nd Reversal etc… Trial Time (ms) Conditional Visuomotor Learning Task Asaad, W.F., Rainer, G. and.
What are Neuromotor Prosthetics? A neuromotor prosthetic is a brain-machine interface that records neural activity from the brain and decodes cellular.
Brain Jean V Bellissard Georgia Institute of Technology School of Physics Fall 2015.
BMI DEVELOPMENT SYSTEMS -SRIKANTH.B. INTRODUCTION The core of this paper is that to operate machines from a remote area. In the given BMI DEVELOPMENT.
Motor cortex Organization of motor cortex Motor cortical map
References and Related Work
Motor cortex Organization of motor cortex Motor cortical map
B. More recent studies have subdivided the premotor cortex of macaque monkeys into several more functional zones with different patterns of cortical and.
Decoding a Perceptual Decision Process across Cortex
Sensing with the Motor Cortex
Volume 97, Issue 1, Pages e5 (January 2018)
Toward More Versatile and Intuitive Cortical Brain–Machine Interfaces
Signal, Noise, and Variation in Neural and Sensory-Motor Latency
Ranulfo Romo, Adrián Hernández, Antonio Zainos  Neuron 
Krishna V. Shenoy, Jose M. Carmena  Neuron 
Vision: In the Brain of the Beholder
Volume 17, Issue 21, Pages (November 2007)
Volume 18, Issue 4, Pages (April 1997)
Posterior parietal cortex
Neural Ensemble Coding of Satiety States
Brain-Machine Interfaces beyond Neuroprosthetics
Volume 66, Issue 4, Pages (May 2010)
Sensory Population Decoding for Visually Guided Movements
Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action  Paul Cisek,
Volume 97, Issue 1, Pages e5 (January 2018)
Wallis, JD Helen Wills Neuroscience Institute UC, Berkeley
Volume 50, Issue 4, Pages (May 2006)
Social Attention and the Brain
Neural Ensemble Coding of Satiety States
Presentation transcript:

A brain-machine interface instructed by direct intracortical microstimulation Joseph E. O’Doherty, Mikhail A. Lebedev, Timothy L. Hanson, Nathan A. Fitzsimmons and Miguel A. L. Nicolelis 1

Key points (abstract) Brain–machine interfaces (BMIs) establish direct communication between the brain and artificial actuators. Future BMIs must also provide a means for delivering sensory signals from the actuators back to the brain. In this study, a direct BMI have been achieved by simultaneously multichannel recording from M1 and stimulating S1. 2

Materials and Methods 3

Animal preparation Subjects: 2 adult male rhesus macaque monkeys (6.7kg and 6.5kg). Cortical Implants: – 6 microelectrode arrays (32 microwires in each) in M1, S1 and Premotor cortex (PMd) in Monkey1; – 4 arrays in M1, PMd, Pariental cortex (PP), supplementary motor area (SMA) in Monkey2. 4

Behavioral Tasks Three behavioral tasks were employed: 1. Center-out, 2. Continuous target pursuit and 3. Target choice task 5

Neural signal processing Linear Discriminant Analysis (LDA): 50ms bins. The neuronal firing rate for each of the neurons in the ensemble was placed into a vector for each time-bin. Prediction Algorithm: Cursor position was reconstructed using multiple Wiener filter linear decoding algorithms applied to the population of recorded Neurons. 6

Result (Average prediction accuracy) HC: Hand Control BCWH: Brain Control With Hand movements BCWOH: Brain Control Without Hand movements R: Average correlation coefficient between actual and predicted value 7

Findings The correspondence between the actual and predicted hand position decreased in sessions BCWH (Wilcoxon signed-rank test). The R for X-position decreased 28.1% and 17.2% in Monkey 2. The R for Y- position decreased 16.7% and 15.6% in Monkeys 1 and 2, respectively. This decrease indicates that the neuronal ensemble adapted to controlling the cursor movements and became less representative of the animal’s hand movements (repeating previous findings of Lebedev et al., 2005; Tkach et al., 2007) 8

BMI with Somatosensory input 9

10

11

Conclusion In the BMI with somatosensory input, one monkey controlled cursor movements directly by using motor cortical activity while receiving somatosensory instructive signals (ICMS) in S1. The second monkey also controlled the cursor using motor cortical activity but, since PP ICMS was ineffective, received somatosensory signals via vibrotactile stimulation of the hand. Therefore, it is conceivable that PP cannot be used for this type of sensory instruction or that use of PP may require much longer training or require different parameters. Stimulation of primary sensory areas of the cortex (and possibly thalamus) appears to be most effective for sensory substitution in BMI. 12

Thank you for your kind attention. 13