1. Brain and Consciousness Class This presentation contains two classes: Brain-machine interface Brain micro-stimulations

2. BMI Control of a Robotic Arm Nicolelis et al PLoS 2003 Large number (thousands) of electrodes in multiple areas (M1, Pre-motor, supplementary motor)

3. Leigh R. Hochberg, Mijail D. Serruya, Gerhard M. Friehs, Jon A. Mukand, Maryam Saleh, Abraham H. Caplan, Almut Branner, David Chen, Richard D. Penn and John P. Donoghue Nature 442, July 2006

4. EEG-Controlled Action

5. EEG Electrodes

6. Walpaw, PNAS 2004

8. Localized brain activation using real-time fMRI Gabrieli et al, NeuroImage 2004 Elevated activity in a selected voxel in somato-motor cortex (primary motor and somatosensory with surrounding region) Elevation depended on the fMRI feedback (no feedback, sham)

9. Voluntary Control of a Brain Region Larger activity after training No muscle movement during the activation Subjective report? Which brain areas are under ‘will’ control?

10. Brain Micro-stimulation

11. Micro Stimulation General strategy: BA (Brain Activity) under similar conditions, with or without awareness. Stimulate an area such as MT, test minimal activation for awareness. avoids indirect routs such as via the S.C. and pulvinar. Test qualia generated by stimulating different areas. In animals: combined with response about guessing?

12. Micro-stimulation Head position, 1 sec Reward delivered L or R signal Somato-sensory cortex for navigation Medial forebrain bundle for reward Chapin et al, Nature 2002

13. Phosphenes in V1 Stimulation of V1 in volunteer epileptic patients. usually a single phosphene, sometimes multiple, could be small as ‘star in the sky’, or larger, ‘a coin at arm’s length’. Some are colored, fade after 10-15 secs. For some reason they are not oriented, not edges and bars? Could be interesting, fMRI, minimal activation for perception?

14. Motion Perception by MT Stimulation Shadlen et al, Nature Neuroscience 6, 891 - 898 (2003)

15. Stimulation of humans in medial parieto-occipital cortex evoked visual motion perception Exp Brain Res. Richter et al 1991

16. Face Microstimulation Face and non-faces with noise. Face with no noise is 100% face-signal Non-face with no noise is -100% face-signal 80%

17. Microstimulation of Face Regions in Monkey

18. Bailey CJ, Karmu J, Ilmoniemi, RJ. 2001. Scand J Psych 42: 297–306.

19. TMS: Blocking Motion Awareness Pascual-Leone, Walsh. Fast backprojections from the motion to the primary visual area necessary for visual awareness. Science 2001 Stimulation of V5, then sub-threshold to V1

20. V1 stimulation blocked the perception of moving phosphenes

21. Where is motion perception generated? TMS study: MT/V5 together with V1 necessary for moving phosphenes G.Y. patient without V1 – motion perception with sufficient V5 stimulation Different qualia associated with different brain regions (general motion in MT, point-wise phosphenes it V1) fMRI from G.Y: stronger activation of MT with fast (perceived) motion

22. Brain Stimulation and Perception Different brain regions supply different qualia From simple sensations to complex percpets (V1 – bright spots, MT – motion, STS – faces) In humans: can test for qualia Stimulation of the dorsal stream: –Do some regions create sensations, others not? –A combination of ‘quale area’ plus ‘enabling’? Wilder Penfield (1975): The Mystery of the Mind: –Never elicited ‘free will’ Monkeys with report on guessing? Combined with fMRI, minimal activation