Center for Brain and Cognitive Science Mind Reading for Cognitive Systems Yong-Ho Lee Center for Brain & Cognitive Research Korea Research Institute of Standards and Science

Center for Brain and Cognitive Science ACS: Artificial Cognitive System ACS Natural Cognition Natural & Life Sciences, Neuroscience Computing, Sensing, Imaging Cogno- Bio- Info- Cognitive system in FP6 Artificial Cognitive SystemHuman Cognitive System

Center for Brain and Cognitive Science “Cognitive systems are natural or artificial information processing systems, including those responsible for perception, learning, reasoning and decision making and for communication and action.” - Foresight Cognitive Systems Project- What is a cognitive system?

Center for Brain and Cognitive Science Self-organization in the nervous system connections between neurons in neo-cortex Human computers : processors Sensory processing : sight, hearing, touch and so on Social cognition Interaction, Planning and Motivation Memory, Reasoning and Learning Advanced Neuroscience Technologies Foresight Cognitive Systems Project

Center for Brain and Cognitive Science Mind reading Interface & Interaction Brain signals or Biological signals Information

Center for Brain and Cognitive Science Imaging tools fMRI MEG EEG PET NIRS ECoG Metabolism Electrophysiology Brain reading tools?

Center for Brain and Cognitive Science Windows to the Brain Metabolic change Electric activity Cognitive process : Changes of brain activity in time and space

Center for Brain and Cognitive Science Functional MRI + High spatial resolution - Poor temporal resolution Most common device for brain study Imaging of hemodynamic changeHigh-field MRI

Center for Brain and Cognitive Science In viewing pictures of different categories (face, house, and painting) Maël Lebreton et al, Neuron (2009) fMRI Different activation area in the brain

Center for Brain and Cognitive Science Hemoglobin Near IRScattered Blood vessel Skin Brain NIRS : Near InfraRed Spectroscopy Dong-il SHIMADZU Corp.

Center for Brain and Cognitive Science Deoxy Hb Oxy Hb 780nm, 805nm, 830nm Absorption spectrum of Hemoglobin Near IR Total Hb Oxy Hb Deoxy Hb Task Task Task Dong-il SHIMADZU Corp. Relative change of Hb Finger tapping task NIRS signals

Center for Brain and Cognitive Science EEG HydroCel Geodesic Sensor Electroencephalography Source localization Besa, MEGIS Software GmbH Susceptive to electric conductivity inhomogeneity of the brain

Center for Brain and Cognitive Science MEG System MEG (Magnetoencephalography) Localization of active currents + High temporal resolution + Measure neural current + Moderate spatial resolution - Need inverse problem process - Poor sensitivity to deep sources

Center for Brain and Cognitive Science Brain: Real time processor in ms time scale ► EEG, MEG-non invasive information with high temporal resolution Temporal resolution : Role of MEG Timing of human cortical functions during cognition

Center for Brain and Cognitive Science - Simultaneous imaging of neural current & anatomical structure - Measurement field : ~ μT - Nuclear magnetic resonance frequency = ~ Neural activity frequency - Imaging of neural current distribution Direct Imaging of Neural Current Imaging of neural activity

Center for Brain and Cognitive Science Magnetically shielded room Stimulus control Insert Dewar RF shielding Stimulus FLL circuits Controller Filter/Amp SQUID Signal processing Source analysis BpBp BmBm Gradient fields Data acquisition system Controlled current source Direct Imaging of Neural Current

Center for Brain and Cognitive Science New MRI : MRI at microTesla field Ultra-low field MRI

Center for Brain and Cognitive Science Biological signals - Heart rate - Respiration rate - Face temperature Mind reading device - Molintent

Center for Brain and Cognitive Science Game : Connecting Your Brain to the Game Application of Mind Reading Brain-Computer Interface Lie Detection Preference Survey … Neuromarketing

Center for Brain and Cognitive Science Control of a Robot Arm by Human Thought Alone Brain-Machine Interface

Center for Brain and Cognitive Science Control of a Robot by Human Thought Alone Brain-Machine Interface Matching accuracy > 90% EEG + NIRS

Center for Brain and Cognitive Science Mind Reading : Until now, reading of only simple thought is possible Both temporal and spatial resolution are important Neural current vs. Metabolic change Golden standard method to be used as the reference for brain activation patterns when several imaging modalities are combined? Ethic issue Summary