1. Center for Brain and Cognitive Science Mind Reading for Cognitive Systems Yong-Ho Lee Center for Brain & Cognitive Research Korea Research Institute of Standards and Science

2. Center for Brain and Cognitive Science ACS: Artificial Cognitive System ACS Natural Cognition Natural & Life Sciences, Neuroscience Computing, Sensing, Imaging Cogno- Bio- Info- Cognitive system in FP6 http://kr.blog.yahoo.com/ekdrn Artificial Cognitive SystemHuman Cognitive System

3. Center for Brain and Cognitive Science “Cognitive systems are natural or artificial information processing systems, including those responsible for perception, learning, reasoning and decision making and for communication and action.” - Foresight Cognitive Systems Project- What is a cognitive system?

4. Center for Brain and Cognitive Science Self-organization in the nervous system 10 14 connections between 10 10 neurons in neo-cortex Human computers : 10 12 processors Sensory processing : sight, hearing, touch and so on Social cognition Interaction, Planning and Motivation Memory, Reasoning and Learning Advanced Neuroscience Technologies Foresight Cognitive Systems Project

5. Center for Brain and Cognitive Science Mind reading Interface & Interaction Brain signals or Biological signals Information

6. Center for Brain and Cognitive Science Imaging tools fMRI MEG EEG PET NIRS ECoG Metabolism Electrophysiology Brain reading tools?

7. Center for Brain and Cognitive Science Windows to the Brain Metabolic change Electric activity Cognitive process : Changes of brain activity in time and space

8. Center for Brain and Cognitive Science Functional MRI + High spatial resolution - Poor temporal resolution Most common device for brain study Imaging of hemodynamic changeHigh-field MRI

9. Center for Brain and Cognitive Science In viewing pictures of different categories (face, house, and painting) Maël Lebreton et al, Neuron (2009) fMRI Different activation area in the brain

10. Center for Brain and Cognitive Science Hemoglobin Near IRScattered Blood vessel Skin Brain NIRS : Near InfraRed Spectroscopy Dong-il SHIMADZU Corp.

11. Center for Brain and Cognitive Science Deoxy Hb Oxy Hb 780nm, 805nm, 830nm Absorption spectrum of Hemoglobin Near IR Total Hb Oxy Hb Deoxy Hb Task Task Task Dong-il SHIMADZU Corp. Relative change of Hb Finger tapping task NIRS signals

12. Center for Brain and Cognitive Science EEG HydroCel Geodesic Sensor http://www.egi.com/clinical-division-clinical-products/c-gsh Electroencephalography Source localization Besa, MEGIS Software GmbH Susceptive to electric conductivity inhomogeneity of the brain

13. Center for Brain and Cognitive Science MEG System MEG (Magnetoencephalography) Localization of active currents + High temporal resolution + Measure neural current + Moderate spatial resolution - Need inverse problem process - Poor sensitivity to deep sources

14. Center for Brain and Cognitive Science Brain: Real time processor in ms time scale ► EEG, MEG-non invasive information with high temporal resolution Temporal resolution : Role of MEG Timing of human cortical functions during cognition

15. Center for Brain and Cognitive Science - Simultaneous imaging of neural current & anatomical structure - Measurement field : ~ μT - Nuclear magnetic resonance frequency = ~ Neural activity frequency - Imaging of neural current distribution Direct Imaging of Neural Current Imaging of neural activity

16. Center for Brain and Cognitive Science Magnetically shielded room Stimulus control Insert Dewar RF shielding Stimulus FLL circuits Controller Filter/Amp SQUID Signal processing Source analysis BpBp BmBm Gradient fields Data acquisition system Controlled current source Direct Imaging of Neural Current

17. Center for Brain and Cognitive Science New MRI : MRI at microTesla field Ultra-low field MRI

18. Center for Brain and Cognitive Science http://article.joins.com/article/photo/article.asp?Total_ID=3311491&p_cat=life Biological signals - Heart rate - Respiration rate - Face temperature Mind reading device - Molintent

19. Center for Brain and Cognitive Science Game : Connecting Your Brain to the Game http://www.emotiv.com/ Application of Mind Reading Brain-Computer Interface Lie Detection Preference Survey … http://www.neurosciencemarketing.com/ Neuromarketing

20. Center for Brain and Cognitive Science Control of a Robot Arm by Human Thought Alone Brain-Machine Interface http://www.studybusiness.com/HTML/TRM/02173-06-2006-TRM-11-K.htm

21. Center for Brain and Cognitive Science Control of a Robot by Human Thought Alone Brain-Machine Interface Matching accuracy > 90% http://www.youtube.com/watch?v=O6yI_4FHSKI EEG + NIRS

22. Center for Brain and Cognitive Science Mind Reading : Until now, reading of only simple thought is possible Both temporal and spatial resolution are important Neural current vs. Metabolic change Golden standard method to be used as the reference for brain activation patterns when several imaging modalities are combined? Ethic issue Summary