FMRI Study on the Cerebral Activation associated with Semantic Processing involved in Producing L1 and L2 Words Donghwee Kim*, Wonil Choi, Hyungook Lim

Slides:

Advertisements

Similar presentations

Methods Effective functional connectivity of phonological and semantic processing processing during word reading Cheryl M. Capek 1,2, Simandeep Poonian.

Advertisements

Figure 12.1 (a) Regions of brain activity in skilled readers during a visual feature detection (implicit reading) task; (b) a map of Brodmann areas (BAs)

Psycholinguistics What is psycholinguistics ? Psycholinguistics is the study of the cognitive processes that support the acquisition and use of language.

Age-related changes in activation during tip-of-the-tongue: An event-related fMRI study. M.A. Shafto 1, E.A. Stamatakis 1, P.P. Tam 1, D.M. Burke 3, &

Modality-specific interaction between phonology and semantics Gail Moroschan & Chris Westbury Department of Psychology, University of Alberta, Edmonton,

Lexical Ambiguity in Sentence Comprehension By R. A. Mason & M. A. Just Brain Research 1146 (2007) Presented by Tatiana Luchkina.

BBI3215 Introduction To Psycholinguistics Dr

CHAPTER 10 Karen Meador. The Study of Language  Linguists – study the “rules” of language (what we do when we write, speak or talk)  Psycholinguists.

Method Participants Fifty-six undergraduate students (age range 19-37), 14 in each of the four language groups (monolingual, Spanish-English bilingual,

Multilingual Brain By : Prakhar Asthana Entry No.-2011CS1027 Indian Institute of Technology Ropar, India.

Phonetic Similarity Effects in Masked Priming Marja-Liisa Mailend 1, Edwin Maas 1, & Kenneth I. Forster 2 1 Department of Speech, Language, and Hearing.

An fMRI investigation of covertly and overtly produced mono- and multisyllabic words. Shuster LI, Lemieux SK. Brain and Language 93 (2005):20-31.

Cortical activation and synchronization during sentence comprehension in high-functioning autism: evidence of underconnectivity Marcel Adam Just, Vladimir.

BACKGROUND Lesion Characteristics Related to Naming Improvement in Aphasic Stroke Patients: The Role of Anterior Cortex and the Basal Ganglia R.B. Parkinson.

Neural correlates of continuous and categorical sinewave speech perception: An FMRI study Rutvik Desai, Einat Liebenthal, Eric Waldron, and Jeffrey R.

PSY 369: Psycholinguistics Representing language.

Fundamentals of Cognitive Psychology

 Frontal Lobes: i. Primary motor cortex ii. Broca’s Area  Parietal Lobes: i. Primary sensory cortex ii. Angular gyrus  Occipital Lobes: i. Primary.

2 nd lecture.  Stages of child’s intellectual development : Birth -2 sensorimotor 2-7 preoperational 7-16 Concrete operational:7-11 Formal operational:

Impact of language proficiency and orthographic transparency on bilingual word reading: An fMRI investigation by Gayane Meschyan and Arturo E. Hernandez.

Plasticity of Language-Related Brain Function During Recovery from Stroke K.R. Thulborn, P.A. Carpenter, & M.A. Just By Sydney Schnell.

Intrinsic Neural Connectiity of ACT-R ROIs Yulin Qin 1, 2, Haiyan Zhou 1, Zhijiang Wang 1, Jain Yang 1, Ning Zhong 1, and John R. Anderson 2 1. International.

By Peter Dang and Kyle Dennison.  Ability to acquire language is a unique and essential human trait  Chomsky’s Universal Grammar The human brain contains.

Task 3 conditions Participants decided whether two pictures both matched the cue or not. Event-related design, 40 trials per condition Items were presented.

Susceptibility Induced Loss of Signal: Comparing PET and fMRI on a Semantic Task Devlin et al. (in press)

RESULTS The masking paradigm worked well (participants reported that they knew there was something in the prime position, but where unable to identify.

1 Visual word recognition rules vs. pattern recognition and memory retrieval Erika Nyhus.

"One brain, two languages-- educating our bilingual students in the light of Neuroscience“ Dr. Luz Mary Rincon.

Bilingualism and Reading in a Native Language By Stacy Colwell.

Development Virtual Environments for fMRI Socially to Interact with a virtual avatar ; a pilot study Hyeongrae, Lee Dept. of Biomedical Engineering, Hanyang.

Comparative Diffusion Tensor Imaging (DTI) Study of Tool Use Pathways in Humans, Apes and Monkeys Ashwin G. Ramayya 1,2, Matthew F. Glasser 1, David A.

Bookheimer 2003 Annual Rev. Neurosci.. Phonology in IFG Gelfand and Bookheimer, Neuron 2002.

 The origin of grammatical rules is ascribed to an innate system in the human brain.  The knowledge of and competence for human language is acquired.

Psycholinguistics “Psycholinguistics is the study of the cognitive processes that support the acquisition and use of language. The scope of psycholinguistics.

 Participants Right-handed, community-dwelling individuals; 16 younger adults (19-28 years; 8 female); 16 older adults (60-82 years; 8 female). Participants.

Human perception and recognition of metric changes of part-based dynamic novel objects Quoc C. Vuong, Johannes Schultz, & Lewis Chuang Max Planck Institute.

Functional Connectivity in an fMRI Working Memory Task in High-functioning Autism (Koshino et al., 2005) Computational Modeling of Intelligence (Fri)

Language By Angela Moss Tanisha Flowers Reginald Alexander.

ADULT LANGUAGE DISORDERS Week 1 Jan 13, Text Book LaPointe, L. L. (2005). Aphasia and Related Neurogenic Language Disorders. 3rd edition, Thieme,

FMRI Activation in a Visual- Perception Task: Network of Areas Detected Using the General Linear Model and Independent Components Analysis Calhoun, Adali,

What you have learned and how you can use it : Grammars and Lexicons Parts I-III.

Role of Working Memory in Visual Selective Attention de Fockert, Rees, Frith, Lavie (2001)

Recent Models of Stuttering Western Illinois University February 7, 1997 J. Scott Yaruss, Ph.D., CCC-SLP University of Pittsburgh.

Pattern Classification of Attentional Control States S. G. Robison, D. N. Osherson, K. A. Norman, & J. D. Cohen Dept. of Psychology, Princeton University,

Localization of Brain Function

Articulatory Net I.2 Oct 14, 2015 – DAY 21

(Example) Class Presentation: John Desmond

Neural correlates of morphological decomposition in a morphologically rich language : An fMRI study Lehtonen, M., Vorobyev, V.A., Hugdahl, K., Tuokkola.

Orienting Attention to Semantic Categories T Cristescu, JT Devlin, AC Nobre Dept. Experimental Psychology and FMRIB Centre, University of Oxford, Oxford,

Language and the brain Introduction to Linguistics.

A FMRI Episodic Memory Study A longitudinal protocol in 31 patients presenting with early memory complain F. Gelbert C. Belin, A.M. Ergis, C. Moroni, C.

Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.

Exploring the relationship between linguistic knowledge, speech processing and oral fluency Dr Zöe Handley, University of York Dr Sible Andringa, Universität.

Vocab 3b The Brain. area at the front of the parietal lobes that registers and processes body touch and movement sensations.

Introduction  Recent neuroimaging studies of memory retrieval have reported the activation of a medial and left – lateralised memory network that includes.

1 LIN 1300 What is language? Dr Marie-Claude Tremblay.

Understanding the Brain The Brain Song. Electroencephalograph (EEG) Monitors the electrical activity of the brain- brain waves Used in clinical diagnosis.

A Novel Assessment Tool for Alzheimer's and Frontotemporal Dementias Jeanyung Chey 1,2, Hyun Song 2, Jungsuh Suk 1, & Minue J. Kim 3 The Proportional Reasoning.

ABSTRACT Figure 3. Results from two ANOVAs (HV > 0, MDD > 0) and a flexible factorial design (HV vs. MDD) in the unpleasant > neutral contrast are shown.

Cognitive Processes in Second Language Learners and Bilinguals: The Development of Lexical and Conceptual Representations JUDITH F. KROLL AND GRETCHEN.

John Cacioppo, PhD2, John Csernansky, PhD1, Xue Wang, PhD3

Cognitive Processes in SLL and Bilinguals:

Cerebral responses to vocal attractiveness and auditory

Results: Behavioral Performance Area and Laterality of activation

Wellcome Trust Centre for Neuroimaging University College London

علم النفس المعرفي (نفس 367)

Experimental Design in Functional Neuroimaging

Reading Disorders and Cortical (Brain) Function

Anthony D. Wagner, Anat Maril, and Daniel L. Schacter

Presentation transcript:

fMRI Study on the Cerebral Activation associated with Semantic Processing involved in Producing L1 and L2 Words Donghwee Kim*, Wonil Choi**, Hyungook Lim** Kichun Nam** *Dept. of Rehabilitation Medicine, College of Medicine, Korea Univ. ** Dept. of Psychology, Korea Univ..

Contents  Purpose  Introduction  Experiment & Results  Conclusion

Purpose To examine if the L1(Korean) semantic system and L2(English) semantic system are the common systems used during word production. To see where the semantic interference or facilitation is resolved in the brain shown in the behavioral data of L1 and L2 word production.

INTRODUCTION

Rhetorical/semantic /syntactic system Conceptual preparation Preverbal message Grammatical encoding Morpho-phonological encoding Phonological score Phonetic coding Surface structure Articulatory score Articulation Self-perception Parsed speech Overt speech Model of addressee (ToM) Discourse model, etc Knowledge of external And internal world Lemmas Morpho-phonological code Mental lexicon Gestural scores Syllabary Phonological/ phonetic system

Example of Experimental Procedure Semanticall related Semanticall unrelated Identical No distractor Ex1). Word Distractor(e.g. 과일 )  Picture(e.g. Apple)  Naming Picture

Previous Study Glasser(1992) –Word(distractor)-Picture naming task –Monolingual participant –Semantic distractor ; inhibitory effect –Phonological distractor ; facilitatory effect Costa, Miozzo, Caramazza(1999) –Same task, but Spanish-English bilingual subjects –The same result with Glasser ’ s one Thus, initial semantic interference and then phonological facilitation

EXPERMENT I: Behavior

Experiment 1: Korean and English Picture Naming with Korean distractors Subjects –100 college students, ages 20 – 27, formal English education in the middle and high schools (6 years) Experimental task: Picture Naming with Distractor - 50 pictures (concrete word)  overt picture naming in Korean and English - Distractors (Korean)  no distractor, semantically unrelated, semantically related, identical,

Korean and English Picture naming with distractors Semanticall related Semanticall unrelated Identical No distractor

RESULTS: Behavioral Data

Korean picture naming (using the Korean distractor) Fast Naming: Shorter than 1100msec Identical < No Distractor  Facilitation  Repetition Priming Related >Unrelated  Inhibition  Lexical Competition Related >Unrelated  Inhibition  Lexical Competition

English picture naming (using the Korean distractor) Slow Naming: Longer than 1600msec Identical > No Distractor  Inhibition  Cross-linguistic Inhibition Related <Unrelated  Facilitation  Semantic Priming

EXPERMENT II: fMRI

Experiment 2-1: fMRI Korean Picture Naming with Korean distractors Subjects : 9 college students ages 20 – 27 all right handed formal English education in the middle and high schools (6 years) Experimental task: Picture Naming : 50 pictures (concrete word)  covert picture naming in Korean : Distractors (Korean) semantically related, semantically unrelated identical,

Experiment 2-2: fMRI English Picture Naming with Korean distractors Subjects : 12 college students : All right handed : Regular English education in the middle and high schools (6 years) Experimental task: Picture Naming : 50 pictures (concrete word)  covert picture naming in English : Distractors (Korean) semantically related, semantically unrelated identical,

Experimental (Activation) Condition Semantically related Semantically unrelated Identical No distractor

Control (Resting) Condition speak silently “mu mu (meaningless picture and meaningless naming)

fMRI Scanning CCCCCAAAACCAA Dummy scan (12 sec) Control task meaningless line figure (30 sec) Activation task Picture naming task (30 sec) Total 6 minutes 42 seconds 12+ (11 x 30) = 342 seconds 114 scans

Experiment 1, 2: fMRI data acquistion and analysis fMRI data acquistion -ISOL 3.0T forte at KIST fMRI center -TR 3000 msec, TE 35 msec –5 mm, 20 slices, 64*64 Matrix –FOV 24 cm, Flip angle 80° Data analysis -off-line analysis with SPM99 (Statistical Parametric Mapping) -Realignment, normalization, smoothing, general linear regression -paired t-test (Significant level, p<0.001)

RESULTS: fMRI

Result_1: ( Picture naming without distractor) – (Meaningless naming) Activation in both cerebellum and occipital lobe (R>L) Activation in both cerebellum and occipital lobes, Left Broca’s area and supramarginal gyrus Korean NamingEnglish Naming

Result_2: ( Picture naming with the unrelated distractor) – (Picture naming) Activation in left cerebellum Occipital lobe near the preoccipital notch Right inferior frontal gyrus and temporal gyrus (posterior) Activation in both cerebellum Inferior parietal lobe (L>R) Left inferior frontal lobe KoreanEnglish

Result_3: ( Picture naming with the related distractor) – (Picture naming) Activation in left cerebellum and both occipital lobe Right temporal, parietal, frontal lobes Activation in both cerebellum Inferior parietal and frontal lobe(L>>R), KoreanEnglish

Result_4: ( Picture naming with the identical distractor) – (Picture naming) Activation in both cerebellum and right inferior parietal and occipital lobe No activation in right frontal lobe Activation in both cerebellum and Inferior parietal and frontal lobe (L>>R), KoreanEnglish

Korean picture naming (Correlation between RT and Brain) Fast Naming: Shorter than 1100msec Identical < No Distractor  Facilitation  Repetition Priming: Right Inferior Parietal Lobe Related >Unrelated  Inhibition  Lexical Competition: Right Inferior Frontal Gyrus Related >Unrelated  Inhibition  Lexical Competition: Right Inferior Frontal Gyrus

English picture naming (Correlation between RT and Brain) Slow Naming: Longer than 1600msec Identical > No Distractor  Inhibition  Cross-linguistic Inhibition: Left Inferior Frontal Lobe and Right Inferior Parietal Lobe Related <Unrelated  Facilitation  Semantic Priming: Larger Activation in Left Inferior Frontal Lobe and Parietal Lobe

Conclusion To examine if the L1(Korean) semantic system and L2(English) semantic system are the common systems used during word production.  Different Processing in Similar Areas To see where the semantic interference or facilitation is resolved in the brain shown in the behavioral data of L1 and L2 word production.   Right Inferior Frontal Gyrus and Right Inferior Parietal Lobe for Inhibition   Left Inferior Frontal and Parietal Lobe for Facilitation

COGNITIVE NEUROSCIENCE

Cognitive Neuroscience Lab. in Korea University Research Directions Cognitive, linguistic, and computational architecture of Korean and foreign language processing Brain mapping of the linguistic processing based on the brain imaging and lesion study Construction of the diagnostic tool and learning programs of native and foreign language disorder Research Group 3 psycholinguists, 4 medical doctors, 3 language pathologists, 2 computational linguists, 4 speech scientists, 2 graduate students in linguistics, 9 graduate students in experimental psychology, 5 undergraduate students

Interdisciplinary Approach Language Processing System Language Processing System 손상 뇌 접근 신경해부학 접근 전산학 접근 정보처리론 접근 한국어 형태 / 구문 지식표상 규명 컴퓨터 시뮬레이션 한국어정보처리시스템 한국어정보처리 대뇌신경회로망 규명 언어장애 분류 및 DB 구축

Where are we? Prof. Nam ’ s Address The homepage of our lab. – Tel : Fax :