Investigating Island Sensitivity in the Processing of Wh- Dependencies: An ERP Study Lauren Covey, Alison Gabriele, and Robert Fiorentino University of.

Slides:



Advertisements
Similar presentations
Working Memory and Nativelikeness in the Processing of Focus Structure Robert Reichle 1 Annie Tremblay 2 Caitlin Coughlin 2 1 Department of Foreign Languages.
Advertisements

Figure 2. L2 Cognates vs. L2 Non-cognates in both language groups at the anterior electrode site Fz (finding A). Figure 3. L2 Cognates vs. L2 Non-cognates.
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Are the anterior negativities to grammatical violations indexing working memory? Manuel Martin-Loeches, Francisco munoz, Pilar Casado, A. Melcon, C. Fernandez-frias,
Intervention by gaps in online sentence processing Michael Frazier, Peter Baumann, Lauren Ackerman, David Potter, Masaya Yoshida Northwestern University.
ERPs to Semantic and Physical Anomalies in Cartoon Videos Jennifer Michelson 1, Courtney Brown 1, Laura Davis 1, Tatiana Sitnikova 2 & Phillip J. Holcomb.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Introduction Semantic Feature Analysis (SFA) is a treatment technique designed to improve the naming abilities by increasing the level of activation within.
Hemispheric asymmetries and joke comprehension Coulson, S., & Williams, R. F. (2005) Neuropsychologia, 43,
Participants seem to utilize predictive information to actively maintain both task sets when doing so aids performance. Decreased mixing and switch costs.
Phonetic Similarity Effects in Masked Priming Marja-Liisa Mailend 1, Edwin Maas 1, & Kenneth I. Forster 2 1 Department of Speech, Language, and Hearing.
1 The role of structural prediction in rapid syntactic analysis Ellen Lau, Clare Sroud, Silke Plesch, Colin Phillips, 2006 PSYC Soondo Baek.
Influence of Word Class Proportion on Cerebral Asymmetries for High and Low Imagery Words Christine Chiarello 1, Connie Shears 2, Stella Liu 3, and Natalie.
Working Memory and Relative Clause Attachment under Increased Sentence Complexity Akira Omaki Department of Second Language Studies, University of Hawai‘i.
Home language environment and brain functions for language Irina Kuzmina, Amanda Hampton Wray, Eric Pakulak, Yoshiko Yamada, & Helen Neville Brain Development.
EXPERIMENT 2 [4] CW- inconsistent If cats were vegetarians they would be cheaper for owners to look after. Families could feed their cat a bowl of |fish.
An Electrophysiological study of translation priming in French/English bilinguals Katherine J. Midgley 1,2, Jonathan Grainger 2 & Phillip J. Holcomb 1.
Introduction To know how perceptual and attentional processes and properties of words guide the eyes through a sentence, the following issues are particularly.
English versus French: Determinants of eye movement control in reading Sébastien Miellet, Cyril Pernet, Patrick J. O’Donnell, and Sara C. Sereno Department.
Introduction Pinker and colleagues (Pinker & Ullman, 2002) have argued that morphologically irregular verbs must be stored as full forms in the mental.
Introduction Multiple Sclerosis (MS) is a chronic inflammatory disease characterized by the demyelization of axons within the central nervous system (CNS).
Introduction How do people recognize objects presented in pictorial form? The ERP technique has been shown to be extremely useful in studies where the.
An electrophysiological study of gender agreement transfer in early language learners Katherine J. Midgley 1,2, Nicole Y. Y. Wicha 3, Phillip J. Holcomb.
METHODOLOGY Experiment 1: - Within-subjects 2 (CW/ RW) x 2 (consistent/ inconsistent) design - 40 experimental items in each condition (total 160) displayed.
Instrument One instructional (INS) slide and three masking (MSK) slides provided directions for 4 test slides that each contained 3 lists of 3 color words.
Electrophysiological evidence for the role of animacy and lexico-semantic associations in processing nouns within passive structures Martin Paczynski 1,
INTRODUCTION Early after injury, persons with mild traumatic brain injury (TBI) have been shown to experience physical, cognitive, and emotional difficulties.
An event related potential investigation of complement set reference Joanne Ingram University of Bedfordshire Linda M Moxey University.
Additional Statistical Investigations A paired t-test was performed to evaluate whether a perceptual learning process occurs between the initial baseline.
As expected, a large N400 effect was observed for all 3 word types in both experiments, |ts|≥7.69, ps
Electrophysiological Processing of Single Words in Toddlers and School-Age Children with Autism Spectrum Disorder Sharon Coffey-Corina 1, Denise Padden.
N400-like semantic incongruity effect in 19-month-olds: Processing known words in picture contexts Manuela Friedrich and Angela D. Friederici J. of cognitive.
1 Cross-language evidence for three factors in speech perception Sandra Anacleto uOttawa.
METHOD RW- inconsistent / consistent If cats are hungry they usually pester their owners until they get fed. Families could feed their cat a bowl of carrots/
The effects of working memory load on negative priming in an N-back task Ewald Neumann Brain-Inspired Cognitive Systems (BICS) July, 2010.
Investigating the combined effects of word frequency and contextual predictability on eye movements during reading Christopher J. Hand Glasgow Language.
Sahin, Pinker, Cash, Schomer, & Halgren (2009) Sequential processing of lexical, grammatical, and phonological information within Broca’s area.
Introduction Can you read the following paragraph? Can we derive meaning from words even if they are distorted by intermixing words with numbers? Perea,
Theory of Mind and Executive Functioning: Dual Task Studies Claire Conway, Rebecca Bull & Louise Phillips School of Psychology, University of Aberdeen,
Processing Faces with Emotional Expressions: Negative Faces Cause Greater Stroop Interference for Young and Older Adults Gabrielle Osborne 1, Deborah Burke.
Without Words for Emotions: Is the emotional processing deficit in alexithymia caused by dissociation or suppression? Christian Sinnott & Dr. Mei-Ching.
Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.
An ERP investigation of response inhibition in adults with DCD Elisabeth Hill Duncan Brown José van Velzen.
Experiment & Results (± honorific features vs. main/embedded subject with Emb.Verb-honorific)  Experimental conditions  Self-paced reading time Participants:
Effects of Word Concreteness and Spacing on EFL Vocabulary Acquisition 吴翼飞 (南京工业大学,外国语言文学学院,江苏 南京211816) Introduction Vocabulary acquisition is of great.
Norming Study Mechanisms of Emotion Regulation: The Role of Attentional Control Lindsey R. Wallace, M. A. & Elisabeth J. Ploran, Ph.D. Department of Psychology,
Lack of adjustment in L2 English?
Investigating the combined effects of word frequency and contextual predictability on eye movements during reading Christopher J. Hand Glasgow Language.
Bi-dialectalism: the investigation of the cognitive advantage and non-native dialect perception in noise Brittany Moore, Jackie Rayyan, & Lynn Gilbertson,
Experimental Psychology
1 University of Hamburg 2 University of Applied Sciences Heidelberg
Effects of Working Memory on Spontaneous Recognition
Contact Discussion and Conclusion
Attention Components and Creative Potential: An ERP Exploration
Sami Gülgöz, Fatoş Gökşen, & Çiğdem Kağıtçıbaşı
Verifiability and Action verb Processing: An ERP Investigation
Neurofeedback of beta frequencies:
A High-Density EEG investigation of the Misinformation Effect: Differentiating between True and False Memories John E. Kiat & Robert F. Belli Department.
Tagler, M. J. , Brown, E. A. , Chambers, A. M. , & Miadich, S. A
FUNDING ACKNOWLEDGEMENT
Effects of inhibition training on event-related potential markers of inhibitory control in heavy drinkers Mrunal Bandawar , MBBS1,2 ; Matt Field, PhD1.
Motor Processing and Brain Activity are Related to Cognitive-Behavioral Improvement in Chronic Tic and Habit Disorders Irina Branet1,2 Caroline Hosatte-Ducassy1,4.
The involvement of visual and verbal representations in a quantitative and a qualitative visual change detection task. Laura Jenkins, and Dr Colin Hamilton.
Experimental Psychology PSY 433
]POST Retrieval cues in language comprehension:
Experimental Design in Functional Neuroimaging
Noriko Hoshino Department of Psychology
]POST Retrieval cues in language comprehension:
Machine Learning for Visual Scene Classification with EEG Data
Differences in verb and noun comprehension in aphasia
Presentation transcript:

Investigating Island Sensitivity in the Processing of Wh- Dependencies: An ERP Study Lauren Covey, Alison Gabriele, and Robert Fiorentino University of Kansas 30th Annual CUNY Conference on Sentence Processing Correspondence to: lrcovey@ku.edu INTRODUCTION STIMULI METHODS & DATA ANALYSIS Resolution of wh- dependencies has been characterized as a predictive process; once a wh- word has been identified, the parser predicts upcoming potential gap sites before encountering information in the bottom-up signal confirming an actual gap Filled-gap effects In the psycholinguistics literature, filled-gap effects are observed when the parser predicts the presence of a gap in a position that is already filled with lexical material, resulting in a reading time slowdown (Clifton & Frazier, 1989; Stowe, 1986) Finding evidence of subject filled-gap effects would provide evidence that the parser makes structural predictions about gap sites prior to encountering a gap-licensing verb, but results in the literature have been mixed (Lee, 2004) Island sensitivity It has also been shown that the parser avoids predicting gaps within illicit grammatical domains known as ‘islands’ (Stowe, 1986) Debates continue regarding whether gap-filling in islands is avoided due to syntactic constraints (Sprouse et al., 2012) or to processing difficulty (Hofmeister & Sag, 2010; Kluender, 2004) Sprouse et al. (2012) suggest that one way to bring evidence to this debate is to examine individual differences in cognitive abilities, with processing approaches predicting that increased processing resources should be related to positing gaps in islands 40 targets per condition, plus 80 filler sentences (all grammatical) Non-Island Conditions No Extraction (1a) Jamie wondered if the editor interviewed Dave Campbell with the reporter from the department. Wh- Extraction (1b) Jamie wondered who the editor interviewed Dave Campbell with __ from the department. Island Conditions (1c) Jamie wondered if the editor [that interviewed Dave Campbell] kissed the reporter after the meeting. (1d) Jamie wondered who the editor [that interviewed Dave Campbell] kissed __ after the meeting. Participants: 26 right-handed native English speakers recruited from university population (6 males, mean age 21.3, range: 18-30) Individual differences: Attentional control assessed via number Stroop task (Bush & Shin, 2006); Working memory assessed via Reading Span and Counting Span tasks (Conway et al., 2005) Stimuli presentation: Stimuli presented using RSVP (450ms/300ms) via Paradigm (Tagliaferri, 2005); yes-no comprehension questions follow 1/3 of trials EEG recording: EEG continuously recorded using Synamps2 amplifier (Compumedics Neuroscan, Inc.) and 32-channel Ag/AgCl electrode cap (Electro- Cap International, Inc.). Data analysis: Linear mixed-effects models with lme4 package (Bates et al., 2015) in R; LMERConvenience Functions used to progressively backwards-fit model including all possible interactions and fixed effects via log-likelihood ratio tests to arrive at the simplest/best-fitting model (Tremblay & Rasijn, 2015) Subject filled gap Object filled gap Actual gap site INDIVIDUAL DIFFERENCES Subject filled gap potential Object filled gap (in island) Actual gap site Subject filled gap Stroop*Extraction significant: increasing attentional control was associated with increased negativities (larger N400) RESULTS: SUBJECT FILLED GAP (300-500 ms) Object filled gap Stroop*Island*Extraction significant: in only Non-Island condition, increasing attentional control was associated with increased negativities (larger N400) Wh- Extraction (1b/d) No Extraction (1a/c) Collapsing across Island/Non-Island conditions for analysis Extraction*Anteriority Significant effects of Extraction in Central and Posterior regions Wh- extraction yielded significant negativity (N400) ERP EVIDENCE: WH- DEPENDENCIES Few studies in the ERP literature have used filled-gap paradigms (Hestvik et al., 2007, 2012), and no study has examined island sensitivity using fully grammatical sentences Studies examining wh- dependency resolution have reported two ERP components: N400: Michel (2014) reported N400s modulated by gap predictability, suggesting that the parser revises its prediction that a gap is forthcoming upon encountering an island boundary P600: In successful filler-gap dependency resolution in licit contexts, P600s have been found at an actual gap site (Kaan et al., 2000; Phillips et al., 2005) Actual gap site (Non-Island condition) Stroop*Extraction*Anteriority significant: increasing attentional control was associated with increased positivities (larger P600) in anterior and central sites RESULTS: OBJECT FILLED GAP Non-Islands (300-500 ms) Islands (300-500 ms) DISCUSSION Our results reveal the dynamics of wh- dependency resolution in fully grammatical sentences at three critical regions: Subject position One of few studies reporting subject filled-gap effects (Lee, 2004); N400 emerged, in line with Michel (2014), indicating that the parser makes structural predictions prior to encountering gap-licensing verb N400 effect related to Stroop scores, suggesting that individuals with greater attentional control were better able to predict upcoming gaps (Johnson, 2015) Object position An object filled-gap effect emerged in only licit contexts, indexed by N400 Licit N400 effect related to Stroop scores, suggesting that individuals with greater attentional control were better able to predict upcoming gaps No effects emerged in the island context, consistent with Michel (2014) that the parser updates its prediction that a gap is forthcoming inside an island Contrary to predictions of processing account of island sensitivity, processing capabilities did not predict ERP effects in at the filled gap located with the island Actual gap site In line with Kaan et al. (2000) and Phillips et al. (2005), successful wh- dependency resolution yielded P600s, in both Island and Non-Island conditions Although Stroop scores were only related to the P600 effect in Non-Island conditions, the P600 at the actual gap site for sentences containing islands indicates that the parser was able to resolve the dependency (i.e., processing did not completely break down) Wh- Extraction (1b) No Extraction (1a) Wh- Extraction (1d) No Extraction (1c) CURRENT STUDY The current study uses ERP components to track the processing of wh- dependencies across the sentence, examining sentences with and without islands at three critical regions: 1. Pre-verbal filled gap site (subject position) 2. Post-verbal filled gap site (object position) 3. The ultimate resolution site (actual gap) Individual difference measures included: Working Memory (Reading Span; Counting Span) Attentional Control (Number Stroop task) Predictions Subject position: If readers attempt to posit a gap in subject position, a filled-gap effect will emerge, indexed by N400 Object position: In licit positions: If readers attempt to posit a gap in object position, a filled-gap effect will emerge, indexed by N400 In islands: If readers avoid positing a gap within an island domain, no filled-gap effect should emerge Actual gap site: If readers successfully resolve the wh- dependency, P600 should emerge If gap filling in islands is avoided due to processing difficulty, then individuals with greater processing resources should show larger filled- gap effects (N400) in the island context Cognitive abilities may also effect prediction in grammatical contexts, with individuals with greater processing resources showing larger filled- gap effects in licit contexts (Hutchison, 2007; Johnson et al., 2016; Nicenboim et al., 2015) ANALYSIS: Extraction*Anteriority Negativity for Wh- Extraction in Anterior, Central, and Posterior regions (N400) No effect of Extraction in Island model RESULTS: GAP SITE Non-Islands (600-900 ms) Islands (600-900 ms) Wh- Extraction (1b) No Extraction (1a) Wh- Extraction (1d) No Extraction (1c) REFERENCES: Kaan, E., Harris, A., Gibson, E., & Holcomb, P. (2000). Lan & Cog Processes 15: 159-201. Bates, D., Mächler, M., Bolker, B., & Walker, S. (2014). doi: arXiv:1406.5823. Kluender, R. (2004). In Proceedings of WCCFL 23: 475-499. Bush, G. & Shin, L. (2006). Nature Protocols, 1(1), 308-313. Lee, M. W. (2004). J of Psycholinguistic Res, 33(1), 51-73. Conway et al. (2005). Psychonomic Bulletin and Review, 12, 769-786. Michel, D. (2014). Doctoral dissertation. UCSD. Clifton, C., Jr., & Frazier, L. (1989). In Ling Structure in Language Processing, 94–128. Nicenboim, B., Vasishth, S., Gattei, C., Sigman, M., & Kliegl, R. (2015). Front in Psych. doi:10.3389/fpsyg.2015.00312 Hestvik, A., Bradley, E., & Bradley, C. (2012). J of Psycholinguistic Res, 41, 425-438. Hestvik, A., Maxfield, N., Schwartz, R., & Shafer, V. (2007). Brain & Lang, 100, 301-316. Phillips, C., Kazanina, N., & Abada, S. H. (2005). Cog Brain Research 22(3): 407-428. Hofmeister, P., & Sag, I. (2010). Language. 86, 366-415. Sprouse, J., Wagers, M., & Phillips, C. (2012). Language. 88, 82-12. Hutchison, K. (2007). Journal of Experimental Psychology, 33(4), 645-662. Stowe, L. (1986). Lang and Cog Processes. 1227-1245. Johnson, A. (2015). Doctoral dissertation, University of Kansas. Tagliaferri, B. (2005). Paradigm. www.perceptionresearchsystems.com. Johnson, A., Fiorentino, R., & Gabriele, A. (2016). Front in Psych. doi: 10.3389/fpsyg.2016.00549 Tremblay, A. & Ransijn, J. (2015). LMERConvenienceFunctions: R package version 2.5. Extraction*Anteriority Positivity for Wh- Extraction in Central and Posterior regions (P600) Main effect of Extraction Positivity for Wh- Extraction across regions (P600) ACKNOWLEDGMENTS: We thank Xiao Yang, Nick Feroce, Heather Fielding, and Lena Roesner for help with data collection. We also thank the students of LING 107/111 for participating in our study.