The Interaction of Lexical and Syntactic Ambiguity by Maryellen C. MacDonald presented by Joshua Johanson.

Slides:



Advertisements
Similar presentations
Dependency Locality Theory: A Distance-based Theory of Linguistic Complexity Boris Krupa 5/4/2001.
Advertisements

TOWARDS A MODULAR APPROACH TO ANAPHORIC PROCESSING: semantic operations precede discourse operations Arnout Koornneef.
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Sentence Processing III Language Use and Understanding Class 12.
Sentence Processing 1: Encapsulation 4/7/04 BCS 261.
A fundamental problem for understanding language
Language, Mind, and Brain by Ewa Dabrowska Chapter 9: Syntactic constructions, pt. 1.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Statistical NLP: Lecture 3
Misplaced and Dangling Modifiers By Colin Wood. The Misplaced Modifier  A misplaced modifier is a group of words that falls in the wrong part of the.
Sentence Memory: A Constructive Versus Interpretive Approach Bransford, J.D., Barclay, J.R., & Franks, J.J.
Introduction and Jurafsky Model Resource: A Probabilistic Model of Lexical and Syntactic Access and Disambiguation, Jurafsky 1996.
Sag et al., Chapter 4 Complex Feature Values 10/7/04 Michael Mulyar.
Generative Models of Discourse Eugene Charniak Brown Laboratory for Linguistic Information Processing BL IP L.
Predicting the Semantic Orientation of Adjective Vasileios Hatzivassiloglou and Kathleen R. McKeown Presented By Yash Satsangi.
Language, Mind, and Brain by Ewa Dabrowska Chapter 2: Language processing: speed and flexibility.
Predicting the Semantic Orientation of Adjectives
Day 2: Pruning continued; begin competition models
“I will not go down to posterity talking bad grammar.”
PSY 369: Psycholinguistics Language Comprehension: The role of memory.
Simple Correlation Scatterplots & r Interpreting r Outcomes vs. RH:
PSY 369: Psycholinguistics Language Comprehension: Sentence comprehension.
Today Concepts underlying inferential statistics
Intro to Psycholinguistics What its experiments are teaching us about language processing and production.
Syntax.
Style, Grammar and Punctuation
Albert Gatt LIN 3098 Corpus Linguistics. In this lecture Some more on corpora and grammar Construction Grammar as a theoretical framework Collostructional.
Introduction To know how perceptual and attentional processes and properties of words guide the eyes through a sentence, the following issues are particularly.
Experimental study of morphological priming: evidence from Russian verbal inflection Tatiana Svistunova Elizaveta Gazeeva Tatiana Chernigovskaya St. Petersburg.
Jelena Mirković and Maryellen C. MacDonald Language and Cognitive Neuroscience Lab, University of Wisconsin-Madison Introduction How to Study Subject-Verb.
Probabilistic Parsing Reading: Chap 14, Jurafsky & Martin This slide set was adapted from J. Martin, U. Colorado Instructor: Paul Tarau, based on Rada.
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
For Friday Finish chapter 23 Homework: –Chapter 22, exercise 9.
Ferreira and Henderson (1990)
Speech Comprehension: Decoding meaning from speech.
Information Density and Word Order. Why are some word orders more common than others? In the majority of languages (with dominant word order) subjects.
1 Statistical Parsing Chapter 14 October 2012 Lecture #9.
Older Adults’ More Effective Use of Context: Evidence from Modification Ambiguities Robert Thornton Pomona College Method Participants: 32 young and 32.
Anaphoric dependencies : A window into the architecture of the language system Eye tracking experiments Eric Reuland Frank Wijnen Arnout Koornneef.
1 Language processing in the mind Linguistics lecture #5 November 9, 2006.
Assessment of Morphology & Syntax Expression. Objectives What is MLU Stages of Syntactic Development Examples of Difficulties in Syntax Why preferring.
Adele E. Goldberg. How argument structure constructions are learned.
Avoiding the Garden Path: Eye Movements in Context
Once you have: 1. Found the student's reading levels with the IRI. 2. Found appropriate materials for the RMI (highest instructional level [oral or silent],
PSY270 Michaela Porubanova. Language  a system of communication using sounds or symbols that enables us to express our feelings, thoughts, ideas, and.
Cognitive Processes PSY 334 Chapter 11 – Language Structure June 2, 2003.
Rules, Movement, Ambiguity
Results of Eyetracking & Self-Paced Moving Window Studies DO-Bias Verbs: The referees warned the spectators would probably get too rowdy. The referees.
CHAPTER 9 THINKING CRITICALLY IN THIS CHAPTER YOU WILL LEARN: What it means to think critically, and why it is important What facts and opinions are, and.
What makes a complete sentence? English I CP. What do you need to make a complete sentence? A subject and a predicate. End of story. Without these, you.
Dec 11, Human Parsing Do people use probabilities for parsing?! Sentence processing Study of Human Parsing.
Correlation They go together like salt and pepper… like oil and vinegar… like bread and butter… etc.
A matter of ambiguity? Using eye movements to examine collective vs. distributive interpretations of plural sets 1 Christine Boylan Dimka Atanassov Florian.
Lecture 1 Ling 442.
48 Item Sets (Only the results for the relative clause versions are reported here.) The professor (who was) confronted by the student was not ready for.
Understanding Statistics © Curriculum Press 2003     H0H0 H1H1.
Differences between EAP and EGP Features of EAP. Categories for the main distinguishing features of Academic English Complexity Formality Precision Objectivity.
Revision Lecture Cognitive Science. Past papers What is the answer to the question? The answer will nearly always involve: “How amazing it is that people.
PARSING David Kauchak CS159 – Fall Admin Assignment 3 Quiz #1  High: 36  Average: 33 (92%)  Median: 33.5 (93%)
Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.
48 Item Sets (Only the results for the relative clause versions are reported here.) The professor (who was) confronted by the student was not ready for.
DictionSyntax Style  Your diction is simply your choice of words. There is no single, correct diction in the English language; instead, you choose.
WR090 Skilled Writing through Inquiry: A Community of Scholars Examines Success, Grit, and Creative Intelligence WEEK 5 Tue., October 22, 2013.
Natural Language Processing Vasile Rus
Language, Mind, and Brain by Ewa Dabrowska
Eye-tracking-while-reading Experiment Coherence Judgment Experiment
Statistical NLP: Lecture 3
More about Tests and Intervals
Linguistic Essentials
David Kauchak CS159 – Spring 2019
Presentation transcript:

The Interaction of Lexical and Syntactic Ambiguity by Maryellen C. MacDonald presented by Joshua Johanson

What do you mean by lexical and syntactic ambiguity? Lexical Ambiguity –financial bank/river bank Syntactic Ambiguity –I saw the spy with the binoculars Lexical and Syntactic Ambiguity –to watch/a watch

Approach 1: Unified Approach Both syntax and lexical ambiguities resolved via probabilistic constraints Very complex interaction All lexical and syntactic interpretations are activated until one is favored The alternative view uses garden sentences to argue that only one syntactic interpretation is activated –I told the girl that the boy met the story –While Mary was mending the sock fell on the floor

Approach 2: Different mechanism for each type of ambiguity Lexical Ambiguity –Representations are created and stored –All senses are activated in parallel until most probable one is chosen Sytactic Ambiguity –Parses are constructed, not stored –There is only one serial parse Lexical and Semantic Ambiguity –The Delay Model

Delay Model If there is an interaction between lexical and syntactic ambiguity, resolution of the ambiguity waits until it is no longer ambiguous –I know that the desert trains could resupply the camp. –I know that the desert trains soldiers to be tough

Frazier and Rayner’s experiment Measured eye fixation for reading times Compared ambiguous readings with unambiguous readings Used this/these to disambiguate –This desert trains –These desert trains

Results

Criticism End region is not consistent (3-10 words) Delay may come from another source besides the ambiguity ‘This’ and ‘These’ are usually used as anaphoric references, but there is no mention of which desert or which trains these refer to. This could be awkward and may be the cause in the delay, not the disambiguation

MacDonald’s Experiment 53 MIT undergraduates tested Saw one word at a time on the screen Pressed space when they were done Asked comprehension question at the end (No feedback) Threw out tests if the comprehension question were wrong Threw out 5 participants who got more than 20% of the comprehension questions wrong

Sentences Modified Frazier’s questions to have exactly four words after the ambiguous phrase Instead of using the modifier to dis- ambiguate, they used the part of speech –“the deserted trains” –“the desert trained” Kept the this/these distinction

Sample Question Set

Results from Ambiguous Region No difference between “the desert trains” and “the deserted trains” Using anaphoric modifiers increases reading time across the board Disambiguation increases reading time in the NV interpretation

Why does disambiguation increase reading time Inherent NN bias affected the reading times Readers might have confused “desert trained”, which is NV, with “desert-trained” which is an adjective “The desert trains soldiers” doesn’t necessarily imply NV –“The desert trains (that) soldiers attacked were destroyed”

Results from the End Region Obvious benefits from disambiguating “the” Still some residual ‘this/these’ confusion, except when it disambiguates “these desert trains”

Experiment 2 Hypothesis: A strong semantic bias affects ambiguity resolution This would disprove the delay model, which suggests all disambiguation waits until the disambiguation is resolved. Avoids anaphoric determiners –“corporation fires” (ambiguous) –“corporations fire” (unambiguous)

Setup 44 (out of 46) MIT undergrads Same basic setup as before with keyboard and comprehension questions 16 questions, each with and without and ambiguity with and without supportive bias Uses different NV combinations to bias the interpretation –“corporation fires” NV bias –“warehouse fires” NN bias

Results

Observations Very little difference in the Supportive Bias times Still seems to be a “reverse ambiguity” effects There might be something to do with it taking longer to process NVs that NNs. Using a word that is still ambiguous but has a stronger bias affects the results This is not supported by the delay model

Can we predict how strong the effect will be? How often is the word the head of the phrase rather than the modifier How often is the word a verb rather than a noun (‘to warehouse prisoners’) How often do the words appear together How plausible is the situation (Is a corporation more likely to have a fire or a warehouse?)

How they collected it Wall Street Journal corpus (yea!!!) Counted the number occurrences for the ‘how often’ questions. Plausibility is subjective, and could be influenced by other factors They tested 96 native English speakers on sentence completion and counted number of times they completed it as a NN vs. NV –“The warehouse fires…”

Results Percentage Heads: –Supportive bias (corporation fires) – 85.5% –Unsupportive bias (warehouse fires) – 58.8% Noun/Verb interpretation –6.5% verb usage (to warehouse prisoners) Co-occurrence –Supportive bias.1% –Unsupportive bias 2.1%(exact) and 42.%(combined) –Still very sparse, went with a Boolean exist or not exist Sentence Completion Norms –Supportive bias – 50.9% NV interpretation –Unsupportive bias – 9.6% NV interpretation

How do these biases affect reading times? Stepwise regression function –Stepwise regression only used the head measure results: –r 2 =.19, F(1,30), p =.01 Simple regression –As supportiveness for NV interpretation increase, reading time increases –Co-occurrence had the reverse effect, since co-occurrence seems to promote NN interpretation

Do these affect unambiguous sentences Yes. People tend to read plausible sentences more quickly than less plausible sentences. This may indicate that plausibility might help disambiguate more than modifiers. “the corporations fire” was read more quickly than “the warehouses fire”.

Let’s do another step-wise regression! This time we use the difference between the ambiguous and unambiguous readings The partial correlation between reading time differences and the percentage head measure was.47 –If the word is more likely to be a head, the reading time increased with the ambiguity. The partial correlation with the sentence completion norms was -.37 –If the word is more plausible, the reading time decreases with the ambiguity

Shouldn’t it be the other way around? Apparently not. We know that NVs take longer to read than NNs. Maybe an incorrect reading of the word as a NN actually decreases the reading time more than having the correct reading of a NV. –“the warehouse fires…” –“the warehouses fire…”

I wonder how that affect carries out to the rest of the sentence?

Conclusions Both lexical and combinatorial factors influence the ambiguity resolution process These factors accounted for a significant portion of variance in reading times More constraints promoted NV, the smaller the effect of ambiguity This data does not support the delay model Psycholinguistics has underestimated the influence of probabilistic information

Do we really keep track of the number of times that a noun is used as the head of a noun phrase? We might need it to disambiguate between head nouns and noun modifiers Maybe it just reflects other factors –Animacy? –Morphological analysis

Questions?