PSY 369: Psycholinguistics Language Comprehension: Sentence comprehension.

Slides:



Advertisements
Similar presentations
Computational language: week 10 Lexical Knowledge Representation concluded Syntax-based computational language Sentence structure: syntax Context free.
Advertisements

The Art of Leading a Great Youth Discussion. Newspaper Headlines Do these make sense to you?
STAGES OF COMPREHENSION discourse modelling semantic analysis syntactic “parsing” lexical access phonemic analysis sensory processing.
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Intro to NLP - J. Eisner1 Human Sentence Processing.
Sentence Processing III Language Use and Understanding Class 12.
The Interaction of Lexical and Syntactic Ambiguity by Maryellen C. MacDonald presented by Joshua Johanson.
Sentence Processing 1: Encapsulation 4/7/04 BCS 261.
Prosodic facilitation and interference in the resolution of temporary syntactic closure ambiguity Kjelgaard & Speer 1999 Kent Lee Ψ 526b 16 March 2006.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Statistical NLP: Lecture 3
Introduction and Jurafsky Model Resource: A Probabilistic Model of Lexical and Syntactic Access and Disambiguation, Jurafsky 1996.
LING NLP 1 Introduction to Computational Linguistics Martha Palmer April 19, 2006.
Language Use and Understanding BCS 261 LIN 241 PSY 261 CLASS 12: SNEDEKER ET AL.: PROSODY.
Syntax 2nd class Chapter 4.
For Monday Read Chapter 23, sections 3-4 Homework –Chapter 23, exercises 1, 6, 14, 19 –Do them in order. Do NOT read ahead.
Introduction to Intonation Jennifer J. Venditti Cognitive Science March 2001.
Psy1302 Psychology of Language Lecture 10 Ambiguity Resolution Sentence Processing I.
PSY 369: Psycholinguistics Language Comprehension: Sentence comprehension.
Amirkabir University of Technology Computer Engineering Faculty AILAB Efficient Parsing Ahmad Abdollahzadeh Barfouroush Aban 1381 Natural Language Processing.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Spring 2006-Lecture 4.
Psy1302 Psychology of Language Lecture 12 Sentence Comprehension II.
The Neural Basis of Thought and Language Week 15 The End is near...
Language, Mind, and Brain by Ewa Dabrowska Chapter 2: Language processing: speed and flexibility.
Day 2: Pruning continued; begin competition models
Syntax LING October 11, 2006 Joshua Tauberer.
PSY 369: Psycholinguistics Language Comprehension: Sentence comprehension.
Understanding Sentences. Two steps back: What is linguistic knowledge? Phonological Syntactical Morphological Lexical Semantic.
Intro to Psycholinguistics What its experiments are teaching us about language processing and production.
Syntax: The analysis of sentence structure
SI485i : NLP Day 1 Intro to NLP. Assumptions about You You know… how to program Java basic UNIX usage basic probability and statistics (we’ll also review)
The Language Instinct Talking Heads.
Interference in Short-Term Memory The Magical Number Two (or Three) in Sentence Processing ` (Sat.) / Chan-hoon Park Hypernetwork Models of Learning.
For Friday Finish chapter 23 Homework: –Chapter 22, exercise 9.
Speech Comprehension: Decoding meaning from speech.
Presentation by Dianne Smith, MJE. Something went wrong In jet crash, expert says.
Dr. Monira Al-Mohizea MORPHOLOGY & SYNTAX WEEK 12.
1 Natural Language Processing Lecture 11 Efficient Parsing Reading: James Allen NLU (Chapter 6)
Language comprehension. understanding speech 1.differentiating speech sounds from other noises 2.recognizing words 3.activating their syntactic and semantic.
CHAPTER 13 NATURAL LANGUAGE PROCESSING. Machine Translation.
PS: Introduction to Psycholinguistics Winter Term 2005/06 Instructor: Daniel Wiechmann Office hours: Mon 2-3 pm Phone:
11 Chapter 14 Part 1 Statistical Parsing Based on slides by Ray Mooney.
PSY 369: Psycholinguistics A Crash Course in Linguistic Theory Part II.
For Wednesday Read chapter 23 Homework: –Chapter 22, exercises 1,4, 7, and 14.
Linguistic Essentials
Lexicalized and Probabilistic Parsing Read J & M Chapter 12.
Rules, Movement, Ambiguity
Natural Language Processing
LING 001 Introduction to Linguistics Spring 2010 Syntactic parsing Part-Of-Speech tagging Apr. 5 Computational linguistics.
Dec 11, Human Parsing Do people use probabilities for parsing?! Sentence processing Study of Human Parsing.
Frazier & Fodor (1978) Goal –Explain why hard sentences are hard –And why structural ambiguities typically have the preferred resolutions they do –Entirely.
SYNTAX.
CS460/IT632 Natural Language Processing/Language Technology for the Web Lecture 13 (17/02/06) Prof. Pushpak Bhattacharyya IIT Bombay Top-Down Bottom-Up.
48 Item Sets (Only the results for the relative clause versions are reported here.) The professor (who was) confronted by the student was not ready for.
PSY 369: Psycholinguistics Language Comprehension: Sentence comprehension.
Incremental parsing and ambiguous sentences - each incoming materials are attached immediately - a single analysis is pursed - given the uncertainty,
48 Item Sets (Only the results for the relative clause versions are reported here.) The professor (who was) confronted by the student was not ready for.
Week 3. Clauses and Trees English Syntax. Trees and constituency A sentence has a hierarchical structure Constituents can have constituents of their own.
College of Science and Humanity Studies, Al-Kharj.
Lecturer : Ms. Abrar Mujaddidi S YNTAX. I NTRODUCTION  In the previous chapter, we moved from the general categories and concepts of traditional grammar,
PSY 369: Psycholinguistics Language Comprehension: Semantic networks.
Cognitive Language Processing for Rosie
How to Lead Discussions
Statistical NLP: Lecture 3
Basic Parsing with Context Free Grammars Chapter 13
SYNTAX.
Sentence Comprehension and Memory
Psycholinguistics: the study of language processing
Probabilistic and Lexicalized Parsing
Linguistic Essentials
Presentation transcript:

PSY 369: Psycholinguistics Language Comprehension: Sentence comprehension

Center embedded structures The house burned down.

Center embedded structures The house burned down. The house the handyman painted burned down.

Center embedded structures The house burned down. The house the handyman painted burned down. This one may be legal, but that doesn’t mean that it is (easily) comprehensible ( the handyman that the teacher hired painted the house that burned down ) The house the handyman the teacher hired painted burned down.

S NP Ndet Themanhit dog withtheleash.the Theman

S NPVP V Ndet Themanhit dog withtheleash.the Themanhit

S NPVP VNP NdetN Themanhit dog withtheleash.the Themanhitdogthe

S NPVP VNP NdetN Themanhit dog withtheleash.the Themanhitdog PP withtheleash the Modifier

S NPVP VNP NdetN Themanhit dog withtheleash.the Themanhitdog PP withtheleash the Instrument

Themanhit dog withtheleash.the How do we know which structure to build?

Parsing The syntactic analyser or “parser” Main task: To construct a syntactic structure from the words of the sentence as they arrive

Different approaches Serial Analysis (Modular): Build just one based on syntactic information and continue to try to add to it as long as this is still possible Interactive Analysis: Use multiple levels (both syntax and semantics) of information to build the “best” structure Parallel Analysis: Build both alternative structures at the same time Minimal Commitment: Stop building - and wait until later material clarifies which analysis is the correct one.

Sentence Comprehension Modular

Sentence Comprehension Modular Interactive models

Sentence Comprehension Garden path sentences A garden path sentence invites the listener to consider one possible parse, and then at the end forces him to abandon this parse in favor of another.

Sentence Comprehension Garden path sentences The horse raced past the barn fell. VP S NP The horse

Sentence Comprehension Garden path sentences The horse raced past the barn fell. VP V raced S NP The horse

Sentence Comprehension Garden path sentences The horse raced past the barn fell. VP VPP PNP racedpast S NP The horse

Sentence Comprehension Garden path sentences The horse raced past the barn fell. VP VPP PNP racedpastthe barn S NP The horse

Sentence Comprehension Garden path sentences The horse raced past the barn fell. VP VPP PNP racedpastthe barn S NP The horse fell

Sentence Comprehension Garden path sentences The horse raced past the barn fell. VP VPP PNP racedpastthe barn S NP The horse raced is initially treated as a past tense verb

Sentence Comprehension Garden path sentences The horse raced past the barn fell. VP VPP PNP racedpastthe barn S NP The horse fell raced is initially treated as a past tense verb This analysis fails when the verb fell is encountered

Sentence Comprehension Garden path sentences The horse raced past the barn fell. VP VPP PNP racedpastthe barn S NP The horse fell raced is initially treated as a past tense verb This analysis fails when the verb fell is encountered raced can be re-analyzed as a past participle. VP V raced PP PNP pastthe barn S NP The horsefell NPRR V

Real Headlines  Juvenile Court to Try Shooting Defendant  Red tape holds up new bridge  Miners Refuse to Work after Death  Retired priest may marry Springsteen  Local High School Dropouts Cut in Half  Panda Mating Fails; Veterinarian Takes Over  Kids Make Nutritious Snacks  Squad Helps Dog Bite Victim  Hospitals are Sued by 7 Foot Doctors

A serial model Formulated by Lyn Frazier (1978, 1987) Build trees using syntactic cues: phrase structure rules plus two parsing principles Minimal Attachment Late Closure

A serial model Minimal Attachment Prefer the interpretation that is accompanied by the simplest structure. simplest = fewest branchings (tree metaphor!) Count the number of nodes = branching points Marcie kissed Ernie and his brother… The girl hit the man with the umbrella.

S NP the girl VP V hit NP the man PP P with NP the umbrella S NP the girl VP V hit NP the man PP P with NP the umbrella The girl hit the man with the umbrella. 8 Nodes 9 nodes Minimal attachment Preferred

Minimal attachment Garden path sentences The spy saw the cop with a telescope. minimal attach non- minimal attach Modular prediction Build this structure first Interactive prediction Build this structure first

Sentence Comprehension Garden path sentences The spy saw the cop with a revolver. minimal attach non- minimal attach Modular prediction Build this structure first Interactive prediction Build this structure first Lexical information rules this one out

MANon-MA S NP the spy VP V saw NP the cop PP P with NP the revolver S’ but the cop didn’t see him S NP the spy VP V saw NP the cop PP P with NP the revolver S’ but the cop didn’t see him The spy saw the cop with the binoculars.. The spy saw the cop with the revolver … (Rayner & Frazier, ‘83) <- takes longer to read

A serial model Late Closure Incorporate incoming material into the phrase or clause currently being processed. OR Associate incoming material with the most recent material possible. She said he tickled her yesterday Tom said that Bill had written his paper yesterday. They were cooking apples.

Parsing Preferences.. late closure She said he tickled her yesterday S np she vp v said S' np he vp v tickled np her adv yesterday S np she vp v said S' np he vp v tickled np her adv yesterday Preferred (Both have 10 nodes, so use LC not MA)

Interactive Models The evidence questioned in the trial … The person questioned in the trial … evidence typically gets questioned, but can’t do the questioning Other factors (e.g., semantic context, co- occurrence of usage & expectation) may provide cues about the likely interpretation of a sentence

Interactive Models Other factors (e.g., semantic context, co- occurrence of usage & expectation) may provide cues about the likely interpretation of a sentence The evidence questioned in the trial … The person questioned in the trial … A lawyer often asks questions (more often than answering them)

Semantic expectations Taraban & McCelland (1988) Expectation The couple admired the house with a friend but knew that it was over-priced. The couple admired the house with a garden but knew that it was over-priced. Other factors (e.g., semantic context, co- occurrence of usage & expectation) may provide cues about the likely interpretation of a sentence

The Non-MA structure may be favoured Semantic expectations Taraban & McCelland, 1988 The couple admired the house with a friend but knew that it was over- priced. The couple admired the house with a garden but knew that it was over- priced.

Intonation as a cue A: I’d like to fly to Davenport, Iowa on TWA. B: TWA doesn’t fly there... B1: They fly to Des Moines. B2: They fly to Des Moines. A1: I met Mary and Elena’s mother at the mall yesterday. A2: I met Mary and Elena’s mother at the mall yesterday.

Chunking, or “phrasing” A1: I met Mary and Elena’s mother at the mall yesterday. A2: I met Mary and Elena’s mother at the mall yesterday.

Phrasing can disambiguate I met Mary and Elena’s mother at the mall yesterday Mary & Elena’s mother mall One intonation phrase with relatively flat overall pitch range.

Phrasing can disambiguate I met Mary and Elena’s mother at the mall yesterday Mary mall Elena’s mother Separate phrases, with expanded pitch movements.

Summing up Is ambiguity resolution a problem in real life? Yes (Try to think of a sentence that isn’t partially ambiguous) Many factors might influence the process of making sense of a string of words. (e.g. syntax, semantics, context, intonation, co- occurrence of words, frequency of usage, …)