Sentence Processing III Language Use and Understanding Class 12.

Slides:



Advertisements
Similar presentations
Prosody and Verb Placement Research question: Do Explicit Prosody and Verb Placement modulate listeners PP-attachment preferences in the processing of.
Advertisements

lec02-parserCFG March 27, 2017 Syntax Analyzer
Marslen-Wilson Big Question: “What processes take place during the period that the sensory information is accumulating for the listener” during spoken.
Chapter 4 Key Concepts.
Language Use and Understanding BCS 261 LIN 241 PSY 261 CLASS 6: EFFECTS OF DISFLUENCY ON REFERENCE COMPREHENSION.
TOWARDS A MODULAR APPROACH TO ANAPHORIC PROCESSING: semantic operations precede discourse operations Arnout Koornneef.
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Intro to NLP - J. Eisner1 Human Sentence Processing.
18 and 24-month-olds use syntactic knowledge of functional categories for determining meaning and reference Yarden Kedar Marianella Casasola Barbara Lust.
1 Parsing The scanner recognizes words The parser recognizes syntactic units Parser operations: Check and verify syntax based on specified syntax rules.
The Interaction of Lexical and Syntactic Ambiguity by Maryellen C. MacDonald presented by Joshua Johanson.
Sentence Processing 1: Encapsulation 4/7/04 BCS 261.
Spoken Word Recognition 1 Language Use and Understanding.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Lecture # 11 Grammar Problems.
Top-down Parsing By Georgi Boychev, Rafal Kala, Ildus Mukhametov.
Phonological Priming in Spontaneous Speech Production Katrina Housel H uman L anguage P rocessing L ab.
Auditory Word Recognition
Understanding Pronouns Jennifer E. Arnold University of Pennsylvania.
Introduction and Jurafsky Model Resource: A Probabilistic Model of Lexical and Syntactic Access and Disambiguation, Jurafsky 1996.
Language Use and Understanding BCS 261 LIN 241 PSY 261 CLASS 12: SNEDEKER ET AL.: PROSODY.
Multiple constraints in action
Amirkabir University of Technology Computer Engineering Faculty AILAB Efficient Parsing Ahmad Abdollahzadeh Barfouroush Aban 1381 Natural Language Processing.
CPSC 322 Introduction to Artificial Intelligence November 10, 2004.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Spring 2006-Lecture 4.
Psy1302 Psychology of Language Lecture 12 Sentence Comprehension II.
1/13 Parsing III Probabilistic Parsing and Conclusions.
Day 2: Pruning continued; begin competition models
1/17 Probabilistic Parsing … and some other approaches.
1 The Parser Its job: –Check and verify syntax based on specified syntax rules –Report errors –Build IR Good news –the process can be automated.
171 Use Case Descriptions Chapter 4 – Facade Iteration Initial Requirements (Inception Phase)
PSY 369: Psycholinguistics Language Comprehension: The role of memory.
Semi-Automatic Learning of Transfer Rules for Machine Translation of Low-Density Languages Katharina Probst April 5, 2002.
Intro to Psycholinguistics What its experiments are teaching us about language processing and production.
Test Taking Tips How to help yourself with multiple choice and short answer questions for reading selections A. Caldwell.
The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye movements Yuki Kamide, Gerry T.M. Altman, and Sarah L.
“How much context do you need?” An experiment about context size in Interactive Cross-language Question Answering B. Navarro, L. Moreno-Monteagudo, E.
WORD SEMANTICS 4 DAY 29 – NOV 4, 2011 Brain & Language LING NSCI Harry Howard Tulane University.
Ferreira and Henderson (1990)
BİL 744 Derleyici Gerçekleştirimi (Compiler Design)1 Syntax Analyzer Syntax Analyzer creates the syntactic structure of the given source program. This.
1 Statistical Parsing Chapter 14 October 2012 Lecture #9.
The Independence of Syntactic Processing Advanced Psycholinguistics Presenter: Dong-Bo Hsu 02/09/06.
What advice would you give to students taking this class next year?
Origins of Modularity. Preliminary Binding Study Results –13 participants tested using Linger –Data can be analyzed using Lingalyzer Lite –Region encoding.
PS: Introduction to Psycholinguistics Winter Term 2005/06 Instructor: Daniel Wiechmann Office hours: Mon 2-3 pm Phone:
Avoiding the Garden Path: Eye Movements in Context
Parsing Introduction Syntactic Analysis I. Parsing Introduction 2 The Role of the Parser The Syntactic Analyzer, or Parser, is the heart of the front.
PSY270 Michaela Porubanova. Language  a system of communication using sounds or symbols that enables us to express our feelings, thoughts, ideas, and.
Results of Eyetracking & Self-Paced Moving Window Studies DO-Bias Verbs: The referees warned the spectators would probably get too rowdy. The referees.
Mastering study skills Revision and Exams. Revision Basic principles:  Revision should be a regular process throughout the course not just in the last.
Dec 11, Human Parsing Do people use probabilities for parsing?! Sentence processing Study of Human Parsing.
Semantic indeterminacy in object relative clauses Maryellen C. MacDonald Silvia P. Gennari.
Syntax Analyzer (Parser)
LEXICAL INTERFACE 5 NOV 2, 2015 – DAY 28 Brain & Language LING NSCI Fall 2015.
48 Item Sets (Only the results for the relative clause versions are reported here.) The professor (who was) confronted by the student was not ready for.
Syntactic Priming in Sentence Comprehension (Tooley, Traxler & Swaab, 2009) Zhenghan Qi.
Lecture # 10 Grammar Problems. Problems with grammar Ambiguity Left Recursion Left Factoring Removal of Useless Symbols These can create problems for.
Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.
48 Item Sets (Only the results for the relative clause versions are reported here.) The professor (who was) confronted by the student was not ready for.
Natural Language Processing Vasile Rus
lec02-parserCFG May 8, 2018 Syntax Analyzer
Multiplication Strategies
Lecture – VIII Monojit Choudhury RS, CSE, IIT Kharagpur
Introduction to Parsing (adapted from CS 164 at Berkeley)
Basic Parsing with Context Free Grammars Chapter 13
CSCI 5832 Natural Language Processing
Lecture 7: Introduction to Parsing (Syntax Analysis)
lec02-parserCFG May 27, 2019 Syntax Analyzer
Use the ten frames to help solve the problems
CS249: Neural Language Model
Presentation transcript:

Sentence Processing III Language Use and Understanding Class 12

Announcements Coming up: Coming up: Wed: Development of Procesing Abilities Wed: Development of Procesing Abilities Next Mon: Rules vs. Probabilistic approaches Next Mon: Rules vs. Probabilistic approaches Next Wed: Midterm Next Wed: Midterm Midterm will be all short answer/ essay Midterm will be all short answer/ essay You’ll get a superset of questions to study from on Wednesday You’ll get a superset of questions to study from on Wednesday

Previous models of parsing Garden Path model Garden Path model Encapsulated syntactic parser Encapsulated syntactic parser Choose the simplest syntactic structure when input is ambiguous Choose the simplest syntactic structure when input is ambiguous Make decisions based ONLY on category information from words, no plausibility information Make decisions based ONLY on category information from words, no plausibility information Referential Hypothesis Referential Hypothesis Try to pick a unique referent in context when available Try to pick a unique referent in context when available Otherwise pick simplest structure Otherwise pick simplest structure

Constraint-based models (MacDonald et al., 1994; Tanenhaus and Trueswell, 1994) Information from multiple sources impacts parsing decisions Information from multiple sources impacts parsing decisions Referential information Referential information Lexical information Lexical information What subcategorization frames are more frequent? What subcategorization frames are more frequent? Plausiblity information Plausiblity information Choices in syntactic frames involve choices in thematic (subcategorization) frames. Which frame allows a plausible thematic role for a given referent? Choices in syntactic frames involve choices in thematic (subcategorization) frames. Which frame allows a plausible thematic role for a given referent?

All models Sentence processing is incremental Sentence processing is incremental Garden-path model: you pick one structure early on, later have to revise if it isn’t the right one Garden-path model: you pick one structure early on, later have to revise if it isn’t the right one Referential model: use pre-existing context if available Referential model: use pre-existing context if available Constraint-based model: use constraints that are availble at the time of a parsing decision Constraint-based model: use constraints that are availble at the time of a parsing decision In no case is it proposed that the parser waits to solve indeterminacies In no case is it proposed that the parser waits to solve indeterminacies

Tanenhaus et al Referential Context Put the apple on the towel in the box. Put the apple on the towel in the box goal referent garden-path goal

Put the apple on the towel in the box. Sensitivity and time course in sentence processing:

Put the apple (that’s) on the towel in the box. Multiple referents eliminate the goal garden-path

Put the apple (that’s) on the towel in the box. 1.0 One-Referent Context Ambiguous Unambiguous Proportion of Trials with Eye Movements to Incorrect Goal Instruction Multiple referents eliminate the goal garden-path

Put the apple (that’s) on the towel in the box. One-Referent Context Ambiguous Unambiguous Proportion of Trials with Eye Movements to Incorrect Goal Instruction Two-Referent Context No garden-path with two potential referents

The influence of non- syntactic information Plausibility Plausibility The historian read the manuscript The historian read the manuscript …during the trip. …during the trip. …had been destroyed in the fire. …had been destroyed in the fire. How likely is it for a manuscript to be the object of read? How likely is it for a manuscript to be the object of read? How likely is it for a manuscript to be the subject of another clause? How likely is it for a manuscript to be the subject of another clause?

The influence of non- syntactic information Verb subcategorization Verb subcategorization Read: He read the book. He read Read: He read the book. He read He read that it had rained. He read that it had rained. Which is more frequent? Which is more frequent?

Garnsey et al. Verb bias: DO-biased verbs (direct object): read SC-biased verbs (sentential complement): accepted EQ-biased verbs (both): regretted The senior senator regretted (that) the decision had ever been made public. The senior senator regretted (that) the reporter had ever seen the report.

Models What does a two-stage model predict? What does a two-stage model predict? What does lexical filtering predict? What does lexical filtering predict? What does the constraint-based model predict? What does the constraint-based model predict?

Discussion The authors repeatedly discuss how verb bias may be the generally more effective constraint (as opposed to plausibility), as it is more readily accessible, and/or based on more experience, and/or more constraining. If this is so, would this affect the set up of the model? Obviously the model would still be interactive and constraint-based, but if it could be conclusively shown that verb bias is always the more important constraint, would it alter the model (i.e. having plausibility play a less central role, or not until slightly later on in the process)?