Overview of comprehension parsing Semantic representation interpretation lexicon Local context Vast database.

Slides:



Advertisements
Similar presentations
The Structure of Sentences Asian 401
Advertisements

Syntactic Complexity and Cohesion
Semantics (Representing Meaning)
The Meaning of Language
SEMANTICS.
Chapter 4 Syntax.
The Cooperative Principle
1 Comprehension: Written and Spoken Language. 2 Conceptual and Rule Knowledge The first three levels of language analysis: the phonological, syntactic,
Sentence Memory: A Constructive Versus Interpretive Approach Bransford, J.D., Barclay, J.R., & Franks, J.J.
Term 1 Week 9 Syntax.
Language is very difficult to put into words. -- Voltaire What do we mean by “language”? A system used to convey meaning made up of arbitrary elements.
Language, Mind, and Brain by Ewa Dabrowska Chapter 2: Language processing: speed and flexibility.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Fall 2005-Lecture 2.
PSY 369: Psycholinguistics Some basic linguistic theory part3.
Talking heads!4/10 Easy and hard problems Artificial intelligence Turing test Loebner prize The real thing: human language comprehension.
Syntax and Grammar John Goldsmith Cognitive Neuroscience May 1999.
The syntax of language How do we form sentences? Processing syntax. Language and the brain.
Iraj Nemati Discourse analysis:. the study of language be yond The sentence, in text and conversation. When we ask how we make sense of what we read,
9/8/20151 Natural Language Processing Lecture Notes 1.
ASPECTS OF LINGUISTIC COMPETENCE 4 SEPT 09, 2013 – DAY 6 Brain & Language LING NSCI Harry Howard Tulane University.
Chapter 6. Semantics is the study of the meaning of words, phrases and sentences. In semantic analysis, there is always an attempt to focus on what the.
The Problem page, Coherence, ideology How an ideological message is conveyed through language, and particularly through the following aspects of textual.
1 LIN 1310B Introduction to Linguistics Prof: Nikolay Slavkov TA: Qinghua Tang CLASS 24, April 3, 2007.
Notes on Pinker ch.7 Grammar, parsing, meaning. What is a grammar? A grammar is a code or function that is a database specifying what kind of sounds correspond.
Meaning. Deictics  Are words, phrases and features of grammar that have to be interpreted in relation to the situation in which they are uttered such.
Albert Gatt LIN3021 Formal Semantics Lecture 4. In this lecture Compositionality in Natural Langauge revisited: The role of types The typed lambda calculus.
LECTURE 2: SEMANTICS IN LINGUISTICS
Grammars Grammars can get quite complex, but are essential. Syntax: the form of the text that is valid Semantics: the meaning of the form – Sometimes semantics.
PSY270 Michaela Porubanova. Language  a system of communication using sounds or symbols that enables us to express our feelings, thoughts, ideas, and.
Rules, Movement, Ambiguity
ACE TESOL Diploma Program – London Language Institute OBJECTIVES You will understand: 1. The terminology and concepts of semantics, pragmatics and discourse.
Linguistic Development Thomas G. Bowers, Ph.D
Presentation about pragmatic concepts Implicatures Presuppositions
Topic and the Representation of Discourse Content
Pragmatics Nuha Alwadaani.
CPSC 422, Lecture 27Slide 1 Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 27 Nov, 16, 2015.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Spring 2006-Lecture 2.
SYNTAX.
3 Phonology: Speech Sounds as a System No language has all the speech sounds possible in human languages; each language contains a selection of the possible.
◦ Process of describing the structure of phrases and sentences Chapter 8 - Phrases and sentences: grammar1.
Yule: “Words themselves do not refer to anything, people refer” Reference and inference Pragmatics: Reference and inference.
SYNTAX 1 NOV 9, 2015 – DAY 31 Brain & Language LING NSCI Fall 2015.
Lecture 1 Ling 442.
Lecture 10 Semantics Sentence Interpretation. The positioning of words and phrases in syntactic structure helps determine the meaning of the entire sentence.
NATURAL LANGUAGE PROCESSING
MORPHOLOGY. PART 1: INTRODUCTION Parts of speech 1. What is a part of speech?part of speech 1. Traditional grammar classifies words based on eight parts.
Deborah Tannen Summary. Basic Issue Men live in a world of hierarchy, Women live in a world of connection.
Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.
18-740: Computer Architecture Last Recitation Prof. Onur Mutlu Carnegie Mellon University Fall 2015 December 1, 2015.
Differences between Spoken and Written Discourse Source: Paltridge, p.p
King Faisal University جامعة الملك فيصل Deanship of E-Learning and Distance Education عمادة التعلم الإلكتروني والتعليم عن بعد [ ] 1 King Faisal University.
Statistical NLP: Lecture 3
SYNTAX.
Language, Logic, and Meaning
Chapter Eight Syntax.
Part I: Basics and Constituency
Chapter ten Pragmatics
Schema Theory 3.1.
What is Linguistics? The scientific study of human language
BBI 3212 ENGLISH SYNTAX AND MORPHOLOGY
Chapter Eight Syntax.
The Cooperative Principle
Pragmatics.
Linguistic Essentials
The Cooperative Principle
Pragmatics: Reference and inference
BACKGROUND KNOWLEDGE1.
Mariana Berenguer AP Language and Composition
Presentation transcript:

Overview of comprehension parsing Semantic representation interpretation lexicon Local context Vast database

The waveform of the utterance Continuous movements convey discrete thoughts.

Lexicon function morphemes Content words (nouns, verbs, adjectives…) Word formation rules (adj -->(prefix)+V+ -able) e.g. unfixable Other info on morphemes: phonology, syntax, meaning and use

Parsing -- computing a structural description (labelled tree) using: Acoustic cues in time-pressure wave Function words and inflections Lexical guidance Word and phrase order cues Determines grammatical relations and input to semantics (recall the aphasic woman given “The bird that the cat watched was hungry.”

Lexical guidance, inflections and parsing -1 In languages with I. E. inflections, subject and object NPs would be indicated directly and thus the syntactic role of an NP is clear. In English only the pronouns retain these inflections. Compare the following she/her/her and he/his/him. In the following examples, we see that the English loss of inflections and optional that puts an extra load on a word-order dependent parser. Notice that if that -- especially unstressed -- follows directly after the verb, it predicts a complement clause.

Lexical guidance, inflections and parsing -2 Some verbs take only simple NP objects (a) 11a- The doctor visited the child/her/*she. others take complement clause NPs (b) 11b- The doctor insisted the child/*her/she/take the pill.

Lexical guidance, inflections and parsing -3 Some take either (c). 11c- 1. The doctor remembered the child/her.) 11c- 2. The doctor remembered the child/she/ had an allergy.

The semantic representation of the utterance Much of the conventional meaning of an utterance derives from its hierarchical structure and morpheme meanings or “senses.” This is the assumption of combinatorial or compositional semantics.

The listener's interpretation of the utterance is based on: A Semantic representation of the sentence Local context –This includes determining referents of referring expressions, antecedents to anaphors and definite descriptions, nonverbal cues, etc. The "vast database” –Anything else!

Reference and local context Reference and co-reference –Significant aspects of meaning come from the context of the utterance. These include deictic words (e.g. now, this, here) and other pronouns, as well immediately preceding conversation in “ working memory. ” Gaps and traces (Pinker, p.219;482) –The policeman saw the boy that the crowd at the party accused (TRACE) of the crime.

Complex sentences - ambiguity Example 1 can be interpreted as a relative (2) or complement clause (3) –1. “ The fact that Otto knew was surprising. ” –2. “ The fact that Otto knew () was surprising. ” (Otto knew some fact that was surprising. Note the gap in 2 but not in 3 below.) –3. ” (The fact) that Otto knew was surprising. ” (A complement clause names explicitly the surprising fact, namely “ that Otto knew (something) was surprising. ”

Complex sentences - ambiguity Multiple gaps allow multiple interpretations – “ The girl that Bill wanted () to leave () wore a blue dress. ” –Is “ that ” coreferent with the first or second gap - - the subject or object of leave? –Compare “ The girl that Bill wanted () to leave Sam wore a blue dress. ”

Acquisition video examples –When did the boy say () that he hurt () himself? –What do you think Cookie Monster eats ()? –You think Cookie Monster eats (what)? –*What do you think what's in here?

Complex sentences - “idea density” Packaging several propositions (sentences) into one sentence increases complexity of processing. The most extreme case is: –The player kicked the ball kicked him. –The player (that was) thrown the ball kicked him. –The player kicked the ball (that was) thrown him.

Many aphasics cope by using several simple reduced complexity sentences. Kemper et al (1997) report low idea density predicts Alzheimers disease decades before other symptoms!. Complex sentences “idea density” 2

“Vast database” contributions to meaning Inference -- going beyond the given propositions -- is part of comprehension. Pinker: She: “I’m leaving.” He: “Who is he?” “In 1950, I was the tallest kid in sixth grade.”

“Vast database” 2 Some inferences are “presuppositions” -- implicit statements assumed true by speaker and inferred by listener. “Bill knows that the world is flat.” “When did you stop drinking?” “Her gift is too tall for her bedroom.”

“vast database” 3 “sportugese” - Sportsfans predict scores from verbs better than non- fans? No kidding! “Lakers crush Celtics” “Celtics hold off Timberwolves” What is the margin of victory?

Read and summarize: "The procedure is actually quite simple. First you arrange things into different groups depending on their makeup. Of course one pile may be sufficient depending on how much there is to do. If you have to go somewhere else due to lack of facilities that is the next step, otherwise you are pretty well set. It is important not to overdo any particular endeavor. That is, it may not seem important, but complications from doing too many can easily arise. A mistake can be expensive as well....." “vast database” 3.5

“vast database” 4 For most of us, this is a parsable text, using known words, but with little overall meaning unless we were given a title "Washing Clothes." Then it becomes meaningful and much more memorable as Bransford and Johnson, (1972) demonstrated. Bransford, J. D., & Johnson, M. K. (1972). Contextual prerequisites for understanding: Some investigations of comprehension and recall. Journal of Verbal Learning and Verbal Behavior, 61,

“vast database” 5 The listener’s perception of the purpose of the utterance influences one’s interpretation of it. "I now see that my husband was simply engaging the world in a way that many men do: as an individual in a hierarchical social order in which he was either one-up or one-down… conversations are negotiations. Life is a contest, a struggle to preserve independence and avoid failure.. I, on the other hand, was approaching the world as many women do: as an individual in a network of connections.. conversations are negotiations for closeness… they try to protect themselves from others' attempts to push them away.." p notes. (Deborah Tannen, 1990)