CS 4705 Lecture Lexical Semantics. What is lexical semantics? Meaning of Words Lexical Relations WordNet Thematic Roles Selectional Restrictions Conceptual.

Slides:



Advertisements
Similar presentations
Natural Language Processing Lecture 2: Semantics.
Advertisements

Semantics (Representing Meaning)
CMSC 723: Intro to Computational Linguistics November 24, 2004 Lecture 12: Lexical Semantics Bonnie Dorr Christof Monz.
Syntax-Semantics Mapping Rajat Kumar Mohanty CFILT.
So What Does it All Mean? Geospatial Semantics and Ontologies Dr Kristin Stock.
Building a Large- Scale Knowledge Base for Machine Translation Kevin Knight and Steve K. Luk Presenter: Cristina Nicolae.
Linguistic Theory Lecture 8 Meaning and Grammar. A brief history In classical and traditional grammar not much distinction was made between grammar and.
Chapter 17. Lexical Semantics From: Chapter 17 of An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, by.
1 Words and the Lexicon September 10th 2009 Lecture #3.
 Christel Kemke 2007/08 COMP 4060 Natural Language Processing Semantics.
NLP and Speech 2004 Feature Structures Feature Structures and Unification.
CS 4705 Relations Between Words. Today Word Clustering Words and Meaning Lexical Relations WordNet Clustering for word sense discovery.
1/27 Semantics Going beyond syntax. 2/27 Semantics Relationship between surface form and meaning What is meaning? Lexical semantics Syntax and semantics.
CS 330 Programming Languages 09 / 13 / 2007 Instructor: Michael Eckmann.
CS 4705 Semantics: Representations and Analyses. What kinds of meaning do we want to capture? Categories/entities –IBM, Jane, a black cat, Pres. Bush.
CS 4705 Semantic Roles and Disambiguation. Today Semantic Networks: Wordnet Thematic Roles Selectional Restrictions Selectional Association Conceptual.
Final Review CS4705 Natural Language Processing. Semantics Meaning Representations –Predicate/argument structure and FOPC Thematic roles and selectional.
November 20, 2003 Chapter 16 Lexical Semantics. Words have structured meanings Lexeme – a pairing of a form with a sense Orthographic form – the way the.
Semantics Ling 571 Fei Xia Week 6: 11/1-11/3/05. Outline Meaning representation: what formal structures should be used to represent the meaning of a sentence?
PSY 369: Psycholinguistics Some basic linguistic theory part3.
Lecture Lexical Semantics CS 4705.
CS 4705 Lexical Semantics. Today Words and Meaning Lexical Relations WordNet Thematic Roles Selectional Restrictions Conceptual Dependency.
February 2009Introduction to Semantics1 Logic, Representation and Inference Introduction to Semantics What is semantics for? Role of FOL Montague Approach.
Albert Gatt LIN 3098 Corpus Linguistics. In this lecture Some more on corpora and grammar Construction Grammar as a theoretical framework Collostructional.
Comments to Karin Kipper Christiane Fellbaum Princeton University and Berlin-Brandenburgische Akademie der Wissenschaften.
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
PropBank, VerbNet & SemLink Edward Loper. PropBank 1M words of WSJ annotated with predicate- argument structures for verbs. –The location & type of each.
Interpreting Dictionary Definitions Dan Tecuci May 2002.
Semantics.
Semantics: Semantic Grammar & Information Extraction CMSC Natural Language Processing May 13, 2003.
Semantics and Pragmatics. Semantics Definition: The study of meaning in language. Pragmatics The study of how context contributes to meaning in language.
November 2003CSA4050: Semantics I1 CSA4050: Advanced Topics in NLP Semantics I What is semantics for? Role of FOL Montague Approach.
WORD SENSE DISAMBIGUATION STUDY ON WORD NET ONTOLOGY Akilan Velmurugan Computer Networks – CS 790G.
Chapter 15 Natural Language Processing (cont)
Lexical Semantics Chapter 16
11 Chapter 19 Lexical Semantics. 2 Lexical Ambiguity Most words in natural languages have multiple possible meanings. –“pen” (noun) The dog is in the.
Albert Gatt LIN3021 Formal Semantics Lecture 4. In this lecture Compositionality in Natural Langauge revisited: The role of types The typed lambda calculus.
Wordnet - A lexical database for the English Language.
Rules, Movement, Ambiguity
WordNet Enhancements: Toward Version 2.0 WordNet Connectivity Derivational Connections Disambiguated Definitions Topical Connections.
Ontology Engineering: from Cognitive Science to the Semantic Web Maria Teresa Pazienza University of Roma Tor Vergata, Italy 1.
Word Relations Slides adapted from Dan Jurafsky, Jim Martin and Chris Manning.
The meaning of Language Chapter 5 Semantics and Pragmatics Week10 Nov.19 th -23 rd.
Word Meaning and Similarity
Knowledge Representation
Lecture 19 Word Meanings II Topics Description Logic III Overview of MeaningReadings: Text Chapter 189NLTK book Chapter 10 March 27, 2013 CSCE 771 Natural.
Knowledge Structure Vijay Meena ( ) Gaurav Meena ( )
Word Meaning and Similarity Word Senses and Word Relations.
NATURAL LANGUAGE PROCESSING
SEMANTICS Chapter 10 Ms. Abrar Mujaddidi. What is semantics?  Semantics is the study of the conventional meaning conveyed by the use of words, phrases.
MENTAL GRAMMAR Language and mind. First half of 20 th cent. – What the main goal of linguistics should be? Behaviorism – Bloomfield: goal of linguistics.
Chapter 3 Word Meaning.
Lec. 10.  In this section we explain which constituents of a sentence are minimally required, and why. We first provide an informal discussion and then.
Semantics (Representing Meaning)
Ontology Engineering: from Cognitive Science to the Semantic Web
LEXICAL RELATIONS IN DISCOURSE
Word Relations Slides adapted from Dan Jurafsky, Jim Martin and Chris Manning.
Lecture 19 Word Meanings II
What is Linguistics? The scientific study of human language
CSCI 5832 Natural Language Processing
CSC 594 Topics in AI – Applied Natural Language Processing
Unit-4 Lexical Semantics M.B.Chandak, HoD CSE,
An Introduction to Linguistics
Dr. Bill Vicars Lifeprint.com
Word Relations Slides adapted from Dan Jurafsky, Jim Martin and Chris Manning.
Lecture 19 Word Meanings II
CS4705 Natural Language Processing
Semantics Going beyond syntax.
Structure of a Lexicon Debasri Chakrabarti 13-May-19.
Relations Between Words
Presentation transcript:

CS 4705 Lecture Lexical Semantics

What is lexical semantics? Meaning of Words Lexical Relations WordNet Thematic Roles Selectional Restrictions Conceptual Dependency

What is a word? Lexeme: an entry in the lexicon that includes –an orthographic representation –a phonological form –a symbolic meaning representation or sense Dictionary entries: –Red (‘red) n: the color of blood or a ruby –Blood (‘bluhd) n: the red liquid that circulates in the heart, arteries and veins of animals Word Sense Disambiguation For any given lexeme, how can its sense be reliably distinguished? Lex. Rel. III: Metaphor, Metonymy What is metaphor? That doesn't scare Digital. What is metonymy? GM killed the Fiero. Extension of existing sense to a new meaning. Lexical Relations IV: Synonomy What is synonomy? Substitutability. How big is that plane? How large is that plane? Compare: A big fat apple ?A large fat apple A big sister ?A large sister Influences on substitutability: subtle shades of meaning differences polysemy register collocational constraints Lexical Relations V: Hyponomy What is hyponomy? General: hyponym Specific: hypernym Example: ``car'' is a hyponym of ``vehicle'' and ``vehicle'' is a hypernym of ``car.'' Test: ``That is a car'' implies ``That is a vehicle'' What is ontology? What is taxonomy? What is object hierarchy? %%%%%%%%%%%% %%%%%% Semantic Networks Used to represent relationships between words Example: WordNet - created by George Miller's team at Princeton %%%%%%%%%%%% %%%%%% WordNet (1.6) WordNet is the most widely used hierarchically organized lexical database for English -- Fellbaum (1998). \vspace{.1in \epsfxsize=1\textwidth \fig{\file{figures{fig16.01.ps %%%%%%%%%%%% %%%%%% Format of WordNet Entries WordNet sense entries consist of a set of synonyms, a dictionary-style definition (or gloss), and some examples of uses. \vspace{.1in \epsfxsize=1\textwidth \fig{\file{figures{fig16.02.ps %%%%%%%%%%%% %%%%%% Sense Distribution for WordNet Verbs \vspace{.1in \epsfxsize=1\textwidth \fig{\file{figures{fig16.03.ps %%%%%%%%%%%% %%%%%% Lexical (N) Relations in WordNet \vspace{.1in \epsfxsize=1\textwidth \fig{\file{figures{fig16.04.ps %%%%%%%%%%%% %%%%%% Verb Relations in WordNet \vspace{.1in \epsfxsize=1\textwidth \fig{\file{figures{fig16.05.ps %%%%%%%%%%%% %%%%%% Adj. and Adv. Relations in WordNet \vspace{.1in \epsfxsize=1\textwidth \fig{\file{figures{fig16.06.ps %%%%%%%%%%%% %%%%%% Synsets in WordNet WordNet is organized around the notion of synset. { chump, fish, fool, gull, mark, patsy, fall guy, sucker, schlemiel, shlemiel, soft touch, mug } Important: It is this exact synset that makes up one of the sense for each of the entries listed in the synset. Theoretically, each synset can be viewed as a concept in a taxonomy -- like the concepts described in Chapter 14. Hyponomy in WordNet fig16.07.ps Internal Structure of Words What are the meaning components underlying word sense? Thematic Roles (theta-roles) What is a thematic role? E w,x,y,z Giving (x) ^ Giver(w,x) ^ Givee(z, x) ^ Given(y,x) $ E w,x,z Breaking (x) ^ Breaker(w,x) ^ Broken(z,x) Generic Thematic Roles fig16.08.ps Examples of Thematic Roles fig16.09.ps Early Theories of Thematic Roles : "The beginning of Lexical Semantics" (Fillmore; Gruber; Jackendoff (based on Gruber)) Two fundamentally different approaches to linguistics Gruber/Jackendoff: account for semantics and use grammar derived to say something about syntax Fillmore: account for syntax and use that to describe semantics Thematic Level Why posit a thematic level distinct from that of syntactic subcategorization? capture similarity between different (but related) uses of same lexical item) obviate need for subcategorization frames: mapping from syntax to lexical semantics Selectional Restrictions What are selectional restrictions? Recall the "Godzilla" example. Selectional Restriction Implementation A WordNet approach: hamburgers are edible fig16.10.ps Primitive Decomposition Jim killed his philodendron Jim did something to cause his philodendron to become not alive Schank's Primitives Conceptual Dependency fig16.11.ps Pred. Independence vs. Dependence Predicate-Independent single set of roles is chosen independent of the type of predicates involved (no reference to type of predicates) Schank Predicate-Dependent roles identified by particular positions arguments occupy with respect to primitive predicates Decomposition vs. Non-Decomposition Decomposition / Compositional Approach (Schank, Jackendoff) vs. Non-decomposition / Noncomposition Approach (Fillmore) Within compositional approaches: exhaustive (Schank) vs. nonexhaustive (Jackendoff) Schank: Motivation Underlying Motivation: "Strong AI" Focus: understanding. Argues that the representation is reversible. Rejects syntax during analysis. Allows it during generation. Attempts to come up with well-defined system of rules and conceptualizations. Inferences, expectation, syntax, conversational norms, real world. Conceptual Structure (CD): Language- independent conceptual level. Schank: Kill vs. Die Schank: Problem 1 "John caused Mary to die" vs. "John killed Mary" Identically substitutable? Flaw of all compositional approaches of this nature. Schank: Problem 2 The decompositions are very complex. Too specific Why are these conceptualizations so radically distinct from the syntactic realization? Talks CD from NL understanding point of view - what about generation? The NLP Bottleneck Acquisition of Computational Lexicons For Next Time Chapter 18

–Right (‘rIt) adj: located nearer the right hand esp. being on the right when facing the same direction as the observer –Left (‘left) adj: located nearer to this side of the body than the right Do dictionaries give us definitions? –Some are circular –All are defined in terms of other lexemes –You have to know something to learn something What can we learn from dictionaries? –Relations between words: Oppositions, similarities, hierarchies

Homonomy Homonyms: Words with same form – orth and pron -- but different, unrelated meanings, or senses (multiple lexemes) –A bank holds investments in a custodial account in the client’s name. –As agriculture is burgeoning on the east bank, the river will shrink even more Word sense disambiguation: what clues? Similar phenomena –homophones - read and red (same pron/different orth) –homographs - bass and bass (same orth/different pron)

Ambiguity: Which applications will these cause problems for? A bass, the bank, read/red General semantic interpretation Machine translation Spelling correction Speech recognition Text to speech Information retrieval

What is polysemy? Word with multiple but related meanings (same lexeme) –They rarely serve red meat. –He served as U.S. ambassador. –He might have served his time in prison. What’s the difference between polysemy and homonymy? Homonymy: –Distinct, unrelated meanings –Different etymology? Coincidental similarity?

Polysemy: –Distinct but related meanings –idea bank, sperm bank, blood bank, bank bank –How different? Different subcategorization frames? Domain specificity? Can the two candidate senses be conjoined? ?He served his time and as ambassador to Norway. For either, practical task: –What are its senses? (related or not) –How are they related? (polysemy ‘easier’ here) –How can we distinguish them?

Metaphor, Metonymy Metaphor? –Father of the atom bomb. Metonymy? –GM killed the Fiero. –The ham sandwich wants his check. Both extend existing sense to new meaning –Metaphor: completely different concept –Metonymy: related concepts

Synonomy Substitutability: different lexemes, same meaning –How big is that plane? –How large is that plane? –How big are you? Big brother is watching. What influences substitutability? –Polysemy (large vs. old sense) –register: He’s really cheap/?parsimonious. –collocational constraint: roast beef, ?baked beef –convention: economy fare/?price

Hyponomy General: hypernym (super…ordinate) –dog is a hypernym of poodle Specific: hyponym (under..neath) –poodle is a hyponym of dog Test: That is a poodle implies that is a dog What is ontology? Object in some domain What is taxonomy? Structuring of those objects What is object hierarchy? Structured hierarchy that supports feature inheritance

Semantic Networks Used to represent lexical relationships –e.g. WordNet (George Miller et al) – –Most widely used hierarchically organized lexical database for English –Synset: set of synonyms, a dictionary-style definition (or gloss), and some examples of uses --> a concept –Databases for nouns, verbs, and modifiers Applications can traverse network to find synonyms, antonyms, hierarchies,...

–Is a rock edible? –What are the parts of a human body? –What is a cheeseburger? –What are its parts? –What is the opposite of ambitious? Why do we care?

Thematic Roles E w,x,y,z {Giving(x) ^ Giver(w,x) ^ Givee(z, x) ^ Given(y,x)} A set of roles for each event: –Agent: volitional causer -- John hit Bill. –Experiencer: experiencer of event – Bill got a headache. –Force: non-volitional causer – The concrete block struck Bill on the head. –Theme/patient: most affected participant – John hit Bill. –Result: end product – Bill got a headache. –Content: proposition of propositional event – Bill thought he should take up martial arts.

–Instrument: instrument used -- John hit Bill with a bat. –Beneficiary: qui bono – John hit Bill to avenge his friend. –Source: origin of object of transfer event – Bill fled from New York to Timbuktu. –Goal: destination of object -- Bill led from New York to Timbuktu.

Thematic Roles and Selectional Restrictions Selectional restrictions: semantic constraint that a word (lexeme) imposes on the concepts that go with it George hit Bill with ….John/a gun/gusto. Jim killed his philodendron/a fly/Bill. ?His philodenron killed Jim. The flu/Misery killed Jim.

Thematic Roles/Selectional Restrictions In practical use: –Given e.g. a verb –What conceptual roles are likely to accompany it? –What lexemes are likely to fill those roles? Assassinate Give Imagine Fall Serve

Schank's Conceptual Dependency Eleven predicate primitives represent all predicates Objects decomposed into primitive categories and modifiers But few predicates result in very complex representations of simple things Ex,y Atrans(x) ^ Actor(x,John) ^ Object(x,Book) ^ To(x,Mary) ^ Ptrans(y) ^ Actor(y,John) ^ Object(y,Book) ^ To(y,Mary) John caused Mary to die vs. John killed Mary

Next time Word sense disambiguation –How do we decide what I went to the bank means? Chapter