1. Lecture 19 Word Meanings II Topics Description Logic III Overview of MeaningReadings: Text Chapter 189NLTK book Chapter 10 March 27, 2013 CSCE 771 Natural Language Processing

2. – 2 – CSCE 771 Spring 2013 Overview Last Time (Programming) Wordnet overviewToday Computational Semantics Feature based grammarsReadings: Text 19 NLTK Book: Chapters 9 and 10 Next Time: Computational Lexical Semantics

3. – 3 – CSCE 771 Spring 2013 HW review Dropboxes Soon to exist: NER for handbook 1.frequency distribution - Handbook Assignmentfrequency distribution - Handbook Assignment 2.Regular Expression /urllib2 - Identify prerequisites AssignmentRegular Expression /urllib2 - Identify prerequisites Assignment 3.Extend backoff tagger to include trigram AssignmentExtend backoff tagger to include trigram Assignment 4.Test1Test1

4. – 4 – CSCE 771 Spring 2013 Wordnet Most synsets are connected to other synsets via a number of semantic relations. These relations vary based on the type of word, and include: Nouns hypernyms: Y is a hypernym of X if every X is a (kind of) Y (canine is a hypernym of dog) “superordinate” “superclass” hypernyms hyponyms: Y is a hyponym of X if every Y is a (kind of) X (dog is a hyponym of canine) “IS-A” hyponyms coordinate terms: Y is a coordinate term of X if X and Y share a hypernym (wolf is a coordinate term of dog, and dog is a coordinate term of wolf) “sibling” holonym: Y is a holonym of X if X is a part of Y (building is a holonym of window) “HAS-PART” holonym meronym: Y is a meronym of X if Y is a part of X (window is a meronym of building) “IS-PART” “IS-MEMBER” meronym http://en.wikipedia.org/wiki/WordNet

5. – 5 – CSCE 771 Spring 2013 Verbs hypernym: the verb Y is a hypernym of the verb X if the activity X is a (kind of) Y (to perceive is an hypernym of to listen) troponym: the verb Y is a troponym of the verb X if the activity Y is doing X in some manner (to lisp is a troponym of to talk) entailment: the verb Y is entailed by X if by doing X you must be doing Y (to sleep is entailed by to snore) coordinate terms: those verbs sharing a common hypernym (to lisp and to yell) Adjectives related nouns similar to participle of verb Adverbs root adjectives http://en.wikipedia.org/wiki/WordNet

6. – 6 – CSCE 771 Spring 2013 http://wordnet.princeton.edu/ x

7. – 7 – CSCE 771 Spring 2013 Wordnet online Fig 19-1

8. – 8 – CSCE 771 Spring 2013 Word senses A word sense is a distinct meaning Synonym sets are relations among word senses couch/sofa, car/automobilecouch/sofa, car/automobile antonyms also long/short, big/large, rise/falllong/short, big/large, rise/fall extremes; or opposite in directionextremes; or opposite in direction

9. – 9 – CSCE 771 Spring 2013 Fig 19-2 Noun relations in wordnet

10. – 10 – CSCE 771 Spring 2013 Fig 19-3 Verb relations in wordnet

11. – 11 – CSCE 771 Spring 2013 Fig19-4-like IS-A (hyponym) Chain for lemma bass#7

12. – 12 – CSCE 771 Spring 2013 Sister terms (= coordinate terms)

13. – 13 – CSCE 771 Spring 2013 Thematic Roles 19.19 “Sasha broke the window.” exists e,x,y breaking(e) & breaker(e, Sasha) & brokenThing(e, y) & window(y) 19.20 Pat opened the door. Deep or thematic roles Panini (Indian grammarian) circa 7 th -4 th century BCPanini (Indian grammarian) circa 7 th -4 th century BC Fillmore 1968, Gruber 1965Fillmore 1968, Gruber 1965

14. – 14 – CSCE 771 Spring 2013 Fig 19.5 Common Thematic Roles

15. – 15 – CSCE 771 Spring 2013 19.6 Examples of Thematic Roles

16. – 16 – CSCE 771 Spring 2013 Variations of expression John broke the window.John broke the window. John broke the window with a rock.John broke the window with a rock. The rock broke the window.The rock broke the window. The window broke.The window broke. The window was broken by John.The window was broken by John.

17. – 17 – CSCE 771 Spring 2013 Case Frames for verbs Break Agent: Subject, Theme:ObjectAgent: Subject, Theme:Object Agent: Subject, Theme:Object, Instrument: PP-withAgent: Subject, Theme:Object, Instrument: PP-with Instrument:Subject, Theme:ObjectInstrument:Subject, Theme:Object Theme: SubjectTheme: Subject

18. – 18 – CSCE 771 Spring 2013 19.4.3 Problems with Thematic Roles Example 19.27  the cook opened the jar with the new gadget.  the new gadget opened the jar. Example 19.28  Shelly ate the banana with a fork.  *The fork ate the banana.

19. – 19 – CSCE 771 Spring 2013 Prop Bank PropBank is a corpus that is annotated with verbal propositions and their arguments—a "proposition bank". corpusannotatedcorpusannotated http://verbs.colorado.edu/~mpalmer/projects/ace.htmlhttp://verbs.colorado.edu/~mpalmer/projects/ace.html http://en.wikipedia.org/wiki/PropBank

20. – 20 – CSCE 771 Spring 2013 PropBank Online http://verbs.colorado.edu/~mpalmer/projects/ace.html

21. – 21 – CSCE 771 Spring 2013 FrameNet

22. – 22 – CSCE 771 Spring 2013 Framenet Core Roles

23. – 23 – CSCE 771 Spring 2013 FrameNet Examples... [ Cook the boys]... GRILL [ Food their catches] [ Heating_instrument on an open fire]. [ Avenger I] 'll GET EVEN [ Offender with you] [ Injury for this]! [ Punishment This attack was conducted] [ Support in] RETALIATION [ Injury for the U.S. bombing raid on Tripoli... [ Sleeper They] [ Copula were] ASLEEP [ Duration for hours]

24. – 24 – CSCE 771 Spring 2013 FrameNet Index of Lexical Units

25. – 25 – CSCE 771 Spring 2013 Selectional restrictions of roles from PropBank

26. – 26 – CSCE 771 Spring 2013 Fig 19-7 Hamburger Edible?

27. – 27 – CSCE 771 Spring 2013

28. – 28 – CSCE 771 Spring 2013

29. – 29 – CSCE 771 Spring 2013 Figure 19.8 Shank’s Conceptual Dependencies Roger Schank 1969  Professor at Yale aclweb.org/anthology-new/C/C69/C69-0201.pdf

30. – 30 – CSCE 771 Spring 2013 Conceptual Dependency Governing Categories PP – an actor or object corresponds to concrete nominal nounsPP – an actor or object corresponds to concrete nominal nouns ACT – an actionACT – an action LOC – a location of a conceptualizationLOC – a location of a conceptualization T – time of a conceptualizationT – time of a conceptualization Assisting Categories PA – attribute of a PPPA – attribute of a PP AA – attribute of an ACTAA – attribute of an ACT Graphical representation aclweb.org/anthology-new/C/C69/C69-0201.pdf

31. – 31 – CSCE 771 Spring 2013 Conceptual syntax rules Ref: ??? Elaine Rich’s Text on AI www.csc.csudh.edu/jhan/Fall2006/csc411/Notes/Chapter%207.ppt

32. – 32 – CSCE 771 Spring 2013 CD Examples 1.John ran. 2.John is tall. 3.John is a doctor. 4.A nice boy. 5.John’s dog 6.John pushed the cart 7.John took the book from Mary 8.John drank milk 9.john fertilized the field 10.the plants grew 11.Bill shot Bob www.csc.csudh.edu/jhan/Fall2006/csc411/Notes/Chapter%207.ppt

33. – 33 – CSCE 771 Spring 2013 CD for “John at the egg.”. www.csc.csudh.edu/jhan/Fall2006/csc411/Notes/Chapter%207.ppt

34. – 34 – CSCE 771 Spring 2013 CD “John prevented Mary from giving the book to Bill.”.More tenses and modes ppast ffuture t transition k continuing cconditional /negative ? Interrogative pilpresent www.csc.csudh.edu/jhan/Fall2006/csc411/Notes/Chapter%207.ppt

35. – 35 – CSCE 771 Spring 2013 Restaurant Script Roger Schank again Collection of scenes describing typical events e.g. “visit a restaurant” 1.Entering 2.Ordering 3.Eating 4.Paying/Leaving www.csc.csudh.edu/jhan/Fall2006/csc411/Notes/Chapter%207.ppt

36. – 36 – CSCE 771 Spring 2013 Modifiers