LING/C SC/PSYC 438/538 Lecture 20 Sandiway Fong 1.

Slides:



Advertisements
Similar presentations
LING 388: Language and Computers
Advertisements

Computational language: week 10 Lexical Knowledge Representation concluded Syntax-based computational language Sentence structure: syntax Context free.
Syntactic analysis using Context Free Grammars. Analysis of language Morphological analysis – Chairs, Part Of Speech (POS) tagging – The/DT man/NN left/VBD.
Natural Language Processing DCG and Syntax NLP DCG A “translation” example: special case A DCG recogniser.
CS344: Introduction to Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 20-21– Natural Language Parsing.
CS Basic Parsing with Context-Free Grammars.
LING 438/538 Computational Linguistics Sandiway Fong Lecture 9: 9/21.
LING/C SC/PSYC 438/538 Computational Linguistics Sandiway Fong Lecture 8: 9/18.
LING/C SC/PSYC 438/538 Computational Linguistics Sandiway Fong Lecture 7: 9/11.
LING 438/538 Computational Linguistics Sandiway Fong Lecture 22: 11/15.
LING 388: Language and Computers Sandiway Fong Lecture 20: 11/2.
LING 388: Language and Computers Sandiway Fong Lecture 14: 10/13.
LING/C SC/PSYC 438/538 Computational Linguistics Sandiway Fong Lecture 9: 9/25.
LING 388 Language and Computers Take-Home Final Examination 12/9/03 Sandiway FONG.
Syntax LING October 11, 2006 Joshua Tauberer.
CS 4705 Lecture 7 Parsing with Context-Free Grammars.
CS 4705 Basic Parsing with Context-Free Grammars.
LING 388: Language and Computers Sandiway Fong Lecture 17: 10/24.
LING 388 Language and Computers Lecture 12 10/9/03 Sandiway FONG.
Basic Parsing with Context- Free Grammars 1 Some slides adapted from Julia Hirschberg and Dan Jurafsky.
Context-Free Grammar CSCI-GA.2590 – Lecture 3 Ralph Grishman NYU.
1 Basic Parsing with Context Free Grammars Chapter 13 September/October 2012 Lecture 6.
LING 388: Language and Computers Sandiway Fong Lecture 8.
SI485i : NLP Set 9 Advanced PCFGs Some slides from Chris Manning.
11 CS 388: Natural Language Processing: Syntactic Parsing Raymond J. Mooney University of Texas at Austin.
LING/C SC/PSYC 438/538 Lecture 19 Sandiway Fong 1.
LING 388: Language and Computers Sandiway Fong Lecture 11.
LING 388: Language and Computers Sandiway Fong Lecture 14 10/11.
LING 388: Language and Computers Sandiway Fong Lecture 17.
1 CPE 480 Natural Language Processing Lecture 5: Parser Asst. Prof. Nuttanart Facundes, Ph.D.
11/22/1999 JHU CS /Jan Hajic 1 Introduction to Natural Language Processing ( ) Shift-Reduce Parsing in Detail Dr. Jan Hajič CS Dept., Johns.
LING 388: Language and Computers Sandiway Fong Lecture 7.
CS : Speech, Natural Language Processing and the Web/Topics in Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 12: Deeper.
LING/C SC/PSYC 438/538 Lecture 14 Sandiway Fong. Administrivia Midterm – This Wednesday – A bit like doing a homework in real time – Bring your laptop.
LING 388: Language and Computers Sandiway Fong Lecture 15 10/13.
LING 388: Language and Computers Sandiway Fong Lecture 18.
LING 388: Language and Computers Sandiway Fong Lecture 10.
LING 388: Language and Computers Sandiway Fong Lecture 19.
LING 388: Language and Computers Sandiway Fong Lecture 13.
LING/C SC/PSYC 438/538 Lecture 26 Sandiway Fong. Administrivia 538 Presentations – Send me your choices if you haven’t already Thanksgiving Holiday –
For Wednesday Read chapter 23 Homework: –Chapter 22, exercises 1,4, 7, and 14.
LING 388: Language and Computers Sandiway Fong Lecture 12.
CPE 480 Natural Language Processing Lecture 4: Syntax Adapted from Owen Rambow’s slides for CSc Fall 2006.
Rules, Movement, Ambiguity
CSA2050 Introduction to Computational Linguistics Parsing I.
CS 4705 Lecture 10 The Earley Algorithm. Review Top-Down vs. Bottom-Up Parsers –Both generate too many useless trees –Combine the two to avoid over-generation:
LING 388: Language and Computers Sandiway Fong Lecture 21.
LING 388: Language and Computers Sandiway Fong Lecture 25.
CS 4705 Lecture 7 Parsing with Context-Free Grammars.
LING 388: Language and Computers Sandiway Fong Lecture 16.
LING/C SC/PSYC 438/538 Lecture 18 Sandiway Fong. Adminstrivia Homework 7 out today – due Saturday by midnight.
LING/C SC 581: Advanced Computational Linguistics Lecture Notes Jan 13 th.
CS460/IT632 Natural Language Processing/Language Technology for the Web Lecture 13 (17/02/06) Prof. Pushpak Bhattacharyya IIT Bombay Top-Down Bottom-Up.
LING 388: Language and Computers Sandiway Fong Lecture 20.
LING/C SC/PSYC 438/538 Lecture 19 Sandiway Fong 1.
CS : Language Technology for the Web/Natural Language Processing Pushpak Bhattacharyya CSE Dept., IIT Bombay Parsing Algos.
PARSING David Kauchak CS159 – Fall Admin Assignment 3 Quiz #1  High: 36  Average: 33 (92%)  Median: 33.5 (93%)
Parallel Tools for Natural Language Processing Mark Brigham Melanie Goetz Andrew Hogue / March 16, 2004.
LING/C SC 581: Advanced Computational Linguistics Lecture Notes Feb 17 th.
Basic Parsing with Context Free Grammars Chapter 13
SYNTAX.
LING/C SC/PSYC 438/538 Lecture 23 Sandiway Fong.
CS : Speech, NLP and the Web/Topics in AI
LING/C SC/PSYC 438/538 Lecture 21 Sandiway Fong.
LING/C SC 581: Advanced Computational Linguistics
LING/C SC/PSYC 438/538 Lecture 23 Sandiway Fong.
LING/C SC/PSYC 438/538 Lecture 22 Sandiway Fong.
LING/C SC/PSYC 438/538 Lecture 24 Sandiway Fong.
LING/C SC/PSYC 438/538 Lecture 25 Sandiway Fong.
LING/C SC/PSYC 438/538 Lecture 26 Sandiway Fong.
Presentation transcript:

LING/C SC/PSYC 438/538 Lecture 20 Sandiway Fong 1

538 Presentations NameColumn1 LastFirst Romero DiazDamian MurielJorge PikeAmmon Johnson FarahnakFarideh LeePuay Leng Patricia BrownRachel SullivanTrevor XuDongfang So far I've received responses from the following people:

Last Time Course webpage: g19.pl John kicked the ball the men kicked the ball a man kicked the ball

Phrase Structure Grammars Berkeley Parser: John kicked the ball

Phrase Structure Grammars Berkeley Parser: the men kicked the ball

Phrase Structure Grammars Berkeley Parser: a man kicked the ball

g19.pl rejects

Phrase Structure Grammars Berkeley Parser: a men kicked the ball

Extra Arguments: Agreement English exhibits subject- verb agreement Examples: – John kicked the ball – The men kicked the ball – John kicks the balls – The men *kicks/kick the ball Constraint: 1.-s form of the verb is compatible with 3rd person singular only for the subject NP 2.uninflected form is not compatible with 3 rd person singular for the subject NP

Subject Verb Agreement We need feature percolation: eats *eat FormEndingComment eat uninflectednot 3 rd person singular eats-s3 rd person singular ate-edpast eaten-enpast participle eating-inggerund Person Number Person Number Ending Subject and VP come together at this rule Person Number Person Number Ending POS tags

Subject Verb Agreement Implementation: using POS tags Constraint table: –% table of Person Number Tag possible combinations –table(3,plural,vb). –table(3,plural,vbd). –table(3,singular,vbz). –table(3,singular,vbd). Person, Number from Subject NP POS tag from verb

Topics Mechanisms: 1.Extra argument for Prolog term representation of a parse 2.Extra arguments for feature value agreement 3.Dealing with left recursive rules: grammar transformation

Left recursion and Prolog Left recursive grammars: we know from an earlier lecture that left recursive rules are a no-no given Prolog’s left-to- right depth-first computation rule… Example: 1.s --> a, [!]. 2.a --> ba, [a]. 3.a --> a, [a]. 4.ba --> b, [a]. 5.b --> [b]. ?- s([b,a,!],[]). ERROR: Out of local stack s a a a a...

Preposition Phrase (PP) Attachment The preferred syntactic analysis is a left recursive parse Examples: – John saw the boy with a telescope – (structural ambiguity: automatically handled by Prolog) with possessive with instrument

Preposition Phrase (PP) Attachment The preferred syntactic analysis is a left recursive parse Can “stack” PPs: – John saw the boy with a limp with Mary with a telescope – ambiguity: with possessive, with accompaniment, with instrument

Preposition Phrase Attachment Linguistically: – PP (recursively) adjoins to NP or VP –np(np(NP,PP)) --> np(NP), pp(PP). –vp(vp(VP,PP)) --> vp(VP), pp(PP). Left recursion gives Prolog problems Derivation (top-down, left-to-right): 1.vp 2.vp pp 3.vp pp pp 4.vp pp pp pp 5.vp pp pp pp ppinfinite loop… other extra arguments not shown here …

Transformation Apply the general transformation: to NP and VP rules: 1.np(np(DT,NN)) --> dt(DT,Number), nn(NN,Number). 2.np(np(NP,PP)) --> np(NP), pp(PP). 3.vp(vp(VBD,NP)) --> vbd(VBD), np(NP). 4.vp(vp(VP,PP)) --> vp(VP), pp(PP). x(x(X,y)) --> x(X), [y]. x(x(z)) --> [z]. x(x(X,y)) --> x(X), [y]. x(x(z)) --> [z]. [z] [y] x x x(X) --> [z], w(X,x(z)). x(x(z)) --> [z]. w(W,X) --> [y], w(W,x(X,y)). w(x(X,y),X) --> [y]. x(X) --> [z], w(X,x(z)). x(x(z)) --> [z]. w(W,X) --> [y], w(W,x(X,y)). w(x(X,y),X) --> [y]. [z] [y] x x Note: w is a fresh non-terminal that takes 2 arguments x is the recursive nonterminal