Lecture – VIII Monojit Choudhury RS, CSE, IIT Kharagpur

Slides:



Advertisements
Similar presentations
 Christel Kemke 2007/08 COMP 4060 Natural Language Processing Feature Structures and Unification.
Advertisements

CS460/IT632 Natural Language Processing/Language Technology for the Web Lecture 2 (06/01/06) Prof. Pushpak Bhattacharyya IIT Bombay Part of Speech (PoS)
Lexical Functional Grammar : Grammar Formalisms Spring Term 2004.
Lexical Functional Grammar History: –Joan Bresnan (linguist, MIT and Stanford) –Ron Kaplan (computational psycholinguist, Xerox PARC) –Around 1978.
BİL711 Natural Language Processing1 Problems with CFGs We know that CFGs cannot handle certain things which are available in natural languages. In particular,
1 Natural Language Processing Lecture 7 Unification Grammars Reading: James Allen NLU (Chapter 4)
Syntactic analysis using Context Free Grammars. Analysis of language Morphological analysis – Chairs, Part Of Speech (POS) tagging – The/DT man/NN left/VBD.
Grammatical Relations and Lexical Functional Grammar Grammar Formalisms Spring Term 2004.
Statistical NLP: Lecture 3
LING NLP 1 Introduction to Computational Linguistics Martha Palmer April 19, 2006.
NLP and Speech Course Review. Morphological Analyzer Lexicon Part-of-Speech (POS) Tagging Grammar Rules Parser thethe – determiner Det NP → Det.
Features & Unification Ling 571 Deep Processing Techniques for NLP January 26, 2011.
Features & Unification Ling 571 Deep Processing Techniques for NLP January 31, 2011.
Matakuliah: G0922/Introduction to Linguistics Tahun: 2008 Session 11 Syntax 2.
Features and Unification
1 CONTEXT-FREE GRAMMARS. NLE 2 Syntactic analysis (Parsing) S NPVP ATNNSVBD NP AT NNthechildrenate thecake.
CS 4705 Lecture 11 Feature Structures and Unification Parsing.
1 Basic Parsing with Context Free Grammars Chapter 13 September/October 2012 Lecture 6.
1 A Chart Parser for Analyzing Modern Standard Arabic Sentence Eman Othman Computer Science Dept., Institute of Statistical Studies and Research (ISSR),
11 CS 388: Natural Language Processing: Syntactic Parsing Raymond J. Mooney University of Texas at Austin.
1 Semantics Interpretation Allen ’ s Chapter 9 J&M ’ s Chapter 15.
1 Features and Unification Chapter 15 October 2012 Lecture #10.
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Chapter 16: Features and Unification Heshaam Faili University of Tehran.
IV. SYNTAX. 1.1 What is syntax? Syntax is the study of how sentences are structured, or in other words, it tries to state what words can be combined with.
THE BIG PICTURE Basic Assumptions Linguistics is the empirical science that studies language (or linguistic behavior) Linguistics proposes theories (models)
11 Chapter 14 Part 1 Statistical Parsing Based on slides by Ray Mooney.
For Wednesday Read chapter 23 Homework: –Chapter 22, exercises 1,4, 7, and 14.
Linguistic Essentials
What you have learned and how you can use it : Grammars and Lexicons Parts I-III.
CPE 480 Natural Language Processing Lecture 4: Syntax Adapted from Owen Rambow’s slides for CSc Fall 2006.
Rules, Movement, Ambiguity
The Passive Voice Ed McCorduck English 402--Grammar SUNY Cortland
October 25, : Grammars and Lexicons Lori Levin.
Artificial Intelligence 2004
LING 6520: Comparative Topics in Linguistics (from a computational perspective) Martha Palmer Jan 15,
CPSC 422, Lecture 27Slide 1 Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 27 Nov, 16, 2015.
SYNTAX.
◦ Process of describing the structure of phrases and sentences Chapter 8 - Phrases and sentences: grammar1.
NLP. Introduction to NLP (U)nderstanding and (G)eneration Language Computer (U) Language (G)
October 10, 2003BLTS Kickoff Meeting1 Transfer with Strong Decoding Learning Module Transfer Rules {PP,4894} ;;Score: PP::PP [NP POSTP] -> [PREP.
September 26, : Grammars and Lexicons Lori Levin.
Chapter 11: Parsing with Unification Grammars Heshaam Faili University of Tehran.
10/31/00 1 Introduction to Cognitive Science Linguistics Component Topic: Formal Grammars: Generating and Parsing Lecturer: Dr Bodomo.
Roadmap Probabilistic CFGs –Handling ambiguity – more likely analyses –Adding probabilities Grammar Parsing: probabilistic CYK Learning probabilities:
Natural Language Processing Vasile Rus
Grammar Grammar analysis.
Beginning Syntax Linda Thomas
An Introduction to the Government and Binding Theory
Modeling Grammaticality
Statistical NLP: Lecture 3
Basic Parsing with Context Free Grammars Chapter 13
Lexical Functional Grammar
The Passive Voice Ed McCorduck English 402--Grammar SUNY Cortland
Chapter Eight Syntax.
Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 27
Dependency Parsing & Feature-based Parsing
LING/C SC/PSYC 438/538 Lecture 21 Sandiway Fong.
CSC 594 Topics in AI – Applied Natural Language Processing
CS 388: Natural Language Processing: Syntactic Parsing
Instructor: Nick Cercone CSEB -
Chapter Eight Syntax.
Natural Language - General
Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 27
Linguistic Essentials
CPSC 503 Computational Linguistics
Modeling Grammaticality
Principles and Parameters (I)
Structure of a Lexicon Debasri Chakrabarti 13-May-19.
Artificial Intelligence 2004 Speech & Natural Language Processing
Presentation transcript:

Lecture – VIII Monojit Choudhury RS, CSE, IIT Kharagpur GRAMMAR – II From Syntax to Meaning Communication Empowerment Laboratory, IIT Kharagpur Lecture – VIII Monojit Choudhury RS, CSE, IIT Kharagpur 14th Feb 2005 CEL, IIT Kharagpur

The Big Picture Source Language Analysis Target Language Generation Text Normalization Text Rendering Morphological Analysis Morphological Synthesis POS Tagging Phrase Generation Parsing Role Ordering Semantic Analysis Lexical Choice Discourse Analysis Discourse Planning 14th Feb 2005 CEL, IIT Kharagpur

Recap Rationalism vs. Empiricism Modelling English using CFG Regular Languages are insufficient Even CFG cannot model English purely Advantages Captures most of the things Efficient parsing algorithms Problems Structural Ambiguity Agreement Constraints 14th Feb 2005 CEL, IIT Kharagpur

But what to do with the parse trees??!!! Parsing Surface Form Deep Structure PARSER Word Tag Pairs All possible parse trees But what to do with the parse trees??!!! Grammar Rules 14th Feb 2005 CEL, IIT Kharagpur

Parse Trees Who like fresh fruits? What do children like? Do children like fresh fruits? VP NP NP N V A N Children like fresh fruits 14th Feb 2005 CEL, IIT Kharagpur

Parse Trees Who like fresh fruits? What do children like? Do children like fresh fruits? VP NP PP Aux V Pre A N N Fresh fruits are liked by children 14th Feb 2005 CEL, IIT Kharagpur

Grammatical Functions Apart from the Phrase Structure in PSG, there are also Grammatical Functions Specifies the relation of the NP with the verb. Subject, Object1, Object2, ... Children like fresh fruits. Their mother gave them some apples. 14th Feb 2005 CEL, IIT Kharagpur

Active vs. Passive voice Fresh fruits are liked by children. They were given some apples. Children like fresh fruits. Their mother gave them some apples. 14th Feb 2005 CEL, IIT Kharagpur

Conclusions In fixed word order languages, Grammatical Functions are dependent on the position of the NP relative to the verb. Grammatical function, therefore, changes with the voice of the sentence. Hence, it does not capture the semantics completely. 14th Feb 2005 CEL, IIT Kharagpur

Theta Roles Semantics is “unambiguously” captured using Theta roles Agent, Co-agent/Patient, Instrument ... The children cut the apples with a knife The apples were cut by a knife 14th Feb 2005 CEL, IIT Kharagpur

“The stone rolled down.” Ambiguity Again! What characterizes Agent-ship/patient-ship? “The stone rolled down.” What should be an ideal set of theta roles? Are Theta roles language independent? The debate is primarily philosophical with some Engineering connotations. 14th Feb 2005 CEL, IIT Kharagpur

Lexical Functional Grammar Joan Bresnan (Ed.) The Mental representation of Grammatical Relations, MIT press, 1982 Why lexical we will come to later. Functional because it captures functional relations c- structure and f-structure 14th Feb 2005 CEL, IIT Kharagpur

c-structure S S VP VP NP NP NP PP N V A N Aux V Pre A N N Children like fresh fruits Fresh fruits are liked by children 14th Feb 2005 CEL, IIT Kharagpur

Children like fresh fruits. f-structure - I Children like fresh fruits. subject Predicate ‘like’ ( subject,  object) Tense present Object Predicate Child Number Plural Predicate fruit Adjective fresh Number plural 14th Feb 2005 CEL, IIT Kharagpur

Fresh fruits are liked by children. f-structure - II Fresh fruits are liked by children. subject Predicate ‘like’ ( by-object,  subject) Tense present by-Object Predicate fruit Adjective fresh Number Plural Predicate Child Number Plural 14th Feb 2005 CEL, IIT Kharagpur

Formal Model R1: S  NP VP  subj =   =  R2: VP  V {NP} {NP} PP* obj =  obj2 =  (pcase) = obj R3: PP  prep NP obj =  14th Feb 2005 CEL, IIT Kharagpur

Lexicon Entries the, det spec = the children, noun pred = child number = plural 14th Feb 2005 CEL, IIT Kharagpur

f-structure representation Feature Structures General Concept: A declarative way of specifying constraints and contexts Can model agreement and other context dependent features which are not modeled using CFG (Compare with types in C) Can be defined at the lexical, syntactic, semantic levels 14th Feb 2005 CEL, IIT Kharagpur

Feature Structure FEATURE1 VALUE1 FEATURE2 VALUE2 FEATURE3 VALUE3 . AVM (Attribute Value Matrix) Representation 14th Feb 2005 CEL, IIT Kharagpur

Atomic vs. Nested Feature Structure Category verb Root run TAM Agreement Category verb Root run Tense Past Aspect Cont Modality Default Number Φ Person Φ Tense Past Aspect Cont Modality Default Number Φ Person Φ “was running” 14th Feb 2005 CEL, IIT Kharagpur

Some Concepts Under-specification & Subsumption  Lattice DAG representation  Feature Path Reentrants Typed Feature Structures and Type Hierarchy Unification 14th Feb 2005 CEL, IIT Kharagpur