Natural Language Processing

Slides:



Advertisements
Similar presentations
Artificial Intelligence: Natural Language and Prolog
Advertisements

Problems of syntax-semantics interface ESSLLI 02 Trento.
Computational Semantics Aljoscha Burchardt, Alexander Koller, Stephan Walter, Universität des Saarlandes,
October 2004CSA4050: Semantics III1 CSA4050: Advanced Topics in NLP Semantics III Quantified Sentences.
Computational language: week 10 Lexical Knowledge Representation concluded Syntax-based computational language Sentence structure: syntax Context free.
 Christel Kemke 2007/08 COMP 4060 Natural Language Processing Feature Structures and Unification.
November 2008NLP1 Natural Language Processing Definite Clause Grammars.
CSA2050: DCG I1 CSA2050 Introduction to Computational Linguistics Lecture 8 Definite Clause Grammars.
Cs7120 (Prasad)L21-DCG1 Definite Clause Grammars
07/05/2005CSA2050: DCG31 CSA2050 Introduction to Computational Linguistics Lecture DCG3 Handling Subcategorisation Handling Relative Clauses.
CSA4050: Advanced Topics in NLP Semantics IV Partial Execution Proper Noun Adjective.
Syntax. Definition: a set of rules that govern how words are combined to form longer strings of meaning meaning like sentences.
CSA2050: DCG IV1 CSA2050: Definite Clause Grammars IV Handling Gaps II Semantic Issues.
Grammars, constituency and order A grammar describes the legal strings of a language in terms of constituency and order. For example, a grammar for a fragment.
DEFINITE CLAUSE GRAMMARS Ivan Bratko University of Ljubljana Faculty of Computer and Information Sc.
Natural Language Processing DCG and Syntax NLP DCG A “translation” example: special case A DCG recogniser.
Natural Language Processing - Feature Structures - Feature Structures and Unification.
1 Words and the Lexicon September 10th 2009 Lecture #3.
LING 364: Introduction to Formal Semantics Lecture 10 February 14th.
Parsing: Features & ATN & Prolog By
LING 388: Language and Computers Sandiway Fong Lecture 15: 10/17.
LING 364: Introduction to Formal Semantics
LING 364: Introduction to Formal Semantics Lecture 4 January 24th.
CS 4705 Lecture 17 Semantic Analysis: Syntax-Driven Semantics.
© Patrick Blackburn, Johan Bos & Kristina Striegnitz Lecture 7: Definite Clause Grammars Theory –Introduce context free grammars and some related concepts.
LING 388 Language and Computers Take-Home Final Examination 12/9/03 Sandiway FONG.
Chapter 3: Formal Translation Models
LING 364: Introduction to Formal Semantics Lecture 5 January 26th.
LING 388: Language and Computers Sandiway Fong Lecture 13: 10/10.
LING 388 Language and Computers Lecture 15 10/21/03 Sandiway FONG.
LING 388: Language and Computers Sandiway Fong 10/4 Lecture 12.
LING/C SC/PSYC 438/538 Lecture 19 Sandiway Fong 1.
February 2009Introduction to Semantics1 Logic, Representation and Inference Introduction to Semantics What is semantics for? Role of FOL Montague Approach.
October 2004csa4050: Semantics II1 CSA4050: Advanced Topics in NLP Semantics II The Lambda Calculus Semantic Representation Encoding in Prolog.
LING 388: Language and Computers Sandiway Fong Lecture 14 10/11.
For Friday Finish chapter 23 Homework: –Chapter 22, exercise 9.
LING 388: Language and Computers Sandiway Fong Lecture 7.
October 2004CSA4050 Advanced Techniques in NLP 1 CSA4050: Advanced Topics in NLP Semantics 6 Semantics of Questions and Assertions involving Quantification.
November 2003CSA4050: Semantics I1 CSA4050: Advanced Topics in NLP Semantics I What is semantics for? Role of FOL Montague Approach.
1 Natural Language Processing Lecture Notes 11 Chapter 15 (part 1)
Semantic Analysis CMSC Natural Language Processing May 8, 2003.
LING 388: Language and Computers Sandiway Fong Lecture 10.
October 2004CSA4050: Semantics III1 CSA4050: Advanced Topics in NLP Semantics III Quantified Sentences.
Computing Science, University of Aberdeen1 CS4025: Logic-Based Semantics l Compositionality in practice l Producing logic-based meaning representations.
2007CLINT-LIN-FEATSTR1 Computational Linguistics for Linguists Feature Structures.
Semantic Construction lecture 2. Semantic Construction Is there a systematic way of constructing semantic representation from a sentence of English? This.
Rules, Movement, Ambiguity
Artificial Intelligence: Natural Language
Computational Semantics Day II: A Modular Architecture
November 2006Semantics I1 Natural Language Processing Semantics I What is semantics for? Role of FOL Montague Approach.
CMSC 330: Organization of Programming Languages Operational Semantics.
April 2010Semantic Grammar1 A short guide to Blackburn’s Grammar of English.
October 2004csa4050: Semantics V1 CSA4050: Advanced Topics in NLP Semantics V NL Access to Databases Semantics of Questions and Answers Simple Interpreters.
NATURAL LANGUAGE PROCESSING
LING/C SC/PSYC 438/538 Lecture 19 Sandiway Fong 1.
7.2 Programming Languages - An Introduction to Informatics WMN Lab. Hye-Jin Lee.
10/31/00 1 Introduction to Cognitive Science Linguistics Component Topic: Formal Grammars: Generating and Parsing Lecturer: Dr Bodomo.
Natural Language Processing Vasile Rus
November 2008NL Semantics V1 Advanced Topics in NLP Semantics V NL Access to Databases Semantics of Questions and Answers Simple Interpreters for Questions.
System Software Unit-1 (Language Processors) A TOY Compiler
Natural Language Processing
Syntax Lecture 1: X-bar Theory.
LING/C SC/PSYC 438/538 Lecture 21 Sandiway Fong.
LING 581: Advanced Computational Linguistics
CSA4050: Advanced Topics in NLP
Natural Language Processing
Principles and Parameters (I)
CSA4050: Advanced Topics in NLP
Lecture 7: Definite Clause Grammars
Visual Programming Languages ICS 539 Icon System Visual Languages & Visual Programming, Chapter 1, Editor Chang, 1990 ICS Department KFUPM Sept. 1,
Presentation transcript:

Natural Language Processing Semantics II The Lambda Calculus Semantic Representation Encoding in Prolog November 2006 Semantics II

The Lambda Calculus The λ-calculus allows us to write down the definition of a function without inventing a special name for it. We use the notation λx.ϕ where x is a variable marking the argument and ϕ is an expression defining the value of the function at that argument, e.g. λx.x+1. We allow the whole expression to stand in the place of a function symbol. So (λx.x+1)(3) is a well-formed term that denotes that function applied to the argument 3. November 2006 Semantics II

β-Reduction The rule of β-reduction says that an expression of the form λx.ϕ(a) can be reduced to ϕ{x=a}, i.e. the expression ϕ with all occurrences of x replaced with a. In this case (λx.x+1)(3) = 3+1. In the semantics we shall be developing, many intermediate LFs will have the form of propositions with certain parts missing. These can be modelled as functions over propositions expressed with λ-expressions. November 2006 Semantics II

λ-expressions as Partial Propositions to walk: λx.walk(x) John: john; Fido: fido λx.walk(x)(john) = walk(john) to kick: λx.λy.kick(x,y). λx.λy.kick(x,y)(john) = λy.kick(john,y) λy.kick(john,y)(fido) = kick(john,fido) λ-calculus can be used to model “semantic operations” November 2006 Semantics II

Rule to Rule Hypothesis: The Sentence Rule Syntactic Rule: S  NP VP Semantic Rule: [S] = [VP]([NP]) i.e. the LF of S is obtained by "applying" the LF of VP to the LF of NP. For this to be possible [VP] must be a function, and [NP] the argument to the function. November 2006 Semantics II

Parse Tree with Logical Forms write(bertrand,principia) NP bertrand VP y.write(y,principia) V x.y.write(y,x) principia writes November 2006 Semantics II

Summary Leaves of the tree are words. Words (or lexical entries) are associated with “semantic forms” by the dictionary (or lexicon) Grammar determines how to combine words and phrases syntactically. Associated semantic rules determine how to combine respective semantic forms. November 2006 Semantics II

Encoding the Semantic System Devise an encoding for logical forms. Associate an encoded λ expression with each constituent. Encode process of β-reduction This can all be done with Prolog! November 2006 Semantics II

Encode Logical Forms LF Prolog x ϕ all(X,ϕ’) x ϕ exist(X,ϕ’) &, v,  λx. λy. ϕ X^Y^ϕ’ November 2006 Semantics II

Associate an encoded λ expression with each constituent Reserve an argument position in a DCG rule to hold the logical form encoding. For example, ignoring the particular constraints governing the use of the rule, we might have s(S) --> np(NP), vp(VP). i.e. sentence with LF S can be formed by concatenating a noun phrase with LF NP and a verb phrase with LF VP. November 2006 Semantics II

Encode Process of β-reduction This is done by means of the predicate reduce(Fn,Arg,Result), which is defined by means of a unit clause as follows: reduce(X^F,X,F). NB. This predicate only performs a single, outermost reduction. It does not reduce to a canonical form. November 2006 Semantics II

A Very Simple DCG that computes Semantics % grammar s(S) --> np(NP), vp(VP), {reduce(VP,NP,S)}. vp(VP) --> v(V), np(NP), {reduce(V,NP,VP)}. vp(VP) --> v(VP). % lexicon v(X^walk(X)) --> [walks]. v(X^Y^hit(X,Y)) --> [hits]. np(suzie) --> [suzie]. np(fido) --> [fido]. November 2006 Semantics II

Demo ?- s(LF,[suzie,walks], [ ]). LF = walk(suzie). ?- s(LF,[suzie,kicks,fido], [ ]). LF = kick(suzie,fido). November 2006 Semantics II

Execution Trace Call: (8) np(_L183, [suzie, walks], _L184) Call: (7) s(_G471, [suzie, walks], []) Call: (8) np(_L183, [suzie, walks], _L184) Exit: (8) np(suzie, [suzie, walks], [walks]) Call: (8) vp(_L185, [walks], _L186) Call: (9) v(_L224, [walks], _L225) Exit: (9) v(_G529^walk(_G529), [walks], []) Call: (9) np(_L226, [], _L227) Fail: (9) np(_L226, [], _L227) Redo: (9) v(_L224, [walks], _L225) Redo: (8) vp(_L185, [walks], _L186) Call: (9) v(_L185, [walks], _L186) Exit: (8) vp(_G529^walk(_G529), [walks], []) Call: (8) reduce(_G529^walk(_G529), suzie, _G471) Exit: (8) reduce(suzie^walk(suzie), suzie, walk(suzie)) Call: (8) []=[] Exit: (8) []=[] Exit: (7) s(walk(suzie), [suzie, walks], []) November 2006 Semantics II