Notes on Pinker ch.7 Grammar, parsing, meaning. What is a grammar? A grammar is a code or function that is a database specifying what kind of sounds correspond.

Slides:



Advertisements
Similar presentations
The Structure of Sentences Asian 401
Advertisements

Prolog programming....Dr.Yasser Nada. Chapter 8 Parsing in Prolog Taif University Fall 2010 Dr. Yasser Ahmed nada prolog programming....Dr.Yasser Nada.
Lecture #9 Syntax, Pragmatics, and Semantics © 2014 MARY RIGGS 1.
 Christel Kemke 2007/08 COMP 4060 Natural Language Processing Feature Structures and Unification.
C O N T E X T - F R E E LANGUAGES ( use a grammar to describe a language) 1.
Chapter 4 Syntax.
Syntax Constituency, Phrase structure rules LING 400 Winter 2010.
Dr. Abdullah S. Al-Dobaian1 Ch. 2: Phrase Structure Syntactic Structure (basic concepts) Syntactic Structure (basic concepts)  A tree diagram marks constituents.
Long Distance Dependencies (Filler-Gap Constructions) and Relative Clauses October 10, : Grammars and Lexicons Lori Levin (Examples from Kroeger.
Statistical NLP: Lecture 3
Syntax (1) Dr. Ansa Hameed.
The study of how words combine to form grammatical sentences.
MORPHOLOGY - morphemes are the building blocks that make up words.
For Monday Read Chapter 23, sections 3-4 Homework –Chapter 23, exercises 1, 6, 14, 19 –Do them in order. Do NOT read ahead.
Syntax Phrase and Clause in Present-Day English. The X’ phrase system Any X phrase in PDE consists of: – an optional specifier – X’ (X-bar) which is the.
 Christel Kemke 2007/08 COMP 4060 Natural Language Processing Feature Structures and Unification.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Fall 2005-Lecture 2.
1 CSC 594 Topics in AI – Applied Natural Language Processing Fall 2009/ Outline of English Syntax.
Context-Free Grammar CSCI-GA.2590 – Lecture 3 Ralph Grishman NYU.
The syntax of language How do we form sentences? Processing syntax. Language and the brain.
Constituency Tests Phrase Structure Rules
Syntax Nuha AlWadaani.
11 CS 388: Natural Language Processing: Syntactic Parsing Raymond J. Mooney University of Texas at Austin.
Three Generative grammars
Sentence Structure Ch. 7 p What is sentence structure? The structure of a sentence refers to the kinds and number of clauses it contains. There.
English II Sentence Notes. So… what is a sentence? A sentence is a group of words with a subject and a verb that expresses a complete thought. Ex. The.
Lecture Four Syntax.
The Language Instinct Talking Heads.
1.Syntax: the rules of sentence formation; the component of the mental grammar that represent speakers’ knowledge of the structure of phrase and sentence.
October 2008csa3180: Setence Parsing Algorithms 1 1 CSA350: NLP Algorithms Sentence Parsing I The Parsing Problem Parsing as Search Top Down/Bottom Up.
1 CPE 480 Natural Language Processing Lecture 5: Parser Asst. Prof. Nuttanart Facundes, Ph.D.
For Friday Finish chapter 23 Homework: –Chapter 22, exercise 9.
IV. SYNTAX. 1.1 What is syntax? Syntax is the study of how sentences are structured, or in other words, it tries to state what words can be combined with.
CS : Language Technology for the Web/Natural Language Processing Pushpak Bhattacharyya CSE Dept., IIT Bombay Constituent Parsing and Algorithms (with.
Compound and Complex Sentences
NLP. Introduction to NLP Is language more than just a “bag of words”? Grammatical rules apply to categories and groups of words, not individual words.
Today Phrase structure rules, trees Constituents Recursion Conjunction
Chapter 4: Syntax Part V.
For Wednesday Read chapter 23 Homework: –Chapter 22, exercises 1,4, 7, and 14.
Parsing with Context-Free Grammars for ASR Julia Hirschberg CS 4706 Slides with contributions from Owen Rambow, Kathy McKeown, Dan Jurafsky and James Martin.
Rules, Movement, Ambiguity
The man bites the dog man bites the dog bites the dog the dog dog Parse Tree NP A N the man bites the dog V N NP S VP A 1. Sentence  noun-phrase verb-phrase.
CSA2050 Introduction to Computational Linguistics Parsing I.
NLP. Introduction to NLP Background –Developed by Jay Earley in 1970 –No need to convert the grammar to CNF –Left to right Complexity –Faster than O(n.
Making it stick together…
Syntax II “I really do not know that anything has ever been more exciting than diagramming sentences.” --Gertrude Stein.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Spring 2006-Lecture 2.
◦ Process of describing the structure of phrases and sentences Chapter 8 - Phrases and sentences: grammar1.
There are 3 Kinds of Sentences Today we are going to talk about three kinds of sentences This will help you learn where to use commas and semicolons in.
Syntax II. Specifiers Specifiers tell us more information about nouns, verbs, adjectives, adverbs and prepositions The, a, this, three, some, many etc.
Welcome to the flashcards tool for ‘The Study of Language, 5 th edition’, Chapter 8 This is designed as a simple supplementary resource for this textbook,
Overview of comprehension parsing Semantic representation interpretation lexicon Local context Vast database.
Clauses and Phrases The keys for unlocking compound / complex sentences.
Chapter 4 Syntax a branch of linguistics that studies how words are combined to form sentences and the rules that govern the formation of sentences.
King Faisal University جامعة الملك فيصل Deanship of E-Learning and Distance Education عمادة التعلم الإلكتروني والتعليم عن بعد [ ] 1 King Faisal University.
Context Free Grammars. Slide 1 Syntax Syntax = rules describing how words can connect to each other * that and after year last I saw you yesterday colorless.
Statistical NLP: Lecture 3
SYNTAX.
Chapter Eight Syntax.
Part I: Basics and Constituency
CS 388: Natural Language Processing: Syntactic Parsing
BBI 3212 ENGLISH SYNTAX AND MORPHOLOGY
Chapter Eight Syntax.
Introduction to Linguistics
Simple, Compound, and Complex
Language Variations: Japanese and English
Linguistic Essentials
Artificial Intelligence 2004 Speech & Natural Language Processing
NLP.
Presentation transcript:

Notes on Pinker ch.7 Grammar, parsing, meaning

What is a grammar? A grammar is a code or function that is a database specifying what kind of sounds correspond to what kinds of meanings in a particular language 197 It is not a recipe or program for speaking or understanding. Procedures are needed for converting thoughts to sounds and sounds to thoughts. The mental program that analyzes sentence structure during comprehension is called the Parser.

Parsing a simple sentence: “the dog likes ice cream.” Pinker uses his “toy” English grammar. S->NP VP A sentence can consist of a noun phrase and a verb phrase.

Define a noun phrase NP NP-> (Det) N (PP) A noun phrase can consist of an optional determiner, a noun, and an optional prepostional phrase. Remember this is a “toy” - the real NP would at least look like this: NP-> (Det) N (PP) (S) This S allows “recursion” - a sentence to appear inside itself.

Define a verb phrase VP VP-> V NP (PP) A verb phrase can consist of a verb, a noun phrase, and an optional prepositional phrase.

Define a prepositional phrase (PP) PP-> P NP A prepositional phrase can consist of a preposition and a noun phrase.

Nouns (N) N->boy, girl, dog, cat, ice cream, candy The nouns in the mental dictionary include boy, girl, dog…

Verbs V V-> eats, likes, bites… The verbs in the mental dictionary include eats, likes, bites

Preposition (P) P-> with, in, near… The prepositions include with, in, near..

Determiners (det) Det->a, the, one…. The determiners include a,the, one..

The parser works word by word, building a labeled tree. “The dog likes ice cream.” Look up ‘the” in the mental dictionary. The rule says the word ‘the’ is a determiner.

“the first twig of the tree” Det->a, the, one..

The rules tell us what the tree with ‘det’ looks like. NP->det N

NPs can be part of an S, a VP, or PP Try S->NP VP The ‘dangling N’ twig predicts the next word is an N.

“the dog…. The next word, dog, fits this prediction. The NP may be complete and the parser can concentrate on finishing the S. The NP can have its meaning computed.

“likes” “likes” is a verb and must come from VP And the tree predicts a NP may be coming next.

“ice cream” The mental dictionary tells us “ice cream” is a N and that fits into the NP. “when memory has been emptied of all its incomplete dangling branches, we experience the mental “click” that signals that we have just heard a complete grammatical sentence.”

Grammatical relationships can be determined from the tree and mental dictionary Who did what to whom? ((Who) ((did) (what (to whom?)))

Complex sentences The ‘toy’ grammar does not capture all the basics of human languages. In particular it lacks the capacity to form complex sentences-- combining two or more simpler sentences into a compound complex sentence.

Three types of complex sentences Basic conjunctions S->S1 S2 He went home and she went to lunch. Relative clauses- give info about the head N NP->det N S+pronoun (that, which, who, whom) The dog which () ran away liked ice cream. Complement clauses-directly ‘name’ heads VP->V COMP COMP->that-S The dog (believed (that she would get ice cream.))

ambiguity

Sources of ambiguity Two or more trees can be built from the same word string. Relative clauses leave more than one gap to be filled (Loss of inflection on N enable more than one possible grammatical role) There may be more than one sense (meaning) in the lexicon for a word (morpheme).

Homework examples (see Topic notes on related examples)

Gaps and traces The policeman saw the boy that the crowd at the party accused (trace) of the crime.