Natural Language Processing Syntax. Syntactic structure John likes Mary PN VtVt NP VP S DetPNVtVt NP VP S Every man likes Mary Noun.

Slides:



Advertisements
Similar presentations
Computational language: week 10 Lexical Knowledge Representation concluded Syntax-based computational language Sentence structure: syntax Context free.
Advertisements

C O N T E X T - F R E E LANGUAGES ( use a grammar to describe a language) 1.
Syntactic analysis using Context Free Grammars. Analysis of language Morphological analysis – Chairs, Part Of Speech (POS) tagging – The/DT man/NN left/VBD.
May 2006CLINT-LN Parsing1 Computational Linguistics Introduction Approaches to Parsing.
Language and Cognition Colombo, June 2011 Day 2 Introduction to Linguistic Theory, Part 4.
Chapter Chapter Summary Languages and Grammars Finite-State Machines with Output Finite-State Machines with No Output Language Recognition Turing.
PSY 369: Psycholinguistics Some basic linguistic theory part2.
Phrase Structure Rules Must allow all and only the grammatical sentences in a language Descriptive rules, not necessarily prescriptive Each rule “rewrites”
Linguistic Theory Lecture 8 Meaning and Grammar. A brief history In classical and traditional grammar not much distinction was made between grammar and.
NLP and Speech Course Review. Morphological Analyzer Lexicon Part-of-Speech (POS) Tagging Grammar Rules Parser thethe – determiner Det NP → Det.
Syntax Lecture 4.
1 CONTEXT-FREE GRAMMARS. NLE 2 Syntactic analysis (Parsing) S NPVP ATNNSVBD NP AT NNthechildrenate thecake.
Lect. 11Phrase structure rules Learning objectives: To define phrase structure rules To learn the forms of phrase structure rules To compose new sentences.
Syntax and Semantics Dr. Walid Amer, Associate Professor of linguistics The Islamic university of Gaza February, 2009.
Theories of Linguistics Developer TraditionalPlato to Aristotle StructuralLeonard Bloomfield Ferdinand de Saussure Prague TransformationalNoam Chomsky.
Dr. Ansa Hameed Syntax (4).
Models of Generative Grammar Smriti Singh. Generative Grammar  A Generative Grammar is a set of formal rules that can generate an infinite set of sentences.
Syntax.
Lecture 1 Introduction: Linguistic Theory and Theories
Generative grammar Lynn W Zimmerman, PhD. Generative grammar  Chomsky – 1950s  Finite number of rules controlling how sentences can be formed.
Generative Grammar(Part ii)
Syntax Nuha AlWadaani.
Phonetics, Phonology, Morphology and Syntax
Linguistic Theory Lecture 3 Movement. A brief history of movement Movements as ‘special rules’ proposed to capture facts that phrase structure rules cannot.
11 CS 388: Natural Language Processing: Syntactic Parsing Raymond J. Mooney University of Texas at Austin.
Three Generative grammars
Context Free Grammars Reading: Chap 12-13, Jurafsky & Martin This slide set was adapted from J. Martin, U. Colorado Instructor: Paul Tarau, based on Rada.
Introduction Syntax: form of a sentence (is it valid) Semantics: meaning of a sentence Valid: the frog writes neatly Invalid: swims quickly mathematics.
THE BIG PICTURE Basic Assumptions Linguistics is the empirical science that studies language (or linguistic behavior) Linguistics proposes theories (models)
GRAMMARS David Kauchak CS159 – Fall 2014 some slides adapted from Ray Mooney.
Chapter 4: Syntax Part V.
Context Free Grammars Reading: Chap 9, Jurafsky & Martin This slide set was adapted from J. Martin, U. Colorado Instructor: Rada Mihalcea.
Syntax Why is the structure of language (syntax) important? How do we represent syntax? What does an example grammar for English look like? What strategies.
1 Prof.Roseline WEEK-4 LECTURE -4 SYNTAX. 2 Prof.Roseline Syntax Concentrate on the structure and ordering of components within a sentence Greater focus.
For Wednesday Read chapter 23 Homework: –Chapter 22, exercises 1,4, 7, and 14.
Introduction to Linguistics Ms. Suha Jawabreh Lecture 19.
syntax Definition Syntax is the study of how sentences are structured or how words are combined with others to form sentences and in what order.
CSA2050 Introduction to Computational Linguistics Lecture 1 What is Computational Linguistics?
Rules, Movement, Ambiguity
1 Context Free Grammars October Syntactic Grammaticality Doesn’t depend on Having heard the sentence before The sentence being true –I saw a unicorn.
The Minimalist Program
Making it stick together…
1Computer Sciences Department. Book: INTRODUCTION TO THE THEORY OF COMPUTATION, SECOND EDITION, by: MICHAEL SIPSER Reference 3Computer Sciences Department.
1 Syntax 1. 2 In your free time Look at the diagram again, and try to understand it. Phonetics Phonology Sounds of language Linguistics Grammar MorphologySyntax.
SYNTAX.
◦ Process of describing the structure of phrases and sentences Chapter 8 - Phrases and sentences: grammar1.
Syntax.
NATURAL LANGUAGE PROCESSING
Composing Music with Grammars. grammar the whole system and structure of a language or of languages in general, usually taken as consisting of syntax.
MENTAL GRAMMAR Language and mind. First half of 20 th cent. – What the main goal of linguistics should be? Behaviorism – Bloomfield: goal of linguistics.
Welcome to the flashcards tool for ‘The Study of Language, 5 th edition’, Chapter 8 This is designed as a simple supplementary resource for this textbook,
Lecturer : Ms. Abrar Mujaddidi S YNTAX. I NTRODUCTION  In the previous chapter, we moved from the general categories and concepts of traditional grammar,
SYNTAX.
King Faisal University جامعة الملك فيصل Deanship of E-Learning and Distance Education عمادة التعلم الإلكتروني والتعليم عن بعد [ ] 1 King Faisal University.
10/31/00 1 Introduction to Cognitive Science Linguistics Component Topic: Formal Grammars: Generating and Parsing Lecturer: Dr Bodomo.
Context Free Grammars. Slide 1 Syntax Syntax = rules describing how words can connect to each other * that and after year last I saw you yesterday colorless.
Natural Language Processing Vasile Rus
Syntax 1.
An Introduction to the Government and Binding Theory
Basic Parsing with Context Free Grammars Chapter 13
SYNTAX.
4.3 The Generative Approach
Chapter Eight Syntax.
CS 388: Natural Language Processing: Syntactic Parsing
Chapter Eight Syntax.
Generative Transformation
CSA2050 Introduction to Computational Linguistics
David Kauchak CS159 – Spring 2019
Artificial Intelligence 2004 Speech & Natural Language Processing
Presentation transcript:

Natural Language Processing Syntax

Syntactic structure John likes Mary PN VtVt NP VP S DetPNVtVt NP VP S Every man likes Mary Noun

Syntactic structure PNDetNounVtVt DetNounPN Johnhatessomefilms eachwomanhasmanyfriends EverymanlikesMary Thefarmerownsacar

Syntactic structure Every man likes Mary Det PNVtVt NP Noun NP VP S

Parsing Parsing is the process of recovering the Two main strategies: –Top-down parsing –Bottom-up parsing

Bottom-up parsing Following this strategy, the analysis starts at the level of the worlds and proceeds upwards to the higher levels.

The transformational model One of the major achievements in the field of theoretical linguistics has been the development of the Transformational Model (TM) by Chomsky [Cho65]. The TM is an attempt to represent, through the use of mathematical abstraction, the Linguistic Competence of an individual. The linguistic competence is the implicit knowledge that every adult has about his/her own language. Chomsky [Cho57] defines a language as a finite/infinite set of well-formed strings of symbols taken from a finite vocabulary, called the lexicon. The well-formed condition is defined by the grammar of the language.

The transformational model A grammar is a finite specification of the sentences of a language: it may consist of an explicit account of every sentence in the language (if the language is finite) or a set of generative rules with the capability of producing all and only the grammatical sentences of the language they define. Chomsky showed that a natural language, like English, cannot be properly represented by a finite-state grammar. He realized that a context-free grammar did not had the power to define a natural language. In [cho65], Chomsky proposed the transformational model, as the first representation of linguistic competence.

The transformational model Base Component Phonological Component Semantic Component Transformational Component Sounds Meanings Surface Structure Syntactic Component

The transformational model In the core of the syntactic component we have two structures: the deep structure and the surface structure. The deep structure contains all the information pertinent to the semantic interpretation of the sentence. The surface structure captures all relevant information for the phonological interpretation of the sentence. The base component is comprising a context-free grammar and a lexicon. This component generates the deep structure of the sentence.

The transformational model The transformational component consists of a set of rewrite rules or transformations, that are applied to the deep structure, rearranging its constituents, and adding, deleting or replacing elements, until the sentence obtains its final form or surface structure. This process of transformation is based on the assumption that transformations do not modify meaning.

The transformational model Since Chomsky´s edition of its first paper [cho57], many linguists have worked on developing transformation rules which give a correct account of English. This work has been a source of disagreement and controversy among linguists. A set of accepted transformations is listed below: Number-Agreement SD:NP VREST SC:1,[num] 2,[num] 3

The transformational model IMPERATIVE-FORMATION SD:you VREST SC: 02 3 YES-NO QUESTION-FORMATION SD:NP AUX VREST SC:

The transformational model THERE-INSERTION SD:NP VREST SC: [There+2]1 3 PASSIVE-FORMATION SD:NP V NPREST SC: 3 [BE+2] [BY+1] 4

The transformational model DO-INSERTION SD:Q NP VREST SC: 0[DO+2] 3 4 DATIVE-MOVEMENT SD:NP V NP1 to NP2 REST SC: