Linguistic Essentials

Slides:



Advertisements
Similar presentations
 Christel Kemke 2007/08 COMP 4060 Natural Language Processing Feature Structures and Unification.
Advertisements

CS460/IT632 Natural Language Processing/Language Technology for the Web Lecture 2 (06/01/06) Prof. Pushpak Bhattacharyya IIT Bombay Part of Speech (PoS)
Syntax and Context-Free Grammars Julia Hirschberg CS 4705 Slides with contributions from Owen Rambow, Kathy McKeown, Dan Jurafsky and James Martin.
Statistical NLP: Lecture 3
Analysing Syntax 1 Lesson 8B.
Fall 2008Programming Development Techniques 1 Topic 9 Symbol Manipulation Generating English Sentences Section This is an additional example to symbolic.
MORPHOLOGY - morphemes are the building blocks that make up words.
Introduction and Jurafsky Model Resource: A Probabilistic Model of Lexical and Syntactic Access and Disambiguation, Jurafsky 1996.
LING NLP 1 Introduction to Computational Linguistics Martha Palmer April 19, 2006.
Natural Language Processing - Feature Structures - Feature Structures and Unification.
1 Words and the Lexicon September 10th 2009 Lecture #3.
NLP and Speech Course Review. Morphological Analyzer Lexicon Part-of-Speech (POS) Tagging Grammar Rules Parser thethe – determiner Det NP → Det.
Matakuliah: G0922/Introduction to Linguistics Tahun: 2008 Session 11 Syntax 2.
 Christel Kemke 2007/08 COMP 4060 Natural Language Processing Feature Structures and Unification.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Fall 2005-Lecture 2.
Syntax LING October 11, 2006 Joshua Tauberer.
1 CSC 594 Topics in AI – Applied Natural Language Processing Fall 2009/ Outline of English Syntax.
Artificial Intelligence 2004 Natural Language Processing - Syntax and Parsing - Language Syntax Parsing.
Linguistics II Syntax. Rules of how words go together to form sentences What types of words go together How the presence of some words predetermines others.
CS224N Interactive Session Competitive Grammar Writing Chris Manning Sida, Rush, Ankur, Frank, Kai Sheng.
Phonetics, Phonology, Morphology and Syntax
March 1, 2009 Dr. Muhammed Al-Mulhem 1 ICS 482 Natural Language Processing INTRODUCTION Muhammed Al-Mulhem March 1, 2009.
THE PARTS OF SYNTAX Don’t worry, it’s just a phrase ELL113 Week 4.
Phrases and Sentences: Grammar
LING/C SC/PSYC 438/538 Lecture 19 Sandiway Fong 1.
9/8/20151 Natural Language Processing Lecture Notes 1.
1 Ch-3: Linguistics Essentials Prepared by Qaiser Abbas ( )
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
IV. SYNTAX. 1.1 What is syntax? Syntax is the study of how sentences are structured, or in other words, it tries to state what words can be combined with.
Natural Language Processing Lecture 6 : Revision.
1 Natural Language Processing Lecture Notes 11 Chapter 15 (part 1)
Parsing and Syntax. Syntactic Formalisms: Historic Perspective “Syntax” comes from Greek word “syntaxis”, meaning “setting out together or arrangement”
For Wednesday Read chapter 23 Homework: –Chapter 22, exercises 1,4, 7, and 14.
Parsing with Context-Free Grammars for ASR Julia Hirschberg CS 4706 Slides with contributions from Owen Rambow, Kathy McKeown, Dan Jurafsky and James Martin.
CPE 480 Natural Language Processing Lecture 4: Syntax Adapted from Owen Rambow’s slides for CSc Fall 2006.
Rules, Movement, Ambiguity
Artificial Intelligence: Natural Language
CSA2050 Introduction to Computational Linguistics Parsing I.
1 Context Free Grammars October Syntactic Grammaticality Doesn’t depend on Having heard the sentence before The sentence being true –I saw a unicorn.
Section 11.3 Features structures in the Grammar ─ Jin Wang.
Syntax III November 21, Just So You Know Phonology homeworks have been graded! Syntax homework will be posted on Friday… And will be due on Wednesday.
Making it stick together…
Syntax II “I really do not know that anything has ever been more exciting than diagramming sentences.” --Gertrude Stein.
CPSC 422, Lecture 27Slide 1 Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 27 Nov, 16, 2015.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Spring 2006-Lecture 2.
SYNTAX.
3 Phonology: Speech Sounds as a System No language has all the speech sounds possible in human languages; each language contains a selection of the possible.
◦ Process of describing the structure of phrases and sentences Chapter 8 - Phrases and sentences: grammar1.
SYNTAX 1 NOV 9, 2015 – DAY 31 Brain & Language LING NSCI Fall 2015.
1 Some English Constructions Transformational Framework October 2, 2012 Lecture 7.
1 LIN 1310B Introduction to Linguistics Prof: Nikolay Slavkov TA: Qinghua Tang CLASS 11, Feb 9, 2007.
Basic Syntactic Structures of English CSCI-GA.2590 – Lecture 2B Ralph Grishman NYU.
NATURAL LANGUAGE PROCESSING
September 26, : Grammars and Lexicons Lori Levin.
NLP. Introduction to NLP #include int main() { int n, reverse = 0; printf("Enter a number to reverse\n"); scanf("%d",&n); while (n != 0) { reverse =
Welcome to the flashcards tool for ‘The Study of Language, 5 th edition’, Chapter 8 This is designed as a simple supplementary resource for this textbook,
10/31/00 1 Introduction to Cognitive Science Linguistics Component Topic: Formal Grammars: Generating and Parsing Lecturer: Dr Bodomo.
Lecture – VIII Monojit Choudhury RS, CSE, IIT Kharagpur
Statistical NLP: Lecture 3
What is linguistics?.
Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 27
LING/C SC/PSYC 438/538 Lecture 21 Sandiway Fong.
BBI 3212 ENGLISH SYNTAX AND MORPHOLOGY
Natural Language - General
Language Variations: Japanese and English
Linguistic Essentials
Structure of a Lexicon Debasri Chakrabarti 13-May-19.
Artificial Intelligence 2004 Speech & Natural Language Processing
Presentation transcript:

Linguistic Essentials

Parts of Speech and Morphology Parts of Speech correspond to syntactic or grammatical categories such as noun, verb, adjectives and prepositions. Word categories are systematically related by morphological processes such as the formation of plural form from the singular form.

Parts of Speech Nouns, verbs, adjectives Determiners Adverbs She ran very quickly; She often travels to Vegas; She started off impressively. Preposition She looked up the tree Particles She looked up the number Conjunctions, complementizer Funny but stupid She is afraid that ….

Syntax or Phrase Structure: A simple context-free grammar S --> NP VP NP --> DT NNS | DT NN | NP PP VP --> VP PP | VBD | VBD NP P --> IN NP DT --> the NNS --> children | students | mountains VBD --> slept | ate | saw IN --> in | of NN --> cake The Grammar The Lexicon

Syntax or Phrase Structure: A Parse Tree NP VP AT NNS VBD NP The children ate AT NN the cake

Local and Non-Local Dependencies Dependencies may be local e.g., DT NNS A non-local dependency is an instance in which two words can be syntactically dependent even though they occur far apart in a sentence (e.g., subject-verb agreement; wh-extraction). Non-local phenomena are a challenge for certain statistical NLP approaches (e.g., n-grams) that model local dependencies.

Semantic Roles Most commonly, noun phrases are arguments of verbs. These arguments have semantic roles: the agent of an action, the patient and other roles such as the instrument or the goal.

Subcategorization Different verbs can relate different numbers of entities: transitive versus intransitive verbs. Verbs are classified according to the type of complements they permit. This called subcategorization. FrameNet combines semantic roles and subcategorization. Let’s look up “put.v”

Attachment Ambiguity and Garden-Path Sentences Attachment ambiguities occur with phrases that could have been generated by two different nodes in the parse tree. E.g.: The children ate the cake with a spoon. Garden-Path sentences are sentences that lead you along a path that suddenly turns out not to work. E.g.: The horse raced past the barn fell.

Semantics Semantics is the study of the meaning of words, constructions, and utterances. Semantics can be divided into two parts: lexical semantics and combination semantics. Lexical semantics: hypernymy, hyponymy, antonymy, meronymy, holonymy, synonymy, homonymy, polysemy (no need to memorize!). Compositionality: the meaning of the whole is built up from the meanings of its parts different from its parts. (More on the next slide…)

Semantics:Idea of Strict Compositionality The overall meaning of a phrase or sentence derives from the meanings of the constituent parts and the particular grammatical ways in which the parts are put together. Let’s consider examples using the context free grammar we saw earlier …

Syntax or Phrase Structure: A simple context-free grammar S --> NP VP NP --> DT NNS | DT NN | NP PP VP --> VP PP | VBD | VBD NP P --> IN NP DT --> the NNS --> children | students | mountains VBD --> slept | ate | saw IN --> in | of NN --> cake The Grammar The Lexicon

While the constituent parts of a sentence and its grammatical structure are important for determining its meaning, strict compositionality often breaks down Idioms are one area of language where meanings are not compositional; “to be at a crossroads” means “facing a decision or choice”

Pragmatics Pragmatics is the area of studies that goes beyond the study of the meaning of a sentence and tries to explain what the speaker really is expressing. Understand the scope of quantifiers, speech acts, discourse analysis, anaphoric relations.