Lecture 1, 7/21/2005Natural Language Processing1 CS60057 Speech &Natural Language Processing Autumn 2005 Lecture 1 21 July 2005.

Slides:



Advertisements
Similar presentations
Natural Language Processing (or NLP) Reading: Chapter 1 from Jurafsky and Martin, Speech and Language Processing: An Introduction to Natural Language Processing,
Advertisements

Please check. Announcements 1.Don't forget your plagiarism certificate next week. You must turn that in in order to stay enrolled in the class. 2.The.
INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING NLP-AI IIIT-Hyderabad CIIL, Mysore ICON DECEMBER, 2003.
For Friday No reading Homework –Chapter 23, exercises 1, 13, 14, 19 –Not as bad as it sounds –Do them IN ORDER – do not read ahead here.
Oct 2009HLT1 Human Language Technology Overview. Oct 2009HLT2 Acknowledgement Material for some of these slides taken from J Nivre, University of Gotheborg,
Chapter 20: Natural Language Generation Presented by: Anastasia Gorbunova LING538: Computational Linguistics, Fall 2006 Speech and Language Processing.
Natural Language and Speech Processing Creation of computational models of the understanding and the generation of natural language. Different fields coming.
NLP and Speech Course Review. Morphological Analyzer Lexicon Part-of-Speech (POS) Tagging Grammar Rules Parser thethe – determiner Det NP → Det.
CSE111: Great Ideas in Computer Science Dr. Carl Alphonce 219 Bell Hall Office hours: M-F 11:00-11:
Introduction to Computational Linguistics Lecture 2.
1/7 INFO60021 Natural Language Processing Harold Somers Professor of Language Engineering.
By Rohana Mahmud (NLP week 1-2)
CHAPTER 7 Natural Language Processing. Natural language processing is a branch of AI whose goal is to facilitate communication between humans and computers.
تمرين شماره 1 درس NLP سيلابس درس NLP در دانشگاه هاي ديگر ___________________________ راحله مکي استاد درس: دکتر عبدالله زاده پاييز 85.
1 Natural Language Processing INTRODUCTION Husni Al-Muhtaseb Tuesday, February 20, 2007.
March 1, 2009 Dr. Muhammed Al-Mulhem 1 ICS 482 Natural Language Processing INTRODUCTION Muhammed Al-Mulhem March 1, 2009.
Statistical Natural Language Processing. What is NLP?  Natural Language Processing (NLP), or Computational Linguistics, is concerned with theoretical.
Natural Language Understanding
What is Natural Language Processing (NLP)
Lecture 2, 7/22/2005Natural Language Processing1 CS60057 Speech &Natural Language Processing Autumn 2005 Lecture 2 22 July 2005.
CHAPTER 1: Language in Our Lives
CAREERS IN LINGUISTICS OUTSIDE OF ACADEMIA CAREERS IN INDUSTRY.
Introduction to NLP.
9/8/20151 Natural Language Processing Lecture Notes 1.
Introduction to Natural Language Processing Heshaam Faili University of Tehran.
Part II. Statistical NLP Advanced Artificial Intelligence Applications of HMMs and PCFGs in NLP Wolfram Burgard, Luc De Raedt, Bernhard Nebel, Lars Schmidt-Thieme.
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Parser-Driven Games Tool programming © Allan C. Milne Abertay University v
1 Natural Language Processing Gholamreza Ghassem-Sani Fall 1383.
1 Computational Linguistics Ling 200 Spring 2006.
CS 4705 Natural Language Processing Fall 2010 What is Natural Language Processing? Designing software to recognize, analyze and generate text and speech.
Natural Language Processing Introduction. 2 Natural Language Processing We’re going to study what goes into getting computers to perform useful and interesting.
Natural Language Processing Rogelio Dávila Pérez Profesor – Investigador
THE BIG PICTURE Basic Assumptions Linguistics is the empirical science that studies language (or linguistic behavior) Linguistics proposes theories (models)
Machine Translation  Machine translation is of one of the earliest uses of AI  Two approaches:  Traditional approach using grammars, rewrite rules,
Introduction to CL & NLP CMSC April 1, 2003.
1 CSI 5180: Topics in AI: Natural Language Processing, A Statistical Approach Instructor: Nathalie Japkowicz Objectives of.
NLP ? Natural Language is one of fundamental aspects of human behaviors. One of the final aim of human-computer communication. Provide easy interaction.
October 2005CSA3180 NLP1 CSA3180 Natural Language Processing Introduction and Course Overview.
CSA2050 Introduction to Computational Linguistics Lecture 1 Overview.
CSA2050 Introduction to Computational Linguistics Lecture 1 What is Computational Linguistics?
ICS 482: Natural language Processing Pre-introduction
CSE573 Autumn /20/98 Planning/Language Administrative –PS3 due 2/23 –Midterms back today –Next topic: Natural Language Processing reading Chapter.
Artificial Intelligence: Natural Language
Lecture 1 Lec. Maha Alwasidi. Branches of Linguistics There are two main branches: Theoretical linguistics and applied linguistics Theoretical linguistics.
For Monday Read chapter 24, sections 1-3 Homework: –Chapter 23, exercise 8.
For Monday Read chapter 26 Last Homework –Chapter 23, exercise 7.
CSE573 Autumn /23/98 Natural Language Processing Administrative –PS3 due today –PS4 out Wednesday, due Friday 3/13 (last day of class) special.
CSE467/567 Computational Linguistics Carl Alphonce Computer Science & Engineering University at Buffalo.
Natural Language Processing Chapter 1 : Introduction.
CS460/IT632 Natural Language Processing/Language Technology for the Web Lecture 1 (03/01/06) Prof. Pushpak Bhattacharyya IIT Bombay Introduction to Natural.
For Friday Finish chapter 23 Homework –Chapter 23, exercise 15.
Natural Language Processing Slides adapted from Pedro Domingos
1 An Introduction to Computational Linguistics Mohammad Bahrani.
For Monday Read chapter 26 Homework: –Chapter 23, exercises 8 and 9.
Overview of Statistical NLP IR Group Meeting March 7, 2006.
NATURAL LANGUAGE PROCESSING
King Faisal University جامعة الملك فيصل Deanship of E-Learning and Distance Education عمادة التعلم الإلكتروني والتعليم عن بعد [ ] 1 جامعة الملك فيصل عمادة.
Text Linguistics. Definition of linguistics Linguistics can be defined as the scientific or systematic study of language. It is a science in the sense.
Natural Language Processing [05 hours/week, 09 Credits] [Theory]
Natural Language Processing (NLP)
Natural Language Processing
Natural Language Processing
Natural Language Processing
Natural Language Processing (NLP)
Artificial Intelligence 2004 Speech & Natural Language Processing
Natural Language Processing (NLP) Chapter One Introduction to Natural Language Processing(NLP)
Natural Language Processing (NLP)
Presentation transcript:

Lecture 1, 7/21/2005Natural Language Processing1 CS60057 Speech &Natural Language Processing Autumn 2005 Lecture 1 21 July 2005

Lecture 1, 7/21/2005Natural Language Processing2 Course Information Instructor : Sudeshna Sarkar Course Web Page:  Teaching Assistants:  Monojit Choudhury

Lecture 1, 7/21/2005Natural Language Processing3 Today’s slides adapted from Ilyas Cicekli’s slide Martin & Jurafsky’s book

Lecture 1, 7/21/2005Natural Language Processing4 Preliminaries Required Basic formal language theory  We will introduce the basics for those not familiar Knowledge of linguistic terminology will be useful. You can get a good overview of the field from “Survey of the State of the Art in Human Language Technology” (1996) Assignment 1: Read the Survey

Lecture 1, 7/21/2005Natural Language Processing5 Text Books Daniel Jurafsky, and James H. Martin, "Speech and Language Processing", Prentice Hall, Other References  James Allen, "Natural Language Understanding", Second edition, The Benjamin/Cumings Publishing Company Inc., 1995  Christopher D. Manning, and Hinrich Schutze, "Foundations of Statistical Natural Language Processing", The MIT Press, 1999.

Lecture 1, 7/21/2005Natural Language Processing6 Goal of NLP Develop techniques and tools to build practical and robust systems that can communicate with users in one or more natural language Natural Lang.Artificial Lang. Lexical> words~100 words SyntaxComplexSimple Semantic1 word --> several meanings 1 word --> 1 meaning

Lecture 1, 7/21/2005Natural Language Processing7 Course Topics Morphological Processing Part-of-Speech Tagging Parsing Algorithms for Context- Free Languages Features and Augmented Grammars Lexicalized and Probabilistic Parsing Semantic Analysis Lexical Semantics and Word Sense Disambiguation Discourse Natural Language Generation Machine Translation Probability & Information Theory Language Modeling  N-gram models  Parameter estimation Some linguistics  Phonology, morphology, syntax, semantics, discourse Words & the lexicon

Lecture 1, 7/21/2005Natural Language Processing8 NLP The ultimate research goal:  To develop an automated language understanding system What is NLP?  The process of computer analysis of input provided in a human language (natural language), and conversion of this input into a useful form of representation. The field of NLP is concerned with  Primarily: getting computers to perform useful and interesting tasks with human languages.  Secondarily: helping us come to a better understanding of human language. Why is this useful?

Lecture 1, 7/21/2005Natural Language Processing9 Motivation for Natural Language Processing / Understanding 1.Getting computers to perform useful and interesting tasks with human languages Enables communication: Human computer interaction e.g., IR Computer assisted human-human communication e.g., MT 2.Computer modeling of NLP helps us to: 1.Understand language processing in humans 2.Understand other human cognitive processes Challenging task-  Requires high level of knowledge about the world  Ability to represent the knowledge and reason with it

Lecture 1, 7/21/2005Natural Language Processing10 Forms of Natural Language The input/output of a NLP system can be:  written text: newspaper articles, letters, manuals, prose, …  Speech: read speech (radio, TV, dictations), conversational speech, commands, … To process written text, we need:  lexical,  syntactic,  Semantic knowledge about the language  discourse information,  real world knowledge

Lecture 1, 7/21/2005Natural Language Processing11 Forms of Natural Language To process written text, we need:  lexical, syntactic, semantic knowledge about the language  discourse information, real world knowledge To process spoken language, we need  everything above plus  speech recognition  speech synthesis

Lecture 1, 7/21/2005Natural Language Processing12 Components of NLP Natural Language Understanding  Mapping the given input in the natural language into a useful representation.  Different level of analysis required: morphological analysis, syntactic analysis, semantic analysis, discourse analysis, … Natural Language Generation  Producing output in the natural language from some internal representation.  Different level of synthesis required:  deep planning (what to say),  syntactic generation Which is harder?

Lecture 1, 7/21/2005Natural Language Processing13 Why NL Understanding is hard? Natural language is extremely rich in form and structure, and very ambiguous.  How to represent meaning,  Which structures map to which meaning structures. One input can mean many different things. Ambiguity can be at different levels.  Lexical (word level) ambiguity -- different meanings of words  Syntactic ambiguity -- different ways to parse the sentence  Interpreting partial information -- how to interpret pronouns  Contextual information -- context of the sentence may affect the meaning of that sentence. Many input can mean the same thing. Interaction among components of the input is not clear. Noisy input (e.g. speech)

Lecture 1, 7/21/2005Natural Language Processing14 Knowledge of Language Phonology – concerns how words are related to the sounds that realize them. Morphology – concerns how words are constructed from more basic meaning units called morphemes. A morpheme is the primitive unit of meaning in a language. Syntax – concerns how can be put together to form correct sentences and determines what structural role each word plays in the sentence and what phrases are subparts of other phrases. Semantics – concerns what words mean and how these meaning combine in sentences to form sentence meaning. The study of context-independent meaning.

Lecture 1, 7/21/2005Natural Language Processing15 Knowledge of Language Pragmatics – concerns how sentences are used in different situations and how use affects the interpretation of the sentence. Discourse – concerns how the immediately preceding sentences affect the interpretation of the next sentence.For example, interpreting pronouns and interpreting the temporal aspects of the information. World Knowledge – includes general knowledge about the world. What each language user must know about the other’s beliefs and goals.