Dr. Ahmad Abdollahzadeh

Slides:



Advertisements
Similar presentations
Artificial Intelligence
Advertisements

Introduction to Computational Linguistics
Natural Language Processing Heshaam Feili July 2003.
Tools: Computers and IT. VB, VBA, Excel, InterDev, Etc. Humans: Decision Making Process Algorithms: Math/Flow Chart stuff that helps the tools help the.
CHAPTER 10 Knowledge-Based Decision Support: Artificial Intelligence and Expert Systems.
Module 14 Thought & Language. INTRODUCTION Definitions –Cognitive approach method of studying how we process, store, and use information and how this.
Natural Language and Speech Processing Creation of computational models of the understanding and the generation of natural language. Different fields coming.
Artificial Intelligence
Artificial Intelligence
Managerial Decision Makers are Knowledge Workers
Chapter 12: Intelligent Systems in Business
Building Knowledge-Driven DSS and Mining Data
Intelligent Information Systems and Problem Solving WAES2105 Course Introduction Lecturer: Md Nor Ridzuan Daud.
6th ed, Copyright 2001, Prentice Hall, Upper Saddle River, NJ
Intelligent Support Systems
Lecture 1, 7/21/2005Natural Language Processing1 CS60057 Speech &Natural Language Processing Autumn 2005 Lecture 1 21 July 2005.
Copyright R. Weber INFO 629 Concepts in Artificial Intelligence Fall 2004 Professor: Dr. Rosina Weber.
1. Human – the end-user of a program – the others in the organization Computer – the machine the program runs on – often split between clients & servers.
9/8/20151 Natural Language Processing Lecture Notes 1.
Introduction to Natural Language Processing Heshaam Faili
1 CHAPTER 10 Decision Support Systems and Intelligent Systems, Efraim Turban and Jay E. Aronson 6th ed, Copyright 2001, Prentice Hall, Upper Saddle River,
Artificial Intelligence Dr. Paul Wagner Department of Computer Science University of Wisconsin – Eau Claire.
CSCI 4410 Introduction to Artificial Intelligence.
Artificial Intelligence CIS 479/579 Bruce R. Maxim UM-Dearborn.
Chapter 10 Artificial Intelligence. © 2005 Pearson Addison-Wesley. All rights reserved 10-2 Chapter 10: Artificial Intelligence 10.1 Intelligence and.
Lecture 1 Note: Some slides and/or pictures are adapted from Lecture slides / Books of Dr Zafar Alvi. Text Book - Aritificial Intelligence Illuminated.
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Knowledge representation
1 CHAPTER 10 Decision Support Systems and Intelligent Systems, Efraim Turban and Jay E. Aronson 6th ed, Copyright 2001, Prentice Hall, Upper Saddle River,
Artificial Intelligence
Natural Language Processing Introduction. 2 Natural Language Processing We’re going to study what goes into getting computers to perform useful and interesting.
Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved. Decision Support Systems Chapter 10.
Artificial Intelligence By Michelle Witcofsky And Evan Flanagan.
CSC 554: Knowledge-Based Systems Part-1 By Dr. Syed Noman Hasany Assistant Professor, CoC Qassim University.
How Solvable Is Intelligence? A brief introduction to AI Dr. Richard Fox Department of Computer Science Northern Kentucky University.
 Dr. Syed Noman Hasany 1.  Review of known methodologies  Analysis of software requirements  Real-time software  Software cost, quality, testing.
1 CS 2710, ISSP 2610 Foundations of Artificial Intelligence introduction.
NLP ? Natural Language is one of fundamental aspects of human behaviors. One of the final aim of human-computer communication. Provide easy interaction.
I Robot.
1 Introduction to Artificial Intelligence (Lecture 1)
October 2005CSA3180 NLP1 CSA3180 Natural Language Processing Introduction and Course Overview.
ARTIFICIAL INTELLIGENCE Human like intelligence Definitions: 1. Focus on intelligent Behaviour “Behaviour by a machine that, if performed by a human.
Course Instructor: K ashif I hsan 1. Chapter # 1 Kashif Ihsan, Lecturer CS, MIHE2.
CSA2050 Introduction to Computational Linguistics Lecture 1 What is Computational Linguistics?
1 The main topics in AI Artificial intelligence can be considered under a number of headings: –Search (includes Game Playing). –Representing Knowledge.
Chapter 4 Decision Support System & Artificial Intelligence.
AI ● Dr. Ahmad aljaafreh. What is AI? “AI” can be defined as the simulation of human intelligence on a machine, so as to make the machine efficient to.
CSE467/567 Computational Linguistics Carl Alphonce Computer Science & Engineering University at Buffalo.
University of Kurdistan Artificial Intelligence Methods (AIM) Lecturer: Kaveh Mollazade, Ph.D. Department of Biosystems Engineering, Faculty of Agriculture,
What is Artificial Intelligence?
Of An Expert System.  Introduction  What is AI?  Intelligent in Human & Machine? What is Expert System? How are Expert System used? Elements of ES.
Artificial Intelligence Chapter 1 - Part 2 Artificial Intelligence (605451) Dr.Hassan Al-Tarawneh.
1 Knowledge-Based Decision Support : Artificial Intelligence and Expert Systems Chapter 10 g 曾文駒 g 柯文周.
Intelligent Control Methods Lecture 2: Artificial Intelligence Slovak University of Technology Faculty of Material Science and Technology in Trnava.
Artificial Intelligence, simulation and modelling.
Primary Decision Support Technologies Management Support Systems (MSS)
1 Artificial Intelligence & Prolog Programming CSL 302.
COMPUTER SYSTEM FUNDAMENTAL Genetic Computer School INTRODUCTION TO ARTIFICIAL INTELLIGENCE LESSON 11.
1 CHAPTER 10 Knowledge-Based Decision Support: Artificial Intelligence and Expert Systems Decision Support Systems and Intelligent Systems, Efraim Turban.
Decision Support and Business Intelligence Systems (9 th Ed., Prentice Hall) Chapter 12: Artificial Intelligence and Expert Systems.
Artificial Intelligence
Introduction to Artificial Intelligence
Introduction to Artificial Intelligence Heshaam Faili University of Tehran.
CHAPTER 1 Introduction BIC 3337 EXPERT SYSTEM.
IB Assessments CRITERION!!!.
Artificial Intelligence introduction(2)
6th ed, Copyright 2001, Prentice Hall, Upper Saddle River, NJ
TA : Mubarakah Otbi, Duaa al Ofi , Huda al Hakami
Introduction to Artificial Intelligence Instructor: Dr. Eduardo Urbina
Presentation transcript:

Dr. Ahmad Abdollahzadeh Amirkabir University of Technology Computer Engineering Faculty Natural Language Processing Course Dr. Ahmad Abdollahzadeh

Session Agenda Artificial Intelligence Natural Language Processing History of NLP Applications of NLP

AI Concepts and Definitions Encompasses Many Definitions AI Involves Studying Human Thought Processes Representing Thought Processes on Machines

Artificial Intelligence Behavior by a machine that, if performed by a human being, would be considered intelligent “…study of how to make computers do things at which, at the moment, people are better” (Rich and Knight [1991]) Theory of how the human mind works (Mark Fox) Decision Support Systems and Intelligent Systems, Efraim Turban and Jay E. Aronson 6th ed, Copyright 2001, Prentice Hall, Upper Saddle River, NJ

(Winston and Prendergast [1984]) AI Objectives Make machines smarter (primary goal) Understand what intelligence is (Nobel Laureate purpose) Make machines more useful (entrepreneurial purpose) (Winston and Prendergast [1984])

Signs of Intelligence Learn or understand from experience Make sense out of ambiguous or contradictory messages Respond quickly and successfully to new situations Use reasoning to solve problems

More Signs of Intelligence Deal with perplexing situations Understand and infer in ordinary, rational ways Apply knowledge to manipulate the environment Think and reason Recognize the relative importance of different elements in a situation

Turing Test for Intelligence A computer can be considered to be smart only when a human interviewer, “conversing” with both an unseen human being and an unseen computer, can not determine which is which

Symbolic Processing Use Symbols to Represent Problem Concepts Apply Various Strategies and Rules to Manipulate these Concepts

AI Represents Knowledge as Sets of Symbols A symbol is a string of characters that stands for some real-world concept Examples Product Defendant 0.8 Chocolate

Symbol Structures (Relationships) (DEFECTIVE product) (LEASED-BY product defendant) (EQUAL (LIABILITY defendant) 0.8) tastes_good (chocolate).

AI Programs Manipulate Symbols to Solve Problems Symbols and Symbol Structures Form Knowledge Representation Artificial Intelligence Dealings Primarily with Symbolic, Nonalgorithmic Problem- Solving Methods

AI Computing Based on symbolic representation and manipulation A symbol is a letter, word, or number representing objects, processes, and their relationships Objects can be people, things, ideas, concepts, events, or statements of fact Creates a symbolic knowledge base

AI Computing (cont’d) Manipulates symbols to generate advice AI reasons or infers with the knowledge base by search and pattern matching Hunts for answers (via algorithms)

Major AI Areas Natural Language Processing Expert Systems Speech Understanding Robotics and Sensory Systems Computer Vision and Scene Recognition Intelligent Computer-Aided Instruction Neural Computing

Additional AI Areas News Summarization Language Translation Fuzzy Logic Genetic Algorithms Intelligent Software Agents

Natural Language? Natural language is the language we write and speak in everyday social interaction. There are of course many varieties of natural language It is quite possible to argue that the spoken and the written forms of the language are different and may be largely independent. There are systems of vocabulary, syntax and semantics which can be observed (or similarly discovered) and recorded. Those working in NLP also would claim (or at least hope) that it is possible to "automate" these descriptions to produce useful systems that are based on these descriptions.

Natural Language Processing (NLP) Natural language processing concerns the development of computational models of aspects of human language processing such as : Reading and interpreting a textbook Writing a letter Holding a conversation Translating a document Searching for useful information Such models are useful in order to write computer programs to perform useful tasks involving language processing and in order to develop a better understanding of human communication.

Other Titles The most common titles, apart from Natural Language Processing include: Automatic Language Processing Computational Linguistics Natural Language Understanding

Computational Lingusitics This is the application of computers to the scientific study of human language. This definition suggests that there are connections with Cognitive Science, that is to say, the study of how humans produce and understand language. Historically, Computational Linguistics has been associated with work in Generative Linguistics and formerly included the study of formal languages (eg finite state automata) and programming languages. The computer is used as a tool on which models can be developed and evaluated, for instance implementations of theories of child language acquisition.

Natural Language Understanding Distinguish a particular approach to Natural Language Processing. The people using this title tend to lay much emphasis on the meaning of the language being processed, in particular getting the computer to respond to the input in an apparently intelligent fashion. At one time, those who belonged to the Natural Language Understanding camp avoided the use of any syntactic processing, but textbooks that bear this title now include significant sections on syntactic processing, which suggests that the edge of the title has been rather blunted. (For instance, see Allen (1987; part 1).

NLP History (1) The first recognisable NLP application was a dictionary look-up system developed at Birkbeck College, London in 1948. NLP from 1966-1980 Augmented Transition Networks The Augmented Transition Network (ATN) is a piece of searching software that is capable of using very powerful grammars to process syntax. Case Grammar The significance of the proposal for NLP is that it contributed a relatively easily implementable theory which could contribute much semantic information with little processing effort. It also contributed to the solution of one of theintractable problems of Machine Translation: thetranslation of prepositions.

NLP History (2) NLP from 1966-1980 Semantic representations Schank and his workers introduced the notion of Conceptual Dependency, a method of expressing language in terms of semantic primitives. Systems were written which included no syntactic processing. QuillianÕs work on memory introduced the idea of the semantic network, which has been used in varying forms for knowledge representation in many systems. William Woods used the idea of procedural semantics to act as an intermediate representation between a language processing system and a database system. The key systems were: SHRDLU LUNAR: A database interface system that used ATNs and Woods' Procedural Semantics. LIFER/LADDER: One of the most impressive of NLP systems. It was designed as a natural language interface to a database of information about US Navy ships.

NLP History (3) NLP from 1980 - 1990 - Grammar Formalisms NLP from 1990- now - Multilinguality and Multimodality

NLP Applications Applications can be classified in different ways, e.g. medium/modality; depth of analysis;degree of interaction Text-based applications NL Understanding Dialogue Systems Multimodal

Text-based Applications Processing of written texts such as books,news, papers,reports: Finding appropriate documents on certain topics from a text database Extracting information from messages,articles, Web pages, etc. Translating documents from one language to another Text summarisation Note: Not all such applications require NLP Keyword based techniques can suce for identifying particular subject areas, e.g. legal, financial, etc.

NL Understanding Other kinds of request require a deeper level of analysis Find me all articles concerning car accidents involving more than two cars in Malta during the first half of 2001 Here the system must extract enough information to determine whether the article meets the criterion defined by the query. A crucial characteristic of an understanding system is that it can compute some representation of the information that can be used for later inference A crucial question for an NLP system is how much understanding is necessary to achieve the purpose of the system.

Dialogue-based Applications Dialogue-based applications involve man-machine communication NL database query systems Automated customer services, e.g. banking services General NL mediated problem solving systems Some of the differences between dialogue and text-based systems: Language used is less formal System needs to act proactively in order to maintain smooth conversation Use of acknowledgements clarication sub-dialogues

Text-based Applications Processing of written texts such as books,news, papers,reports: Finding appropriate documents on certain topics from a text database Extracting information from messages,articles, Web pages, etc. Translating documents from one language to another Text summarisation Note: Not all such applications require NLP Keyword based techniques can suce for identifying particular subject areas, e.g. legal, financial, etc.

Multimodal Applications Involve two or more modalities of communication Text Speech Gesture Image Text  speech Speech  text Multimodal document generation Spoken translation systems Spoken dialogue systems