Linguistics in the context of the computational and cognitive sciences Winter 2000 John Goldsmith.

Slides:



Advertisements
Similar presentations
Approaches, Tools, and Applications Islam A. El-Shaarawy Shoubra Faculty of Eng.
Advertisements

Pat Langley Computational Learning Laboratory Center for the Study of Language and Information Stanford University, Stanford, California USA
Artificial Intelligence
Perceptron Learning Rule
Chapter 4 Introduction to Cognitive Science
Knowledge Representation
An Introduction to Artificial Intelligence Presented by : M. Eftekhari.
AI 授課教師:顏士淨 2013/09/12 1. Part I & Part II 2  Part I Artificial Intelligence 1 Introduction 2 Intelligent Agents Part II Problem Solving 3 Solving Problems.
WHAT IS ARTIFICIAL INTELLIGENCE?
The Mind, The Brain, Intelligence, and Cognition.
LEARNING FROM OBSERVATIONS Yılmaz KILIÇASLAN. Definition Learning takes place as the agent observes its interactions with the world and its own decision-making.
Cognitive & Linguistic Sciences What is cognitive science anyway? Why is it interdisciplinary? Why do we need to learn about information processors?
Cognitive Processes PSY 334 Chapter 1 – The Science of Cognition.
Green’s Tri-Level Hypothesis Behavioral: a person’s performance on specific experimental tasks Cognitive: the postulated cognitive or affective systems.
Overview and History of Cognitive Science
What is Cognitive Science? … is the interdisciplinary study of mind and intelligence, embracing philosophy, psychology, artificial intelligence, neuroscience,
LEARNING FROM OBSERVATIONS Yılmaz KILIÇASLAN. Definition Learning takes place as the agent observes its interactions with the world and its own decision-making.
Overview and History of Cognitive Science. How do minds work? What would an answer to this question look like? What is a mind? What is intelligence? How.
CSE 471/598,CBS598 Introduction to Artificial Intelligence Fall 2004
Introduction to Artificial Intelligence Prof. Kathleen McKeown 722 CEPSR, TAs: Kapil Thadani 724 CEPSR, Phong Pham TA Room.
COGN1001 Introduction to Cognitive Science Sept 2006 :: Lecture #1 :: Joe Lau :: Philosophy HKU.
Random Administrivia In CMC 306 on Monday for LISP lab.
What is Cognitive Science? … is the interdisciplinary study of mind and intelligence, embracing philosophy, psychology, artificial intelligence, neuroscience,
Cognitive Psychology, 2 nd Ed. Chapter 1. Defining Cognitive Psychology The study of human mental processes and their role in thinking, feeling, and behaving.
Reference: "Artificial Intelligence, a Modern Approach, 3rd ed."
ARTIFICIAL INTELLIGENCE Introduction: Chapter 1. Outline Course overview What is AI? A brief history The state of the art.
1 AI and Agents CS 171/271 (Chapters 1 and 2) Some text and images in these slides were drawn from Russel & Norvig’s published material.
CSCI 4410 Introduction to Artificial Intelligence.
Introduction (Chapter 1) CPSC 386 Artificial Intelligence Ellen Walker Hiram College.
Artificial Intelligence: An Introduction Definition of AI Foundations of AI History of AI Advanced Techniques.
A RTIFICIAL I NTELLIGENCE Introduction 3 October
Psy Introduction1 Introduction Psychology 612.
Artificial Intelligence Introductory Lecture Jennifer J. Burg Department of Mathematics and Computer Science.
THE COGNITIVE REVOLUTION: A HISTORICAL PERSPECTIVE Asheley Landrum and Amy Louise Schwarz.
AI History, Philosophical Foundations Part 2. Some highlights from early history of AI Gödel’s theorem: 1930 Turing machines: 1936 McCulloch and Pitts.
Introduction to Artificial Intelligence and Soft Computing
How Solvable Is Intelligence? A brief introduction to AI Dr. Richard Fox Department of Computer Science Northern Kentucky University.
1 CS 2710, ISSP 2610 Foundations of Artificial Intelligence introduction.
I Robot.
ARTIFICIAL INTELLIGENCE Human like intelligence Definitions: 1. Focus on intelligent Behaviour “Behaviour by a machine that, if performed by a human.
Artificial Intelligence Lecture 1. Objectives Definition Foundation of AI History of AI Agent Application of AI.
1 CS 385 Fall 2006 Chapter 1 AI: Early History and Applications.
1 The main topics in AI Artificial intelligence can be considered under a number of headings: –Search (includes Game Playing). –Representing Knowledge.
Introduction to Artificial Intelligence CS 438 Spring 2008 Today –AIMA, Chapter 1 –Defining AI Next Tuesday –Intelligent Agents –AIMA, Chapter 2 –HW: Problem.
Neural Network Basics Anns are analytical systems that address problems whose solutions have not been explicitly formulated Structure in which multiple.
Introduction to Artificial Intelligence CS 438 Spring 2008.
Cognitive Psychology. Overview What is Cognitive Psychology? Study of HOW the mind works, not WHY we do what we do Focuses on the day-to-day functions.
What is Artificial Intelligence?
IE 585 History of Neural Networks & Introduction to Simple Learning Rules.
FOUNDATIONS OF ARTIFICIAL INTELLIGENCE
RULES Patty Nordstrom Hien Nguyen. "Cognitive Skills are Realized by Production Rules"
Cognitive Science Overview Introduction, Syllabus
Introduction to Cogsci April 07, Central Theme Cognitive Science was occuppied with the algorithmic level for much of its history: successive manipulation.
Artificial Intelligence Hossaini Winter Outline book : Artificial intelligence a modern Approach by Stuart Russell, Peter Norvig. A Practical Guide.
COMPUTER SYSTEM FUNDAMENTAL Genetic Computer School INTRODUCTION TO ARTIFICIAL INTELLIGENCE LESSON 11.
Cognitive Modeling Cogs 4961, Cogs 6967 Psyc 4510 CSCI 4960 Mike Schoelles
Decision Support and Business Intelligence Systems (9 th Ed., Prentice Hall) Chapter 12: Artificial Intelligence and Expert Systems.
Artificial Intelligence
Overview of Artificial Intelligence (1) Artificial intelligence (AI) Computers with the ability to mimic or duplicate the functions of the human brain.
Introduction To Artificial Intelligence
Classification of models
Artificial Intelligence
Artificial Intelligence (CS 370D)
Introduction Artificial Intelligent.
Artificial Intelligence introduction(2)
Introduction to Artificial Intelligence and Soft Computing
Artificial Intelligence Lecture 2: Foundation of Artificial Intelligence By: Nur Uddin, Ph.D.
TA : Mubarakah Otbi, Duaa al Ofi , Huda al Hakami
AI and Agents CS 171/271 (Chapters 1 and 2)
Introduction to Artificial Intelligence Instructor: Dr. Eduardo Urbina
Presentation transcript:

Linguistics in the context of the computational and cognitive sciences Winter 2000 John Goldsmith

Mind LogicComputation Language Machines

Is the origin of knowledge in the senses, or in the mind? World representation Representation = F(P1, P2) P1 P2

What lessons can we learn from the natural sciences in developing the human sciences?

Information Sciences The Illusion of Reality, Howard L. Resnikoff (Springer Verlag, 1989) “The history of information science consists of four interwoven strands: n the study of thermodynamics and the theory of measurement in physics; n the study of sensory information processing and knowledge representation in biological systems; n the rise of electrical communication engineering; n and the study of computability and the development of computing machines. In recent years, the common features of these superficially disparate themes have begun to coalesce to form an integrated intellectual discipline whose principal problems blend elements of all four constituent fields.” (p. 3)

The Cognitive Sciences n Goal: to study intelligence; intelligent systems; intelligence behavior; n (Looking ahead: is linguistic “behavior” or “knowledge” a form of intelligence?) n Goal: the study of intelligence and its computational processes.

What contributes to Cog Sci? n Psychology: –Cognitive psychology (George Miller, J.J. Gibson, U. Neisser) –Psycholinguistics –Use of “information processing” as a point of view without actual computer modeling (simulations).

Disciplines in cog sci n Artificial intelligence (as a part of computer science -- computer science as a part of electrical engineering!) n Seymour Papert, Marvin Minsky at MIT; Newell and Simon;

Linguistics n From the mid-1950s, staking a claim to psychological reality. n Chomskian program; n Computational linguistics; n Psycholinguistics.

(what is computational linguistics?) n Syntactic parsing n Mapping surface structures (linear word order) to semantic slots for data base access. n Automatic speech recognition

What is the relationship of language to linguistics within cog sci? n The other disciplines in the cognitive sciences do NOT cede the problem of language to linguistics. In many cases, they almost entirely ignore the current linguistic take on language problems.

Contributers to Cog Sci n Philosophy: epistemology (the study of the origin and logical foundations of knowledge) n logic; study of probability; n ?Where to place: the study of Bayesian decision theory.

Contributers to Cog Sci n Neuroscience: especially neuroanatomy n Others: Economics (study of rational decision-takers); n Cognitive anthropology, n Cognitive sociology.

What is an analysis of a cognitive system? At its most abstract: An analysis of the control and flow of information. I. Memory: how is information retained in a permanent fashion? (long-term); 2. How is new information added (learning)? 3. How is the environment perceived? 4. How is a problem defined and solved?

Some typical problems for cognitive science n Vision: perception of objects (in 3D space) n Memory: of events; of information; of language; n Categorization/classification n Planning: how to achieve goals from initial state;

Types of models n Simple prose models with a veneer of information processing. n Implemented models (= program written in a programming language) n Mathematical models n Connectionist/neural network models

Traditional symbolic models using von Neumann-style computer models Memory accessed through address- labeling; Memory can store both data and program; Input and output devices; Serial computation primarily; Structured linear computational logic. Heavy use of linked lists and associative lists (hashes).

Neural network style models Large numbers of simple, identical objects; Each object has an activation level (a real number); Distributed connections among units; Learning is inherent to the system; No centralized control.

Coming to grips with the analysis of intelligence: 2 models n Inference versus n Search n Inference: philosophy. Linguistics and psycholinguistics, bayesian decisions, computer science; n Search: traditional AI, much psychology: study of heuristics (=rules of thumb that work most of the time pretty well.)

Issues in serialism: n The 100-step limit: n Many interesting cognitive computations take one second or less. n Each machine cycle is about 10 msec; hence no more than 100 cycles are required to accomplish most interesting cognitive tasks. n That’s a serious limit.

Some common assumptions in dealing with intelligence: n A large number of rules of the form of productions: n Rule #N: Under conditions C, do P. n What do you do when more than one rule is satisfied at a given time? The control structure. n Linguists know about that problem! But linguists have been remarkably uncreative in considering alternatives.

Network models n William James n Donald Hebb n Warren McCulloch (and Pitts) n Frank Rosenblatt n Ross Quillian (spreading activation models) n PDP: McClelland and Rumelhart, back- propagation. n John Hopfield

Language -- finally. Is language: a. unique b. what pulls all of cognition together? c. both a and b (NO!) d. neither a nor b.

n Does what we know about categorization and memory from general functions tell us anything about language? Could language’s approach to the problems of categorization and memory be distinct from other problems? n Does what we know about language inform us about other cognitive functions?

Is language unique? n (1) Is language innate? n (2) Does that question bear on whether language is isolated from other functions/deeply linked to other functions? n Does our growing knowledge of localization of functions in the brain help answer questions (1) or (2)?

Learning So a big pair of questions is: Whether language is innate; Whether language is integrated vs language is isolated from (other) cognitive functions. Can we shed light on these questions by studying how (if?) language is learned?

Should we ask the question: Can language be learned? Are we prepared to take seriously the answer, No, language cannot be learned. If it is known but cannot be learned, then in some sense it must be innate. But are we prepared to consider that possibility?

The Chomskian position seems to be clearly, Yes. I think about that view what Hume thought about the view that miracles exist: while we can’t prove it’s not so, there’s essentially no sensible scenario that we could imagine under which a reasonable person would take that hypothesis as the most reasonable explanation.

Is knowledge of language a kind of intelligence? n Let’s distinguish between language- learning (= knowledge of how to learn a language) from language-using (= knowing a particular language). n Are either of them a kind of intelligence? n (Related question: is intelligence always adaptive -- a way of responding to the constraints of an external world? If so, that makes it more likely that language is not intelligent/not intelligence.)

Is knowledge of language a kind of intelligence?