Course Overview  What is AI?  What are the Major Challenges?  What are the Main Techniques?  Where are we failing, and why?  Step back and look at.

Slides:



Advertisements
Similar presentations
How Children Acquire Language
Advertisements

Second Language Acquisition
Intro to Linguistics Class # 2 Chapter 1: What is Language?
Introduction: The Chomskian Perspective on Language Study.
Nativism: Noam Chomsky
1 Language and kids Linguistics lecture #8 November 21, 2006.
Language Special form of communication in which we learn complex rules to manipulate symbols that can be used to generate an endless number of meaningful.
Module 14 Thought & Language.
Module 14 Thought & Language. INTRODUCTION Definitions –Cognitive approach method of studying how we process, store, and use information and how this.
Introduction to Linguistics and Basic Terms
Topic: Theoretical Bases for Cognitive Method Objectives Trainees will be able to give reasons for the design and procedures of the Cognitive Method.
Syntax LING October 11, 2006 Joshua Tauberer.
Psycholinguistics 12 Language Acquisition. Three variables of language acquisition Environmental Cognitive Innate.
Lecture 1 Introduction: Linguistic Theory and Theories

Generative Grammar(Part ii)
TOPIC 2: Some Basic Concepts
BILINGUALISM: ENGLISH & SPANISH Tashia Hernandez.
Main Branches of Linguistics
Linguistics in Cognitive Science
Chapter 9: Thinking, Language, and Intelligence
X Language Acquisition
How much harder would it be to communicate without language? Need two volunteers from the class One will need to leave the class for a minute Goal is to.
Linguistics and Language
Language. Language Communication – transmitting information Many animals communicate Call systems – system of communication limited to a set number of.
Language.  Our spoken, written, or signed words and the ways we combine them as we think and communicate  Human essence: the qualities of the mind are.
LANGUAGE. VERBAL AND NONVERBAL LANGUAGE Human interaction and communication involve both verbal and nonverbal language.  Verbal language is what is being.
Lecture 2 What Is Linguistics.
Chapter 10 - Language 4 Components of Language 1.Phonology Understanding & producing speech sounds Phoneme - smallest sound unit Number of phonemes varies.
© Child language acquisition To what extent do children acquire language by actively working out its rules?
Linguistics The first week. Chapter 1 Introduction 1.1 Linguistics.
Language and Thought Its all about communication.
SPEECH AND WRITING. Spoken language and speech communication In a normal speech communication a speaker tries to influence on a listener by making him:
Levels of Language 6 Levels of Language. Levels of Language Aspect of language are often referred to as 'language levels'. To look carefully at language.
Simulated Evolution of Language By: Jared Shane I400: Artificial Life as an approach to Artificial Intelligence January 29, 2007.
A very, very brief introduction to linguistics Computational Linguistics, NLL Riga 2008, by Pawel Sirotkin 1.
Universal Grammar Noam Chomsky.
First Language Acquisition
A means of communication.
PSY270 Michaela Porubanova. Language  a system of communication using sounds or symbols that enables us to express our feelings, thoughts, ideas, and.
WHAT IS LANGUAGE?. INTRODUCTION In order to interact,human beings have developed a language which distinguishes them from the rest of the animal world.
16 January 2015 Take a few minutes to study your memory notes, we’ll take a short quiz first (it’s in two parts – one scantron, one not) After that, one.
Introduction Chapter 1 Foundations of statistical natural language processing.
Course Overview  What is AI?  What are the Major Challenges?  What are the Main Techniques?  Where are we failing, and why?  Step back and look at.
The Develop ment of Thought and Languag e Chapter 11 Thought & Language Chapter 10.
What is Artificial Intelligence?
First Language Acquisition
2014 Fall Semester- Week 6. Introduction (1) 1. James Asher (1960) hypothesis: Language learning starts first with understanding and ends with production.
Language and Cognition Colombo, June 2011 Day 2 Introduction to Linguistic Theory, Part 3.
Language Development. Four Components of Language Phonology sounds Semantics meanings of words Grammar arrangements of words into sentences Pragmatics.
Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.
Cognition  Refers to the way in which information is processed and manipulated in remembering, thinking, and knowing.  Includes: Memory, Thinking, and.
Language Objective: Student will: be able to identify the structural features of language be able to explain theories of language be able to explain stages.
Chapter 3 Language Acquisition: A Linguistic Treatment Jang, HaYoung Biointelligence Laborotary Seoul National University.
This I Believe Essay Writer’s Workshop: Introductions, Juicy Details, & Conclusions 8 th ELA St. Joseph School.
Language: our spoken, written, or signed words & the ways we combine them to communicate meaning! “When we study language, we are approaching what some.
Chapter 10 Language acquisition Language acquisition----refers to the child’s acquisition of his mother tongue, i.e. how the child comes to understand.
Child Syntax and Morphology
PSYC 206 Lifespan Development Bilge Yagmurlu.
Syntax 1 Introduction.
Glottodidactics Lesson 3.
What is Language Acquisition?
SYNTAX.
Theories of Language Development
Course Overview What is AI? What are the Major Challenges?
Course Overview What is AI? What are the Major Challenges?
Over the past fifty years, three main theoretical positions have been advanced to explain language development from infancy through the early school years:
Over the past fifty years, three main theoretical positions have been advanced to explain language development from infancy through the early school years:
Traditional Grammar VS. Generative Grammar
Over the past fifty years, three main theoretical positions have been advanced to explain language development from infancy through the early school years:
Presentation transcript:

Course Overview  What is AI?  What are the Major Challenges?  What are the Main Techniques?  Where are we failing, and why?  Step back and look at the Science  Step back and look at the History of AI  What are the Major Schools of Thought?  What of the Future? Part I: Introduce you to what’s happening in Artificial Intelligence Part II: Give you an appreciation for the big picture  Why it is a grand challenge Done

Course Overview  What is AI?  What are the Major Challenges?  What are the Main Techniques?  Where are we failing, and why?  Step back and look at the Science  Step back and look at the History of AI  What are the Major Schools of Thought?  What of the Future? Part I: Introduce you to what’s happening in Artificial Intelligence Part II: Give you an appreciation for the big picture  Why it is a grand challenge Done

Course Overview  What is AI?  What are the Major Challenges?  What are the Main Techniques?  Where are we failing, and why?  Step back and look at the Science  Step back and look at the History of AI  What are the Major Schools of Thought?  What of the Future? Looking at the Science  Engineering vs. Science  Introduction to Cognitive Science  Cognitive Psychology 1  Cognitive Psychology 2  Cognitive Development  Linguistics  Neuroscience  Philosophy

Course Overview  What is AI?  What are the Major Challenges?  What are the Main Techniques?  Where are we failing, and why?  Step back and look at the Science  Step back and look at the History of AI  What are the Major Schools of Thought?  What of the Future? Looking at the Science  Engineering vs. Science  Introduction to Cognitive Science  Cognitive Psychology 1  Cognitive Psychology 2  Cognitive Development  Linguistics  Neuroscience  Philosophy

Linguistics in Cognitive Science  Why are Cognitive Scientists Interested in Linguistics?  Language seems to be uniquely human trait  All normal humans use language  Animals don’t seem to –Sometimes have some signals, but no complex grammar, relationships –Not sure about dolphins…  Language is how we express our thoughts  It must give us some hints about those thoughts themselves  Language is easy to study  Compare with brain scans, or anthropology

Linguistics in Cognitive Science  Example: Grammar  Grammar is the study of the rules governing the use of a given natural language  Why is that interesting?  Trying to get some scientific hypothesis about the language knowledge native speakers have  How to describe that knowledge?  The dog irritated Mary.  Mary irritated the dog.  Dog the Mary irritated.  Irritated the Mary dog.  Describe grammar as a list of options?  It seems we would have to describe too many options  These rules seem to be best described by algorithms  Quite advanced - recursion  Quite complicated  Note: these are used by ALL speakers, not just some advanced experts

Knowledge of Grammar is Implicit  We all know the rules…  but are usually unaware of this knowledge  The rules of a natural language are very complicated  Hard to find because they are implicit  More complicated than grammar you might learn in school  John believed that pigs can fly.  That sugar is sweet is obvious to everyone. (optional that)  The pain that I feel is unpleasant.  The dog that bit me is missing now. (seems to depend on head-subject)  Everybody knows the rules, but few can write them down  These rules are complicated…  but most kids have learnt most by 5 yrs … how?  Language acquisition – address later

Overview of Linguistics Areas  Phonology - sounds  Lexical - words  Morphology - words built up of bits  Syntax – order of words  Semantics - meaning  Words  Sentences  Pragmatics  Pretty much everything else  Example: Context  Example: Gricean maxims  Example: Dialogues

Morphology  Two types of languages:  Synthetic: stick parts together to make words  English has synthetic features: Unbreakable, Antidisestablishmentarianism  Turkish: Avustralyalılaştıramadıklarımızdanmışsınız  Analytic: order of words is used to make up the meaning  Chinese, many far-eastern languages  Example: tense is indicated by words around, rather than conjugation  Morphemes are smallest bits of language that have meaning  Example: cat, dog, happy, un-, -ness, -s, break, -able, -ory, -ment  Many ways to things  Can compound words: toothbrush  Output of one can input to another  Toothbrush-holder  Unmicrowaveability  Can use recursion  Anti-missile missile  Anti-anti-missile missile missile  Anti-anti-anti-missile missile missile missile  Need to keep track of antis and missiles

Phonology  Phonology tells us how words (made of morphemes) get pronounced  Examples…  Plural: cat  cats  Plural: dog  dogs  Pronounced “dogz” … why?  Plural: glass  glasses  What about non-words  Blort  ?  Blorb  ?  Blorch  ?  There seem to be some rules being applied

Phonology  Example: Do you want to?  Do you wanto  Do you wanna  Dyu wanna  Juwanna  Is this simply what happens when you try to force your voice to go fast  Or are there also rules?  Another example  I’m going to leave (“to” is part of the verb)  I’m gonna leave  I’m going to New York (“to” is a preposition)  I’m gonna New York (sounds odd?)  I’m going to split  I’m going to Split (city in Croatia)  I’m gonna split  Depends on grammar rules…  Interestingly… principles of phonology also apply to sign language  Something common underlying both grammars

Syntax Noam Chomsky  “A Review of BF Skinner's Verbal Behaviour”  Challenged the behaviourist approach (was dominant in the 1950s)  Especially to the study of language  Sparked the “cognitive revolution” in psychology  Mind contains mental states, beliefs, desires, intentions  Most properties of language and mind are innate (puts him at odds with Piaget)

Poverty of the stimulus  Premises: 1.Patterns in grammar of natural language cannot be learned using positive evidence alone 2.Children are only ever presented with positive evidence 3.Children do learn the correct grammars for their native languages  Conclusion  Humans must have some innate knowledge of the rules for language  Example of what is learned:  Statement: You are happy.  Question: Are you happy?  Statement: Anyone who is interested can see me later. 1. Is anyone who interested can see me later? 2. Can anyone who is interested see me later?  Some controversy… some premises not accepted by some  Example: Maybe domain general learning theory adequate  Example: Some say positive evidence is enough

Universal Grammar  A basic grammatical structure common to all human languages  Humans are born with innate knowledge of this Principles and Parameters approach  Grammatical principles underlying languages are innate and fixed  Differences among world's languages are parameter settings in the brain  Example: “pro-drop parameter”  Indicates if an explicit subject is always required  Yes in English  No in Spanish, Maltese  Mar. Maltese sentence "he went/left" (verb)  A child learning a language only needs to  acquire lexical items (words, grammatical morphemes, and idioms)  and determine the appropriate parameter settings  can be done based on a few key examples

Universal Grammar  Principles and Parameters approach Explains a lot…  Rate at which children learn languages is very fast  Similar learning steps taken by children across the world  Children make same characteristic errors on first language  Some seemingly logical kinds of errors never occur

Some Limitations on Internal Buffers…  “That many teachers are being laid off in a shortsighted attempt to balance this year’s budget at the same time that governor's cronies and bureaucratic hacks are lining their pockets is appalling.”  “It is appalling that many teachers are being laid off in a shortsighted attempt to balance this year’s budget at the same time that governor's cronies and bureaucratic hacks are lining their pockets.”  Maybe grammar allows choice to ease buffer burden  “The rapidity that the motion has is remarkable.”  “The motion that the wing has is remarkable.”  “The rapidity that the motion that the wing has has is remarkable.”  “The rapidity that the motion that the wing that the hummingbird has has has is remarkable.”  “The dog bit the cat.”  “The dog the stick beat bit the cat.”  “The dog the stick the fire burned beat bit the cat.”  Not short term memory… seems to be one part of the “parser”  Special buffer for this type of “incomplete phrase” – buffer size = 1!

Ambiguity and Garden Paths…  “Rumour had it that, for years, the government building had been plagued with problems. The man was not surprised when he found several spiders, roaches, and other bugs in the corner of his room.”  Human must make choices… how long to entertain alternatives?  “The man who hunts ducks …

Ambiguity and Garden Paths…  “Rumour had it that, for years, the government building had been plagued with problems. The man was not surprised when he found several spiders, roaches, and other bugs in the corner of his room.”  Human must make choices… how long to entertain alternatives?  “The man who hunts ducks out on weekends.”

Ambiguity and Garden Paths…  “Rumour had it that, for years, the government building had been plagued with problems. The man was not surprised when he found several spiders, roaches, and other bugs in the corner of his room.”  Human must make choices… how long to entertain alternatives?  “The man who hunts ducks out on weekends.”  “Fat people eat …

Ambiguity and Garden Paths…  “Rumour had it that, for years, the government building had been plagued with problems. The man was not surprised when he found several spiders, roaches, and other bugs in the corner of his room.”  Human must make choices… how long to entertain alternatives?  “The man who hunts ducks out on weekends.”  “Fat people eat accumulates.”

Ambiguity and Garden Paths…  “Rumour had it that, for years, the government building had been plagued with problems. The man was not surprised when he found several spiders, roaches, and other bugs in the corner of his room.”  Human must make choices… how long to entertain alternatives?  “The man who hunts ducks out on weekends.”  “Fat people eat accumulates.”  “The cotton clothing is usually made of …

Ambiguity and Garden Paths…  “Rumour had it that, for years, the government building had been plagued with problems. The man was not surprised when he found several spiders, roaches, and other bugs in the corner of his room.”  Human must make choices… how long to entertain alternatives?  “The man who hunts ducks out on weekends.”  “Fat people eat accumulates.”  “The cotton clothing is usually made of grows in Mississippi.”

Ambiguity and Garden Paths…  “Rumour had it that, for years, the government building had been plagued with problems. The man was not surprised when he found several spiders, roaches, and other bugs in the corner of his room.”  Human must make choices… how long to entertain alternatives?  “The man who hunts ducks out on weekends.”  “Fat people eat accumulates.”  “The cotton clothing is usually made of grows in Mississippi.”  “The horse raced past the barn …

Ambiguity and Garden Paths…  “Rumour had it that, for years, the government building had been plagued with problems. The man was not surprised when he found several spiders, roaches, and other bugs in the corner of his room.”  Human must make choices… how long to entertain alternatives?  “The man who hunts ducks out on weekends.”  “Fat people eat accumulates.”  “The cotton clothing is usually made of grows in Mississippi.”  “The horse raced past the barn fell.”  Conscious processing of grammar is necessary for difficult writing.

Language Acquisition  Children learn very quickly  17 year old has about 60,000 words  Must learn about 10 new words a day  6 year old has about 13,000 words  Child learns a new word every two hours  Learning a word is not easy  Know what aspect of situation was referred to  Without having to try the word in many situations  Example: gavagai  Humans tend to chop up the world into the same categories

Language Acquisition Do children have a special device for language learning?  Children learn very quickly and easily  Children become perfect speakers  adults usually learn second language imperfectly  and with great difficulty  Children make mistakes, but not the same ones adults make  Example: Children never misjudge appropriate position of question words  Even on basis of sentences like "I know what John ate."

Language Acquisition  Hawaiian sugar plantations  Adults from many countries  Communicated in pidgin  Their children invented a creole  Some controversy about the claims  Sign language  Nicaragua created new schools for the deaf  Younger children invented a new sign language

Course Overview  What is AI?  What are the Major Challenges?  What are the Main Techniques?  Where are we failing, and why?  Step back and look at the Science  Step back and look at the History of AI  What are the Major Schools of Thought?  What of the Future? Looking at the Science  Engineering vs. Science  Introduction to Cognitive Science  Cognitive Psychology 1  Cognitive Psychology 2  Cognitive Development  Linguistics  Neuroscience  Philosophy