Evolution of Universal Grammar Pia Göser Universität Tübingen Seminar: Sprachevolution Dozent: Prof. Jäger 11.02.2010.

Slides:



Advertisements
Similar presentations
Formal Languages: main findings so far A problem can be formalised as a formal language A formal language can be defined in various ways, e.g.: the language.
Advertisements

CS 345: Chapter 9 Algorithmic Universality and Its Robustness
AVRAM NOAM CHOMSKY Biography Criticisms and problems
Computation and representation Joe Lau. Overview of lecture What is computation? Brief history Computational explanations in cognitive science Levels.
Language Learning in Early Childhood Explaining first language acquisition.
Introduction: The Chomskian Perspective on Language Study.
* Cognition: mental processes involved in acquiring knowledge.
Chapter Chapter Summary Languages and Grammars Finite-State Machines with Output Finite-State Machines with No Output Language Recognition Turing.
Module 14 Thought & Language. INTRODUCTION Definitions –Cognitive approach method of studying how we process, store, and use information and how this.
Theory of Computation What types of things are computable? How can we demonstrate what things are computable?
Introduction to Computational Natural Language Learning Linguistics (Under: Topics in Natural Language Processing ) Computer Science (Under:
CS Master – Introduction to the Theory of Computation Jan Maluszynski - HT Lecture 1 Introduction Jan Maluszynski, IDA, 2007
Foundations of (Theoretical) Computer Science Chapter 4 Lecture Notes (Section 4.1: Decidable Languages) David Martin With modifications.
1 Introduction to Computational Natural Language Learning Linguistics (Under: Topics in Natural Language Processing ) Computer Science (Under:
Latent Semantic Analysis (LSA). Introduction to LSA Learning Model Uses Singular Value Decomposition (SVD) to simulate human learning of word and passage.
Fall 2003Costas Busch - RPI1 Turing Machines (TMs) Linear Bounded Automata (LBAs)
Grammars, Languages and Finite-state automata Languages are described by grammars We need an algorithm that takes as input grammar sentence And gives a.
Formal Learning Theory Michele Friend (Philosophy) and Valentina Harizanov (Mathematics)
 Language acquisition is language change Brenda M. Martinez Professor: Evelyn Lugo ENGG 604.
Generative Grammar(Part ii)
Three Generative grammars
EFL Anthony’s model: Approach Method Technique
Introduction There are three major scientific research methods that are used to study the theories of Second Language Acquisition (SLA). These three methods.
By: Er. Sukhwinder kaur.  Computation Computation  Algorithm Algorithm  Objectives Objectives  What do we study in Theory of Computation ? What do.
1 Introduction to Automata Theory Reading: Chapter 1.
What is linguistics  It is the science of language.  Linguistics is the systematic study of language.  The field of linguistics is concerned with the.
Tutorial CSC3130 : Formal Languages and Automata Theory Haifeng Wan ( )
CS/IT 138 THEORY OF COMPUTATION Chapter 1 Introduction to the Theory of Computation.
Bi-Weekly BTP Meeting Bhargava Reddy
THE BIG PICTURE Basic Assumptions Linguistics is the empirical science that studies language (or linguistic behavior) Linguistics proposes theories (models)
Simulated Evolution of Language By: Jared Shane I400: Artificial Life as an approach to Artificial Intelligence January 29, 2007.
Universal Grammar Noam Chomsky.
Parsing Introduction Syntactic Analysis I. Parsing Introduction 2 The Role of the Parser The Syntactic Analyzer, or Parser, is the heart of the front.
First Language Acquisition
1. Describe how Kanzi’s communication skills fulfill each of the four critical properties of language. Kanzi used symbols to represent objects and actions.
GROUP 5 ANNIS LUTHFIANA AULYA PURNAWIDHA D FITA ARIYANA
CSA2050 Introduction to Computational Linguistics Lecture 1 What is Computational Linguistics?
Language Acquisition A brief introduction to a selection of theories behind language acquisition.
Chapter 12 FUSION OF FUZZY SYSTEM AND GENETIC ALGORITHMS Chi-Yuan Yeh.
1 Turing’s Thesis. 2 Turing’s thesis: Any computation carried out by mechanical means can be performed by a Turing Machine (1930)
1Computer Sciences Department. Book: INTRODUCTION TO THE THEORY OF COMPUTATION, SECOND EDITION, by: MICHAEL SIPSER Reference 3Computer Sciences Department.
D E C I D A B I L I T Y 1. 2 Objectives To investigate the power of algorithms to solve problems. To explore the limits of algorithmic solvability. To.
9.7: Chomsky Hierarchy.
1Computer Sciences Department. Book: INTRODUCTION TO THE THEORY OF COMPUTATION, SECOND EDITION, by: MICHAEL SIPSER Reference 3Computer Sciences Department.
Chap2. Language Acquisition: The Problem of Inductive Inference (2.1 ~ 2.2) Min Su Lee The Computational Nature of Language Learning and Evolution.
Miss. Mona AL-Kahtano. The proponent of this theory: Chomsky When: ( ) Basic assumption: Humans has a specific, innate capacity for languages.
CSCI 2670 Introduction to Theory of Computing October 13, 2005.
1 Course Overview Why this course “formal languages and automata theory?” What do computers really do? What are the practical benefits/application of formal.
Chapter 7 Linguistics aspect of interlanguage
1 CD5560 FABER Formal Languages, Automata and Models of Computation Lecture 12 Mälardalen University 2007.
C Sc 132 Computing Theory Professor Meiliu Lu Computer Science Department.
Lecture 2: Language Announcements & Review Announcements Accounts? Pair in discussion sections PAI 3.70 The Web page works mckinley/305j.
Chapter 3 Language Acquisition: A Linguistic Treatment Jang, HaYoung Biointelligence Laborotary Seoul National University.
The Church-Turing Thesis Chapter Are We Done? FSM  PDA  Turing machine Is this the end of the line? There are still problems we cannot solve:
Week 14 - Friday.  What did we talk about last time?  Simplifying FSAs  Quotient automata.
The Introduction of Saussure and Chomsky ——12 英语 2 班 丁王婷、陈楠、刘燕妹 庞林艳、高志鹏、翟小波.
Chapter 10 Language acquisition Language acquisition----refers to the child’s acquisition of his mother tongue, i.e. how the child comes to understand.
Ch 5. Language Change: A Preliminary Model 5.1 ~ 5.2 The Computational Nature of Language Learning and Evolution P. Niyogi 2006 Summarized by Kwonill,
Computational and Evolutionary Aspects of Language Written by: Martin Nowak, Natalia Komarova, and Partha Niyogi Presentation by: Amerika Adams, Isaac.
Topic 3: Automata Theory 1. OutlineOutline Finite state machine, Regular expressions, DFA, NDFA, and their equivalence, Grammars and Chomsky hierarchy.
Chapter 14. Conclusions From “The Computational Nature of Language Learning and Evolution” Summarized by Seok Ho-Sik.
LANE 622 APPLIED LINGUISTICS
Biointelligence Laboratory, Seoul National University
Introduction to Formal Languages
Course 1 Introduction to Formal Languages and Automata Theory (part 1)
Theory of Computation Theory of computation is mainly concerned with the study of how problems can be solved using algorithms.  Therefore, we can infer.
Automata, Formal Grammars, and Consequences
Formal Language Theory
CSE322 The Chomsky Hierarchy
Traditional Grammar VS. Generative Grammar
Presentation transcript:

Evolution of Universal Grammar Pia Göser Universität Tübingen Seminar: Sprachevolution Dozent: Prof. Jäger

Structure Historical outline Arguments for Universal Grammar – Language and Grammar – Learning Theory – Language Acquisition Evolutionary Processes – Language – Universal Grammar

Universal Grammar Brief history of a theory... Basic: Researches on language acquisition From ‘20s: behavioristic approach  Problem: „poverty of stimulus“ ‘60s/‘70s: Alternative model: nativistic approach  Noam Chomsky: innate human mechanism Still controversial topic  mathematical approach tries to explain it

What is language? Formal language theory: Generative system Set of sentences – A sentence is a string of symbols – there are infinite many sentences (countable) Finite Languages (are infinite – countable) Infinite Languages (are infinite – uncountable)  set of languages is uncountable Biologically: extended phenotype of population What is language?

What is grammar? Finite list of rules specifying a language There are infinitely many grammars (countable)  only small subset of languages can be described by a grammar (=computable languages) What is grammar?

Relationship language-grammar

Languages, grammars and machines Chomsky hierarchy of formal grammarautomata Phrase structure (Unrestricted)Turing machine; description for computable languages with unrestricted rewrite-rules Context sensitiveLinear-bounded; Turing machine can decide every sentence’s belonging to the language; TM has an infinite memory Context freePush-down; language can be described with computers with only one memory task Regular (Finite State)Finite-State; generate regular languages; subset of regular languages contains all finite languages

Learning Theory Classical Learning Theory (Gold) assumptions: a) learner has to identify the target language b) learner receives only positive examples c)learner has access to an arbitrary large number of examples d) learner is not limited by any consideration of computational complexity Gold’s theorem: no algorithm can learn the set of all regular language; only by memorization Statistical learning theory assumptions: a) learner will come very close to the right language with a high probability b) learner receives both positive and negative examples (distribution P) c) after a Number of “empirical data” the learner guesses a language out of a set of languages Theorem: -> set of all regular and finite languages cannot be learnt -> subsets of regular languages with finite-state automata can be learnt Basically: generalizing rules beyond one’s own experience

Learning Theory no learning theory can permit all languages to be learnable  necessity of specific resrictions  innate “restricted search space” for languages

Learning a language Paradox of language acquisition Poverty of stimulus  possible answer: UG argument: there is a learning algorithm lim A (T N ) =L N →∞ Approaches: a) principles and parameters theory (Chomsky) b) optimality theory

Chomsky Hierarchy UG as a restricted search space: Natural languages finite state grammar is not capable of representing “if…then”-sentences at least context-free grammars are necessary no phrase structure (is unrestricted)

Summary: Arguments for UG Language acquisition – Paradox of Language acquisition Learning theory: – necessity of restricted search space Human brain contains of an algorithm that can learn grammar  there is no algorithm that can learn an unrestricted set of grammars  Human brain can only learn a certain subset of all possible languages  The theory of this subset is UG.

Cultural Evolution of Language starting position: population of individuals with the same UG UG specifies finite number of languages L 1,…,L n each individual uses particular language selective aspect: successful communication (coherent language) results in pay-off  increased fitness Variation: Offspring inherit a mechanism to learn language and UG (mutation) Offspring use this mechanism to learn the language of their parents etc (mistakes)

Cultural Evolution of Language Model: Two individuals communicating by L i and L j Components: Equation: Communicative pay-off for user of L i F ij Relative abundance of speakers of L i xixi Learning Matrix (Probability of an offspring speaking L j with L i parents) Q ij Fitness of L i n f i = ∑x j F ij j=1 Average fitness (grammatical coherence) of population (x)=∑ i f i (x)x i total population size is consant: ∑ i x i =1- (x)x j

Evolution of UG starting position: population of individuals with different UGs (U I … U M ) each individual uses particular U each U I admits a subset of n grammars selective aspect: ability to generate coherent language Variation: small search space increases probability of linguistic coherence

Evolution of UG Model: Two individuals communicating with U I und U J Additional Components: Equation:  in the limit of no mutation: only one UG Relative abundance of individuals with U J speaking L j x Jj Probability of genetical mutation from U I to U J W IJ

Linguistic coherence

Combination Evolution of the algorithm of UG as a prerequisitional mechanism for distinction between humans and apes UG specifies the mechanisms of language acquisition and allows cultural evolution of language

Possible Criticism theory of UG is not falsifiable Daniel Everett: Non-recursive languages: Pirahã language (!) Tomasello: Language acquisition can be explained by development of cognitive abilities  Remains a theory

Thank you for listening Nowak, Martin, Evolutionary Dynamics. Exploring the Equations of Life, Harvard University Press, 2006 Nowak, Martin et al, Computational and evolutionary aspects of language, In:Nature, Vol.417, June 2002, p Grewendorf, G., Hamm, F., Sternefeld, W., Sprachliches Wissen. Eine Einführung in moderne Theorien der grammatischen Beschreibung, Suhrkamp, 1999.