Chapter 5 Language Change: A Preliminary Model (2/2)

Slides:



Advertisements
Similar presentations
Artificial Intelligence Chapter 21 The Situation Calculus Biointelligence Lab School of Computer Sci. & Eng. Seoul National University.
Advertisements

Ch 11. Sampling Models Pattern Recognition and Machine Learning, C. M. Bishop, Summarized by I.-H. Lee Biointelligence Laboratory, Seoul National.
(C) 2001 SNU CSE Biointelligence Lab Incremental Classification Using Tree- Based Sampling for Large Data H. Yoon, K. Alsabti, and S. Ranka Instance Selection.
Artificial Intelligence Chapter 14 Resolution in the Propositional Calculus Artificial Intelligence Chapter 14 Resolution in the Propositional Calculus.
Factor Graphs Young Ki Baik Computer Vision Lab. Seoul National University.
Evolution of Universal Grammar Pia Göser Universität Tübingen Seminar: Sprachevolution Dozent: Prof. Jäger
Kernel Classifiers from a Machine Learning Perspective (sec ) Jin-San Yang Biointelligence Laboratory School of Computer Science and Engineering.
Ch 2. Probability Distributions (1/2) Pattern Recognition and Machine Learning, C. M. Bishop, Summarized by Yung-Kyun Noh and Joo-kyung Kim Biointelligence.
Software Engineering Chapter 3 CPSC Pascal Brent M. Dingle Texas A&M University.
Artificial Intelligence Chapter 3 Neural Networks Artificial Intelligence Chapter 3 Neural Networks Biointelligence Lab School of Computer Sci. & Eng.
Copyright (c) 2002 by SNU CSE Biointelligence Lab 1 Chap. 4 Pairwise alignment using HMMs Biointelligence Laboratory School of Computer Sci. & Eng. Seoul.
Artificial Intelligence Chapter 10 Planning, Acting, and Learning Biointelligence Lab School of Computer Sci. & Eng. Seoul National University.
Chapter 2. From Complex Networks to Intelligent Systems in Creating Brain-like Systems, Sendhoff et al. Course: Robots Learning from Humans Baek, Da Som.
Chapter 1. Introduction From “The Computational Nature of Language Learning and Evolution” Summarized by Seok Ho-Sik.
Approaches to Selection and their Effect on Fitness Modelling in an Estimation of Distribution Algorithm A. E. I. Brownlee, J. A. McCall, Q. Zhang and.
Chapter 14. Active Vision for Goal-Oriented Humanoid Robot Walking (2/2) in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from.
Learning Kernel Classifiers 1. Introduction Summarized by In-Hee Lee.
Genetic Algorithm Dr. Md. Al-amin Bhuiyan Professor, Dept. of CSE Jahangirnagar University.
Chapter 4. Analysis of Brain-Like Structures and Dynamics (2/2) Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans 09/25.
The Computational Nature of Language Learning and Evolution 10. Variations and Case Studies Summarized by In-Hee Lee
Bayesian Brain Probabilistic Approaches to Neural Coding 1.1 A Probability Primer Bayesian Brain Probabilistic Approaches to Neural Coding 1.1 A Probability.
Chapter 3 Language Acquisition: A Linguistic Treatment Jang, HaYoung Biointelligence Laborotary Seoul National University.
Ch 4. Language Acquisition: Memoryless Learning 4.1 ~ 4.3 The Computational Nature of Language Learning and Evolution Partha Niyogi 2004 Summarized by.
Ch 2. The Probably Approximately Correct Model and the VC Theorem 2.3 The Computational Nature of Language Learning and Evolution, Partha Niyogi, 2004.
Chapter 9. The PlayMate System ( 2/2 ) in Cognitive Systems Monographs. Rüdiger Dillmann et al. Course: Robots Learning from Humans Summarized by Nan Changjun.
Artificial Intelligence DNA Hypernetworks Biointelligence Lab School of Computer Sci. & Eng. Seoul National University.
Ch 5. Language Change: A Preliminary Model 5.1 ~ 5.2 The Computational Nature of Language Learning and Evolution P. Niyogi 2006 Summarized by Kwonill,
Chapter 9. A Model of Cultural Evolution and Its Application to Language From “The Computational Nature of Language Learning and Evolution” Summarized.
Computational and Evolutionary Aspects of Language Written by: Martin Nowak, Natalia Komarova, and Partha Niyogi Presentation by: Amerika Adams, Isaac.
Chapter 14. Conclusions From “The Computational Nature of Language Learning and Evolution” Summarized by Seok Ho-Sik.
Biointelligence Laboratory, Seoul National University
Introduction to Spatial Computing CSE 5ISC
Chapter 7. Classification and Prediction
Anticipatory Systems(Prolegomena) by Rosen, R
Let us consider a sample word graph as described below:
Summarized by In-Hee Lee
Artificial Intelligence Chapter 17 Knowledge-Based Systems
Turing Machines Chapter 17.
Artificial Intelligence Chapter 17 Knowledge-Based Systems
Biointelligence Laboratory, Seoul National University
The Computational Nature of Language Learning and Evolution
CHAPTER 12 Sample Surveys.
4 (c) parsing.
Artificial Intelligence Project 2 Genetic Algorithms
On Template Method for DNA Sequence Design
Hidden Markov Models Part 2: Algorithms
Biointelligence Lab School of Computer Sci. & Eng.
EVALUATING STATISTICAL REPORTS
Artificial Intelligence Chapter 3 Neural Networks
Artificial Intelligence Chapter 2 Stimulus-Response Agents
Biointelligence Lab School of Computer Sci. & Eng.
Some Thoughts on Theorem Proving
Artificial Intelligence Chapter 3 Neural Networks
Biointelligence Lab School of Computer Sci. & Eng.
Artificial Intelligence Chapter 10 Planning, Acting, and Learning
A Classification Data Set for PLM
Biointelligence Lab School of Computer Sci. & Eng.
Guideline Try to summarize to express explicitly
Adaptive Cooperative Systems Chapter 6 Markov Random Fields
Functions and Graphing
Artificial Intelligence Chapter 3 Neural Networks
Ch 6. Language Change: Multiple Languages 6.1 Multiple Languages
Adaptive Cooperative Systems Chapter 3 Coperative Lattice Systems
Artificial Intelligence Chapter 3 Neural Networks
Artificial Intelligence Chapter 17 Knowledge-Based Systems
Information Processing by Neuronal Populations Chapter 5 Measuring distributed properties of neural representations beyond the decoding of local variables:
Artificial Intelligence Chapter 10 Planning, Acting, and Learning
Sampling: How to Select a Few to Represent the Many
Biointelligence Laboratory, Seoul National University
The Nature of learner language
Presentation transcript:

Chapter 5 Language Change: A Preliminary Model (2/2) The Computational Nature of Language Learning and Evolution P. Niyogi, 2004. Summary by Byoung-Hee Kim Biointelligence Lab School of Computer Sci. & Eng. Seoul National University

(C) 2009 SNU CSE Biointelligence Lab Contents 5.1 An Acquisition-Based Model of Language Change 5.2 A Preliminary Model Learning by individuals Population dynamics Some examples Memoreless learners batch error-based learner cue-based learner 5.3 Implications and Further Directions An example from Yiddish Discussion – major insights Future directions – relaxing simplifying assumptions (C) 2009 SNU CSE Biointelligence Lab

Setting for Population Dynamics Choices: K (maturation time), A (learning algorithm) (C) 2009 SNU CSE Biointelligence Lab

Batch Error-Based Learner Batch learner waits until the entire data set of K examples has been received Simply chooses the language that is more consistent L1 L2 K example sentences = n1 + n2 + n3 L1∩L2 n1 n2 n3 Choose L1 if n1 ≥ n3, Choose L2 if n1 < n3 (C) 2009 SNU CSE Biointelligence Lab

Analysis on the Map of BE Learners (C) 2009 SNU CSE Biointelligence Lab

Analysis on the Map of BE Learners (C) 2009 SNU CSE Biointelligence Lab

Cue-Based Learner Cue-based learner Examines the data set for cues to a linguistic parameter setting Choose the language with more cues if p : the probability with which an L1 user produces a cue (C) 2009 SNU CSE Biointelligence Lab

Analysis on the Map of Cue Learners (C) 2009 SNU CSE Biointelligence Lab

Analysis on the Map of Cue Learners DO NOT BE PURPLEXED BY THE EQUATIONS when they are just about details of simple calculations. Directional change, or Irreversability… why?? (C) 2009 SNU CSE Biointelligence Lab

Investigation on the Fixed Points (C) 2009 SNU CSE Biointelligence Lab

(C) 2009 SNU CSE Biointelligence Lab Limiting Analysis Allowing the number of examples K goes infinite The dynamics of the finite sample case are qualitatively similar to the infinite sample case (C) 2009 SNU CSE Biointelligence Lab

Directional Changes in Linguistic Grammars A homogeneous population of L2 users will always remain stable and can never change to a population of L1 users A homogenous population of L1 users will remain stable only in a certain regime of p values. As p changes, the basin of attraction shrinks and after a critical value of p the population switches to a stable mode of L2 speakers A change from L1 to L2 is possible. The other way is never possible (C) 2009 SNU CSE Biointelligence Lab

An Example from Yiddish L1: INFL-final L2: INFL-medial Yiddish (literally "Jewish") is a non-territorial High German language of Jewish origin, spoken throughout the world. Unlike other Germanic languages, Yiddish is written with the Hebrew alphabet as opposed to a Latin alphabet. (C) 2009 SNU CSE Biointelligence Lab

(C) 2009 SNU CSE Biointelligence Lab Discussion (C) 2009 SNU CSE Biointelligence Lab

Reflection on General Findings with Learning Models (C) 2009 SNU CSE Biointelligence Lab

Reflection on General Findings with Learning Models (C) 2009 SNU CSE Biointelligence Lab

Reflection on General Findings with Learning Models (C) 2009 SNU CSE Biointelligence Lab

(C) 2009 SNU CSE Biointelligence Lab Major Insights (C) 2009 SNU CSE Biointelligence Lab

Future Directions – Relaxing Symplifying Assumptions Multiple languages Finite populations Generational structure Spatial population structure Multilingual acquisition Non-vertical and other nodes of transmission (C) 2009 SNU CSE Biointelligence Lab