Chapter 14. Conclusions From “The Computational Nature of Language Learning and Evolution” Summarized by Seok Ho-Sik.

Slides:



Advertisements
Similar presentations
HOW CAN CT AID IN THE INVESTIGATION OF INDIVIDUAL DIFFERENCES IN ADDITIONAL LANGUAGE LEARNING? Zoltán Dörnyei University of Nottingham.
Advertisements

Whole Child Assessment Connection, Context, & Qualities Whole Child Assessment Connection, Context, & Qualities “The greatest gift I can conceive of having.
Causation, Control, and the Evolution of Complexity H. H. Pattee Synopsis Steve B. 3/12/09.
Communications: Language Thought and Society. In order for social scientists to understand how people organize their lives, carry out work, practice religions,
The dynamics of iterated learning Tom Griffiths UC Berkeley with Mike Kalish, Steve Lewandowsky, Simon Kirby, and Mike Dowman.
A. How does life arise from the nonliving? 1.Generate a molecular proto-organism in vitro. 2.Achieve the transition to life in an artificial chemistry.
Artificial Chemistries – A Review Peter Dittrich, Jens Ziegler, and Wolfgang Banzhaf Artificial Life 7: , 2001 Summarized by In-Hee Lee.
Theory (and Application) Learning: A change in human performance or performance potential that results from practice or other experience and endures over.
Evolution of Universal Grammar Pia Göser Universität Tübingen Seminar: Sprachevolution Dozent: Prof. Jäger
Chapter 1 Introduction to Statistics. Statistical Methods Were developed to serve a purpose Were developed to serve a purpose The purpose for each statistical.
The Major Psychological Perspectives. Major Perspectives A. There are five leading approaches to studying and explaining mental processes and behavior.
Jalongo & Isenberg, Exploring Your Role, 3e Copyright © 2008 by Pearson Education, Inc. All rights reserved. 7.1 Chapter 7: Exploring Your Role as a Curriculum.
Chapter 2. From Complex Networks to Intelligent Systems in Creating Brain-like Systems, Sendhoff et al. Course: Robots Learning from Humans Baek, Da Som.
Chapter 1. Introduction From “The Computational Nature of Language Learning and Evolution” Summarized by Seok Ho-Sik.
Chapter 4. Analysis of Brain-Like Structures and Dynamics (2/2) Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans 09/25.
The Computational Nature of Language Learning and Evolution 10. Variations and Case Studies Summarized by In-Hee Lee
Chapter 3 Language Acquisition: A Linguistic Treatment Jang, HaYoung Biointelligence Laborotary Seoul National University.
The Problem of Pattern and Scale in Ecology - Summary What did this paper do that made it a citation classic? 1.It summarized a large body of work on spatial.
Copyright © Allyn & Bacon 2007 This multimedia product and its contents are protected under copyright law. The following are prohibited by law: any public.
The Scientific Method. Scientifically Solving a Problem Observe Define a Problem Review the Literature Observe some More Develop a Theoretical Framework.
Ch 4. Language Acquisition: Memoryless Learning 4.1 ~ 4.3 The Computational Nature of Language Learning and Evolution Partha Niyogi 2004 Summarized by.
Ch 2. THERMODYNAMICS, STATISTICAL MECHANICS, AND METROPOLIS ALGORITHMS 2.6 ~ 2.8 Adaptive Cooperative Systems, Martin Beckerman, Summarized by J.-W.
Chapter 9. The PlayMate System ( 2/2 ) in Cognitive Systems Monographs. Rüdiger Dillmann et al. Course: Robots Learning from Humans Summarized by Nan Changjun.
Artificial Intelligence DNA Hypernetworks Biointelligence Lab School of Computer Sci. & Eng. Seoul National University.
Ch 5. Language Change: A Preliminary Model 5.1 ~ 5.2 The Computational Nature of Language Learning and Evolution P. Niyogi 2006 Summarized by Kwonill,
Chapter 9. A Model of Cultural Evolution and Its Application to Language From “The Computational Nature of Language Learning and Evolution” Summarized.
Computational and Evolutionary Aspects of Language Written by: Martin Nowak, Natalia Komarova, and Partha Niyogi Presentation by: Amerika Adams, Isaac.
Origin Statement – August 8, 2012 From your experience so far, what do you know about science? Write down as much of the scientific method, in order, as.
What is cognitive psychology?
Principle Of Learning and Education Course NUR 315
Biointelligence Laboratory, Seoul National University
PSYC 206 Lifespan Development Bilge Yagmurlu.
Chapter 5: Genes, Culture, and Gender
Language Chapter topics Language Is Symbolic
What is Anthropology?.
All about Evolutionary Psychology and its functions
Chapter 1 Introduction: Themes in the Study of Life
Animals use their senses for survival
Introduction and History of Psychology
Chapter 2 Culture.
Summarized by In-Hee Lee
Biology is the scientific study of life
Biointelligence Laboratory, Seoul National University
State Machine Diagrams
The Computational Nature of Language Learning and Evolution
Frequently asked questions about software engineering
Lesson plans Introduction.
Quantum mechanics from classical statistics
Theory of Evolution Chapter 15.
Using Relationships of Support to Nurture the Language of Emotions
Knowledge is the true organ of sight, not the eyes’
The Language of genes Su Dong Kim Biointelligence Lab.
Psychological Perspectives.
Biol 115 Evolution, Behavior, and Ecology
a preliminary step for a systematic research
Philip G. Zimbardo Robert L. Johnson Ann L. Weber
There is a Great Diversity of Organisms
Boltzmann Machine (BM) (§6.4)
Applied Linguistics Chapter Four: Corpus Linguistics
Adaptive Cooperative Systems Chapter 6 Markov Random Fields
What Is Psychology? General Psychology.
Ch 6. Language Change: Multiple Languages 6.1 Multiple Languages
Ch 15 – Theory of Evolution
Chapter 5 Language Change: A Preliminary Model (2/2)
The Meaning of Texts Inherent to the interpreting process is the goal of determining the meaning of a source language message and the equivalency of.
Information Processing by Neuronal Populations Chapter 5 Measuring distributed properties of neural representations beyond the decoding of local variables:
Unit 5 – English-Language Development
EDUC103 – Educational Psychology
Biointelligence Laboratory, Seoul National University
Developmental Theories
Presentation transcript:

Chapter 14. Conclusions From “The Computational Nature of Language Learning and Evolution” Summarized by Seok Ho-Sik

14. 1 A Summary of the Major Insights 14.1.1 Learning and Memory Learning at the individual level and evolution at the population level are related. Memoryless learner A single attractor to which the population converged from all initial conditions. Batch learner A bistable situation with two stable attractors. Asymmetric cue-based learner Two different regimes – one with a single stable attractor and one with two stable attractors. There is a qualitative difference in evolutionary behavior between small-n and large-n setting  a change in the developmental lifecycle of protohumans could result in a qualitatively different evolutionary pattern for the emergence of communal languages. © 2009 SNU CSE Biointelligence Lab

© 2009 SNU CSE Biointelligence Lab 14. 1 A Summary of the Major Insights 14.1.2 Bifurcations in the History of Language Bifurcation Appropriate explanatory constructs to account for major transitions in language. The change of language from one seemingly stable mode to another. Principle & Parameters model For frequencies a and b  a=b: no evolutionary change, a>b or a<b: one language is stable and the other is unstable. A change in frequency can make a language go from a stable to an unstable state. If the usage frequencies cross a threshold, then rapid change may come about. © 2009 SNU CSE Biointelligence Lab

© 2009 SNU CSE Biointelligence Lab 14. 1 A Summary of the Major Insights 14.1.3 Natural Selection and the Emergence of Language Coherence emerges only if the learning fidelity is high (for every possible target grammar, the learner will learn it with high confidence). Learning from parents Natural selection based on communicative fitness is necessary for the emergence of a shared linguistic system. Learning from community Natural selection is not necessary  it is not necessary to postulate mechanisms of natural selection for the emergence of language. © 2009 SNU CSE Biointelligence Lab

© 2009 SNU CSE Biointelligence Lab 14.2 Future Directions (1/2) 1. Need for a network of influences on a child  a better understanding on the effect of network topology on the dynamics of language evolution is required. 2-1. Finite population size  a stochastic process  what is the relationship between the stationary distribution of a stochastic process and the attractors of the dynamical system? 2-2. Dependency only between successive generations  what is the effect of more complicated generation structures on learning? 3. Bilingual and monolingual models of learning could have different evolutionary consequences. 4. What is the relationship between first-and second-language learning and their relative effects on language change? © 2009 SNU CSE Biointelligence Lab

© 2009 SNU CSE Biointelligence Lab 14.2 Future Directions (2/2) 5. No commitment to detail of linguistic theory or learning theory  every choice of H (human grammatical systems) and A (learning algorithm) would give rise to a potentially different population dynamics. 6. The role of fitness and natural selection is poorly understood. 7. Evolution of novel structure is poorly introduced. 8. Conditions necessary for emergence of coherence  learning fidelity must be high (H needs to be a highly restricted family). 9. Exploring some of the natural evolutionary questions in the context of animal communication. © 2009 SNU CSE Biointelligence Lab

14.2.2 Connections to Other Discipline Analogies between evolution in linguistic populations and biological populations Grammars are formal and discrete. Genes are discrete. Grammars are transmitted from one generation to the next via learning. Statistical physics and language evolution Statistical physics: deriving the characteristics of the ensemble from the statistics of individual particles. Phase transition & bifurcation, linguistic agents & particles, learning fidelity (a measure of how well a learner learns a potential target language) & temperature. A bifurcation led to the transition from incoherent regimes to coherent regimes (a majority of the population spoke a shared language). Language evolution as a particular instantiation of cultural evolution The contents of this book could also serve theories of cultural evolution. © 2009 SNU CSE Biointelligence Lab

© 2009 SNU CSE Biointelligence Lab 14.3 A Concluding Thought A historical perspective provides a deeper appreciation of why things are the way they are. “Nothing in biology makes sense except in the light of evolution” An evolutionary perspective will provide a richer understanding of the fundamental nature of human language, and more generally of communication in humans, animals, and machines. © 2009 SNU CSE Biointelligence Lab