Language emergence and neuronal replication Eörs Szathmáry Eötvös University Collegium Budapest.

Slides:



Advertisements
Similar presentations
Approaches, Tools, and Applications Islam A. El-Shaarawy Shoubra Faculty of Eng.
Advertisements

Learning School of Computing, University of Leeds, UK AI23 – 2004/05 – demo 2.
Adapted from
Intelligent systems Lection 7 Frames, selection of knowledge representation, its combinations.
Module 14 Thought & Language. INTRODUCTION Definitions –Cognitive approach method of studying how we process, store, and use information and how this.
Towards and Extended Evolutionary Synthesis Eörs Szathmáry Collegium Budapest Eötvös University München.
1Neural Networks B 2009 Neural Networks B Lecture 1 Wolfgang Maass
Genetic Algorithms1 COMP305. Part II. Genetic Algorithms.
Evolutionary Computation Introduction Peter Andras s.
Natural Computation: computational models inspired by nature Dr. Daniel Tauritz Department of Computer Science University of Missouri-Rolla CS347 Lecture.
Simulation Models as a Research Method Professor Alexander Settles.
Why? Why teach X. Why? How? Why teach XHow to teach X.
EVOLUTION. EVOLUTION The first living organisms were simple, single celled organisms. Through time more complex simple- celled creatures were created.
The Neuronal Replicator Hypothesis Chrisantha Fernando 1,2,3 Eörs Szathmary 1,4,5 1 Collegium Budapest (Institute for Advanced Study), Budapest, Hungary.
Creationism, Evolutionism, Interventionism and The Scopes Monkey Trials.
THEORIES OF MIND: AN INTRODUCTION TO COGNITIVE SCIENCE Jay Friedenberg and Gordon Silverman.
Genetic Programming.
Chapter 1 Invitation to Biology Hsueh-Fen Juan 阮雪芬 Sep. 11, 2012.
QUIZ. Practice Quiz for roll taking. Provide the best answer from those shown.
Artificial Intelligence Lecture No. 28 Dr. Asad Ali Safi ​ Assistant Professor, Department of Computer Science, COMSATS Institute of Information Technology.
Evolutionary Algorithms BIOL/CMSC 361: Emergence Lecture 4/03/08.
Evolution IN the brain? Eörs Szathmáry Collegium Budapest Eötvös University Munich.
Chapter 15 a Darwin’s Thinking Life’s Diversity Darwin’s Case
Biology I.  Biology offers a framework to pose and answer questions about the natural world.  What do Biologists study?  Questions about how living.
Several key insights led to Darwin’s idea for natural selection.
1 Language genes and evolution Linguistics lecture #10 November 28, 2006.
Pp Define evolution. Evolution is the cumulative change in the heritable characteristics of a population over time. Not only does species evolve.
Origin of Language: the Hardest Problem in Science? Eörs Szathmáry Collegium Budapest Eötvös University.
1 Machine Learning The Perceptron. 2 Heuristic Search Knowledge Based Systems (KBS) Genetic Algorithms (GAs)
Boltzmann Machine (BM) (§6.4) Hopfield model + hidden nodes + simulated annealing BM Architecture –a set of visible nodes: nodes can be accessed from outside.
110/19/2015CS360 AI & Robotics AI Application Areas  Neural Networks and Genetic Algorithms  These model the structure of neurons in the brain  Humans.
Artificial Intelligence/Life Presented by James H. Sunshine September 2, 2004.
Genetic Algorithms Genetic Algorithms – What are they? And how they are inspired from evolution. Operators and Definitions in Genetic Algorithms paradigm.
Chapter 11 Artificial Intelligence Introduction to CS 1 st Semester, 2015 Sanghyun Park.
Artificial Intelligence By Michelle Witcofsky And Evan Flanagan.
Mi öröklődik a géneken kívül? Szathmáry Eörs Eötvös University Collegium Budapest.
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Neural Networks Design  Motivation  Evolutionary training  Evolutionary design of the architecture.
Simulated Evolution of Language By: Jared Shane I400: Artificial Life as an approach to Artificial Intelligence January 29, 2007.
SIS Piemonte a.a. 2004_2005 Corso di Fondamenti della Matematica Nodi fondamentali in Matematica.
© 2008 The McGraw-Hill Companies, Inc. Chapter 8: Cognition and Language.
1 What is Life? – Living organisms: – are composed of cells – are complex and ordered – respond to their environment – can grow and reproduce – obtain.
Darwinian evolution MORE THAN JUST A THEORY?. DO YOU AGREE?
Chapter Eight The Evolutionary Approach: Change Over Time.
Linguistics 001, Spring 2010 Evolution of Language: Prospects.
Darwin for all Seasons Eörs Szathmáry Collegium Budapest and Eötvös University.
Invitation to Biology Chapter Life’s Levels of Organization  Nature has levels of organization  Unique properties emerge at successively higher.
Dialog Processing with Unsupervised Artificial Neural Networks Andrew Richardson Thomas Jefferson High School for Science and Technology Computer Systems.
What It Is To Be Conscious: Exploring the Plausibility of Consciousness in Deep Learning Computers Senior Project – Philosophy and Computer Science ID.
Evolving P2P overlay networks with Tags, SLAC and SLACER for Cooperation and possibly other things… Saarbrücken SP6 workshop July 19-20th 2005 Presented.
An evolutionary approach for improving the quality of automatic summaries Constantin Orasan Research Group in Computational Linguistics School of Humanities,
LECTURE 1: Theory of evolution 1.Evolution is the scientific idea of the gradual development of the various types of plants, animals etc from fewer a simple.
Evolution and Biodiversity G. Tyler Miller’s Living in the Environment 14 th Edition Chapter 5 Part 1 G. Tyler Miller’s Living in the Environment 14 th.
Cmpe 588- Modeling of Internet Emergence of Scale-Free Network with Chaotic Units Pulin Gong, Cees van Leeuwen by Oya Ünlü Instructor: Haluk Bingöl.
Chapter 14. Conclusions From “The Computational Nature of Language Learning and Evolution” Summarized by Seok Ho-Sik.
The Theory of Evolution by Natural Selection
Genetic Algorithm in TDR System
What is cognitive psychology?
Our understanding of man’s place in the universe
Chapter 7 Psychology: Memory.
The Standard Social Science Model (SSSM)
Introduction Artificial Intelligent.
Mi öröklődik a géneken kívül?
Activities and Labs to Support Evolution Unit
Boltzmann Machine (BM) (§6.4)
CHAPTER I. of EVOLUTIONARY ROBOTICS Stefano Nolfi and Dario Floreano
The Theory of Evolution by Natural Selection
A Gentle introduction Richard P. Simpson
Lecture 4. Niching and Speciation (1)
The Struggle For Existence
Presentation transcript:

Language emergence and neuronal replication Eörs Szathmáry Eötvös University Collegium Budapest

Design features of language Compositionality (meaning dependent on how parts are combined) Recursion (phrases within phrases) Symbolicism (versus icons and indices) Cultural transmission (rather than genetic) SYMBOLIC REFERENCE and SYNTAX

Three interwoven processes Note the different time-scales involved Cultural transmission: language transmits itself as well as other things, has its own dynamics

The coevolutionary star and the human adaptive suite Special links between cooperation and language

Origin of language in the list of major transitions Novel inheritance system, allows for cumulative cultural evolution As epigenetic inheritance systems allow cell differentiation and the division of labour, hence more complex organisms, language allows for more complex societies (Jablonka) Allows for culturally defined content of cooperation

Recruitment (predaptation) is fine, except it is unlikely to give optimal solutions Initial engulfment of bacteria, BUT… Hundreds of mutations must have gone to fixation!!!

Recuerdos de mi vida (Cajal, 1917, pp. 345–350) “At that time, the generally accepted idea that the differences between the brain of [non-human] mammals (cat, dog, monkey, etc.) and that of man are only quantitative, seemed to me unlikely and even a little offensive to human dignity... but do not articulate language, the capability of abstraction, the ability to create concepts, and, finally, the art of inventing ingenious instruments... seem to indicate (even admitting fundamental structural correspondences with the animals) the existence of original resources, of something qualitatively new which justifies the psychological nobility of Homo sapiens?... ’’.

FCG: symbolic pole and semantic pole are linked

The Elba programme An enzyme “knows” how to convert a substrate into a product (and vice versa) A grammatical contruction “knows” how to transform feature structures Enzymes evolved by natural selection Constructions may evolve by “artificial selection” in the brain

selective amplification by linked replication mutation, recombination, etc. Fluid Construction Grammar with replicating constructs

Monod, 1971 For a biologist it is tempting to draw a parallel between the evolution of ideas and that of the biosphere. For while the abstract kingdom stands at a yet greater distance above the biosphere than the latter does above the nonliving universe, ideas have retained some of the properties of organisms. Like them, they tend to perpetuate their structure and to breed; they too can fuse, recombine, segregate their content; indeed they too can evolve, and in this evolution selection must surely play an important role. I shall not hazard a theory of the selection of ideas. But one may at least try to define some of the principal factors involved in it. This selection must necessarily operate at two levels: that of the mind itself and that of performance.

Changeux, 1973 There is selection, but without the capacity for the modification of a heuristic search ( permitted by the full natural selection algorithm ). This fundamentally important limitation is admitted by the authors who write "an organism can not learn more than is initially present in its pre-representations."

Variation and selection in neural development (Changeux) There is vast overproduction of synapses Transient redundancy is selectively eliminated according to functional needs The statistics and the pruning rules for the network architecture are under genetic control

There are no units of evolution here! We propose that the algorithms of Edelman and Changeux fundamentally consist of a population of stochastic hill-climbers. Each neuronal group is randomly initialized, and those groups that are closest to a good solution obtain a greater quantity of synaptic resources allowing them to ‘grow’ and/or ‘change’. Thus groups become strengthened but not replicated.

A crucial limitation Replication has the advantage of leaving the original solution intact, so that a non-functional variant does not result in loss of the original solution. Unless the neuronal group has the capacity to revert to its original state given a harmful variation, in which case it is effectively behaving as a 1+1 Evolutionary Strategy (Beyer 2001), there is the potential that good solutions are lost.

William James, 1890 Every scientific conception is, in the first instance, a 'spontaneous variation' in someone's brain. For one that proves useful and applicable there are a thousand that perish through their worthlessness. Their genesis is strictly akin to that of the flashes of poetry and sallies of wit to which the instable brain-paths equally give rise. But whereas the poetry and wit (like the science of the ancients) are their own excuse for being... the 'scientific' conceptions must prove their worth by being 'verified'. This test, however, is the cause of their preservation, not of their production…

Let us explore then the possibility of neuronal replication (NR) NOT neurons! –Connectivity patterns –Dynamical activity patterns Functional possibilities This is NOT to say that all the other mechanisms are unimportant NR most important in complex cognitive tasks (e.g. language and insight problems)

If this is (essentially) true, then There must have been evolution of –Replication fidelity –Selection mechanisms –Corresponding niches (morphophysiological structures) in the brain