1. From Amoeba to Cognition Frankfurt Institute of Advanced Studies April 16, 2003 Christoph von der Malsburg Institut für Neuroinformatik und Fakultät für Physik und Astronomie Ruhr-University Bochum, Germany and Computer Science Department and Program in Neuroscience University of Southern California Los Angeles

2. Amoeba

3. Euglena

4. History of life

5. Repertoire of single-celled animals 1 Metabolism Production, transformation and breakdown of molecules Synthesis of molecules under genetic control Regulation, e.g., of ionic concentrations Transport of molecules, inside, in and out of cell Electrical “behavior” Circadian rhythm Reproduction

6. Repertoire of single-celled animals 2 Behavior Sensing (light, sound, chemical milieu) Self-shaping (pseudopodia, mitosis) Motility, esp. chemotaxis Feeding: ingestion and digestion Aggression, flight Signalling Collaboration (e.g., slime mold, biofilms)

7. Amoeba aggregation 2

8. Spiral waves

9. Ants

10. Neuron 1

11. Neuron 2

12. Synapse

13. The Ontogenetic “Riddle” Information content of the genome: 10 9 bits Information content of the brain’s wiring: 10 16 bits (10 10 neurons, hence ld 10 10 = 33 bits per connection, times 10 15 synapses = 10 16 bits of information) Solution: genetically controlled self-organization

14. Rettec anatomical schema A Model for the Ontogenesis of Retinotopy (Willshaw and Malsburg, 1976)

15. Rettec functional schma Chemotaxis Synaptic plasticity controlled by electrical signals

16. Hebbian Plasticity Correlation-controlled Synaptic Plasticity (“Hebbian Plasticity”) Time 10 sec

17. Meister (Prenatal ferret retina, M. Meister et al.)

18. Network Self-Organization NetworkSignals Signal Dynamic Synaptic Plasticity

19. Rettec functional schma

20. Rettec principle 2

21. Rettec development

22. Visual system schema

23. Levay stripes

24. Binoc 1 A Model for the Ontogenesis of Ocularity Domains (Biol. Cybernetics, 1977)

25. Binoc 2

26. H&W orient

27. Devalois 2

28. 73 projection A model for the development of orientation- specific neurons (Kybernetik, 1973) Retina Cortex Connection Strength

29. 73 stimuli Retinal Stimuli

30. Meister (Prenatal ferret retina, M. Meister et al.)

31. 73 cell 70 Re-organization of a cortical receptive field

32. 73 cortex post

33. 73 orientmap

34. Devalois 1

35. Gabors

36. Olshausen-and Field: Schema Development of connections strengths Φ i (x,y) under 2 constraints: Preservation of information (ability to reconstruct) Sparsity Natural images

37. Olshausen-Field Gabors

38. Points of Conclusion: Retinotopy, orientation specificity as paradigms of network self-organization and CNS ontogenesis Ontogenesis of CNS and cellular repertoire Amount of genetic information

39. Invariant object Recognition (As paradigm of a cognitive function) imagemodel

40. van Essen

41. Rubfig 1 Image DomainModel Domain Model Window Object recognition

42. Rubfig 2 Image DomainModel Domain Model Window Objection recognition 2

43. Temporal binding Rapid, Reversible Synaptic Plasticity Time 10 msec

44. Network Self-Organization NetworkSignals Signal Dynamic Synaptic Plasticity

45. Image-to-jets

46. Maryl-representation

47. 2D mapping formation

48. Face recognition rates ModelProbeSizeRecogniti on rate * Other systems frontalDiff expression large transform 12485% frontalDiff expression small transform 12496.8%98% (=245/250)(Wiskott et al 97) frontal30° rotation in depth 11093.6%66.4% (=73/110)(Wiskott & Malsburg 96) * After 3 iterations

49. Marylin

50. Points of Conclusion: Evolution as a game of varying the eurkaryote’s repertoire Ontogenesis as a refinement of old cellular behavioral patterns reproduction, differentiation cellular migration, chemotaxis chemical signalling, reaction-diffusion patterns putting out of “pseudopodia” Brain function as a fast version of the same game again Network Self-Organization the central process

51. Outlook The flexibility of the human brain shows that fundamental principles are at work Similar conclusions may be drawn from the rapid development of human society Elucidating the general principles of organization is the challenge of our times This issue has at present no academic home

52. Molecular Biology

53. The Software Crisis NIST Study 02: yearly US loss due to SW failure: $60 Billion

54. Human: Detailed Communication Machine : Creative Infrastructure: Goals, Methods, Interpretation, World Knowledge, Diagnostics Algorithms: deterministic, fast, clue-less Algorithmic Division of Labor Algorithmic DOL

55. Human: Loose Communication Machine : Goal Definition Creative Infrastructure: Goals, Methods, Interpretation, World Knowldege, Debugging Data, „Algorithms“ Organic Computers

56. Self-Organization in Need of Development The ideas of self-organization have created a revolution, but they are now in need of forceful further development! Underdeveloped aspects: Control of the control parameters (Ashby’s super-stability) Explicit representation of goals Cascades of organization (description of unfolding systems) Escaping geometry (e.g., network self-organization)

57. Physics to the Rescue!! Physics has a proven track-record of understanding complex phenomena on the basis of simple paradigms and principles Physics is in possession of highly relevant methodology (statistical mechanics, systems of non-linear differential equations) Physics has a very successful system of education Physics is on the look-out for a new application field