Biointelligence Laboratory, Seoul National University

Slides:



Advertisements
Similar presentations
Computational Neuroscience 03 Lecture 8
Advertisements

2806 Neural Computation Self-Organizing Maps Lecture Ari Visa.
Biointelligence Laboratory, Seoul National University
Activity-Dependent Development I April 23, 2007 Mu-ming Poo 1.Development of OD columns 2.Effects of visual deprivation 3. The critical period 4. Hebb’s.
5/16/2015Intelligent Systems and Soft Computing1 Introduction Introduction Hebbian learning Hebbian learning Generalised Hebbian learning algorithm Generalised.
Artificial neural networks:
Spike timing dependent plasticity Homeostatic regulation of synaptic plasticity.
Plasticity in the nervous system Edward Mann 17 th Jan 2014.
The “Humpty Dumpty” problem
Slides are based on Negnevitsky, Pearson Education, Lecture 8 Artificial neural networks: Unsupervised learning n Introduction n Hebbian learning.
Un Supervised Learning & Self Organizing Maps Learning From Examples
Synapses are everywhere neurons synapses Synapse change continuously –From msec –To hours (memory) Lack HH type model for the synapse.
A globally asymptotically stable plasticity rule for firing rate homeostasis Prashant Joshi & Jochen Triesch
Artificial neural networks.
1 Activity-dependent Development (2) Hebb’s hypothesis Hebbian plasticity in visual system Cellular mechanism of Hebbian plasticity.
Summarized by Soo-Jin Kim
Unsupervised learning
Learning and Stability. Learning and Memory Ramón y Cajal, 19 th century.
Artificial Intelligence Chapter 2 Stimulus-Response Agents
Biointelligence Laboratory, Seoul National University
The BCM theory of synaptic plasticity.
Chapter 9 Neural Network.
Artificial Neural Network Unsupervised Learning
HEBB’S THEORY The implications of his theory, and their application to Artificial Life.
Plasticity and learning Dayan and Abbot Chapter 8.
Deriving connectivity patterns in the primary visual cortex from spontaneous neuronal activity and feature maps Barak Blumenfeld, Dmitri Bibitchkov, Shmuel.
What to make of: distributed representations summation of inputs Hebbian plasticity ? Competitive nets Pattern associators Autoassociators.
Unsupervised learning
The BCM theory of synaptic plasticity. The BCM theory of cortical plasticity BCM stands for Bienestock Cooper and Munro, it dates back to It was.
1 7. Associators and synaptic plasticity Lecture Notes on Brain and Computation Byoung-Tak Zhang Biointelligence Laboratory School of Computer Science.
1 4. Associators and Synaptic Plasticity Lecture Notes on Brain and Computation Byoung-Tak Zhang Biointelligence Laboratory School of Computer Science.
1 Psychology 304: Brain and Behaviour Lecture 22.
Adaptive Cooperative Systems Chapter 8 Synaptic Plasticity 8.11 ~ 8.13 Summary by Byoung-Hee Kim Biointelligence Lab School of Computer Sci. & Eng. Seoul.
Ch 5. The Patterning of Neural Connections 5.5 ~ 5.6 Adaptive Cooperative Systems, Martin Beckerman, Summarized by Kwonill, Kim Biointelligence Laboratory,
Ch 9. Rhythms and Synchrony 9.7 Adaptive Cooperative Systems, Martin Beckerman, Summarized by M.-O. Heo Biointelligence Laboratory, Seoul National.
0 Chapter 4: Associators and synaptic plasticity Fundamentals of Computational Neuroscience Dec 09.
Information Processing by Neuronal Populations Chapter 6: Single-neuron and ensemble contributions to decoding simultaneously recoded spike trains Information.
Chapter 4. Analysis of Brain-Like Structures and Dynamics (2/2) Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans 09/25.
Jochen Triesch, UC San Diego, 1 Part 3: Hebbian Learning and the Development of Maps Outline: kinds of plasticity Hebbian.
Ch 8. Synaptic Plasticity 8.9 ~ 8.10 Adaptive Cooperative Systems, Martin Beckerman, Summarized by Kim, S. –J. Biointelligence Laboratory, Seoul.
Ch 1. Introduction Pattern Recognition and Machine Learning, C. M. Bishop, Updated by J.-H. Eom (2 nd round revision) Summarized by K.-I.
9 Distributed Population Codes in Sensory and Memory Representations of the Neocortex Matthias Munk Summarized by Eun Seok Lee Biointelligence Laboratory,
Ch 2. THERMODYNAMICS, STATISTICAL MECHANICS, AND METROPOLIS ALGORITHMS 2.6 ~ 2.8 Adaptive Cooperative Systems, Martin Beckerman, Summarized by J.-W.
1 9. Continuous attractor and competitive networks Lecture Notes on Brain and Computation Byoung-Tak Zhang Biointelligence Laboratory School of Computer.
Ch 5. Language Change: A Preliminary Model 5.1 ~ 5.2 The Computational Nature of Language Learning and Evolution P. Niyogi 2006 Summarized by Kwonill,
Bayesian Brain - Chapter 11 Neural Models of Bayesian Belief Propagation Rajesh P.N. Rao Summary by B.-H. Kim Biointelligence Lab School of.
Biointelligence Laboratory, Seoul National University
Biointelligence Laboratory, Seoul National University
Biointelligence Laboratory, Seoul National University
Self-Organizing Network Model (SOM) Session 11
Brain development.
Biointelligence Laboratory, Seoul National University
Ch 14. Active Vision for Goal-Oriented Humanoid Robot Walking (1/2) Creating Brain-Like Intelligence, Sendhoff et al. (eds), Robots Learning from.
Presented by Rhee, Je-Keun
Presented by Rhee, Je-Keun
Artificial Intelligence Chapter 2 Stimulus-Response Agents
Emre O. Neftci  iScience  Volume 5, Pages (July 2018) DOI: /j.isci
OCNC Statistical Approach to Neural Learning and Population Coding ---- Introduction to Mathematical.
Introduction (2/2) in Adaptive Cooperative Systems by Martine Beckerman, ’ 7.10 B.-W. Ku.
Biointelligence Laboratory, Seoul National University
7. Associators and synaptic plasticity
Biointelligence Laboratory, Seoul National University
Ch. 1. How could populations of neurons encode information
Adaptive Cooperative Systems Chapter 3 Coperative Lattice Systems
Ch 3. Linear Models for Regression (2/2) Pattern Recognition and Machine Learning, C. M. Bishop, Previously summarized by Yung-Kyun Noh Updated.
Information Processing by Neuronal Populations Chapter 5 Measuring distributed properties of neural representations beyond the decoding of local variables:
Biointelligence Laboratory, Seoul National University
Ch. 8 Synaptic Plasticity 8. 5 ~ 8
Cortical plasticity: Is it time for a change?
Presentation transcript:

Biointelligence Laboratory, Seoul National University Ch 8. Synaptic Plasticity 8.1 ~ 8.4 Adaptive Cooperative Systems, Martin Beckerman, 1997. Summarized by Kwonill, Kim Biointelligence Laboratory, Seoul National University http://bi.snu.ac.kr/

(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/ Contents 8.1 Synaptic Plasticity in the Visual Cortex 8.1.1 Forms of Synaptic Plasticity 8.1.2 Use-Dependent Changes in Synaptic Efficiency 8.2 Models of Synaptic Modification 8.2.1 Feature Selectivity 8.2.2 Stability 8.2.3 Information Processing in the Visual System 8.3 Outline of the Chapter 8.4 Dynamics 8.4.1 Phase Space 8.4.2 Trajectories in Phase Space 8.4.3 Conservative and Dissipative Systems (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/ QnA What is the main model to discuss in this chapter? (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

Forms of Synaptic Plasticity Sprouting of new axonal and dendritic structures Pruning, retraction and disappearance of old arbors Changes in the membrane properties of existing growth Cell death Use-dependent changes in synaptic efficiency (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

Forms of Synaptic Plasticity – Cell Death Overproduced neurons  Cell death 15% ~ 85% loss during late prenatal and early postnatal development 1st Function: Numerically matching pre- and postsynaptic neural structures 2nd Function: Selectively removing cells whose axons project to inappropriate targets. (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/ Forms of Synaptic Plasticity – Use-dependent Changes in Synaptic Efficiency Critical period in the visual system Cat, monkey, … LTP, LTD Hippocampus of rat Adult plasticity in which cortical motor and sensory maps After injury Not static STDP (Spike-Timing Dependent Plasticity) ? (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

Use-dependent Changes in Synaptic Efficiency Hebb-Stent rule Highly local process of synaptic modification driven by correlated pre- and postsynaptic activity Cooperative processes initiated by spatiotemporally correlated afferent input NMDAR & BCM theory Critical period Kitten (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

Models of Synaptic Modification – Feature Selectivity Input activity vector: Random variable Stationary stochastic process with a time-invariant distribution in general Synaptic weight vector: Selectivity of to averaging The peak respose to a particular input (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

Models of Synaptic Modification – Feature Selectivity Related works The earliest model by Anderson, Kohonen and Cooper Linear associator Bounded weights by Malsburg Orientation selectivity and related properties By Perez, Glass, and Shlaer By Nass and Cooper (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

Models of Synaptic Modification – Stability BCM (Bienenstock, Cooper, and Munro) To explain the development of orientation selectivity and binocular interaction in kitten visual cortex Single-cell  Network by Cooper and Scofield Dynamic (nonlinear) equation for synaptic modification by Cooper, Liberman and Oja Modification threshold (moving) (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/ Models of Synaptic Modification – Information Processing in the Visual System Three viewpoints of BCM theory Single-cell & networks formulation, and its objective function Connections between the theory and biology Information-processing functions of BCM Synaptic systems constraint on the square of the summed synaptic strength Function as PCA Maximal information preservation A number of models of synaptic modification (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/ Outline of the Chapter 8.4~8.5 : a brief overview of the phase space behavior of dynamic systems 8.6~8.8 : how feature selective states develop from the Hebbian, BCM modification rule, a fixed network architecture, and patterned visual input 8.9~8.10 : the neurophysiological basis for the theory 8.11~8.13 : the information processing activities carried out by model neurons in the visual system (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/ Dynamics – Phase Space Phase space a space in which all possible states of a system are represented, with each possible state of the system corresponding to one unique point in the phase space In BCM theory, plane is interesting An physical example : Newton’s 2nd law (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

Trajectories in Phase Space Fixed points Equilibrium states of thermodynamic system Limit cycle Periodic motion (oscillator) (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

Conservative and Dissipative Systems Properties of phase space Trajectories in phase space are unique No intersection Collections of neighboring points obey certain invariance conditions A theorem of Cauchy’s Liouville’s theorem (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/ Summary Synaptic Plasticity Cell Death Use-Dependent Changes in Synaptic Efficiency Models of Synaptic Modification Feature Selectivity Stability : BCM theory Information Processing in the Visual System Outline of the Chapter Dynamics Phase Space Trajectories in Phase Space (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/

(C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/ QnA What is the main model to discuss in this chapter? BCM theory (C) 2009, SNU Biointelligence Lab, http://bi.snu.ac.kr/