Basic Models in Neuroscience Oren Shriki 2010 Associative Memory 1

Associative Memory in Neural Networks Original work by John Hopfield (1982). The model is based on a recurrent network with stable attractors. 2

The Basic Idea Memory patterns are stored as stable attractors of a recurrent network. Each memory pattern has a basin of attraction in the phase space of the network. 3

4

Information Storage The information is stored in the pattern of synaptic interactions. 5

Energy Function The dynamics lead to one of the local minima of the energy function, which are the stored memories. In some models the dynamics are governed by an energy function 6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

Important properties of the model Content Addressable Memory (CAM) - Access to memory is based on the content and not an address. Error correction – The network “corrects” the neurons which are inconsistent with the memory pattern. 40

The Mathematical Model 41

Binary Networks We will use binary neurons: (-1) means ‘inactive’ and (+1) means ‘active’. The dynamics are given by: Input from within the network External input 42

Stability Condition for a Neuron The condition for a neuron to remain with the same activity is that its current activity and its current input have the same sign: 43

Energy Function If the external inputs are constant the network may reach a stable state, but this is not guaranteed (the attractors may be limit cycles and the network may even be chaotic). When the recurrent connections are symmetric and there is no self coupling we can write an energy function, such that at each time step the energy decreases or does not change. Under these conditions, the attractors of the network are stable fixed points, which are the local minima of the energy function. 44

Energy Function Mathematically, the conditions are: The energy is given by: And one can prove that: 45

Setting the Connections Our goal is to embed in the network stable stead-states which will form the memory patterns. To ensure the existence of such states, we will choose symmetric connections, that guarantee the existence of an energy function. 46

Setting the Connections We will denote the P memory patterns by: For instance, for a network with 4 neurons and 3 memory patterns, the patterns can be: 47

Setting the Connections Hopfield proposed the following rule: The correlation among neurons across memory patterns A normalizatio n factor 48

Choosing the Patterns to Store To enhance the capacity of the network we will choose patterns that are not similar to one another. In the Hopfield model, (-1) and (+1) are chosen with equal probabilities. In addition, there are no correlations among the neurons within a pattern and there are no correlations among patterns. 49

Memory Capacity Storing more and more patterns adds more constraints to the pattern of connections. There is a limit on the number of stable patterns that can be stored. In practice, a some point a new pattern will not be stable even if we set the network to this pattern. 50

Memory Capacity If we demand that at every pattern all neurons will be stable, we obtain: 51

Memory Capacity What happens to the system if we store more patterns? Initially, the network will still function as associative memory, although the local minima will differ from the memory states by a few bits. At some point, the network will abruptly stop functioning as associative memory. 52

Adding “Temperature” It is also interesting to consider the case of stochastic dynamics. We add noise to the neuronal dynamics in analogy with the temperature in physical systems. Physiologically, the noise can arise from random fluctuations in the synaptic release, delays in nerve conduction, fluctuations in ionic channels and more. 53

Adding “Temperature” h P(s ) 54

Adding “Temperature” h P(s ) 55

Adding “Temperature” Adding temperature has computational advantages: It drives the system out of spurious local minima, such that only the deep volleys in the energy landscape affect the dynamics. One approach is to start the system at high temperature and then gradually cool it down and allow it to stabilize (Simulated annealing). In general, increasing the temperature reduces the storage capacity but can prevent undesirable attractors. 56

Associative Memory - Summary The Hopfield model is an example of connecting between dynamical concepts (attractors and basins of attraction) and functional concepts (associative memory). The work pointed out the relation between neural networks and statistical physics and attracted many physicists to the field. 57

Associative Memory - Summary Over the years, models that are based on the same principles but are more biologically plausible were developed. Attractor networks are still useful in modelling a wide variety of phenomena. 58

References Hopfield, 1982 –Hopfield, J. (1982). Neural networks and physical systems with emergent collective computational properties. Proceedings of the National Academy of Sciences of the USA, 79: Hopfield, 1984 –Hopfield, J. (1984). Neurons with graded response have collective computational properties like those of two-state neurons. Proceedings of the National Academy of Sciences of the USA, 81:

מקורות Amit, 1989 –Amit, D. Modeling Brain Function. Cambridge University Press, 1989 Hertz et al., 1991 –John Hertz, Anders Krogh, Richard G. Palmer. Introduction to the Theory of Neural Computation. Addison-Wesley,

Associative Memory of Sensory Objects – Theory and Experiments Misha Tsodyks, Dept of Neurobiology, Weizmann Institute, Rehovot, Israel Joint work with Son Preminger and Dov Sagi 61

Non Friends …… Experiments - Terminology Friends 62

Experiment – Terminology (cont.) Basic Friend or Non-Friend task (FNF task) –Face images of faces are flashed for 200 ms –for each image the subject is asked whether the image is a friend image (learned in advance) or not. –50% of images are friends, 50% non-friends, in random order; each friend is shown the same number of times. No feedback is given F/NF ? 200ms F/NF ? ? 200ms 63

Morph Sequence 1… 20 Source (friend) Target (unfamiliar) …40…60…80100… Experiment – Terminology (cont.) 64

Two Pairs: Source and Target Pair 1 Pair 2 65

Subject HL (blue-green spectrum) days 1-18 FNF-Grad on Pair 1 Bin number Number of ‘Friend’ responses 66