Dynamical Encoding by Networks of Competing Neuron Groups : Winnerless Competition M. Rabinovich 1, A. Volkovskii 1, P. Lecanda 2,3, R. Huerta 1,2, H.D.I.

Slides:



Advertisements
Similar presentations
Bioinspired Computing Lecture 16
Advertisements

Introduction to Neural Networks 2. Overview  The McCulloch-Pitts neuron  Pattern space  Limitations  Learning.
Modelling and Identification of dynamical gene interactions Ronald Westra, Ralf Peeters Systems Theory Group Department of Mathematics Maastricht University.
MATHEMATICAL MODELS OF SPIKE CODES AS DETERMINISTIC DYNAMICAL SYSTEMS Eleonora Catsigeras Universidad de la República Uruguay Neural Coding Montevideo.
Phase Bursting Rhythms in Inhibitory Rings Matthew Brooks, Robert Clewley, and Andrey Shilnikov Abstract Leech Heart Interneuron Model 3-Cell Inhibitory.
Neural Network of the Cerebellum: Temporal Discrimination and the Timing of Responses Michael D. Mauk Dean V. Buonomano.
Gain control in insect olfaction for efficient odor recognition Ramón Huerta Institute for Nonlinear Science UCSD.
Tuomas Sandholm Carnegie Mellon University Computer Science Department
WINNERLESS COMPETITION PRINCIPLE IN NEUROSCIENCE Mikhail Rabinovich INLS University of California, San Diego ’
Encoding of spatiotemporal patterns in SPARSE networks Antonio de Candia*, Silvia Scarpetta** *Department of Physics,University of Napoli, Italy **Department.
BIOLOGICAL NEURONAL NETWORKS AS DETERMINISTIC DYNAMICAL SYSTEMS Eleonora Catsigeras Universidad de la República Uruguay
The quantum signature of chaos through the dynamics of entanglement in classically regular and chaotic systems Lock Yue Chew and Ning Ning Chung Division.
Reading population codes: a neural implementation of ideal observers Sophie Deneve, Peter Latham, and Alexandre Pouget.
CH12: Neural Synchrony James Sulzer Background Stability and steady states of neural firing, phase plane analysis (CH6) Firing Dynamics (CH7)
Stable Propagation of Synchronous Spiking in Cortical Neural Networks Markus Diesmann, Marc-Oliver Gewaltig, Ad Aertsen Nature 402: Flavio Frohlich.
Dyskretne i niedyskretne modele sieci neuronów Winfried Just Department of Mathematics, Ohio University Sungwoo Ahn, Xueying Wang David Terman Department.
How facilitation influences an attractor model of decision making Larissa Albantakis.
Neural Networks (NN) Ahmad Rawashdieh Sa’ad Haddad.
Itti: CS564 - Brain Theory and Artificial Intelligence. Systems Concepts 1 CS564 - Brain Theory and Artificial Intelligence University of Southern California.
Biologically Inspired Robotics Group,EPFL Associative memory using coupled non-linear oscillators Semester project Final Presentation Vlad TRIFA.
Percolation in Living Neural Networks Ilan Breskin, Jordi Soriano, Tsvi Tlusty, and Elisha Moses Department of Physics of Complex Systems, The Weizmann.
Bump attractors and the homogeneity assumption Kevin Rio NEUR April 2011.
Chaos in Neural Network Theme presentation Cui, Shuoyang 03/08/2005.
Dynamics of Coupled Oscillators-Theory and Applications
Lecture 10: Mean Field theory with fluctuations and correlations Reference: A Lerchner et al, Response Variability in Balanced Cortical Networks, q-bio.NC/ ,
Dynamical network motifs: building blocks of complex dynamics in biological networks Valentin Zhigulin Department of Physics, Caltech, and Institute for.
1 Dynamical System in Neuroscience: The Geometry of Excitability and Bursting پيمان گيفانی.
Deriving connectivity patterns in the primary visual cortex from spontaneous neuronal activity and feature maps Barak Blumenfeld, Dmitri Bibitchkov, Shmuel.
Correlation-Induced Oscillations in Spatio-Temporal Excitable Systems Andre Longtin Physics Department, University of Ottawa Ottawa, Canada.
Synchronization State Between Pre-turbulent Hyperchaotic Attractors G. Vidal H. Mancini Universidad de Navarra.
John Wordsworth, Peter Ashwin, Gabor Orosz, Stuart Townley Mathematics Research Institute University of Exeter.
Lecture 9: Introduction to Neural Networks Refs: Dayan & Abbott, Ch 7 (Gerstner and Kistler, Chs 6, 7) D Amit & N Brunel, Cerebral Cortex 7, (1997)
Multiple attractors and transient synchrony in a model for an insect's antennal lobe Joint work with B. Smith, W. Just and S. Ahn.
Neural codes and spiking models. Neuronal codes Spiking models: Hodgkin Huxley Model (small regeneration) Reduction of the HH-Model to two dimensions.
National Taiwan A Road Sign Recognition System Based on a Dynamic Visual Model C. Y. Fang Department of Information and.
Balancing at the border of instability Luc Moreau, Ghent University Eduardo Sontag, The State University of New Jersey (2003) presented by Helmut Hauser.
The Function of Synchrony Marieke Rohde Reading Group DyStURB (Dynamical Structures to Understand Real Brains)
Michael Arbib CS564 - Brain Theory and Artificial Intelligence, USC, Fall Lecture 19. Systems Concepts 1 Michael Arbib: CS564 - Brain Theory and.
Lecture 21 Neural Modeling II Martin Giese. Aim of this Class Account for experimentally observed effects in motion perception with the simple neuronal.
Synchronization in complex network topologies
Chapter 4. Formal Tools for the Analysis of Brain-Like Structures and Dynamics (1/2) in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots.
Asymptotic behaviour of blinking (stochastically switched) dynamical systems Vladimir Belykh Mathematics Department Volga State Academy Nizhny Novgorod.
Neural Synchronization via Potassium Signaling. Neurons Interactions Neurons can communicate with each other via chemical or electrical synapses. Chemical.
Information encoding and processing via spatio-temporal spike patterns in cortical networks Misha Tsodyks, Dept of Neurobiology, Weizmann Institute, Rehovot,
Dynamics of Perceptual Bistability J Rinzel, NYU w/ N Rubin, A Shpiro, R Curtu, R Moreno Alternations in perception of ambiguous stimulus – irregular…
An Oscillatory Correlation Approach to Scene Segmentation DeLiang Wang The Ohio State University.
Ch 9. Rhythms and Synchrony 9.7 Adaptive Cooperative Systems, Martin Beckerman, Summarized by M.-O. Heo Biointelligence Laboratory, Seoul National.
Biological Modeling of Neural Networks: Week 15 – Fast Transients and Rate models Wulfram Gerstner EPFL, Lausanne, Switzerland 15.1 Review Populations.
From LIF to HH Equivalent circuit for passive membrane The Hodgkin-Huxley model for active membrane Analysis of excitability and refractoriness using the.
Alternating and Synchronous Rhythms in Reciprocally Inhibitory Model Neurons Xiao-Jing Wang, John Rinzel Neural computation (1992). 4: Ubong Ime.
Network Models (2) LECTURE 7. I.Introduction − Basic concepts of neural networks II.Realistic neural networks − Homogeneous excitatory and inhibitory.
Biological Modeling of Neural Networks: Week 10 – Neuronal Populations Wulfram Gerstner EPFL, Lausanne, Switzerland 10.1 Cortical Populations - columns.
Pattern Recognition. What is Pattern Recognition? Pattern recognition is a sub-topic of machine learning. PR is the science that concerns the description.
Bayesian Perception.
An Introduction To The Backpropagation Algorithm.
Ch. 13 A face in the crowd: which groups of neurons process face stimuli, and how do they interact? KARI L. HOFFMANN 2009/1/13 BI, Population Coding Seminar.
Building a scalable neural processing subsystem Joy Bose Supervisors Steve Furber (Amulet Group) Jonathan Shapiro (AI Group) Amulet Group Meeting 30 January.
J. Kubalík, Gerstner Laboratory for Intelligent Decision Making and Control Artificial Neural Networks II - Outline Cascade Nets and Cascade-Correlation.
Biointelligence Laboratory, Seoul National University
Computational models of epilepsy
OCNC Statistical Approach to Neural Learning and Population Coding ---- Introduction to Mathematical.
Volume 66, Issue 6, Pages (June 2010)
Volume 30, Issue 2, Pages (May 2001)
Volume 36, Issue 5, Pages (December 2002)
Uma R. Karmarkar, Dean V. Buonomano  Neuron 
Information Processing by Neuronal Populations Chapter 5 Measuring distributed properties of neural representations beyond the decoding of local variables:
Volume 30, Issue 2, Pages (May 2001)
Intuition for latent factors and dynamical systems.
Shunting Inhibition Modulates Neuronal Gain during Synaptic Excitation
Presentation transcript:

Dynamical Encoding by Networks of Competing Neuron Groups : Winnerless Competition M. Rabinovich 1, A. Volkovskii 1, P. Lecanda 2,3, R. Huerta 1,2, H.D.I. Abarbanel 1,4, and G. Laurent 5 presented by Michael Downes 6 1 Institute for Nonlinear Science, University of California, San Diego, La Jolla, California GNB, E.T.S. de Ingenieria Informatica, Universidad Autonoma de Madrid, Madrid, Spain 3 Instituto de Ciencia de Materiales de Madrid, CSIC Cantoblanco, Madrid, Spain 4 Department of Physics and Marine Physical Laboratory, Scripps Institution of Oceanography, University of California, San Diego, La Jolla, California California Institute of Technology, Division of Biology, MC Pasadena, California Department of Physics, Drexel University, Philadelphia, PA 19104

Introduction Competitive or Winnerless Competition Networks Identity or spatiotemporal coding Identity or spatiotemporal coding Deterministic trajectories : heteroclinic orbits Deterministic trajectories : heteroclinic orbits Connect saddle fixed points or saddle limit cycles Connect saddle fixed points or saddle limit cycles Saddle states correspond to neuron activity Saddle states correspond to neuron activity Separatrices correspond to sequential switching Separatrices correspond to sequential switching

Introduction (cont.) Features of Neural Encoding – Representation of Input Information: Uses both space and time Sensitively depends on stimulus Deterministic and reproducible Robust against noise Observations Suggest Dissipative dynamical system => “forgetfulness” Information represented as transient trajectories

Model and Parameters Neuron Dynamics System of N neurons System of N neurons F[y i (t)] : nonlinear function describing i th neuron dynamics G ij (S) : nonlinear operator describing inhibitory action of j th neuron on i th S(t) :vector-represented stimuli Stimulus acts in 2 ways: Stimulus acts in 2 ways: Excites subset of neurons through S(t) Modifies effective inhibitory connections through G ij (S) Instability in presence of stimulus leads to : Instability in presence of stimulus leads to : Sequence of heteroclinic trajectories Rapid action Robustness against noise Response independent of initial state

Model and Parameters (cont.) Numerical Model 9 Fitzhugh-Nagumo Model neurons with constant stimulus 9 Fitzhugh-Nagumo Model neurons with constant stimulus x(t) : membrane potential y(t) : recovery variable z(t) : synaptic current (included inhibition term) f(x) : nonlinear Fitzhugh-Nagumo neuron dynamics G(x) : inhibition function Asserted when membrane potential is greater than zero Asserted when membrane potential is greater than zero “turns on” inhibitory term g ji = 2 for neurons with inhibitory relationships “turns on” inhibitory term g ji = 2 for neurons with inhibitory relationships

Models and Parameters (cont.)

Results Membrane Potential vs. time for 2 Stimuli S 1 = [0.10,0.15,0.00,0.00,0.15,0.10,0.00,0.00,0.00] S 1 = [0.10,0.15,0.00,0.00,0.15,0.10,0.00,0.00,0.00] S 2 = [0.01,0.03,0.05,0.04,0.06,0.02,0.03,0.05,0.04] S 2 = [0.01,0.03,0.05,0.04,0.06,0.02,0.03,0.05,0.04] Stimulus patterns distinguishable

Model and Parameters Information Encoding Input information solely in inhibitory coupling strength between i and j Input information solely in inhibitory coupling strength between i and j Non-symmetric inhibitory connections lead to closed heteroclinic orbits Non-symmetric inhibitory connections lead to closed heteroclinic orbits Global attractors Change in stimulus => new global attractor in orbit vicinity

Model and Parameters (cont.) Capacity # of different items the network can encode # of different items the network can encode With N neurons: With N neurons: N-1 cyclically equivalent permutation: (1,2,3,4,5)  (2,3,4,5,1) (N-1)! heteroclinic orbits More heteroclinic orbits associated with N-1, N-2, etc. subspaces For Large N,

Conclusion Winnerless Competition model competent to describe data experimental dataWinnerless Competition model competent to describe data experimental data Unique trajectories sensitively dependent on stimulus Unique trajectories sensitively dependent on stimulus Large Encoding Capability Large Encoding Capability

Questions?