BIOLOGICAL NEURONAL NETWORKS AS DETERMINISTIC DYNAMICAL SYSTEMS Eleonora Catsigeras Universidad de la República Uruguay

Slides:



Advertisements
Similar presentations
Jürgen Klüver Information Technologies and Educational Processes
Advertisements

A brief introduction to neuronal dynamics Gemma Huguet Universitat Politècnica de Catalunya In Collaboration with David Terman Mathematical Bioscience.
Learning in Neural and Belief Networks - Feed Forward Neural Network 2001 년 3 월 28 일 안순길.
A model of one biological 2-cells complex Akinshin A.A., Golubyatnikov V.P. Sobolev Institute of Mathematics SB RAS, Bukharina T.A., Furman D.P. Institute.
MATHEMATICAL MODELS OF SPIKE CODES AS DETERMINISTIC DYNAMICAL SYSTEMS Eleonora Catsigeras Universidad de la República Uruguay Neural Coding Montevideo.
Action Potentials and Limit Cycles Computational Neuroeconomics and Neuroscience Spring 2011 Session 8 on , presented by Falk Lieder.
5/16/2015Intelligent Systems and Soft Computing1 Introduction Introduction Hebbian learning Hebbian learning Generalised Hebbian learning algorithm Generalised.
Artificial neural networks:
Presented by Suganya Karunakaran Reduction of Spike Afterdepolarization by Increased Leak Conductance Alters Interspike Interval Variability Fernando R.
Biological and Artificial Neurons Michael J. Watts
Artificial Neural Networks - Introduction -
Basic Models in Theoretical Neuroscience Oren Shriki 2010 Synaptic Dynamics 1.
Marseille, Jan 2010 Alfonso Renart (Rutgers) Jaime de la Rocha (NYU, Rutgers) Peter Bartho (Rutgers) Liad Hollender (Rutgers) Néstor Parga (UA Madrid)
Artificial Neural Networks - Introduction -
Introduction to Mathematical Methods in Neurobiology: Dynamical Systems Oren Shriki 2009 Modeling Conductance-Based Networks by Rate Models 1.
Neuronal excitability from a dynamical systems perspective Mike Famulare CSE/NEUBEH 528 Lecture April 14, 2009.
Stable Propagation of Synchronous Spiking in Cortical Neural Networks Markus Diesmann, Marc-Oliver Gewaltig, Ad Aertsen Nature 402: Flavio Frohlich.
Introduction to chaotic dynamics
Effects of Excitatory and Inhibitory Potentials on Action Potentials Amelia Lindgren.
1 Class #27 Notes :60 Homework Is due before you leave Problem has been upgraded to extra-credit. Probs and are CORE PROBLEMS. Make sure.
How does the mind process all the information it receives?
AN INTERACTIVE TOOL FOR THE STOCK MARKET RESEARCH USING RECURSIVE NEURAL NETWORKS Master Thesis Michal Trna
Part I: Single Neuron Models BOOK: Spiking Neuron Models, W. Gerstner and W. Kistler Cambridge University Press, 2002 Chapters 2-5 Laboratory of Computational.
Dyskretne i niedyskretne modele sieci neuronów Winfried Just Department of Mathematics, Ohio University Sungwoo Ahn, Xueying Wang David Terman Department.
The McCulloch-Pitts Neuron. Characteristics The activation of a McCulloch Pitts neuron is binary. Neurons are connected by directed weighted paths. A.
Neural Networks (NN) Ahmad Rawashdieh Sa’ad Haddad.
Lecture 09 Clustering-based Learning
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Biological Modeling of Neural Networks Week 3 – Reducing detail : Two-dimensional neuron models Wulfram Gerstner EPFL, Lausanne, Switzerland 3.1 From Hodgkin-Huxley.
Basal Ganglia. Involved in the control of movement Dysfunction associated with Parkinson’s and Huntington’s disease Site of surgical procedures -- Deep.
DIGITAL IMAGE PROCESSING Dr J. Shanbehzadeh M. Hosseinajad ( J.Shanbehzadeh M. Hosseinajad)
Lecture 3: linearizing the HH equations HH system is 4-d, nonlinear. For some insight, linearize around a (subthreshold) resting state. (Can vary resting.
1 Dynamical System in Neuroscience: The Geometry of Excitability and Bursting پيمان گيفانی.
Hebbian Coincidence Learning
Neural Networks and Fuzzy Systems Hopfield Network A feedback neural network has feedback loops from its outputs to its inputs. The presence of such loops.
Multiple attractors and transient synchrony in a model for an insect's antennal lobe Joint work with B. Smith, W. Just and S. Ahn.
Neural codes and spiking models. Neuronal codes Spiking models: Hodgkin Huxley Model (small regeneration) Reduction of the HH-Model to two dimensions.
Simplified Models of Single Neuron Baktash Babadi Fall 2004, IPM, SCS, Tehran, Iran
Systems Biology ___ Toward System-level Understanding of Biological Systems Hou-Haifeng.
”When spikes do matter: speed and plasticity” Thomas Trappenberg 1.Generation of spikes 2.Hodgkin-Huxley equation 3.Beyond HH (Wilson model) 4.Compartmental.
A Geodesic Method for Spike Train Distances Neko Fisher Nathan VanderKraats.
Introduction: Brain Dynamics Jaeseung Jeong, Ph.D Department of Bio and Brain Engineering, KAIST.
Synchronization in complex network topologies
Artificial Neural Networks Students: Albu Alexandru Deaconescu Ionu.
Biological Neural Network & Nonlinear Dynamics Biological Neural Network Similar Neural Network to Real Neural Networks Membrane Potential Potential of.
Biological Modeling of Neural Networks Week 4 – Reducing detail - Adding detail Wulfram Gerstner EPFL, Lausanne, Switzerland 3.1 From Hodgkin-Huxley to.
Chapter 3. Stochastic Dynamics in the Brain and Probabilistic Decision-Making in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning.
It’s raining outside; want to go to the pub? It’s dry outside; want to go to the pub? Sure; I’ll grab the umbrella. What, are you insane? I’ll grab the.
Asymptotic behaviour of blinking (stochastically switched) dynamical systems Vladimir Belykh Mathematics Department Volga State Academy Nizhny Novgorod.
Neural Synchronization via Potassium Signaling. Neurons Interactions Neurons can communicate with each other via chemical or electrical synapses. Chemical.
From LIF to HH Equivalent circuit for passive membrane The Hodgkin-Huxley model for active membrane Analysis of excitability and refractoriness using the.
Where are we? What’s left? HW 7 due on Wednesday Finish learning this week. Exam #4 next Monday Final Exam is a take-home handed out next Friday in class.
Dimension Review Many of the geometric structures generated by chaotic map or differential dynamic systems are extremely complex. Fractal : hard to define.
Biointelligence Laboratory, Seoul National University
NEURONAL DYNAMICS 2: ACTIVATION MODELS
Synaptic Dynamics: Unsupervised Learning
Introduction to chaotic dynamics
Computational models of epilepsy
Dayan Abbot Ch 5.1-4,9.
OCNC Statistical Approach to Neural Learning and Population Coding ---- Introduction to Mathematical.
Introduction to chaotic dynamics
Learning Precisely Timed Spikes
Volume 40, Issue 6, Pages (December 2003)
Linking Memories across Time via Neuronal and Dendritic Overlaps in Model Neurons with Active Dendrites  George Kastellakis, Alcino J. Silva, Panayiota.
Volume 36, Issue 5, Pages (December 2002)
H.Sebastian Seung, Daniel D. Lee, Ben Y. Reis, David W. Tank  Neuron 
Yann Zerlaut, Alain Destexhe  Neuron 
Synaptic integration.
Teaching Recurrent NN to be Dynamical Systems
Recurrent neuronal circuits in the neocortex
Presentation transcript:

BIOLOGICAL NEURONAL NETWORKS AS DETERMINISTIC DYNAMICAL SYSTEMS Eleonora Catsigeras Universidad de la República Uruguay MEDYFINOL Punta del Este. Uruguay. Dic. 2008

NERVOUS SYSTEMS OF n NEURONS WITH UP TO 2n(n-1) SYNAPSIS: modelled as a DETERMINISTIC DYNAMICAL SYSTEM. highly COMPLEX: n ~ 10 exp(12) cells NON-LINEAR each cell has a THRESHOLD for producing SPIKES System of n cells may have LIMIT CYCLES, CHAOTIC ATTRACTORS.

NERVOUS SYSTEMS OF n NEURONS WITH UP TO 2n(n-1) SYNAPSIS: modelled as a DETERMINISTIC DYNAMICAL SYSTEM. highly COMPLEX: n ~ 10 exp(12) cells NON-LINEAR each cell has a THRESHOLD for producing SPIKES System of n cells may have LIMIT CYCLES, CHAOTIC ATTRACTORS. EACH CELL DIFFERENTIAL EQUATION Hodgkin-Huxley model (1952) particularly Integrate and fire type (Stein-French-Holden 1972) Relaxation dV/dt = F(V), F >0, F’ < 0. POTENTIAL INCREASING WITH TIME: a THRESHOLD LEVEL TO PRODUCE one SPIKE the (n-1) SYNAPSIS connections with other cells (for each of n cells): positive (excitatory) or negative (inhibitory) jump (SYNAPSIS).

In green: Evolution of the system while not firing. A line from backwards to front, seen like a point due to perspective. In blue: Firing of a neuron. A line from the front faces to the paralell backward faces. In red: Negative synapses. Reduction of the voltage of other neurons not fired. Front faces 1, 2 and 3: Threshold levels of neurons. Backward faces: Zero levels of voltage of the neurons.

For n neurons: dynamics in a n- dimensional cube. G = First return map to the backward faces of the cube. F= G o G = Second return map. F k = 2k-th. return map.

In blue: Atoms of generation k of the return map F In yellow: Atoms of an extension of F. Any map perturbed from F has its atoms in the blue and yellow regions. In red: the discontinuity lines of F.

F is piecewise continuous (discontinuity (n-2)- dimensional surfaces). F is contractive in each continuous piece (with a well chosen metric in the (n-1) dimensional dominium of F). This is due to inhibitory synapsis hypothesis. F has the separation property: Atoms of the same generation are pairwise disjoint, so there is a positive minimum distance between them (if the neurons are not very different).

THEOREM 1 (Budelli-Catsigeras-Rovella): Contractive piecewise continuous maps F in n -1 ≥ 2 dimensions that have the separation property generically exhibit persistent limits cycles (i.e. a periodic attractors that persists under small perturbations of the map F). COROLLARY: Generic networks of n ≥ 3 inhibitory neurons have persistent periodic behaviours (up to many periodic attractors (limit cycles), and of finite but “unbounded!!!” period).

PERSISTENCE OF LIMIT CYCLES: They are structurable stable: Persist under (small) perturbations of the parameters of the system. Do not persist (but change) under significative perturbations of the parameters Jump from a cycle to other under external excitations (for instance spike train of cells out of the system of n neurons, but synaptically connected to it.) Route to BIFURCATING SYSTEMS: periods INCREASING, to a non generic dynamical system:

THEOREM 2 (Budelli-Catsigeras-Rovella): Contractive piecewise continuous maps F in n-1 ≥ 2 dimensions that have the separation property and do not have a periodic limit cycle exhibit a Cantor set attractor (i.e.non numerable infinite set, inside which dynamics is TOPOLOCIALLY chaotic). COROLLARY: Non generic networks of n ≥ 3 inhibitory neurons are bifurcation from the periodic behavior and exhibit a Cantor set chaotic attractor.

CONCLUSIONS: 1) EXTERIOR SIGNALS DO CHANGE THE BEHAVIOR (spike train codes) OF THE SYSTEM of n neurons, and allow: categorize the inputs between large number of possibilities (different limit cycles) if the system has n neurons (n ~ 10 exp 12), __________________________________________________________________ 2) Period of spike train codes are theoretically as large as needed (finite but UNBOUNDED) so, in practice (not assympthotically) they may be VIRTUALLY chaotic. Long periods of LIMIT CYCLES OF SPIKE TRAINS allow the system: long term memory functions categorize many different inputs have a scenario of many (finitely many but a large number) of equilibrium states. __________________________________________________________________

CONCLUSIONS: 3) INSIGNIFICATIVE PERTURBATIONS OF THE SYSTEM DO NOT CHANGE THE NUMBER NOR THE CHARACTERISTICS OF SPIKE TRAIN PERIODIC LIMIT CYCLES OF THE SYSTEM. (THE SYSTEM IS STRUCTURABLY STABLE) _________________________________________________________________ 4) SIGNIFICATIVE CHANGES IN THE PARAMETERS OF THE SYSTEMS for instance: some decreasing in the number of neurons, or in the number of synapsis, DO CHANGE the quantity, characteristics, size of its basins, and periods of the limit cycles of spike trains. __________________________________________________________________