Extracting Time and Space Scales with Feedback and Nonlinearity André Longtin Physics + Cellular and Molecular Medicine CENTER FOR NEURAL DYNAMICS UNIVERSITY.

Slides:



Advertisements
Similar presentations
Introduction to Neural Networks
Advertisements

What is the neural code? Puchalla et al., What is the neural code? Encoding: how does a stimulus cause the pattern of responses? what are the responses.
Important requirements for JAR: 1.Absolute value of the difference in frequency less than 20 Hz 2. Mixing of signals 3. Variation in mixing ratio 4. Modulation.
Biological Modeling of Neural Networks: Week 9 – Coding and Decoding Wulfram Gerstner EPFL, Lausanne, Switzerland 9.1 What is a good neuron model? - Models.
Sensorimotor Transformations Maurice J. Chacron and Kathleen E. Cullen.
Neural Network of the Cerebellum: Temporal Discrimination and the Timing of Responses Michael D. Mauk Dean V. Buonomano.
Spike Train Statistics Sabri IPM. Review of spike train  Extracting information from spike trains  Noisy environment:  in vitro  in vivo  measurement.
A model for spatio-temporal odor representation in the locust antennal lobe Experimental results (in vivo recordings from locust) Model of the antennal.
Computational neuroethology: linking neurons, networks and behavior Mark E. Nelson Beckman Institute Univ. of Illinois, Urbana-Champaign.
Electrosensory data acquisition and signal processing strategies in electric fish Mark E. Nelson Beckman Institute Univ. of Illinois, Urbana-Champaign.
LFPs 1: Spectral analysis Kenneth D. Harris 11/2/15.
Synchrony in Neural Systems: a very brief, biased, basic view Tim Lewis UC Davis NIMBIOS Workshop on Synchrony April 11, 2011.
Neurophysics Part 1: Neural encoding and decoding (Ch 1-4) Stimulus to response (1-2) Response to stimulus, information in spikes (3-4) Part 2: Neurons.
Impact of Correlated inputs on Spiking Neural Models Baktash Babadi Baktash Babadi School of Cognitive Sciences PM, Tehran, Iran PM, Tehran, Iran.
What is the language of single cells? What are the elementary symbols of the code? Most typically, we think about the response as a firing rate, r(t),
Introduction: Neurons and the Problem of Neural Coding Laboratory of Computational Neuroscience, LCN, CH 1015 Lausanne Swiss Federal Institute of Technology.
NOISE and DELAYS in NEUROPHYSICS Andre Longtin Center for Neural Dynamics and Computation Department of Physics Department of Cellular and Molecular Medicine.
1 3. Spiking neurons and response variability Lecture Notes on Brain and Computation Byoung-Tak Zhang Biointelligence Laboratory School of Computer Science.
1 Eigenmannia: Glass Knife Fish A Weakly Electric Fish Electrical organ discharges (EODs) – Individually fixed between 250 and 600 Hz –Method of electrolocation.
Part II: Population Models BOOK: Spiking Neuron Models, W. Gerstner and W. Kistler Cambridge University Press, 2002 Chapters 6-9 Laboratory of Computational.
The spatial extent of cortical synchronization: Modulation by internal and external factors Adrian M Bartlett, BA Cog. Sci. Perception & Plasticity Lab.
Neural Coding 4: information breakdown. Multi-dimensional codes can be split in different components Information that the dimension of the code will convey.
Some concepts from Cognitive Psychology to review: Shadowing Visual Search Cue-target Paradigm Hint: you’ll find these in Chapter 12.
For a random variable X with distribution p(x), entropy is given by H[X] = -  x p(x) log 2 p(x) “Information” = mutual information: how much knowing the.
Overview of Neuroscience Tony Bell Helen Wills Neuroscience Institute University of California at Berkeley.
Spike-triggering stimulus features stimulus X(t) multidimensional decision function spike output Y(t) x1x1 x2x2 x3x3 f1f1 f2f2 f3f3 Functional models of.
The Decisive Commanding Neural Network In the Parietal Cortex By Hsiu-Ming Chang ( 張修明 )
Part I: Single Neuron Models BOOK: Spiking Neuron Models, W. Gerstner and W. Kistler Cambridge University Press, 2002 Chapters 2-5 Laboratory of Computational.
Biological Modeling of Neural Networks: Week 15 – Population Dynamics: The Integral –Equation Approach Wulfram Gerstner EPFL, Lausanne, Switzerland 15.1.
Mechanisms for phase shifting in cortical networks and their role in communication through coherence Paul H.Tiesinga and Terrence J. Sejnowski.
Michael P. Kilgard Sensory Experience and Cortical Plasticity University of Texas at Dallas.
Biological Modeling of Neural Networks Week 8 – Noisy input models: Barrage of spike arrivals Wulfram Gerstner EPFL, Lausanne, Switzerland 8.1 Variation.
Large scale models of the brain Institut des Sciences du Mouvement Viktor Jirsa Theoretical Neuroscience Group Anandamohan Ghosh Rolf Kötter Randy McIntosh.
Neural coding (1) LECTURE 8. I.Introduction − Topographic Maps in Cortex − Synesthesia − Firing rates and tuning curves.
Correlation-Induced Oscillations in Spatio-Temporal Excitable Systems Andre Longtin Physics Department, University of Ottawa Ottawa, Canada.
Design constraints for an active sensing system Insights from the Electric Sense Mark E. Nelson Beckman Institute Univ. of Illinois, Urbana-Champaign.
Learning sensorimotor transformations Maurice J. Chacron.
Basic BPM Hardware Theory Jim Steimel. Wall Current Charge in a cylindrical perfectly conducting pipe produces an equal and opposite image charge at the.
Signals CY2G2/SE2A2 Information Theory and Signals Aims: To discuss further concepts in information theory and to introduce signal theory. Outcomes:
The Ring Model of Cortical Dynamics: An overview David Hansel Laboratoire de Neurophysique et Physiologie CNRS-Université René Descartes, Paris, France.
Evolvability and Sensor Evolution University of Birmingham 25 April 2003 Electroreception: Functional, evolutionary and information processing perspectives.
Stochastic Dynamics & Small Networks Farzan Nadim.
Biological Modeling of Neural Networks Week 8 – Noisy output models: Escape rate and soft threshold Wulfram Gerstner EPFL, Lausanne, Switzerland 8.1 Variation.
The Function of Synchrony Marieke Rohde Reading Group DyStURB (Dynamical Structures to Understand Real Brains)
Circadian Rhythms 안용열 ( 물리학과 ). Index Intro - What is the circadian rhythm? Mechanism in reality How can we understand it?  Nonlinear dynamics –Limit.
What is the neural code?. Alan Litke, UCSD What is the neural code?
Andre Longtin Physics Department University of Ottawa Ottawa, Canada Effects of Non-Renewal Firing on Information Transfer in Neurons.
Oscillatory Models of Hippocampal Activity and Memory Roman Borisyuk University of Plymouth, UK In collaboration with.
Neural Networks with Short-Term Synaptic Dynamics (Leiden, May ) Misha Tsodyks, Weizmann Institute Mathematical Models of Short-Term Synaptic plasticity.
Biological Neural Network & Nonlinear Dynamics Biological Neural Network Similar Neural Network to Real Neural Networks Membrane Potential Potential of.
The brain at rest. Spontaneous rhythms in a dish Connected neural populations tend to synchronize and oscillate together.
Effect of Small-World Connectivity on Sparsely Synchronized Cortical Rhythms W. Lim (DNUE) and S.-Y. KIM (LABASIS)  Fast Sparsely Synchronized Brain Rhythms.
Biological Modeling of Neural Networks Week 7 – Variability and Noise: The question of the neural code Wulfram Gerstner EPFL, Lausanne, Switzerland 7.1.
Neuronal Dynamics: Computational Neuroscience of Single Neurons
Ch 9. Rhythms and Synchrony 9.7 Adaptive Cooperative Systems, Martin Beckerman, Summarized by M.-O. Heo Biointelligence Laboratory, Seoul National.
Energy, Stereoscopic Depth, and Correlations. Molecules Levels of Information Processing in the Nervous System 0.01  m Synapses 1m1m Neurons 100 
From LIF to HH Equivalent circuit for passive membrane The Hodgkin-Huxley model for active membrane Analysis of excitability and refractoriness using the.
Biological Modeling of Neural Networks Week 10 – Variability and Noise: The question of the neural code Wulfram Gerstner EPFL, Lausanne, Switzerland 10.1.
The Neural Code Baktash Babadi SCS, IPM Fall 2004.
Biological Modeling of Neural Networks Week 11 – Variability and Noise: Autocorrelation Wulfram Gerstner EPFL, Lausanne, Switzerland 11.1 Variation of.
Effects of noisy adaptation on neural spiking statistics Tilo Schwalger,Benjamin Lindner, Karin Fisch, Jan Benda Max-Planck Institute for the Physics of.
3) determine motion and sound perceptions.
Volume 30, Issue 2, Pages (May 2001)
Volume 36, Issue 5, Pages (December 2002)
Thomas Akam, Dimitri M. Kullmann  Neuron 
Yann Zerlaut, Alain Destexhe  Neuron 
Volume 32, Issue 1, Pages (October 2001)
Feedforward, Feedback and Response Variability
Jan Benda, André Longtin, Leonard Maler  Neuron 
Rapid Neocortical Dynamics: Cellular and Network Mechanisms
Presentation transcript:

Extracting Time and Space Scales with Feedback and Nonlinearity André Longtin Physics + Cellular and Molecular Medicine CENTER FOR NEURAL DYNAMICS UNIVERSITY OF OTTAWA Funding by NSERC, CIHR, PREA

Processing of spatio-temporal signals Processing of spatio-temporal signals Global Feedback + common noise:  oscillations Global Feedback + common noise:  oscillations Spatial scale for feedback and input Spatial scale for feedback and input Envelope processing for narrowband in time Envelope processing for narrowband in time Information resonances Information resonances Coincidence transforms for synchronous firing Coincidence transforms for synchronous firing Short term Plasticity and information processing Short term Plasticity and information processing Overview

Research Program: Stochastic neural network driven by Stochastic input in space and time Experimental Theoretical

Relevance to this group: What nonlinearity (if any) supports patterns or computations ?

HIGHER BRAIN AREA I HIGHER BRAIN AREA II THALAMUS RECEPTORS PHYSICAL STIMULI

Brain Diagram by Arab philosopher Avicenna (circa 1300) Five ventricles: common sense, imagination, judging, second imagination (composing/combining images), memory. ( University Library, Cambridge ) From Da Vinci’s notes

Courtesy W. Ellis (1991) Electrosensory lateral line lobe (ELL) Courtesy N. Berman and L. Maler, J. Exp. Biol., 1999

Electrosensory Lateral Line Lobe (ELL) Electroreceptors Higher Brain Electrosensory Input Amplitude Modulation (AM) Krahe and Gabbiani (2004) Nat. Neurosci.Rev. 5:13-23 Electric Organ Discharge (EOD) afferents The electric sense

Temporal Characteristics: Spatial Characteristics: Harmonic “local” “global” Broadband (noise) Chacron, et al., Nature, Frequency tuning is highly correlated with spatial frequency - Tuning for harmonics or broadband signals are qualitatively the same

Weakly Electric Fish: main negative feedback loop Weakly Electric Fish: main negative feedback loop ELL Pyramidal Cells: the first stage of sensory processing

Prey Stimuli Prey (bug) excites a fraction of the electroreceptors: Local stimulation

Communication Stimuli Communication calls between fish stimulate the whole body: Global Stimulation

Oscillation Mechanism (Doiron, Chacron, Bastian, Longtin, Maler, Nature 2003) Local Stimuli : applied heterogeneously in space: No stimulus-induced correlations. Global Stimuli : acts homogenously in space (strong spatial correlations). Correlated activity and delay cause “waves” of inhibition

Electrosensory Circuitry Sodium channel blocker can open the feedback loop.

Network Model – Global Stimuli To mimic communication stimuli we apply the external stimulus to all neurons equally. Autocorrelation Histogram

Experimental Verification Doiron, Chacron, Maler, Longtin and Bastian, Nature 42, 539 (2003) ISI HistogramAutocorrelation controlblockrecover

Correlated Stimuli in Experiments Dipole 1 Dipole 2 Dipole 3 Dipole 4 Each dipole emits an intrinsic noise  i (t), and global source,  G (t). Their relative strengths is c, i.e. the covariance between dipoles.

Integrate-and-fire dynamics y

Linear Response Consider the spike train from the i th neuron in our network,. Assuming weak inputs, the Fourier transform of the spike train is A(  intrinsic frequency response of the noisy neuron. X i (w): Fourier transform of input (external + feedback) to neuron i. (1)

POWER SPECTRUM

Single Neuron Power Spectrum vs percentage of common noise (c) For an infinite network: (Input-output sync) (spike-spike sync.)

Fokker-Planck analysis on noisy Leaky Integrate-and-fire Neurons + Delays+ Spatial Input Doiron, Lindner, Longtin, Bastian and Maler, Phys. Rev. Lett. 93, (2004) Linear Fluctuation Theory: needs noise.

Input-output coherence for delayed feedback network (global feedback)

Coherence function: Correlation coefficient (in the frequency domain) between two signals, X and Y Response: spike trainStimulus: - narrowband stimulus (linear) - envelope of narrowband stimulus (non-linear)

Network of stochastic Perfect IF’s with + and - global delayed feedback S(t) is the stimulus Chacron, Longtin, Maler, Phys.Rev.E (2005)

Network of Perfect IF’s with global feedback: Information theory Coherence = | H(f)| 2 P ss /P xx

INFORMATION RESONANCE (Chacron, Longtin, Maler, PRE 2005) G<0 G=0 Experimental DATA !!

Introducing… Spatial scale for feedback Spatial scale for feedback Spatial scale for noise Spatial scale for noise  Two regimes with respect to gamma oscillations gamma oscillations

In linear response, only the ratio of length scales matters (Hutt, Sutherland, Longtin, submitted)

GLOBAL IN SPACE NARROWBAND IN TIME: NARROWBAND IN TIME: 2 TIME SCALES 2 TIME SCALES

EOD amplitude EOD

Hey guys EOD amplitude EOD

EOD amplitude EOD From: E. W. Tan et al, Behav. Brain Res., 164:83-92 (2005) Most probable population size 3-5 fish Average  f in black (white) waters: Day: 35.3 (54.1) Hz Night: 54.6 (65.8) Hz

P-units (primary receptors) Feed forward: - P-units respond as linear encoders

- global stimulation: linear response to narrowband signal and its low frequency envelope - Envelope response is absent under local stimulation Pyramidal Cells

Middleton, Longtin, Benda, Maler, PNAS (2006)

input output - Generation of envelope signal is likely due to spike threshold nonlinearity - Output spike train is phase- locked to fast oscillation and modulated at lower frequencies Middleton, Harvey-Girard, Maler, Longtin, Phys. Rev. E. (2006) MECHANISM

transfer function input signal output signal (rectification)

signalsSpectral composition time frequency

Network instead of single cell

Stochastic Envelope Gating (and not SR! See Middleton et al., PRE 2006)

Leaky Integrate-and-Fire (LIF) neuron: Mean firing rate: where

GLOBAL SPATIAL SIGNALS EXTRACTING EXTRACTING HIGH FREQUENCY CHIRPS FROM LOWER FREQUENCY BEATS “SYNC-DESYNC CODE”

Context: electrocommunication Male-male or female-female call causes synchronization of receptors Male-male or female-female call causes synchronization of receptors Male-female or female-male call causes desynchronization of receptors Male-female or female-male call causes desynchronization of receptors (Benda, Longtin, Maler, Neuron 2006)

Encoding a modulatory signal

Coincidence transforms… Middleton, Longtin, Benda, Maler (submitted)

Short-term Plasticity

Broadband Coding Depression dominates Facilitation dominates

-Gamma rhythms for global correlated inputs - Gamma strength proportional to correlation - Spatial feedback can assess spatial correlation of input - Information resonances with delayed feedback - Envelope generation due to spike threshold nonlinearity - Envelope generation is dependent on mean bias and noise

Intrinsic noise can gate a signal competing with envelope Plasticity: paradoxical effects on coding Importance of spatiotemporal statistics of input

Brent Doiron Maurice Chacron Jason MiddletonCarlo LaingEric Harvey-GirardJohn Lewis Jan Benda Benjamin Lindner Len Maler & André Longtin Joe Bastian Connie Sutherland Axel Hutt

COHERENCE AND STOCHASTIC RESONANCE WITH DELAYED FEEDBACK Morse and Longtin, Phys. Lett. A (2006)

MULTIPLE RESONANCES (fixed driving frequency)

The analytic signal: The Hilbert transform: 90 o phaseshift Mapping of a time varying signal onto a 2D phase plane Allows for the definition of phase and amplitude variables

- Ovoid Cells are high-pass - Ovoid spike trains are coherent with narrowband signals (blue) and their envelopes (red) - Subthreshold voltage shows no coherence with signal envelope

Courtesy R. Krahe and F. Gabbiani, Nat. Neurosci. Rev. (2004) Electric Fields Courtesy G. Hupe and J. Lewis (2005) Apteronotus Leptorhynchus