Romain Brette Institut de la Vision, Paris Main developers of : Dan Goodman & Marcel Stimberg Neural.

Slides:



Advertisements
Similar presentations
Introduction to Neural Networks 2. Overview  The McCulloch-Pitts neuron  Pattern space  Limitations  Learning.
Advertisements

Introduction to Artificial Neural Networks
Marković Miljan 3139/2011
Phantom Limb Phenomena. Hand movement observation by individuals born without hands: phantom limb experience constrains visual limb perception. Funk M,
Artificial Neural Network
B.Macukow 1 Lecture 3 Neural Networks. B.Macukow 2 Principles to which the nervous system works.
Dan Goodman & Romain Brette Ecole Normale Supérieure Projet Odyssée
Biological and Artificial Neurons Michael J. Watts
A computational paradigm for dynamic logic-gates in neuronal activity Sander Vaus
Basic Models in Theoretical Neuroscience Oren Shriki 2010 Synaptic Dynamics 1.
Cerebellar Spiking Engine: EDLUT simulator UGR with input from other partners.  Motivation 1. Simulation of biologically plausible spiking neural structures.
Romain Brette Computational neuroscience of sensory systems Dynamics of neural excitability.
A Batch-Language, Vector-Based Neural Network Simulator Motivation: - general computer languages (e.g. C) lead to complex code - neural network simulators.
Slides are based on Negnevitsky, Pearson Education, Lecture 8 Artificial neural networks: Unsupervised learning n Introduction n Hebbian learning.
CSE 153Modeling Neurons Chapter 2: Neurons A “typical” neuron… How does such a thing support cognition???
How does the mind process all the information it receives?
AN INTERACTIVE TOOL FOR THE STOCK MARKET RESEARCH USING RECURSIVE NEURAL NETWORKS Master Thesis Michal Trna
Neural Networks Primer Dr Bernie Domanski The City University of New York / CSI 2800 Victory Blvd 1N-215 Staten Island, New York 10314
The McCulloch-Pitts Neuron. Characteristics The activation of a McCulloch Pitts neuron is binary. Neurons are connected by directed weighted paths. A.
Laurent Itti: CS599 – Computational Architectures in Biological Vision, USC Lecture 7: Coding and Representation 1 Computational Architectures in.
1 COMP305. Part I. Artificial neural networks.. 2 The McCulloch-Pitts Neuron (1943). McCulloch and Pitts demonstrated that “…because of the all-or-none.
Parallel Implementation of a Biologically Realistic NeoCortical Simulator E.Courtenay Wilson.
Spike Sorting Algorithm Implemented on FPGA Elad Ilan Asaf Gal Sup: Alex Zviaginstev.
Simulating neural networks with Romain Brette
Biologically-Inspired Neural Nets Modeling the Hippocampus.
1 Introduction to Artificial Neural Networks Andrew L. Nelson Visiting Research Faculty University of South Florida.
Neurons, Neural Networks, and Learning 1. Human brain contains a massively interconnected net of (10 billion) neurons (cortical cells) Biological.
Connectionism. ASSOCIATIONISM Associationism David Hume ( ) was one of the first philosophers to develop a detailed theory of mental processes.
Evolving a Sigma-Pi Network as a Network Simulator by Justin Basilico.
Artificial Neural Network Yalong Li Some slides are from _24_2011_ann.pdf.
Establishing the Equivalence between Recurrent Neural Networks and Turing Machines. Ritesh Kumar Sinha(02d05005) Kumar Gaurav Bijay( )
Cognition, Brain and Consciousness: An Introduction to Cognitive Neuroscience Edited by Bernard J. Baars and Nicole M. Gage 2007 Academic Press Chapter.
Modeling the Calcium Dysregulation Hypothesis of Alzheimer's Disease Júlio de Lima do Rêgo Monteiro, Marcio Lobo Netto, Diego Andina, Javier Ropero Pelaez.
Logical Calculus of Ideas Immanent in Nervous Activity McCulloch and Pitts Deep Learning Fatima Al-Raisi.
Artificial Neural Networks. The Brain How do brains work? How do human brains differ from that of other animals? Can we base models of artificial intelligence.
PSY105 Neural Networks 2/5 2. “A universe of numbers”
NEURAL - FUZZY LOGIC FOR AUTOMATIC OBJECT RECOGNITION.
”When spikes do matter: speed and plasticity” Thomas Trappenberg 1.Generation of spikes 2.Hodgkin-Huxley equation 3.Beyond HH (Wilson model) 4.Compartmental.
1. 2 Preface In the time since the 1986 edition of this book, the world of compiler design has changed significantly 3.
Dan Goodman & Romain Brette Ecole Normale Supérieure Projet Odyssée
Neural Network Basics Anns are analytical systems that address problems whose solutions have not been explicitly formulated Structure in which multiple.
READINGS IN DEEP LEARNING 4 Sep ADMINSTRIVIA New course numbers (11-785/786) are assigned – Should be up on the hub shortly Lab assignment 1 up.
Kirchhoff Institute for Physics Johannes Schemmel Ruprecht-Karls-Universität Heidelberg 1 Accelerated Neuromorphic Hardware : Hybrid Plasticity - The Next.
Basics of Neuromorphic Design Sylvain Saïghi IMS Lab – University of Bordeaux.
From brain activities to mathematical models The TempUnit model, a study case for GPU computing in scientific computation.
Next Generation Domain-Services in PL-Grid Infrastructure for Polish Science Górecki 1,2, Bachniak 1,2, Liput 2, Rauch 1,2, Kitowski 2,3, Pietrzyk 1,2.
Neural Networks Teacher: Elena Marchiori R4.47 Assistant: Kees Jong S2.22
Artificial Neural Networks Chapter 4 Perceptron Gradient Descent Multilayer Networks Backpropagation Algorithm 1.
Brian A clock driven simulator for spiking neural networks in Python.
IE 585 History of Neural Networks & Introduction to Simple Learning Rules.
Keeping the neurons cool Homeostatic Plasticity Processes in the Brain.
Artificial Neural Networks (ANN). Artificial Neural Networks First proposed in 1940s as an attempt to simulate the human brain’s cognitive learning processes.
Spiking Neural Networks Banafsheh Rekabdar. Biological Neuron: The Elementary Processing Unit of the Brain.
Perceptrons Michael J. Watts
CSC321: Neural Networks Lecture 1: What are neural networks? Geoffrey Hinton
IJCNN, July 27, 2004 Extending SpikeProp Benjamin Schrauwen Jan Van Campenhout Ghent University Belgium.
Where are we? What’s left? HW 7 due on Wednesday Finish learning this week. Exam #4 next Monday Final Exam is a take-home handed out next Friday in class.
Many Facets of Hardware Monitoring Konstantin Selyunin Stefan Jakšić Vienna University of Technology Austrian Institute of Technology Joint work with:
1 Azhari, Dr Computer Science UGM. Human brain is a densely interconnected network of approximately neurons, each connected to, on average, 10 4.
Introduction to Connectionism Jaap Murre Universiteit van Amsterdam en Universiteit Utrecht
Building a scalable neural processing subsystem Joy Bose Supervisors Steve Furber (Amulet Group) Jonathan Shapiro (AI Group) Amulet Group Meeting 30 January.
Simulation Environments for Neuroscience Presented by Ali Nadalizadeh – IPM – Summer 2009 به نام خداوند بخشنده مهربان.

Systems Design, Implementation, and Operation
Demonstration of STDP based Neural Networks on an FPGA
Introduction to Neural Network
Active, dynamic, interactive, system
Learning Combinational Logic
Models of the brain hardware
Continuous attractor neural networks (CANNs)
Presentation transcript:

Romain Brette Institut de la Vision, Paris Main developers of : Dan Goodman & Marcel Stimberg Neural simulation in the post-connectionist era

The old neural models McCulloch & Pitts « A logical calculus of the ideas immanent in nervous activity » (1943) binary units (active/inactive) discrete time Why getting rid of time? Motivation = isomorphism with calculus of logical propositions t -> t+1 = inference Earlier models: continuous time Nicolas Rashevsky Outline of a physico-mathematical theory of excitation and inhibition (1933)

The old neural models McCulloch & Pitts « A logical calculus of the ideas immanent in nervous activity » (1943) No time => structural parameters = connection weights and activation threshold => connectionism Learning = modifying weights

Spiking neuron models Input = N spike trains Output = 1 spike train A neuron model is defined by: what happens when a spike is received the condition for spiking what happens when a spike is produced what happens between spikes discrete events continuous dynamics

Spiking neuron models Input = N spike trains Output = 1 spike train => Many more structural parameters! Time is back! « weight » duration + conduction delay etc connectionism X

What do we know about learning for other parameters? Next to nothing! But: about every element of structure is plastic expression of ionic channels properties of ionic channels position of synapsesposition of initiation site conduction delay neurotransmitter release also: plasticity is plastic (meta-plasticity)

The future of neural models Current models: synaptic weights Hebbian learning connectionism post-connectionism everything else plasticity rules for everything else (no time) (time) Future models:

How to simulate post-connectionist models? PROBLEM #1: Flexibility => standardization is a bad idea! 1 PROBLEM #2: Speed and hardware implementation 2

PROBLEM #1: FLEXIBILITY

The spirit of “A simulator should not only save the time of processors, but also the time of scientists” scientist computer Writing code often takes more time than running it Goals: Quick model coding Flexible models are defined by equations (rather than pre-defined) Goodman, D. and R. Brette (2009). The Brian simulator. Front Neurosci doi: /neuro

An example Stimberg M, Goodman DFM, Benichoux V, Brette R (2014).Equation- oriented specification of neural models for simulations. Frontiers Neuroinf, doi: /fninf

Example: synaptic plasticity Stimberg M, Goodman DFM, Benichoux V, Brette R (2014).Equation-oriented specification of neural models for simulations. Frontiers Neuroinf, doi: /fninf

PROBLEM #2: SPEED & HARDWARE

Brian code generation User provided Python code Targets Automatically generated code PC GPU Spinnaker FPGA Android smartphone

Code generation

Brian runtime mode

Brian standalone mode

Generated files

The future of Implementation of various targets PC clusters GPU Spinnaker FPGA Android smartphone

Thank you! Dan Goodman Marcel Stimberg Latest publication Stimberg M, Goodman DFM, Benichoux V, Brette R (2014).Equation-oriented specification of neural models for simulations. Frontiers Neuroinf, doi: /fninf