Lecture 16 Spiking neural networks

Slides:



Advertisements
Similar presentations
Introduction to Neural Networks
Advertisements

NEU Neural Computing MSc Natural Computation Department of Computer Science University of York.
A Brief Overview of Neural Networks By Rohit Dua, Samuel A. Mulder, Steve E. Watkins, and Donald C. Wunsch.
Introduction to Artificial Neural Networks
Introduction to Training and Learning in Neural Networks n CS/PY 399 Lab Presentation # 4 n February 1, 2001 n Mount Union College.
Neural Network of the Cerebellum: Temporal Discrimination and the Timing of Responses Michael D. Mauk Dean V. Buonomano.
Adaptive Resonance Theory (ART) networks perform completely unsupervised learning. Their competitive learning algorithm is similar to the first (unsupervised)
Analogue to Digital Conversion
Spike Sorting Goal: Extract neural spike trains from MEA electrode data Method 1: Convolution of template spikes Method 2: Sort by spikes features.
Impact of Correlated inputs on Spiking Neural Models Baktash Babadi Baktash Babadi School of Cognitive Sciences PM, Tehran, Iran PM, Tehran, Iran.
Introduction: Neurons and the Problem of Neural Coding Laboratory of Computational Neuroscience, LCN, CH 1015 Lausanne Swiss Federal Institute of Technology.
Soft computing Lecture 6 Introduction to neural networks.
Neural Networks Basic concepts ArchitectureOperation.
November 19, 2009Introduction to Cognitive Science Lecture 20: Artificial Neural Networks I 1 Artificial Neural Network (ANN) Paradigms Overview: The Backpropagation.
Un Supervised Learning & Self Organizing Maps Learning From Examples
COGNITIVE NEUROSCIENCE
Connectionist Modeling Some material taken from cspeech.ucd.ie/~connectionism and Rich & Knight, 1991.
Introduction to Neural Network Justin Jansen December 9 th 2002.
November 5, 2009Introduction to Cognitive Science Lecture 16: Symbolic vs. Connectionist AI 1 Symbolism vs. Connectionism There is another major division.
Chapter Seven The Network Approach: Mind as a Web.
Neural Networks for Information Retrieval Hassan Bashiri May 2005.
Data representation techniques for adaptation Alexandra I. Cristea USI intensive course “Adaptive Systems” April-May 2003.
Neural Networks Lab 5. What Is Neural Networks? Neural networks are composed of simple elements( Neurons) operating in parallel. Neural networks are composed.
CHAPTER 12 ADVANCED INTELLIGENT SYSTEMS © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang.
Machine Learning. Learning agent Any other agent.
Presentation on Neural Networks.. Basics Of Neural Networks Neural networks refers to a connectionist model that simulates the biophysical information.
Cascade Correlation Architecture and Learning Algorithm for Neural Networks.
Introduction to Neural Networks. Neural Networks in the Brain Human brain “computes” in an entirely different way from conventional digital computers.
DIGITAL IMAGE PROCESSING Dr J. Shanbehzadeh M. Hosseinajad ( J.Shanbehzadeh M. Hosseinajad)
Artificial Intelligence Lecture No. 29 Dr. Asad Ali Safi ​ Assistant Professor, Department of Computer Science, COMSATS Institute of Information Technology.
An informal description of artificial neural networks John MacCormick.
IE 585 Associative Network. 2 Associative Memory NN Single-layer net in which the weights are determined in such a way that the net can store a set of.
Artificial Neural Networks An Introduction. What is a Neural Network? A human Brain A porpoise brain The brain in a living creature A computer program.
Neural Networks Steven Le. Overview Introduction Architectures Learning Techniques Advantages Applications.
Soft Computing Lecture 19 Part 2 Hybrid Intelligent Systems.
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 12-1 Chapter 12 Advanced Intelligent Systems.
INTRODUCTION OF INTEGRATE AND FIRE MODEL Single neuron modeling By Pooja Sharma Research Scholar LNMIIT-Jaipur.
Introduction to Neural Networks. Biological neural activity –Each neuron has a body, an axon, and many dendrites Can be in one of the two states: firing.
Neural Network Basics Anns are analytical systems that address problems whose solutions have not been explicitly formulated Structure in which multiple.
From brain activities to mathematical models The TempUnit model, a study case for GPU computing in scientific computation.
Analysis of spectro-temporal receptive fields in an auditory neural network Madhav Nandipati.
Dr.Abeer Mahmoud ARTIFICIAL INTELLIGENCE (CS 461D) Dr. Abeer Mahmoud Computer science Department Princess Nora University Faculty of Computer & Information.
CS 621 Artificial Intelligence Lecture /11/05 Guest Lecture by Prof
November 21, 2013Computer Vision Lecture 14: Object Recognition II 1 Statistical Pattern Recognition The formal description consists of relevant numerical.
Back-propagation network (BPN) Student : Dah-Sheng Lee Professor: Hahn-Ming Lee Date:20 September 2003.
R ECURRENT N EURAL N ETWORKS OR A SSOCIATIVE M EMORIES Ranga Rodrigo February 24,
Perceptrons Michael J. Watts
Neural Networks Si Wu Dept. of Informatics PEV III 5c7 Spring 2008.
Electrophysiology & fMRI. Neurons Neural computation Neural selectivity Hierarchy of neural processing.
Neural Communication: Action Potential Lesson 10.
Network Models (2) LECTURE 7. I.Introduction − Basic concepts of neural networks II.Realistic neural networks − Homogeneous excitatory and inhibitory.
Biological Modeling of Neural Networks: Week 10 – Neuronal Populations Wulfram Gerstner EPFL, Lausanne, Switzerland 10.1 Cortical Populations - columns.
University of Jordan1 Physiology of Synapses in the CNS- L4 Faisal I. Mohammed, MD, PhD.
March 31, 2016Introduction to Artificial Intelligence Lecture 16: Neural Network Paradigms I 1 … let us move on to… Artificial Neural Networks.
Ghent University Backpropagation for Population-Temporal Coded Spiking Neural Networks July WCCI/IJCNN 2006 Benjamin Schrauwen and Jan Van Campenhout.
The Neural Code Baktash Babadi SCS, IPM Fall 2004.
Greater Intensity = Faster Cortical Response These “data” are for illustration only.
Yu Kai 2010/09/27 Journal Club 1. Introduction In sensory cortical areas, neurons are turned to specific stimulus features. In the present paper, the.
Implementing a sequence machine using spiking neurons
Artificial Intelligence (CS 370D)
CSSE463: Image Recognition Day 17
Chapter 12 Advanced Intelligent Systems
XOR problem Input 2 Input 1
CSSE463: Image Recognition Day 17
The Naïve Bayes (NB) Classifier
H.Sebastian Seung, Daniel D. Lee, Ben Y. Reis, David W. Tank  Neuron 
CSSE463: Image Recognition Day 17
ARTIFICIAL NEURAL networks.
The Network Approach: Mind as a Web
Outline Announcement Neural networks Perceptrons - continued
Presentation transcript:

Lecture 16 Spiking neural networks Soft Computing Lecture 16 Spiking neural networks 9.11.2005

Phenomenology of spike generation j threshold -> Spike i Spike reception: EPSP, summation of EPSPs Threshold Spike emission (Action potential) Spike reception: EPSP 9.11.2005

temporal codes The problem of neural coding: Time to first spike after input correlations Phase with respect to oscillation 9.11.2005

Rank Order Coding One possibility takes advantage of the fact that a neuron can be thought of as an analog-delay convertor. It acts somewhat like a capacitance which is progressively charged by an input until it reaches a threshold, at which point it generates an output pulse – the action potential or spike. Such neurons will naturally fire earliest when the input is strong, and will take progressively longer to fire when the input is weaker. In this way, the time at which a neuron fires (its response latency) can be used to code the intensity of the stimulus. However, this sort of code requires knowledge of when the stimulation started, information which is not generally available in the case of the biological visual system. There is, however, a way round this. Consider what happens when several neurons are used in parallel. In this case, even without knowing the precise moment at which the stimulus came on, information can be obtained by looking at the order in which the neurones fire The order of firing of a group of neurons is potentially a very rich source of information about the input pattern 9.11.2005

SpikeNet Is developed for control systems Features of neuron: Feedback from output to inputs for updating of weights At summation of signals take account of frequency of signal Activation function is threshold function Award is used for learning of neuron Inputs is discrete One-layer network from this neurons is able to execute functions which available only for multi layer recurrent networks 9.11.2005

The neural network architecture: SEQAINET (SEQence association and Integration NETwork). 9.11.2005

FPGA – hardware spike neural network for robots 9.11.2005

FPGA – hardware spike neural network for robots (2) 9.11.2005