-Gaurav Mishra -Pulkit Agrawal. How do neurons work Stimuli  Neurons respond (Excite/Inhibit) ‘Electrical Signals’ called Spikes Spikes encode information.

Slides:



Advertisements
Similar presentations
Introduction to Neural Networks
Advertisements

What is the neural code? Puchalla et al., What is the neural code? Encoding: how does a stimulus cause the pattern of responses? what are the responses.
V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.
Chapter 2.
INTRODUCTION TO Machine Learning ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
Biological Modeling of Neural Networks: Week 9 – Coding and Decoding Wulfram Gerstner EPFL, Lausanne, Switzerland 9.1 What is a good neuron model? - Models.
Neural Network Approach to Modeling the Laser Material-Removal Process By Basem. F. Yousef London, Canada, N6A 5B9 December 2001.
Purpose The aim of this project was to investigate receptive fields on a neural network to compare a computational model to the actual cortical-level auditory.
Spike Train Statistics Sabri IPM. Review of spike train  Extracting information from spike trains  Noisy environment:  in vitro  in vivo  measurement.
Spike Trains Kenneth D. Harris 3/2/2015. You have recorded one neuron How do you analyse the data? Different types of experiment: Controlled presentation.
Neuronal Coding in the Retina and Fixational Eye Movements Christian Mendl, Tim Gollisch Max Planck Institute of Neurobiology, Junior Research Group Visual.
Introduction: Neurons and the Problem of Neural Coding Laboratory of Computational Neuroscience, LCN, CH 1015 Lausanne Swiss Federal Institute of Technology.
Lecture 16 Spiking neural networks
黃文中 Preview 2 3 The Saliency Map is a topographically arranged map that represents visual saliency of a corresponding visual scene. 4.
Test Oct. 21 Review Session Oct 19 2pm in TH201 (that’s here)
Some concepts from Cognitive Psychology to review: Shadowing Visual Search Cue-target Paradigm Hint: you’ll find these in Chapter 12.
Application of Statistical Techniques to Neural Data Analysis Aniket Kaloti 03/07/2006.
Business Minor grade adjustments on Midterm 2 Opportunity to participate in Cognitive Neuroscience and Perception experiment - sign up for Tuesday, Wednesday.
Back-Propagation Algorithm
Efficient Coding of Natural Sounds Grace Wang HST 722 Topic Proposal.
Spike Train decoding Summary Decoding of stimulus from response –Two choice case Discrimination ROC curves –Population decoding MAP and ML estimators.
Introduction to Recurrent neural networks (RNN), Long short-term memory (LSTM) Wenjie Pei In this coffee talk, I would like to present you some basic.
Image Compression Using Neural Networks Vishal Agrawal (Y6541) Nandan Dubey (Y6279)
Face Recognition Using Neural Networks Presented By: Hadis Mohseni Leila Taghavi Atefeh Mirsafian.
Convolutional Neural Networks for Image Processing with Applications in Mobile Robotics By, Sruthi Moola.
Ising Models for Neural Data John Hertz, Niels Bohr Institute and Nordita work done with Yasser Roudi (Nordita) and Joanna Tyrcha (SU) Math Bio Seminar,
Tahereh Toosi IPM. Recap 2 [Churchland and Abbott, 2012]
A Shaft Sensorless Control for PMSM Using Direct Neural Network Adaptive Observer Authors: Guo Qingding Luo Ruifu Wang Limei IEEE IECON 22 nd International.
Presentation on Neural Networks.. Basics Of Neural Networks Neural networks refers to a connectionist model that simulates the biophysical information.
Multi-Layer Perceptrons Michael J. Watts
Explorations in Neural Networks Tianhui Cai Period 3.
Waqas Haider Khan Bangyal. Multi-Layer Perceptron (MLP)
Radial Basis Function Networks:
1 Computational Vision CSCI 363, Fall 2012 Lecture 31 Heading Models.
Neural coding (1) LECTURE 8. I.Introduction − Topographic Maps in Cortex − Synesthesia − Firing rates and tuning curves.
Methods Neural network Neural networks mimic biological processing by joining layers of artificial neurons in a meaningful way. The neural network employed.
Building high-level features using large-scale unsupervised learning Anh Nguyen, Bay-yuan Hsu CS290D – Data Mining (Spring 2014) University of California,
Projects: 1.Predictive coding in balanced spiking networks (Erwan Ledoux). 2.Using Canonical Correlation Analysis (CCA) to analyse neural data (David Schulz).
Human vision Jitendra Malik U.C. Berkeley. Visual Areas.
Image Stabilization by Bayesian Dynamics Yoram Burak Sloan-Swartz annual meeting, July 2009.
Neural Networks Presented by M. Abbasi Course lecturer: Dr.Tohidkhah.
Spatio-temporal saliency model to predict eye movements in video free viewing Gipsa-lab, Grenoble Département Images et Signal CNRS, UMR 5216 S. Marat,
Analysis of spectro-temporal receptive fields in an auditory neural network Madhav Nandipati.
CS 621 Artificial Intelligence Lecture /11/05 Guest Lecture by Prof
Brain-Machine Interface (BMI) System Identification Siddharth Dangi and Suraj Gowda BMIs decode neural activity into control signals for prosthetic limbs.
July 23, BSA, a Fast and Accurate Spike Train Encoding Scheme Benjamin Schrauwen.
Biological Modeling of Neural Networks: Week 10 – Neuronal Populations Wulfram Gerstner EPFL, Lausanne, Switzerland 10.1 Cortical Populations - columns.
Deep Learning Overview Sources: workshop-tutorial-final.pdf
Temporal receptive windows in the brain NBE-E5700 Introduction to Cognitive Neuroscience Gustaf Lönn,
Machine Learning Artificial Neural Networks MPλ ∀ Stergiou Theodoros 1.
The Neural Code Baktash Babadi SCS, IPM Fall 2004.
Stephen V David, William E Vinje, Jack L Gallant J Neurosci, Aug 2004
Unsupervised Learning of Video Representations using LSTMs
Neural Network Architecture Session 2
Convolutional Neural Network
Learning in Neural Networks
Article Review Todd Hricik.
The General Linear Model (GLM): the marriage between linear systems and stats FFA.
Using Artificial Neural Networks and Support Vector Regression to Model the Lyapunov Exponent Adam Maus.
XOR problem Input 2 Input 1
Gaurav Aggarwal, Mark Shaw, Christian Wolf
network of simple neuron-like computing elements
Adaboost for faces. Material
Dynamic Causal Modelling for M/EEG
Volume 55, Issue 3, Pages (August 2007)
Volume 64, Issue 6, Pages (December 2009)
by Khaled Nasr, Pooja Viswanathan, and Andreas Nieder
Christoph Kayser, Nikos K. Logothetis, Stefano Panzeri  Current Biology 
Madhav Nandipati pd. 6 Third Quarter Presentation
Outline Announcement Neural networks Perceptrons - continued
Presentation transcript:

-Gaurav Mishra -Pulkit Agrawal

How do neurons work Stimuli  Neurons respond (Excite/Inhibit) ‘Electrical Signals’ called Spikes Spikes encode information !! (Many Models)

Our Case… Stimuli  Video of Natural Images Response of 12 V1 neurons  #Spikes

Our Data… A movie for each neuron Frames  Down sampled images (16x16) Each frame Image spans twice the receptive field diameter 16ms in duration Known: #Spikes/frame To build a model correlating stimulus and spike count.

Method 1: RNNs Recursive neural networks Composed of feed forward and feed back subnets. Were initially designed for the purpose of controlling nonlinear dynamical systems Source: Hush et al. The Recursive Neural Network and its Application in Control Theory. Computers Elect. Engng. Vol. 19, No. 4, pp , 1993

An exemplary recursive multi-layer perceptron:

Echo State Networks Dynamic neural networks The hidden layer of ESN consists of a single large reservoir with neurons connected to each other randomly.

Using RNNs RNNs have been used for inverse modeling purposes Can handle time series data because of the presence of feed back and delay mechanisms May need to down sample data even further to keep network size manageable.

Results Accuracy: Average: around 50 percent Best Case: 89 percent But does percentage error give the correct picture? No. The correlation coefficient gives a more accurate picture of the performance of the network.

Results Average CC: 0.15

STRF Problem: Stimulus Black Box Spike Rate Concept of ‘Filter’ Space and Time both ! Latency !

Phase Invariance..

The Math of Estimation..

Current Results Using ADABOOST: Accuracy: 34 percent CC: SRTF CC:

References Predicting neural responses during natural vision, S. David, J.Gallant, Computation in neural systems 2005 Wikipedia article on neural coding ( Theunissen et al., Estimating spatial temporal receptive field of auditory and visual neurons from their responses to natural stimuli.Network: Comp Neural Systems 12:289–316. Hush et al. The Recursive Neural Network and its Application in Control Theory. Computers Elect. Engng. Vol. 19, No. 4, pp , 1993 Le Yang, Yanbo Xue. Development of A New Recurrent Neural Network Toolbox (RNN-Tool) ( ng_Xue.pdf) ng_Xue.pdf