The Neuron Computational Cognitive Neuroscience Randall O’Reilly.

Slides:



Advertisements
Similar presentations
Introduction to Neural Networks
Advertisements

Neural Network I Week 7 1. Team Homework Assignment #9 Read pp. 327 – 334 and the Week 7 slide. Design a neural network for XOR (Exclusive OR) Explore.
For Wednesday Read chapter 19, sections 1-3 No homework.
Review key ideas from Chapters 5 & 6. Sensory processing starts with transduction…t Transduction = transformation of physical energy into a neural code.
Dark Rooms and Chinese Brains Philosophy of Mind BRENT SILBY Unlimited (UPT)
Introduction to Training and Learning in Neural Networks n CS/PY 399 Lab Presentation # 4 n February 1, 2001 n Mount Union College.
Pandemonium Model of Mind. Pandemonium? Chaos? Doesn’t pandemonium imply chaotic? – Yes, but ignore that The “pandemonium” term comes from the arena of.
B.Macukow 1 Lecture 3 Neural Networks. B.Macukow 2 Principles to which the nervous system works.
Nerve Cells and Electrical Signaling
Artificial Spiking Neural Networks
Introduction: Neurons and the Problem of Neural Coding Laboratory of Computational Neuroscience, LCN, CH 1015 Lausanne Swiss Federal Institute of Technology.
Functional Link Network. Support Vector Machines.
Biological and Artificial Neurons Michael J. Watts
Cerebellar Spiking Engine: EDLUT simulator UGR with input from other partners.  Motivation 1. Simulation of biologically plausible spiking neural structures.
Marseille, Jan 2010 Alfonso Renart (Rutgers) Jaime de la Rocha (NYU, Rutgers) Peter Bartho (Rutgers) Liad Hollender (Rutgers) Néstor Parga (UA Madrid)
An introduction to: Deep Learning aka or related to Deep Neural Networks Deep Structural Learning Deep Belief Networks etc,
CSE 153 Cognitive ModelingChapter 3 Representations and Network computations In this chapter, we cover: –A bit about cortical architecture –Possible representational.
Effects of Excitatory and Inhibitory Potentials on Action Potentials Amelia Lindgren.
CSE 153Modeling Neurons Chapter 2: Neurons A “typical” neuron… How does such a thing support cognition???
How does the mind process all the information it receives?
COGNITIVE SCIENCE 17 The Electric Brain Part 1 Jaime A. Pineda, Ph.D.
Cognitive Neuroscience How do we connect cognitive processes in the mind with physical processes in the brain?
Nervous Systems. What’s actually happening when the brain “learns” new information? 3. I’m too old to learn anything new anymore; I hire people do that.
Neurons & Neuroanatomy What are the characteristics of neurons important for Cognitive Neuroscience? What is the brain structure important for CogNeuro?
Sequential circuit design
Computational Cognitive Neuroscience Lab Today: First session.
Introducing Climate Prediction Find out what happens to radiation from the Sun when it reaches the Earth and what this means for the temperature of the.
Mind, Brain & Behavior Wednesday January 15, 2003.
H exam 1 H CH6: flight in locusts H locust flight H flight system H sensory integration during flight H summary PART 3: MOTOR STRATEGIES #13: FLIGHT IN.
Connectionism. ASSOCIATIONISM Associationism David Hume ( ) was one of the first philosophers to develop a detailed theory of mental processes.
Spiking Neural Networks and You Brains and games.
Lecture 10: Mean Field theory with fluctuations and correlations Reference: A Lerchner et al, Response Variability in Balanced Cortical Networks, q-bio.NC/ ,
Chapter 37 Nervous System.
Slide 1 Estimating Performance Below the National Level Applying Simulation Methods to TIMSS Fourth Annual IES Research Conference Dan Sherman, Ph.D. American.
Cognition, Brain and Consciousness: An Introduction to Cognitive Neuroscience Edited by Bernard J. Baars and Nicole M. Gage 2007 Academic Press Chapter.
PSY105 Neural Networks 1/5 1. “Patterns emerge”. π.
An informal description of artificial neural networks John MacCormick.
Week 2 Membrane Potential and Nernst Equation. Key points for resting membrane potential Ion concentration across the membrane E ion : Equilibrium potential.
Announcements:. Last lecture 1.Organization of the nervous system 2.Introduction to the neuron Today – electrical potential 1.Generating membrane potential.
1 CMSC 671 Fall 2001 Class #25-26 – Tuesday, November 27 / Thursday, November 29.
Family Weekend Dr. Davis in Office or Lab 10-11:30 am
The Neuron. QOTD Christina Noll Is "mind reading" possible? A. Yes B. No C. Possibly in the future (See movie: Strange Days, 1995)
”When spikes do matter: speed and plasticity” Thomas Trappenberg 1.Generation of spikes 2.Hodgkin-Huxley equation 3.Beyond HH (Wilson model) 4.Compartmental.
INTRODUCTION OF INTEGRATE AND FIRE MODEL Single neuron modeling By Pooja Sharma Research Scholar LNMIIT-Jaipur.
CHAPTER ONE CELL MEMBRANE STRUCTURE. CHAPTER TWO MEMBRANE TRANSPORT.
Multi-Valued Neurons and Multilayer Neural Network based on Multi-Valued Neurons MVN and MLMVN 1.
Learning Objectives Students should be able to: Define resting membrane potential and how it is generated. Relate Nernst Equilibrium potential for sodium,
Structure and functions of cells of the nervous system Chapter 2.
Neuronal Dynamics: Computational Neuroscience of Single Neurons
Neuroscience Chapter 3: The Neuronal Membrane at Rest 高毓儒
Dialog Processing with Unsupervised Artificial Neural Networks Andrew Richardson Thomas Jefferson High School for Science and Technology Computer Systems.
UW BIO UNIT 1 LECTURE 5 THE SYNAPSE & CELL COMMUNICATION.
The Action Potential. Four Signals Within the Neuron  Input signal – occurs at sensor or at points where dendrites are touched by other neurons.  Integration.
IJCNN, July 27, 2004 Extending SpikeProp Benjamin Schrauwen Jan Van Campenhout Ghent University Belgium.
Memory. Hopfield Network Content addressable Attractor network.
Neural Communication Signaling within a neuron. Postsynaptic Potentials n E m changes dendrites & soma n Excitatory: + n Inhibitory: - ~
April 5, 2016Introduction to Artificial Intelligence Lecture 17: Neural Network Paradigms II 1 Capabilities of Threshold Neurons By choosing appropriate.
Introduction to the TLearn Simulator n CS/PY 231 Lab Presentation # 5 n February 16, 2005 n Mount Union College.
an introduction to: Deep Learning
Dialog Processing with Unsupervised Artificial Neural Networks
ECE 471/571 - Lecture 17 Back Propagation.
What is an artificial neural network?
MCB Exam 2 Review Session
Artificial neurons Nisheeth 10th January 2019.
H.Sebastian Seung, Daniel D. Lee, Ben Y. Reis, David W. Tank  Neuron 
Dialog Processing with Unsupervised Artificial Neural Networks
THE PHYSIOLOGICAL APPROACH
The Network Approach: Mind as a Web
An introduction to: Deep Learning aka or related to Deep Neural Networks Deep Structural Learning Deep Belief Networks etc,
UNIT 3 – BIOLOGICAL BASES OF BEHAVIOR
Presentation transcript:

The Neuron Computational Cognitive Neuroscience Randall O’Reilly

The Basic Unit of Cognition!?

Detector Model Is it really all just detection?

Pandemonium! (Oliver Selfridge)

Feature Demons 1.Vertical Line: | 2.Horizontal Line: -- 3.Up-Right Diagonal: / 4.Up-Left Diagonal: \

Cognitive Demons 5.T: 1,2 6.V: 3,4 7.A: 2,3,4 8.K: 1,3,4

Testing..

Ooops..

Pandemonium Summary Maybe you can see how collective action of many detectors, organized hierarchically, could achieve more complex cognition? But detection needs to be a lot more sophisticated..

Neurons in the Dark Neurons live in the dark! “Hear” an incredible jumble of inputs. Have absolutely no idea what is going on in the real world outside their little area of the brain.. All of this is very counterintuitive given that we tend to think of neurons as communicating in full English sentences about the weather, etc.. Neurons only get spikes, not words!

The Social Network Neurons depend on network of “trust” built up over a long time period – only way they can overcome the jumble in the dark..

The Social Network How do neurons ever know if senders change what they are encoding? How does the brain ever change?

Back to the Detector Model How do we simulate on a computer?

Overall Strategy Neurons are electrical systems, can be described using basic electrical equations. Use these equations to simulate on a computer. Need a fair bit of math to get a full working model (more here than most chapters), but you only really need to understand conceptually.

The Tug-of-War How strongly each guy pulls: I = g (E-Vm) g = how many input channels are open E = driving potential (pull down for inhibition, up for excitation) Vm = the “flag” – reflects net balance between two sides

Relative Balance..

Equations..

Equilibrium This is just the balance of forces..

The Full Story..

Input Conductances and Weights Just add ‘em up (and take the average) Key concept is weight: how much unit listens to given input Weights determine what the neuron detects Everything you know is encoded in your weights..

Generating Output If Vm gets over threshold, neuron fires a spike. Spike resets membrane potential back to rest. Has to climb back up to threshold to spike again

Rate Code Approximation Brain likes spikes, but rates are great!  Instantaneous and steady – smaller, faster models  But definitely lose several important things  Soln: do it both ways, and see what the diffs are.. Goal: equation that makes good approx of actual spiking rate for same sets of inputs.

Sigmoidal Activation Threshold Saturating Smooth

Rate Code Equations A little bit tricky because Vm doesn’t work. Need to use excitatory conductance – threshold XX1 equation: ge-theta: Tracking Vm timecourse: