Computational Modeling of Cognitive Activity Prof. Larry M. Manevitz Course Slides: 2012.

Slides:



Advertisements
Similar presentations
Introduction to Neural Networks 2. Overview  The McCulloch-Pitts neuron  Pattern space  Limitations  Learning.
Advertisements

Slides from: Doug Gray, David Poole
Learning in Neural and Belief Networks - Feed Forward Neural Network 2001 년 3 월 28 일 안순길.
Artificial Neural Networks (1)
Phantom Limb Phenomena. Hand movement observation by individuals born without hands: phantom limb experience constrains visual limb perception. Funk M,
Neural Network I Week 7 1. Team Homework Assignment #9 Read pp. 327 – 334 and the Week 7 slide. Design a neural network for XOR (Exclusive OR) Explore.
Artificial Neural Network
Artificial Neural Networks
Linear Learning Machines  Simplest case: the decision function is a hyperplane in input space.  The Perceptron Algorithm: Rosenblatt, 1956  An on-line.
NNs Adaline 1 Neural Networks - Adaline L. Manevitz.
Slide 1 EE3J2 Data Mining EE3J2 Data Mining Lecture 15: Introduction to Artificial Neural Networks Martin Russell.
Artificial Neural Networks Artificial Neural Networks are (among other things) another technique for supervised learning k-Nearest Neighbor Decision Tree.
Linear Learning Machines  Simplest case: the decision function is a hyperplane in input space.  The Perceptron Algorithm: Rosenblatt, 1956  An on-line.
Learning via Neural Networks L. Manevitz All rights reserved.
Neural Network Computing Lecture no.1. All rights reserved L. Manevitz Lecture 12 McCullogh-Pitts Neuron The activation of a McCullogh-Pitts Neuron is.
Neural Networks An Introduction.
Neural Networks Lab 5. What Is Neural Networks? Neural networks are composed of simple elements( Neurons) operating in parallel. Neural networks are composed.
NEURAL NETWORKS Introduction
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
1 Introduction to Artificial Neural Networks Andrew L. Nelson Visiting Research Faculty University of South Florida.
Machine Learning. Learning agent Any other agent.
Neural Networks AI – Week 21 Sub-symbolic AI One: Neural Networks Lee McCluskey, room 3/10
Presentation on Neural Networks.. Basics Of Neural Networks Neural networks refers to a connectionist model that simulates the biophysical information.
1 Mehran University of Engineering and Technology, Jamshoro Department of Electronic, Telecommunication and Bio-Medical Engineering Neural Networks Mukhtiar.
Artificial Neural Nets and AI Connectionism Sub symbolic reasoning.
Explorations in Neural Networks Tianhui Cai Period 3.
NEURAL NETWORKS FOR DATA MINING
LINEAR CLASSIFICATION. Biological inspirations  Some numbers…  The human brain contains about 10 billion nerve cells ( neurons )  Each neuron is connected.
Artificial Neural Networks. The Brain How do brains work? How do human brains differ from that of other animals? Can we base models of artificial intelligence.
L. Manevitz U. Haifa 1 Neural Networks: Capabilities and Examples L. Manevitz Computer Science Department HIACS Research Center University of Haifa.
CS 478 – Tools for Machine Learning and Data Mining Perceptron.
Introduction to Neural Networks Introduction to Neural Networks Applied to OCR and Speech Recognition An actual neuron A crude model of a neuron Computational.
Ten MC Questions taken from the Text, slides and described in class presentation. COSC 4426 AJ Boulay Julia Johnson.
Cognitive Neuroscience 4e Lecture Slides Gazzaniga, Ivry, Mangun © 2014, W.W. Norton & Company, Inc.
Artificial Neural Networks Chapter 4 Perceptron Gradient Descent Multilayer Networks Backpropagation Algorithm 1.
COMP53311 Other Classification Models: Neural Network Prepared by Raymond Wong Some of the notes about Neural Network are borrowed from LW Chan’s notes.
Perceptrons Michael J. Watts
Artificial Intelligence CIS 342 The College of Saint Rose David Goldschmidt, Ph.D.
Artificial Intelligence Methods Neural Networks Lecture 3 Rakesh K. Bissoondeeal Rakesh K. Bissoondeeal.
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Prepared by: Akash Agarwal
Intro. ANN & Fuzzy Systems Lecture 3 Basic Definitions of ANN.
CS621 : Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 20: Neural Net Basics: Perceptron.
INTRODUCTION TO NEURAL NETWORKS 2 A new sort of computer What are (everyday) computer systems good at... and not so good at? Good at..Not so good at..
Introduction to the Basic Principles of Machine Learning
Classification of models
Multilayer Perceptrons
Fall 2004 Perceptron CS478 - Machine Learning.
Learning in Neural Networks
Recognition of biological cells – the beginning of study
A I (Artificial Intelligence)
Other Classification Models: Neural Network
slides created by Leon Barrett
What is an ANN ? The inventor of the first neuro computer, Dr. Robert defines a neural network as,A human brain like system consisting of a large number.
Dr. Unnikrishnan P.C. Professor, EEE
Wed June 12 Goals of today’s lecture. Learning Mechanisms
Introduction to Neural Networks And Their Applications
Prof. Carolina Ruiz Department of Computer Science
Computational Modeling of Cognitive Activity
XOR problem Input 2 Input 1
Learning via Neural Networks
Neural Networks and Deep Learning
Pattern Recognition & Machine Learning
CS 621 Artificial Intelligence Lecture /10/05 Prof
Lecture 02: Perceptron By: Nur Uddin, Ph.D.
ARTIFICIAL NEURAL networks.
Introduction to Neural Network

Deep Neural Networks as Scientific Models
Prof. Carolina Ruiz Department of Computer Science
Presentation transcript:

Computational Modeling of Cognitive Activity Prof. Larry M. Manevitz Course Slides: 2012

Aim of Course: To view some of the methods and results of Cognitive and Brain Modeling – What is it good for? – What does it replace? Aim of Course: To understand how machine learning methods could help understand cognition and Brain Function

Some Cognitive Tasks Memory – Declarative – Procedural – Associative Decision Making Pattern Identification Language Speech Reading …

What is the brain? What is cognition? – We can think of brain activity as a computation. – Can we do “reverse engineering”? – Can we explain activity? Many approaches – Physiological Explanations – Computational Explanations – Cognitive Explanations

Related Fields, Related Methods? Neurophysiology – Cell Structure – System Biology Cognitive Psychology – Psychophysical Experiments  Important Tools  fMRI  EEG  Others …

We have several tools from CS that can help us – Successfully model cognitive activity – Successfully explore activity in vivo (i.e. in a person…)

What tools are appropriate?

Basic Structure of Neural System From work of Cajal (as opposed to Golgi), the neural system is separated into discrete cells. So we need to understand at least – Computational aspect of separate cells – Computational aspect of network of cells

Let’s start with the simplest model. The neural system is known to be cellular. That means there is not continuous connections (like an electric wire) but discrete elements.

Examples of Neurons

Neuron Stains

Let’s start in McCullough Pitts. Want to understand how the brain works. Their view: all there is, is Boolean functions. Note: Same view as logicians as old as Boole (1898)

L. Manevitz U. Haifa20 Definitions and History McCullough –Pitts Neuron Perceptron Adaline Linear Separability Multi-Level Neurons Neurons with Loops

L. Manevitz U. Haifa21 Natural versus Artificial Neuron Natural NeuronMcCullough Pitts Neuron

L. Manevitz U. Haifa22 Sample Feed forward Network (No loops) Weights Input Output Wji Vik F(  wji xj