Summary Presentation of Cortical Computing with Memrisitve Nanodevices Authored by Greg S. Snider Hewlett-Packard Laboratories Published Winter 2008, SciDAC.

Slides:



Advertisements
Similar presentations
Introduction to Neural Networks
Advertisements

NEURAL NETWORKS Biological analogy
Thinking Like A Human – With Memristors
Neural Network I Week 7 1. Team Homework Assignment #9 Read pp. 327 – 334 and the Week 7 slide. Design a neural network for XOR (Exclusive OR) Explore.
Artificial Neural Network
 What Do Neurons Have to Do With Psychology?  How Do Neurons Communicate?  How Can Neurons Produce Complex Processes?  How is the Nervous System.
Artificial Neural Networks - Introduction -
Artificial Intelligence (CS 461D)
Artificial Neural Networks ECE 398BD Instructor: Shobha Vasudevan.
September 14, 2010Neural Networks Lecture 3: Models of Neurons and Neural Networks 1 Visual Illusions demonstrate how we perceive an “interpreted version”
CSE 153Modeling Neurons Chapter 2: Neurons A “typical” neuron… How does such a thing support cognition???
How does the mind process all the information it receives?
Cognitive Neuroscience How do we connect cognitive processes in the mind with physical processes in the brain?
Neurons & Neuroanatomy What are the characteristics of neurons important for Cognitive Neuroscience? What is the brain structure important for CogNeuro?
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Traffic Sign Recognition Using Artificial Neural Network Radi Bekker
1 Introduction to Artificial Neural Networks Andrew L. Nelson Visiting Research Faculty University of South Florida.
MSE 2400 EaLiCaRA Spring 2015 Dr. Tom Way
Chapter 14: Artificial Intelligence Invitation to Computer Science, C++ Version, Third Edition.
Data Mining and Neural Networks Danny Leung CS157B, Spring 2006 Professor Sin-Min Lee.
Artificial Neural Nets and AI Connectionism Sub symbolic reasoning.
IE 585 Introduction to Neural Networks. 2 Modeling Continuum Unarticulated Wisdom Articulated Qualitative Models Theoretic (First Principles) Models Empirical.
ARTIFICIAL NEURAL NETWORKS. Introduction to Neural Networks.
Artificial Neural Network Yalong Li Some slides are from _24_2011_ann.pdf.
NEURAL NETWORKS FOR DATA MINING
Cognition, Brain and Consciousness: An Introduction to Cognitive Neuroscience Edited by Bernard J. Baars and Nicole M. Gage 2007 Academic Press Chapter.
LINEAR CLASSIFICATION. Biological inspirations  Some numbers…  The human brain contains about 10 billion nerve cells ( neurons )  Each neuron is connected.
Artificial Neural Networks. The Brain How do brains work? How do human brains differ from that of other animals? Can we base models of artificial intelligence.
1 Introduction to Neural Networks And Their Applications.
Introduction to Artificial Intelligence (G51IAI) Dr Rong Qu Neural Networks.
Neural Networks II By Jinhwa Kim. 2 Neural Computing is a problem solving methodology that attempts to mimic how human brain function Artificial Neural.
Features of Biological Neural Networks 1)Robustness and Fault Tolerance. 2)Flexibility. 3)Ability to deal with variety of Data situations. 4)Collective.
Neural Networks Steven Le. Overview Introduction Architectures Learning Techniques Advantages Applications.
Soft Computing Lecture 8 Using of perceptron for image recognition and forecasting.
Features of Biological Neural Networks 1)Robustness and Fault Tolerance. 2)Flexibility. 3)Ability to deal with variety of Data situations. 4)Collective.
Artificial Intelligence & Neural Network
Aim of neuromorphic engineering: o Design and construct physical models of biological neural networks that replicate:  robust computation  adaptability.
© SEMINAR ON ARTIFICIAL NEURAL NETWORK AND ITS APPLICATIONS By Mr. Susant Kumar Behera Mrs. I. Vijaya.
Over-Trained Network Node Removal and Neurotransmitter-Inspired Artificial Neural Networks By: Kyle Wray.
Introduction to Neural Networks Introduction to Neural Networks Applied to OCR and Speech Recognition An actual neuron A crude model of a neuron Computational.
Artificial Neural Networks Chapter 4 Perceptron Gradient Descent Multilayer Networks Backpropagation Algorithm 1.
Dr.Abeer Mahmoud ARTIFICIAL INTELLIGENCE (CS 461D) Dr. Abeer Mahmoud Computer science Department Princess Nora University Faculty of Computer & Information.
NEURAL NETWORKS LECTURE 1 dr Zoran Ševarac FON, 2015.
Introduction to Neural Networks Freek Stulp. 2 Overview Biological Background Artificial Neuron Classes of Neural Networks 1. Perceptrons 2. Multi-Layered.
Artificial Intelligence Methods Neural Networks Lecture 1 Rakesh K. Bissoondeeal Rakesh K.
COMPUTATIONAL INTELLIGENCE
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
CSC321: Neural Networks Lecture 1: What are neural networks? Geoffrey Hinton
Where are we? What’s left? HW 7 due on Wednesday Finish learning this week. Exam #4 next Monday Final Exam is a take-home handed out next Friday in class.
1 Azhari, Dr Computer Science UGM. Human brain is a densely interconnected network of approximately neurons, each connected to, on average, 10 4.
March 31, 2016Introduction to Artificial Intelligence Lecture 16: Neural Network Paradigms I 1 … let us move on to… Artificial Neural Networks.
Fundamental ARTIFICIAL NEURAL NETWORK Session 1st
Neural Networks.
Artificial Intelligence (CS 370D)
Real Neurons Cell structures Cell body Dendrites Axon
CSE 473 Introduction to Artificial Intelligence Neural Networks
Dr. Unnikrishnan P.C. Professor, EEE
Introduction to Neural Networks And Their Applications
Convolutional Neural Networks
شبکه عصبی تنظیم: بهروز نصرالهی-فریده امدادی استاد محترم: سرکار خانم کریمی دانشگاه آزاد اسلامی واحد شهرری.
Binary Decision Diagrams
OVERVIEW OF BIOLOGICAL NEURONS
XOR problem Input 2 Input 1
Information Processing in Motor Learning
Effects of Excitatory and Inhibitory Potentials on Action Potentials
ARTIFICIAL NEURAL networks.
Introduction to Neural Network
Machine Learning.
Summary Presentation of Cortical Computing with Memrisitve Nanodevices
Presentation transcript:

Summary Presentation of Cortical Computing with Memrisitve Nanodevices Authored by Greg S. Snider Hewlett-Packard Laboratories Published Winter 2008, SciDAC Review Presented by: Joseph Lee Greathouse

Overview of Topics Quick refresher on real neurons Reminder of artificial neural networks Memristors Memristor-based neural circuits “Cortical Computing” 2

Neurons are nervous system cells 3 Neuron body receives signals from other neurons Synapse is connection point between neurons Synapse can be electrical or chemical “All-or-none” principle

More detailed makeup of a neuron 4

Artificial Neural Networks Computational model that simulates real neurons Inputs send signals through hidden layer Hidden layer weighs inputs and gives outputs based on those inputs This yields actions akin to neurons 5

Artificial Neural Net Example Artificial Neural Networks can be used to do full-fledged computations This perceptron example requires designer to know a truth table. Would like to have a circuit that trains itself based on examples 6

Pattern Recognition ANN 7 “Neurons” “Synapses” Pattern Excitatory inputs Inhibitory inputs Categorization

Memristors Passive two-terminal devices Basically: Variable resistance as a function of voltage previously applied 8

Memristor Learning Behavior 9

Utilizing Memristors for ANN Synapses ANNs can use memristors as artificial synapses Resistance changes signal strength between input & output neurons Memristors allow learning to take place utilizing only two terminals 10

Artificial neurons as a circuit 11 Two inputs (inhibitory/excitatory) Two outputs (inhibitory/excitatory) Some calculation core Example of this as a computational neuron with memristors

Building circuit on silicon Lay out circuit to use multiple metal layers Each neuron circuit fabbed in regular CMOS 12

Layout of an entire neural network Build entire cortex structure using Neurons (boxes/circuits), axons & dendrites (wires), and synapses (memristors/wire crossings). 13

Neural circuitry doing pattern recognition 14

Cortical Computing "People confuse these kinds of networks with neural networks," … But neural networks - the previous best hope for creating an artificial brain - are software working on standard computing hardware. "What we're aiming for is actually a change in architecture," -- from “Memristor minds: The future of artificial intelligence” 15