ECE 488 Computer Engineering Design I Fall 2005 Hau Ngo Ming Zhang.

Slides:



Advertisements
Similar presentations
NEURAL NETWORKS Biological analogy
Advertisements

Neural Network I Week 7 1. Team Homework Assignment #9 Read pp. 327 – 334 and the Week 7 slide. Design a neural network for XOR (Exclusive OR) Explore.
Adaptive Resonance Theory (ART) networks perform completely unsupervised learning. Their competitive learning algorithm is similar to the first (unsupervised)
Artificial Intelligence (CS 461D)
S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2008 Shreekanth Mandayam ECE Department Rowan University.
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
1 Artificial Neural Networks: An Introduction S. Bapi Raju Dept. of Computer and Information Sciences, University of Hyderabad.
Carla P. Gomes CS4700 CS 4700: Foundations of Artificial Intelligence Prof. Carla P. Gomes Module: Intro Neural Networks (Reading:
S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks / Fall 2004 Shreekanth Mandayam ECE Department Rowan University.
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2010 Shreekanth Mandayam ECE Department Rowan University.
Artificial Neural Networks (ANNs)
S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks ECE /ECE Fall 2010 Shreekanth Mandayam ECE Department Rowan University.
S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks / Spring 2002 Shreekanth Mandayam Robi Polikar ECE Department.
Presenting: Itai Avron Supervisor: Chen Koren Characterization Presentation Spring 2005 Implementation of Artificial Intelligence System on FPGA.
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Artificial neural networks:
Machine Learning. Learning agent Any other agent.
Neurons, Neural Networks, and Learning 1. Human brain contains a massively interconnected net of (10 billion) neurons (cortical cells) Biological.
MSE 2400 EaLiCaRA Spring 2015 Dr. Tom Way
Artificial Intelligence Lecture No. 28 Dr. Asad Ali Safi ​ Assistant Professor, Department of Computer Science, COMSATS Institute of Information Technology.
Invitation to Computer Science 5th Edition
Chapter 14: Artificial Intelligence Invitation to Computer Science, C++ Version, Third Edition.
Artificial Neural Nets and AI Connectionism Sub symbolic reasoning.
Introduction to Neural Networks. Neural Networks in the Brain Human brain “computes” in an entirely different way from conventional digital computers.
Introduction to Artificial Neural Network Models Angshuman Saha Image Source: ww.physiol.ucl.ac.uk/fedwards/ ca1%20neuron.jpg.
Artificial Neural Networks. Applied Problems: Image, Sound, and Pattern recognition Decision making  Knowledge discovery  Context-Dependent Analysis.
1 Machine Learning The Perceptron. 2 Heuristic Search Knowledge Based Systems (KBS) Genetic Algorithms (GAs)
NEURAL NETWORKS FOR DATA MINING
LINEAR CLASSIFICATION. Biological inspirations  Some numbers…  The human brain contains about 10 billion nerve cells ( neurons )  Each neuron is connected.
Artificial Neural Networks. The Brain How do brains work? How do human brains differ from that of other animals? Can we base models of artificial intelligence.
Artificial Neural Networks An Introduction. What is a Neural Network? A human Brain A porpoise brain The brain in a living creature A computer program.
Features of Biological Neural Networks 1)Robustness and Fault Tolerance. 2)Flexibility. 3)Ability to deal with variety of Data situations. 4)Collective.
Neural Networks Steven Le. Overview Introduction Architectures Learning Techniques Advantages Applications.
Features of Biological Neural Networks 1)Robustness and Fault Tolerance. 2)Flexibility. 3)Ability to deal with variety of Data situations. 4)Collective.
Language Project.  Neural networks have a large appeal to many researchers due to their great closeness to the structure of the brain, a characteristic.
Artificial Intelligence & Neural Network
Mehdi Ghayoumi MSB rm 132 Ofc hr: Thur, a Machine Learning.
CS 478 – Tools for Machine Learning and Data Mining Perceptron.
CHAPTER 15 Neural Computing: The Basics. n Artificial Neural Networks (ANN) n Mimics How Our Brain Works n Machine Learning.
Lecture 5 Neural Control
Image Source: ww.physiol.ucl.ac.uk/fedwards/ ca1%20neuron.jpg
Dr.Abeer Mahmoud ARTIFICIAL INTELLIGENCE (CS 461D) Dr. Abeer Mahmoud Computer science Department Princess Nora University Faculty of Computer & Information.
Back-propagation network (BPN) Student : Dah-Sheng Lee Professor: Hahn-Ming Lee Date:20 September 2003.
Artificial Intelligence Methods Neural Networks Lecture 1 Rakesh K. Bissoondeeal Rakesh K.
Artificial Intelligence CIS 342 The College of Saint Rose David Goldschmidt, Ph.D.
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Where are we? What’s left? HW 7 due on Wednesday Finish learning this week. Exam #4 next Monday Final Exam is a take-home handed out next Friday in class.
“Principles of Soft Computing, 2 nd Edition” by S.N. Sivanandam & SN Deepa Copyright  2011 Wiley India Pvt. Ltd. All rights reserved. CHAPTER 2 ARTIFICIAL.
1 Azhari, Dr Computer Science UGM. Human brain is a densely interconnected network of approximately neurons, each connected to, on average, 10 4.
How do you get here?
Michael Holden Faculty Sponsor: Professor Gordon H. Dash.
Electrical Engineering
Learning in Neural Networks
Artificial Intelligence (CS 370D)
Artificial neural networks:
Real Neurons Cell structures Cell body Dendrites Axon
Dr. Unnikrishnan P.C. Professor, EEE
CSSE463: Image Recognition Day 17
Introduction to Neural Networks And Their Applications
Artificial Intelligence
OVERVIEW OF BIOLOGICAL NEURONS
CSSE463: Image Recognition Day 17
Artificial Intelligence Lecture No. 28
Pattern Recognition & Machine Learning
CSSE463: Image Recognition Day 17
CSSE463: Image Recognition Day 17
CSSE463: Image Recognition Day 17
ARTIFICIAL NEURAL networks.
Introduction to Neural Network
Presentation transcript:

ECE 488 Computer Engineering Design I Fall 2005 Hau Ngo Ming Zhang

Agenda Administrative Discussion Administrative Discussion –Syllabus –Schedule etc. Project Discussion Project Discussion Milestone 1 (due today) Milestone 1 (due today) Grouping Grouping

Administrative Discussion

Project Discussion Brain Characteristics Brain Characteristics –Approximately neurons and interconnections –A neuron receives, processes and transmits electrochemical signals neuron axons axon synapses dendrites......

Project Discussion Artificial Neural Network Artificial Neural Network –Biologically inspired networks –Massively parallel architecture –Dense arrangements of interconnections and simple computing elements x0x0 x1x1 x N-1  Net j f (.) yjyj w j0 w j1 w j(N-1)  f(.)

Project Discussion Adaptive Resonance Theory (ART) based Self-Organizing Neural Network Adaptive Resonance Theory (ART) based Self-Organizing Neural Network –Capable of rapid stable learning of recognition categories –Example: Categorize people based on: Categorize people based on: –Age –Gender –Height –Hair color –Eye color –Ethnicity, etc.

Project Discussion The learning and categorization algorithm of Binary-ART Network The learning and categorization algorithm of Binary-ART Network –For each input and a category j, calculate choice function T j –Chosen category is indexed by J so that –For the chosen category, calculate the match function ρ’ –If chosen category meet vigilance criterion (ρ’≥ ρ), learning the new input by updating weight W J –Else, select the next category calculate the match function ρ’ –If no match is found, new category is created

Project Discussion Category Weight Input Calculation I = Since this is the first input, the input form the first category/group Weight if this category is W 1 = I (1) W 1 = ρ = 0.4

Project Discussion Category Weight Input Calculation (1) W 1 = ρ = 0.4 I = Calculate choice function with respect to Category 1 Choose max. choice function Calculate match function for W 1 ρ’< ρ  create a new category/group (2) W 2 =

Project Discussion Category Weight Input Calculation (1) W 1 = ρ = 0.4 I = Calculate choice function with respect to Category 1, 2 Choose max. choice function Calculate match function for W 2 ρ’≥ ρ  I joins category 2; update W 2 (2) W 2 = (2) W 2 =

Project Discussion Specifications Specifications –Binary-ART Network –8-bit input data –Design and implement ONE neuron in EPLD (limitation in resource) –Complete network with microcontroller PC Microcontroller (M68HC11) EPLD

Milestones 1. Test and verify EPLD programming hardware. Wire up the EPLD, program it using the ByteBlaster and verify the function of the programmed EPLD. (August 29, 2005) 2. Design and simulate the neural network processor in high level language e.g. C/C++ (September 12, 2005) 3. Design and simulate a neuron circuit. The simulation results should show the EPLD input the data, read the synaptic weights, compute the net value, perform threshloding and modify the synaptic weights. (September 26, 2005) 4. Build and test the neuron hardware on the EPLD. Program, debug and verify the capabilities listed in milestone 3. (October 17, 2005) 5. Interface the EPLD directly with the M68HC11. The hardware design should include way to monitor the internal operations. (October 31, 2005) 6. Build and test the complete neural processor. Interface with the M68HC11. In addition, develop a program that runs on the M68HC11 that can input any desired inputs into the neural processor. (November 21, 2005) 7.Final report and project demonstration. Final report should include a description of the design, design processes, design decisions and design trade-offs presented in a clear and cohesive fashion. (December 5, 2005)

Milestone 1 Compile and Simulate a simple circuit (e.g. an AND gate) Compile and Simulate a simple circuit (e.g. an AND gate) Program circuit onto Max7000s chip Program circuit onto Max7000s chip Verify the functionality of the circuit Verify the functionality of the circuit Steps to program Max7000s chip can be found in the handouts Steps to program Max7000s chip can be found in the handouts Demo? Demo?

Grouping Form groups of 3 Form groups of 3 Groups are responsible for partition tasks among group members Groups are responsible for partition tasks among group members Define responsibility each member clearly and early Define responsibility each member clearly and early One person in each group signs for: One person in each group signs for: –Altera’s Board –Byteblaster Cable –Power Supply