1. S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Neural Networks 0909.560.01/0909.454.01 Spring 2002 Shreekanth Mandayam Robi Polikar ECE Department Rowan University http://engineering.rowan.edu/~shreek/spring02/ann/ Lecture 1 January 24, 2002

2. S. Mandayam/ ANN/ECE Dept./Rowan UniversityPlan What is artificial intelligence? Course introduction Historical development – the neuron model The artificial neural network paradigm What is knowledge? What is learning? The Perceptron The “Future”….?

3. S. Mandayam/ ANN/ECE Dept./Rowan University Artificial Intelligence Systems that think like humans Cognitive modeling Systems that think rationally Logic Systems that act like humans Natural language processing Knowledge representation Machine learning Systems that act rationally Decision theoretic agents

4. S. Mandayam/ ANN/ECE Dept./Rowan University Course Introduction Why should we take this course? PR, Applications What are we studying in this course? Course objectives/deliverables How are we conducting this course? Course logistics http://engineering.rowan.edu/shreek/spring02/ann/

5. S. Mandayam/ ANN/ECE Dept./Rowan University Course Objectives At the conclusion of this course the student will be able to: Identify and describe engineering paradigms for knowledge and learning Identify, describe and design artificial neural network architectures for simple cognitive tasks

6. S. Mandayam/ ANN/ECE Dept./Rowan University Biological Origins

7. S. Mandayam/ ANN/ECE Dept./Rowan University Biological Origins

8. S. Mandayam/ ANN/ECE Dept./Rowan UniversityHistory/People 1940’sTuringGeneral problem solver, “Turing test” 1940’sShannonInformation theory 1943McCulloch and PittsMath of neural processes 1949HebbLearning model 1959RosenblattThe “Perceptron” 1960WidrowLMS training algorithm 1969Minsky and PapertPerceptron deficiency 1985RumelhartFeedforward MLP, backprop 1988Broomhead and LoweRadial basis function neural nets 1990’sVLSI implementations

9. S. Mandayam/ ANN/ECE Dept./Rowan University Neural Network Paradigm Stage 1: Network Training ArtificialNeuralNetwork Present Examples Indicate Desired Outputs Determine Synaptic Weights ArtificialNeuralNetwork New Data Predicted Outputs Stage 2: Network Testing “knowledge”

10. S. Mandayam/ ANN/ECE Dept./Rowan University ANN Model ArtificialNeuralNetwork x Input Vector y Output Vector f Complex Nonlinear Function f(x) = y “knowledge”

11. S. Mandayam/ ANN/ECE Dept./Rowan University Popular I/O Mappings ANN x y Single output y1y1 ANN x 1-out-of-c selector y2y2 ycyc y1y1 ANN x Coder y2y2 ycyc ANN x Associator y

12. S. Mandayam/ ANN/ECE Dept./Rowan University The Perceptron    (.) w k1 w k2 w km x1x1 x2x2 xmxm Inputs Synaptic weights Bias, b k Induced field, v k Output, y k ukuk Activation/ squashing function

13. S. Mandayam/ ANN/ECE Dept./Rowan University“Learning” [w] x y ANN Mathematical Model of the Learning Process [w] 0 x y(0) Intitialize: Iteration (0) [w] 1 x y(1) Iteration (1) [w] n x y(n) = d Iteration (n) desired o/p

14. S. Mandayam/ ANN/ECE Dept./Rowan University The Age of Spiritual Machines When Computers Exceed Human Intelligence by Ray Kurzweil | Penguin paperback | 0-14-028202-5 |

15. S. Mandayam/ ANN/ECE Dept./Rowan UniversitySummary