Artificial neural networks

Slides:



Advertisements
Similar presentations
A Brief Overview of Neural Networks By Rohit Dua, Samuel A. Mulder, Steve E. Watkins, and Donald C. Wunsch.
Advertisements

1 Machine Learning: Lecture 4 Artificial Neural Networks (Based on Chapter 4 of Mitchell T.., Machine Learning, 1997)
Artificial Neural Networks (1)
Ch. Eick: More on Machine Learning & Neural Networks Different Forms of Learning: –Learning agent receives feedback with respect to its actions (e.g. using.
Perceptron Learning Rule
1 Neural networks. Neural networks are made up of many artificial neurons. Each input into the neuron has its own weight associated with it illustrated.
Multilayer Perceptrons 1. Overview  Recap of neural network theory  The multi-layered perceptron  Back-propagation  Introduction to training  Uses.
Decision Support Systems
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Power Systems Application of Artificial Neural Networks. (ANN)  Introduction  Brief history.  Structure  How they work  Sample Simulations. (EasyNN)
Artificial Neural Network
1 Introduction to Artificial Neural Networks Andrew L. Nelson Visiting Research Faculty University of South Florida.
MSE 2400 EaLiCaRA Spring 2015 Dr. Tom Way
Artificial Neural Networks
Artificial Neural Nets and AI Connectionism Sub symbolic reasoning.
Explorations in Neural Networks Tianhui Cai Period 3.
Waqas Haider Khan Bangyal. Multi-Layer Perceptron (MLP)
Chapter 3 Neural Network Xiu-jun GONG (Ph. D) School of Computer Science and Technology, Tianjin University
11 CSE 4705 Artificial Intelligence Jinbo Bi Department of Computer Science & Engineering
Appendix B: An Example of Back-propagation algorithm
NEURAL NETWORKS FOR DATA MINING
 Diagram of a Neuron  The Simple Perceptron  Multilayer Neural Network  What is Hidden Layer?  Why do we Need a Hidden Layer?  How do Multilayer.
Classification / Regression Neural Networks 2
LINEAR CLASSIFICATION. Biological inspirations  Some numbers…  The human brain contains about 10 billion nerve cells ( neurons )  Each neuron is connected.
Artificial Intelligence Techniques Multilayer Perceptrons.
Artificial Neural Networks. The Brain How do brains work? How do human brains differ from that of other animals? Can we base models of artificial intelligence.
From Machine Learning to Deep Learning. Topics that I will Cover (subject to some minor adjustment) Week 2: Introduction to Deep Learning Week 3: Logistic.
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
Artificial Neural Networks An Introduction. What is a Neural Network? A human Brain A porpoise brain The brain in a living creature A computer program.
METU Informatics Institute Min720 Pattern Classification with Bio-Medical Applications Part 8: Neural Networks.
Multi-Layer Perceptron
Neural Network Basics Anns are analytical systems that address problems whose solutions have not been explicitly formulated Structure in which multiple.
Back-Propagation Algorithm AN INTRODUCTION TO LEARNING INTERNAL REPRESENTATIONS BY ERROR PROPAGATION Presented by: Kunal Parmar UHID:
Neural Networks Presented by M. Abbasi Course lecturer: Dr.Tohidkhah.
Neural Networks Teacher: Elena Marchiori R4.47 Assistant: Kees Jong S2.22
NEURAL NETWORKS LECTURE 1 dr Zoran Ševarac FON, 2015.
Modelleerimine ja Juhtimine Tehisnärvivõrgudega Identification and Control with artificial neural networks.
Perceptrons Michael J. Watts
Artificial Intelligence CIS 342 The College of Saint Rose David Goldschmidt, Ph.D.
Chapter 6 Neural Network.
Artificial Neural Networks for Data Mining. Copyright © 2011 Pearson Education, Inc. Publishing as Prentice Hall 6-2 Learning Objectives Understand the.
Artificial Neural Networks By: Steve Kidos. Outline Artificial Neural Networks: An Introduction Frank Rosenblatt’s Perceptron Multi-layer Perceptron Dot.
1 Neural Networks MUMT 611 Philippe Zaborowski April 2005.
Business Intelligence and Decision Support Systems (9 th Ed., Prentice Hall) Chapter 6: Artificial Neural Networks for Data Mining.
Neural networks.
Neural Networks.
Learning in Neural Networks
Artificial neural networks:
DEPARTMENT: COMPUTER SC. & ENGG. SEMESTER : VII
CSE 473 Introduction to Artificial Intelligence Neural Networks
with Daniel L. Silver, Ph.D. Christian Frey, BBA April 11-12, 2017
FUNDAMENTAL CONCEPT OF ARTIFICIAL NETWORKS
CSSE463: Image Recognition Day 17
CSE P573 Applications of Artificial Intelligence Neural Networks
Classification / Regression Neural Networks 2
CSE 473 Introduction to Artificial Intelligence Neural Networks
CSC 578 Neural Networks and Deep Learning
Artificial Intelligence Methods
General Aspects of Learning
CSE 573 Introduction to Artificial Intelligence Neural Networks
Artificial Neural Networks
CSSE463: Image Recognition Day 17
CSSE463: Image Recognition Day 17
Introduction to Neural Network
David Kauchak CS158 – Spring 2019
General Aspects of Learning
PYTHON Deep Learning Prof. Muhammad Saeed.
Outline Announcement Neural networks Perceptrons - continued
Presentation transcript:

Artificial neural networks Šarūnas Stanskis

Some history 1943 - Warren McCulloch and Walter Pitts introduced models of neurological networks, recreated threshold switches based on neurons and showed that even simple networks of this kind are able to calculate nearly any logic or arithmetic function. 1949: Donald O. Hebb formulated the classical Hebbian rule which represents in its more generalized form the basis of nearly all neural learning procedures. 1951: For his dissertation Marvin Minsky developed the neurocomputer Snark, which has already been capable to adjust its weights automatically …

Neuroniniai tinklai Biological neural network Artificial neural network

Biological and artificial neurons Biological neuron Artificial neuron

Neuron model Output Imputs with corresponding weights x1,w1 x2,wn ... xn,wn y1 f(∑xi *wi) i=1 n Output Imputs with corresponding weights Summation and transfer function Decision boundary

Percepton Percepton model

Activation Function examples Linear Treshold Logic sigmoid Tangent sigmoid

Feedforward ANN Feedforward ANN includes: Single layer perceptron Multilayer perceptron Radial basis function network Multilayer Feed Forward ANN example

Feedback ANN Recurrent ANN example

ANN learning The purpose of ANN learning is to minimize error between its response and actual wanted result. ANN learning algorithms can be divided into three categories: Supervised Learning with a Teacher; Supervised Learning with Reinforcement; Unsupervised Learning.

Supervised Learning with a Teacher The network is provided with a set of inputs and the appropriate outputs for those inputs.

Supervised Learning with Reinforcement The network is provided with a evaluation of its output given the input and alters the weights to try to increase the reinforcement it receives.

Unsupervised Learning The network receives no external feedback but has an internal criterion that it tries to fulfil given the inputs that it faces.

Backpropagation Backward propagation of errors

Backpropagation First apply the inputs to the network and work out the output. Next work out the errors for neurons in output layer. Change the weights. Calculate the Errors for the hidden layer neurons by using proceeding layer neutron errors. Change the hidden layer weights.

Problems related to ANN learning Finding local minimum instead of global minimum. Neural network overfitting to training data.

ANN application ANN applications can be divided into to main tasks: Classification Regression

ANN application More detailed examples: Image and signal analysis Character recognition Sales forecasting Industrial process control Customer research Data validation Risk management Target marketing

Questions What are 2 different ANN architecture category types? Name at least two activation functions. And why are they needed? What are ANN learning categories? What problems can arise during ANN learning? Name some ANN applications.

Thank you for your attention