COMPUTATIONAL INTELLIGENCE

Slides:



Advertisements
Similar presentations
Neural Network I Week 7 1. Team Homework Assignment #9 Read pp. 327 – 334 and the Week 7 slide. Design a neural network for XOR (Exclusive OR) Explore.
Advertisements

Biological and Artificial Neurons Michael J. Watts
Artificial Intelligence (CS 461D)
Decision Support Systems
1 Part I Artificial Neural Networks Sofia Nikitaki.
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
November 19, 2009Introduction to Cognitive Science Lecture 20: Artificial Neural Networks I 1 Artificial Neural Network (ANN) Paradigms Overview: The Backpropagation.
Artificial Neural Networks Artificial Neural Networks are (among other things) another technique for supervised learning k-Nearest Neighbor Decision Tree.
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Introduction to Neural Networks John Paxton Montana State University Summer 2003.
Detailed q2/Q2 results for 100 bootstraps for final runs with (38 + dummy features)
JYC: CSM17 Bioinformatics Week 9: Simulations #3: Neural Networks biological neurons natural neural networks artificial neural networks applications.
NEURAL NETWORKS Introduction
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
SOMTIME: AN ARTIFICIAL NEURAL NETWORK FOR TOPOLOGICAL AND TEMPORAL CORRELATION FOR SPATIOTEMPORAL PATTERN LEARNING.
Revision Michael J. Watts
CHAPTER 12 ADVANCED INTELLIGENT SYSTEMS © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang.
1 Introduction to Artificial Neural Networks Andrew L. Nelson Visiting Research Faculty University of South Florida.
Machine Learning. Learning agent Any other agent.
KOHONEN SELF ORGANISING MAP SEMINAR BY M.V.MAHENDRAN., Reg no: III SEM, M.E., Control And Instrumentation Engg.
Artificial Intelligence Lecture No. 28 Dr. Asad Ali Safi ​ Assistant Professor, Department of Computer Science, COMSATS Institute of Information Technology.
IE 585 Introduction to Neural Networks. 2 Modeling Continuum Unarticulated Wisdom Articulated Qualitative Models Theoretic (First Principles) Models Empirical.
What is a neural network? Collection of interconnected neurons that compute and generate impulses. Components of a neural network include neurons, synapses,
Appendix B: An Example of Back-propagation algorithm
Mestrado em Ciência de Computadores Mestrado Integrado em Engenharia de Redes e Sistemas Informáticos VC 14/15 – TP19 Neural Networks & SVMs Miguel Tavares.
NEURAL NETWORKS FOR DATA MINING
Chapter 7 Neural Networks in Data Mining Automatic Model Building (Machine Learning) Artificial Intelligence.
LINEAR CLASSIFICATION. Biological inspirations  Some numbers…  The human brain contains about 10 billion nerve cells ( neurons )  Each neuron is connected.
Artificial Neural Networks. The Brain How do brains work? How do human brains differ from that of other animals? Can we base models of artificial intelligence.
An informal description of artificial neural networks John MacCormick.
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
Artificial Neural Networks An Introduction. What is a Neural Network? A human Brain A porpoise brain The brain in a living creature A computer program.
Features of Biological Neural Networks 1)Robustness and Fault Tolerance. 2)Flexibility. 3)Ability to deal with variety of Data situations. 4)Collective.
Features of Biological Neural Networks 1)Robustness and Fault Tolerance. 2)Flexibility. 3)Ability to deal with variety of Data situations. 4)Collective.
Artificial Intelligence & Neural Network
© SEMINAR ON ARTIFICIAL NEURAL NETWORK AND ITS APPLICATIONS By Mr. Susant Kumar Behera Mrs. I. Vijaya.
CS 478 – Tools for Machine Learning and Data Mining Perceptron.
Over-Trained Network Node Removal and Neurotransmitter-Inspired Artificial Neural Networks By: Kyle Wray.
Introduction to Neural Networks Introduction to Neural Networks Applied to OCR and Speech Recognition An actual neuron A crude model of a neuron Computational.
Lecture 5 Neural Control
Image Source: ww.physiol.ucl.ac.uk/fedwards/ ca1%20neuron.jpg
Dr.Abeer Mahmoud ARTIFICIAL INTELLIGENCE (CS 461D) Dr. Abeer Mahmoud Computer science Department Princess Nora University Faculty of Computer & Information.
NEURAL NETWORKS LECTURE 1 dr Zoran Ševarac FON, 2015.
Introduction to Neural Networks Freek Stulp. 2 Overview Biological Background Artificial Neuron Classes of Neural Networks 1. Perceptrons 2. Multi-Layered.
COMP53311 Other Classification Models: Neural Network Prepared by Raymond Wong Some of the notes about Neural Network are borrowed from LW Chan’s notes.
Artificial Intelligence Methods Neural Networks Lecture 1 Rakesh K. Bissoondeeal Rakesh K.
Neural networks – Hands on
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Soft Computing & Computational Intelligence Biologically inspired computing models Compatible with human expertise/reasoning Intensive numerical computations.
“Principles of Soft Computing, 2 nd Edition” by S.N. Sivanandam & SN Deepa Copyright  2011 Wiley India Pvt. Ltd. All rights reserved. CHAPTER 2 ARTIFICIAL.
Business Intelligence and Decision Support Systems (9 th Ed., Prentice Hall) Chapter 6: Artificial Neural Networks for Data Mining.
Intro. ANN & Fuzzy Systems Lecture 3 Basic Definitions of ANN.
Summary Presentation of Cortical Computing with Memrisitve Nanodevices Authored by Greg S. Snider Hewlett-Packard Laboratories Published Winter 2008, SciDAC.
1 Neural Networks MUMT 611 Philippe Zaborowski April 2005.
INTRODUCTION TO NEURAL NETWORKS 2 A new sort of computer What are (everyday) computer systems good at... and not so good at? Good at..Not so good at..
Neural Networks.
Artificial Intelligence (CS 370D)
CSE 473 Introduction to Artificial Intelligence Neural Networks
Dr. Unnikrishnan P.C. Professor, EEE
CSSE463: Image Recognition Day 17
CSE P573 Applications of Artificial Intelligence Neural Networks
شبکه عصبی تنظیم: بهروز نصرالهی-فریده امدادی استاد محترم: سرکار خانم کریمی دانشگاه آزاد اسلامی واحد شهرری.
XOR problem Input 2 Input 1
SOM to create POVERTY MAP based on various economic indicators by country (by T. Kohonen et al.)
SOM to create POVERTY MAP based on various economic indicators by country (by T. Kohonen et al.)
Artificial Intelligence Lecture No. 28
CSSE463: Image Recognition Day 17
CSSE463: Image Recognition Day 17
ARTIFICIAL NEURAL networks.
Summary Presentation of Cortical Computing with Memrisitve Nanodevices
Presentation transcript:

COMPUTATIONAL INTELLIGENCE SOFT COMPUTING & COMPUTATIONAL INTELLIGENCE Biologically inspired computing models Compatible with human expertise/reasoning Intensive numerical computations Data and goal driven Model-free learning Fault tolerant Real world/novel applications RENSSELAER

COMPUTATIONAL INTELLIGENCE SOFT COMPUTING & COMPUTATIONAL INTELLIGENCE Artificial Neural Networks (ANN) Fuzzy Logic Genetic Algorithms (GAs) Fractals/Chaos Artificial life Wavelets Data mining ANNs FL GAs RENSSELAER

Biological neuron signal dendrites flow synapse axon hillock cell body hair cell (sensory transducer) signal flow dendrites synapse axon hillock cell body axon synapse RENSSELAER

 Artificial neuron i1 w1 inputs o output i2 w2 o w3 i3 w1 i1 + w2 i2 sigmoid nonlinear transfer function weighted sum of the inputs w1 i1 + w2 i2 + w3 i3 w1 i1 + w2 i2 + w3 i3 RENSSELAER

Neural net yields weights to map inputs to outputs  Neural Network Molecular weight w11 h w11   Boiling Point H-bonding   Biological response Hydrofobicity  h Electrostatic interactions w23  w34 Observable Projection Molecular Descriptor There are many algorithms that can determine the weights for ANNs RENSSELAER

Neural networks in a nutshell A problem can be formulated and represented as a mapping problem from Such a map can be realized by an ANN, which is a framework of basic building blocks of McCulloch-Pitts neurons The neural net can be trained to conform with the map based on samples of the map and will reasonably generalize to new cases it has not encountered before RENSSELAER

Neural network as a map RENSSELAER

McCulloch-Pitts Neuron y x 1 3 N S f() w 2 RENSSELAER

Neural network as collection of M-P neurons x 1 2 w 11 12 13 23 22 32 21 3 y First hidden layer Second hidden Output neuron RENSSELAER

Kohonen SOM for text retrieval on WWW newsgroups WEBSOM node u21 Click arrows to move to neighboring nodes on the map. Instructions Re: Fuzzy Neural Net References Needed Derek Long , 27 Oct 1995, Lines: 24. Distributed Neural Processing Jon Mark Twomey, 28 Oct 1995, Lines: 12. Re: neural-fuzzy TiedNBound, 11 Dec 1995, Lines: 10. New neural net C library available Simon Levy, 2 Feb 1996, Lines: 15. Re: New neural net C library available Michael Glover, Sun, 04 Feb 1996, Lines: 25.

From Guido De Boeck SOM’s for Data Mining To be published (Springer Verlag)