Dr. Unnikrishnan P.C. Professor, EEE

Slides:



Advertisements
Similar presentations
Advances in Neuro-Fuzzy Systems and their Applications
Advertisements

Rulebase Expert System and Uncertainty. Rule-based ES Rules as a knowledge representation technique Type of rules :- relation, recommendation, directive,
An Introduction to Artificial Intelligence By Dr Brad Morantz Viral Immunology Center Georgia State University.
Intelligent systems Lecture 6 Rules, Semantic nets.
4 Intelligent Systems.
Rule Based Systems Michael J. Watts
Computer Intelligence and Soft Computing
Neuro-Fuzzy Control Adriano Joaquim de Oliveira Cruz NCE/UFRJ
AI – CS364 Hybrid Intelligent Systems Overview of Hybrid Intelligent Systems 07 th November 2005 Dr Bogdan L. Vrusias
EXPERT SYSTEMS Part I.
Introduction to Rule-Based Systems, Expert Systems, Fuzzy Systems Introduction to Rule-Based Systems, Expert Systems, Fuzzy Systems (sections 2.7, 2.8,
Hybrid intelligent systems:
PRESETATION BY: TEJAS KAVITAKE DANIEL AKU YIRANG.
Neuro-fuzzy Systems Xinbo Gao School of Electronic Engineering Xidian University 2004,10.
CHAPTER 12 ADVANCED INTELLIGENT SYSTEMS © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang.
Artificial Intelligence Lecture No. 15 Dr. Asad Ali Safi ​ Assistant Professor, Department of Computer Science, COMSATS Institute of Information Technology.
Machine Learning. Learning agent Any other agent.
Neurons, Neural Networks, and Learning 1. Human brain contains a massively interconnected net of (10 billion) neurons (cortical cells) Biological.
Chapter 14: Artificial Intelligence Invitation to Computer Science, C++ Version, Third Edition.
What is Artificial Intelligence? AI is the effort to develop systems that can behave/act like humans. Turing Test The problem = unrestricted domains –human.
Hybrid intelligent systems:
Using Neural Networks in Database Mining Tino Jimenez CS157B MW 9-10:15 February 19, 2009.
© Negnevitsky, Pearson Education, Lecture 10 Introduction Introduction Neural expert systems Neural expert systems Evolutionary neural networks.
TECHNOLOGY GUIDE FOUR Intelligent Systems.
An Introduction to Artificial Intelligence and Knowledge Engineering N. Kasabov, Foundations of Neural Networks, Fuzzy Systems, and Knowledge Engineering,
10/6/2015 1Intelligent Systems and Soft Computing Lecture 0 What is Soft Computing.
Artificial Neural Networks. Applied Problems: Image, Sound, and Pattern recognition Decision making  Knowledge discovery  Context-Dependent Analysis.
© Negnevitsky, Pearson Education, Lecture 11 Neural expert systems and neuro-fuzzy systems Introduction Introduction Neural expert systems Neural.
110/19/2015CS360 AI & Robotics AI Application Areas  Neural Networks and Genetic Algorithms  These model the structure of neurons in the brain  Humans.
Chapter 13 Artificial Intelligence and Expert Systems.
I Robot.
Soft Computing Lecture 19 Part 2 Hybrid Intelligent Systems.
Fuzzy Systems Michael J. Watts
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 12-1 Chapter 12 Advanced Intelligent Systems.
Group Learning By Philip Sterne Supervisor : Shaun Bangay Neural Networks: sharing information.
PART 9 Fuzzy Systems 1. Fuzzy controllers 2. Fuzzy systems and NNs 3. Fuzzy neural networks 4. Fuzzy Automata 5. Fuzzy dynamic systems FUZZY SETS AND FUZZY.
PLUG IT IN 5 Intelligent Systems. 1.Introduction to intelligent systems 2.Expert Systems 3.Neural Networks 4.Fuzzy Logic 5.Genetic Algorithms 6.Intelligent.
Chapter 1: Introduction to Neuro-Fuzzy (NF) and Soft Computing (SC)
Artificial Neural Networks (ANN). Artificial Neural Networks First proposed in 1940s as an attempt to simulate the human brain’s cognitive learning processes.
A field of study that encompasses computational techniques for performing tasks that require intelligence when performed by humans. Simulation of human.
TECHNOLOGY GUIDE FOUR Intelligent Systems. TECHNOLOGY GUIDE OUTLINE TG4.1 Introduction to Intelligent Systems TG4.2 Expert Systems TG4.3 Neural Networks.
Dinner for Two. Fuzzify Inputs Apply Fuzzy Operator.
Business Analytics Several odds and ends Copyright © 2016 Curt Hill.
Intro. ANN & Fuzzy Systems Lecture 28 Modeling (3): Expert System and Reinforcement Learning.
Network Management Lecture 13. MACHINE LEARNING TECHNIQUES 2 Dr. Atiq Ahmed Université de Balouchistan.
A Presentation on Adaptive Neuro-Fuzzy Inference System using Particle Swarm Optimization and it’s Application By Sumanta Kundu (En.R.No.
Chapter 13 Artificial Intelligence. Artificial Intelligence – Figure 13.1 The Turing Test.
CHAPTER 1 Introduction BIC 3337 EXPERT SYSTEM.
Fuzzy Systems Michael J. Watts
Soft Computing Introduction.
DSS & Warehousing Systems
TECHNOLOGY GUIDE FOUR Intelligent Systems.
Il-Kyoung Kwon1, Sang-Yong Lee2
Dr. Unnikrishnan P.C. Professor, EEE
Dr. Unnikrishnan P.C. Professor, EEE
Dr. Unnikrishnan P.C. Professor, EEE
Dr. Unnikrishnan P.C. Professor, EEE
EXPERT SYSTEMS.
Artificial Intelligence
Chapter 12 Advanced Intelligent Systems
Neural Networks Advantages Criticism
Intelligent Systems and
The use of Neural Networks to schedule flow-shop with dynamic job arrival ‘A Multi-Neural Network Learning for lot Sizing and Sequencing on a Flow-Shop’
Dr. Unnikrishnan P.C. Professor, EEE
Artificial Intelligence 12. Two Layer ANNs
Dr. Unnikrishnan P.C. Professor, EEE
Hybrid intelligent systems:
Dr. Unnikrishnan P.C. Professor, EEE
Fuzzy Logic Bai Xiao.
Fuzzy Logic Based on a system of non-digital (continuous & fuzzy without crisp boundaries) set theory and rules. Developed by Lotfi Zadeh in 1965 Its advantage.
Presentation transcript:

Dr. Unnikrishnan P.C. Professor, EEE EE368 Soft Computing Dr. Unnikrishnan P.C. Professor, EEE

Module III Hybrid Intelligent Systems

Hybrid Intelligent Systems: Neural expert systems and neuro-fuzzy systems Introduction Neural expert systems Fuzzy expert Systems Neuro-Fuzzy systems ANFIS: Adaptive Neuro-Fuzzy Inference System

Introduction A hybrid intelligent system is one that combines at least two intelligent technologies. For example, combining a neural network with a fuzzy system

Lotfi Zadeh said that a good hybrid would be “British Police, German Mechanics, French Cuisine, Swiss Banking and Italian Love”.But “British Cuisine, German Police, French Mechanics, Italian Banking and Swiss Love” would be a bad one. Likewise, a hybrid intelligent system can be good or bad – it depends on which components constitute the hybrid.

Comparison of Expert Systems, Fuzzy Systems, Neural Networks and Genetic Algorithms

Neural expert systems Expert systems rely on logical inferences and decision trees and focus on modelling human reasoning. Neural networks rely on parallel data processing and focus on modelling a human brain. Expert systems treat the brain as a black-box. Neural networks look at its structure and functions, particularly at its ability to learn. Knowledge in a rule-based expert system is represented by IF-THEN production rules. Knowledge in neural networks is stored as synaptic weights between neurons.

In expert systems, knowledge can be divided into individual rules and the user can see and understand the piece of knowledge applied by the system. In neural networks, one cannot select a single synaptic weight as a discrete piece of knowledge. Knowledge is embedded in the entire network; it cannot be broken into individual pieces, and any change of a synaptic weight may lead to unpredictable results. A neural network is, in fact, a black-box for its user.

Can we combine advantages of expert systems and neural networks to create a more powerful and effective expert system? A hybrid system that combines a neural network and a rule-based expert system is called a neural expert system (or a connectionist expert system).

Basic structure of a neural expert system Training Data Neural Knowledge Base Rule Extraction Rule: IF - THEN New Data Inference Engine Explanation Facilities User Interface User

The heart of a neural expert system is the inference engine The heart of a neural expert system is the inference engine. It controls the information flow in the system and initiates inference over the neural knowledge base. A neural inference engine also ensures approximate reasoning.

Approximate reasoning In a rule-based expert system, the inference engine compares the condition part of each rule with data given in the database. When the IF part of the rule matches the data in the database, the rule is fired and its THEN part is executed. Precise matching is required (inference engine cannot cope with noisy or incomplete data). Neural expert systems use a trained neural network in place of the knowledge base. The input data does not have to precisely match the data that was used in network training. This ability is called approximate reasoning.

Eg:-The neural knowledge base Wings +1 -0.8 Rule 1 Bird -1.6 -0.7 -0.2 1.0 Tail +1 -1.1 2.2 -0.1 Beak Rule 2 Plane +1 1.0 1 0.0 -1.0 Feathers 2.8 -1.6 +1 -2.9 -1.1 1.9 Rule 3 Glider 1.0 Engine 1 1 -1.3 Expert System, Neural, Fussy System, Jamil AlAgha ©2012

If we set each input of the input layer to either +1 (true), 1 (false), or 0 (unknown), we can give a semantic interpretation for the activation of any output neuron. For example, if the object has Wings (+1), Beak (+1) and Feathers (+1), but does not have Engine (1), then we can conclude that this object is Bird (+1): X Rule1  1 (0.8)  0 (0.2) 1 2.2 1 2.8  (1)  (1.1)  5.3  0 YRule1  YBird  1

We can similarly conclude that this object is not Plane: X Rule 2  1 (0.7)  0 (0.1) 1 0.0 1 (1.6)  (1) 1.9  4.2  0 YRule 2  YPlane  1 and not Glider: X Rule 3  1 (0.6)  0 (1.1) 1 (1.0) 1 (2.9)  (1)  (1.3)  4.2  0 YRule 3  YGlider  1

By attaching a corresponding question to each input neuron, we can enable the system to prompt the user for initial values of the input variables: Neuron: Wings Question: Does the object have wings? Neuron: Tail Question: Does the object have a tail? Neuron: Beak Question: Does the object have a beak? Neuron: Feathers Question: Does the object have feathers? Neuron: Engine Question: Does the object have an engine?

An inference can be made if the known net weighted input to a neuron is greater than the sum of the absolute values of the weights of the unknown inputs. n n  xi wi   w j i1 j 1 where i  known, j  known and n is the number of neuron inputs.

Example: Enter initial value for the input Feathers:  +1 KNOWN = 12.8 = 2.8 UNKNOWN = 0.8 + 0.2 + 2.2 + 1.1 = 4.3 KNOWN  UNKNOWN Enter initial value for the input Beak: KNOWN = 12.8 + 12.2 = 5.0 UNKNOWN = 0.8 + 0.2 + 1.1 = 2.1 KNOWN  UNKNOWN CONCLUDE: Bird is TRUE

An example of a multi-layer knowledge base Rule 1: IF a1 AND a3 THEN b1 (0.8) Rule 2: IF a1 AND a4 THEN b1 (0.2) Rule 3: IF a2 AND a5 THEN b2 (-0.1) Rule 4: IF a3 AND a4 THEN b3 (0.9) Rule 5: IF a5 THEN b3 (0.6) Rule 6: IF b1 AND b3 THEN c1 (0.7) Rule 7: IF b2 THEN c1 (0.1) Rule 8: IF b2 AND b3 THEN c2 (0.9) Input Layer Conjunction Layer Disjunction Layer Conjunction Layer Disjunction Layer 1.0 a1 R1 0.8 R2 0.2 a2 b1 1.0 R6 0.7 1.0 c1 1.0 0.1 a3 R3 -0.1 b2 1.0 R7 1.0 1.0 c2 0.9 R4 0.9 a4 b3 R8 1.0 a5 1.0 R5 0.6

Fuzzy Expert Systems

Fuzzy Expert Systems