Abdul Rahim Ahmad MITM 613 Intelligent System Chapter 0: Introduction

Contents  Introduction  Objectives  Outcomes  Chapters  Plan  Assessment  References  Conclusion and Expectations Abdul Rahim Ahmad 2

Introduction  This course emphasises on the methods and techniques that can be used to develop intelligent systems.  knowledge-based techniques  expert and rule-based system  object-oriented and frame-based systems  intelligent agents.  computational intelligence or Machine Learning techniques  neural networks and its similar tools  genetic algorithms  Fuzzy logic  a hybrid of both. Abdul Rahim Ahmad 3

Objectives  To provide understanding of intelligent systems and the various methods and tools in implementing Intelligent Systems.  To demonstrate the implementation of individual methods within the scope of Intelligent systems  To compare the pros and cons of each method of developing Intelligent Systems.  To develop the ability to implement a particular Intelligent system of choice Abdul Rahim Ahmad 4

Outcomes At the end of the course, you should be able to:  Explain the various methods of implementing Intelligent systems  Describe the issues involved in each method of implementing an Intelligent System.  Describe the tools that can be used.  Develop a particular intelligent system of choice in a class project environment. Abdul Rahim Ahmad 5

Main text  Adrian A. Hopgood, Intelligent Systems for Engineers and Scientists, 2nd Edition, CRC Publication (2000).  Abdul Rahim Ahmad 6

7

Chapters from Hopgood  Chapter one: Introduction  Chapter two: Rule-based systems  Chapter three: Dealing with uncertainty  Chapter four: Object-oriented systems  Chapter five: Intelligent agents  Chapter six: Symbolic learning  Chapter seven: Optimization algorithms  Chapter eight: Neural networks  Chapter nine: Hybrid systems  Chapter ten: Tools and languages  Chapter eleven: Systems for interpretation and diagnosis  Chapter twelve: Systems for design and selection  Chapter thirteen: Systems for planning  Chapter fourteen: Systems for control  Chapter fifteen: Concluding remarks  Specifically on Genetic Algorithm  Additional Chapter – Support Vector Machine  Includes Fuzzy Logic

Chapter one: Introduction 1.1 Intelligent systems 1.2 Knowledge-based systems 1.3 The knowledge base 1.4 Deduction, abduction, and induction 1.5 The inference engine 1.6 Declarative and procedural programming 1.7 Expert systems 1.8 Knowledge acquisition 1.9 Search 1.10 Computational intelligence 1.11 Integration with other software

Chapter two: Rule-based systems 2.1 Rules and facts 2.2 A rule-based system for boiler control 2.3 Rule examination and rule firing 2.4 Maintaining consistency 2.5 The closed-world assumption 2.6 Use of variables within rules 2.7 Forward-chaining (a data-driven strategy) Single and multiple instantiation of variables Rete algorithm 2.8 Conflict resolution First come, first served Priority values Metarules 2.9 Backward-chaining (a goal-driven strategy) The backward-chaining mechanism Implementation of backward-chaining Variations of backward-chaining 2.10 A hybrid strategy 2.11 Explanation facilities

Chapter three: Dealing with uncertainty 3.1 Sources of uncertainty 3.2 Bayesian updating Representing uncertainty by probability Direct application of Bayes’ theorem Likelihood ratios Using the likelihood ratios Dealing with uncertain evidence Combining evidence Combining Bayesian rules with production rules A worked example of Bayesian updating Discussion of the worked example Advantages and disadvantages of Bayesian updating 3.3 Certainty theory Introduction Making uncertain hypotheses Logical combinations of evidence A worked example of certainty theory Discussion of the worked example Relating certainty factors to probabilities 3.4 Possibility theory: fuzzy sets and fuzzy logic Crisp sets and fuzzy sets Fuzzy rules Defuzzification 3.5 Other techniques Dempster–Shafer theory of evidence Inferno

Chapter four: Object-oriented systems Skipped

Chapter five: Intelligent agents 5.1 Characteristics of an intelligent agent 5.2 Agents and objects 5.3 Agent architectures Logic-based architectures Emergent behavior architectures Knowledge-level architectures Layered architectures 5.4 Multiagent systems Benefits of a multiagent system Building a multiagent system Communication between agents

Chapter six: Symbolic learning Skipped

Chapter seven: Optimization algorithms 7.1 Optimization 7.2 The search space 7.3 Searching the search space 7.4 Hill-climbing and gradient descent algorithms Hill-climbing Steepest gradient descent or ascent Gradient-proportional descent Conjugate gradient descent or ascent 7.5 Simulated annealing  7.6 Genetic algorithms  The basic GA  Selection  Gray code  Variable length chromosomes  Building block hypothesis  Selecting GA parameters  Monitoring evolution  Lamarckian inheritance  Finding multiple optima  Genetic programming

Chapter eight: Neural networks 8.1 Introduction 8.2 Neural network applications Nonlinear estimation Classification Clustering Content-addressable memory 8.3 Nodes and interconnections 8.4 Single and multilayer perceptrons Network topology Perceptrons as classifiers Training a perceptron Hierarchical perceptrons Some practical considerations 8.5 The Hopfield network 8.6 MAXNET 8.7 The Hamming network 8.8 Adaptive Resonance Theory (ART) networks 8.9 Kohonen self-organizing networks 8.10 Radial basis function networks

Chapter nine: Hybrid systems 9.1 Convergence of techniques 9.2 Blackboard systems 9.3 Genetic-fuzzy systems 9.4 Neuro-fuzzy systems 9.5 Genetic-neural systems 9.6 Clarifying and verifying neural networks 9.7 Learning classifier systems

Chapter ten: Tools and languages  10.1 A range of intelligent systems tools  10.2 Expert system shells  10.3 Toolkits and libraries  10.4 Artificial intelligence languages  Lists  Other data types  Programming environments  10.5 Lisp  Background  Lisp functions  A worked example  10.6 Prolog  Background  A worked example  Backtracking in Prolog  10.7 Comparison of AI languages

Assessment  Assignments (3 x 5)15%  Projects(best of 2 x 15)15%  Mid. Semester Examination30%  Final Examination40% Abdul Rahim Ahmad 19

All References  Adrian A. Hopgood, Intelligent Systems for Engineers and Scientists, 2nd Edition, CRC Publication (2000).  Vojislav Kecman, Learning and Soft Computing: Support Vector Machines, Neural Networks, and Fuzzy Logic Models (Complex Adaptive Systems), MIT Press 2001  Artificial Intelligence, Elain Rich, Kevin Knight, Shivashanker Nair, McGraw Hill, 2009 Abdul Rahim Ahmad 20

Conclusion/Expectations  Able to explain fundamental concepts.  Able to implement selected methods.  Appreciation for using intelligent methods in other field. Abdul Rahim Ahmad 21