Chapter 12 Advanced Intelligent Systems

Slides:



Advertisements
Similar presentations
Learning in Neural and Belief Networks - Feed Forward Neural Network 2001 년 3 월 28 일 안순길.
Advertisements

Artificial Neural Networks (1)
Computer Science Department FMIPA IPB 2003 Neural Computing Yeni Herdiyeni Computer Science Dept. FMIPA IPB.
Introduction to Business Analytics
Kostas Kontogiannis E&CE
Artificial Neural Networks
Machine Learning Neural Networks
Soft computing Lecture 6 Introduction to neural networks.
Artificial Intelligence (CS 461D)
Neural NetworksNN 11 Neural Networks Teacher: Elena Marchiori R4.47 Assistant: Kees Jong S2.22
Decision Support Systems
Neural Networks Basic concepts ArchitectureOperation.
Carla P. Gomes CS4700 CS 4700: Foundations of Artificial Intelligence Prof. Carla P. Gomes Module: Neural Networks: Concepts (Reading:
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
Artificial Neural Networks (ANNs)
1 Part 5: CUTTING EDGE DECISION SUPPORT TECHNOLOGIES n Neural Computing n Genetic Algorithms n Fuzzy Logic n Integration Decision Support Systems and Intelligent.
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Traffic Sign Recognition Using Artificial Neural Network Radi Bekker
CHAPTER 12 ADVANCED INTELLIGENT SYSTEMS © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang.
Machine Learning. Learning agent Any other agent.
MSE 2400 EaLiCaRA Spring 2015 Dr. Tom Way
Presentation on Neural Networks.. Basics Of Neural Networks Neural networks refers to a connectionist model that simulates the biophysical information.
Using Neural Networks in Database Mining Tino Jimenez CS157B MW 9-10:15 February 19, 2009.
Artificial Neural Nets and AI Connectionism Sub symbolic reasoning.
Introduction to Neural Networks. Neural Networks in the Brain Human brain “computes” in an entirely different way from conventional digital computers.
IE 585 Introduction to Neural Networks. 2 Modeling Continuum Unarticulated Wisdom Articulated Qualitative Models Theoretic (First Principles) Models Empirical.
 The most intelligent device - “Human Brain”.  The machine that revolutionized the whole world – “computer”.  Inefficiencies of the computer has lead.
Chapter 3 Neural Network Xiu-jun GONG (Ph. D) School of Computer Science and Technology, Tianjin University
1 Machine Learning The Perceptron. 2 Heuristic Search Knowledge Based Systems (KBS) Genetic Algorithms (GAs)
NEURAL NETWORKS FOR DATA MINING
Chapter 7 Neural Networks in Data Mining Automatic Model Building (Machine Learning) Artificial Intelligence.
LINEAR CLASSIFICATION. Biological inspirations  Some numbers…  The human brain contains about 10 billion nerve cells ( neurons )  Each neuron is connected.
Boltzmann Machine (BM) (§6.4) Hopfield model + hidden nodes + simulated annealing BM Architecture –a set of visible nodes: nodes can be accessed from outside.
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
Artificial Neural Networks An Introduction. What is a Neural Network? A human Brain A porpoise brain The brain in a living creature A computer program.
1 Introduction to Neural Networks And Their Applications.
Neural Networks II By Jinhwa Kim. 2 Neural Computing is a problem solving methodology that attempts to mimic how human brain function Artificial Neural.
Neural Networks Steven Le. Overview Introduction Architectures Learning Techniques Advantages Applications.
Soft Computing Lecture 19 Part 2 Hybrid Intelligent Systems.
Chapter 6: Artificial Neural Networks for Data Mining
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 12-1 Chapter 12 Advanced Intelligent Systems.
Artificial Intelligence & Neural Network
 Based on observed functioning of human brain.  (Artificial Neural Networks (ANN)  Our view of neural networks is very simplistic.  We view a neural.
CHAPTER 15 Neural Computing: The Basics. n Artificial Neural Networks (ANN) n Mimics How Our Brain Works n Machine Learning.
Neural Networks Presented by M. Abbasi Course lecturer: Dr.Tohidkhah.
Neural Networks Teacher: Elena Marchiori R4.47 Assistant: Kees Jong S2.22
Perceptrons Michael J. Watts
Artificial Intelligence CIS 342 The College of Saint Rose David Goldschmidt, Ph.D.
Chapter 6 Neural Network.
A field of study that encompasses computational techniques for performing tasks that require intelligence when performed by humans. Simulation of human.
Artificial Neural Networks for Data Mining. Copyright © 2011 Pearson Education, Inc. Publishing as Prentice Hall 6-2 Learning Objectives Understand the.
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Kim HS Introduction considering that the amount of MRI data to analyze in present-day clinical trials is often on the order of hundreds or.
Business Intelligence and Decision Support Systems (9 th Ed., Prentice Hall) Chapter 6: Artificial Neural Networks for Data Mining.
Business Intelligence and Decision Support Systems (9 th Ed., Prentice Hall) Chapter 6: Artificial Neural Networks for Data Mining.
Supervised Learning – Network is presented with the input and the desired output. – Uses a set of inputs for which the desired outputs results / classes.
Network Management Lecture 13. MACHINE LEARNING TECHNIQUES 2 Dr. Atiq Ahmed Université de Balouchistan.
A Presentation on Adaptive Neuro-Fuzzy Inference System using Particle Swarm Optimization and it’s Application By Sumanta Kundu (En.R.No.
Business Intelligence and Decision Support Systems (9 th Ed., Prentice Hall) Chapter 6: Artificial Neural Networks for Data Mining.
Neural Network Architecture Session 2
Learning in Neural Networks
Neural Computing: The Basics
Artificial Intelligence (CS 370D)
Introduction to Neural Networks And Their Applications
MANAGING KNOWLEDGE FOR THE DIGITAL FIRM
Artificial Intelligence Methods
Boltzmann Machine (BM) (§6.4)
ARTIFICIAL NEURAL networks.
Modeling and Analysis Tutorial
The Network Approach: Mind as a Web
Presentation transcript:

Chapter 12 Advanced Intelligent Systems Turban, Aronson, and Liang Decision Support Systems and Intelligent Systems, Seventh Edition Chapter 12 Advanced Intelligent Systems © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Understand second-generation intelligent systems. Learning Objectives Understand second-generation intelligent systems. Learn the basic concepts and applications of case-based systems. Understand the uses of artificial neural networks. Examine the advantages and disadvantages of artificial neural networks. Learn about genetic algorithms. Examine the theories and applications of fuzzy knowledge. © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Household Financial’s Vision Speeds Loan Approvals With Neural Networks Vignette Loan product regulation varies in each state Develop an object-oriented loan approval system Neural network-based Fed risk, interest rate variables, customer data Estimates credit worthiness, potential for fraud Pattern recognition Integrates all loan approval phases Uses intelligent underwriting engine Reduced training time and administrative overhead Decreased managed basis efficiency ratio Upgradeable to web-based architecture © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Machine Learning Acquisition of knowledge through historical examples Implicitly induces expert knowledge from history Different from the way that humans learn Implications of system success and failure unclear Manipulates of symbols instead of numbers © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Methods Supervised learning Unsupervised learning Induce knowledge from known outcomes New cases used to modify existing theories Statistical methods Rule induction Case based and inference Neural computing Genetic algorithms leading to survival of fittest Unsupervised learning Determine knowledge from data with unknown outcomes Clustering data into similar groups © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Case Reasoning Inductive Case base used for decision-making Effective when rule-based reasoning is not Case Primary knowledge element Ossified Paradigmatic Stories © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Process Features assigned as character indexes Indexing rules identify input features Indexes used to retrieve similar cases from memory Episodic case memories Similarity metrics applied Old solution adjusted to fit new case Modification rules Solution tested If successful, assigned value and stored If failure, explain, repair, test Alter plan to fit situation Rules for permissible alterations © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Case Reasoning Success Factors Specific business objectives Knowledge should directly support end users Appropriate design Updatable Measurable metrics Acceptable ROI User accessible Expandable across enterprise © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Human Brain 50 to 150 billion neurons in brain Neurons grouped into networks Axons send outputs to cells Received by dendrites, across synapses © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Neural Networks Attempts to mimic brain functions Analogy, not accurate model Artificial neurons connected in network Organized by topologies Structure Three or more layers Input, intermediate (one or more hidden layers), output Receives modifiable signals © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Processing Processing elements are neurons Allows for parallel processing Each input is single attribute Connection weight Adjustable mathematical value of input Summation function Weighted sum of input elements Internal stimulation Transfer function Relation between internal activation and output Sigmoid/transfer function Threshold value Outputs are problem solution © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Architecture Feedforward-backpropogation Associative memory system Neurons link output in one layer to input in next No feedback Associative memory system Correlates input data with stored information May have incomplete inputs Detects similarities Recurrent structure Activities go through network multiple times to produce output © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Network Learning Learning algorithms Supervised Unsupervised Connection weights derived from known cases Pattern recognition combined with weighting changes Back error propagation Easy implementation Multiple hidden layers Adjust learning rate and momentum Known patterns compared to output and allows for weight adjustment Established error tolerance Unsupervised Only stimuli shown to network Humans assign meanings and determine usefulness Adaptive resonance theory Kohonen self-organizing feature maps © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Development of Systems Collect data The more, the better Separate data into training set to adjust weights Divide into test sets for network validation Select network topology Determine input, output, and hidden nodes, and hidden layers Select learning algorithm and connection weights Iterative training until network achieves preset error level Black box testing to verify inputs produce appropriate outputs Contains routine and problematic cases Implementation Integration with other systems User training Monitoring and feedback © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Genetic Algorithms Computer programs that apply processes of evolution Viability of candidate solutions Self-organized Adaptable Fitness function Measured by objective obtained Iterative process Candidate solutions combine to produce generations Reproduction, crossover, mutation © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Genetic Algorithms Establish problem Generate initial set of solutions Parameters Number of initial solutions, number of offspring, number of parents and offspring for each generation, mutation level, probability distribution of crossover point occurrence Generate initial set of solutions Compute fitness functions Total all fitness functions Compare each solution’s fitness function to total Apply crossover Apply random mutation Repeat until good enough solution or no improvement © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang

Fuzzy Logic Mathematical theory of fuzzy sets Imprecise thinking Describes human perception Continuous logic Not 100% true or false, black or white Fuzzy neural networks Fuzzification Fuzzy logic applied to input and output used to create model Defuzzification Model converted back to original input, output scales Output becomes input for another intelligent system © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang