Reasoning in Uncertain Situations

Slides:



Advertisements
Similar presentations
Bayesian Network and Influence Diagram A Guide to Construction And Analysis.
Advertisements

Dynamic Bayesian Networks (DBNs)
Structures and Strategies For Space State Search
BAYESIAN NETWORKS CHAPTER#4 Book: Modeling and Reasoning with Bayesian Networks Author : Adnan Darwiche Publisher: CambridgeUniversity Press 2009.
1 Chapter 13 Uncertainty Types of uncertainty Predicate logic and uncertainty Nonmonotonic logics Truth Maintenance Systems Fuzzy sets.
1 Reasoning in Uncertain Situations 9 9.0Introduction 9.1Logic-Based Abductive Inference 9.2Abduction: Alternatives to Logic 9.3The Stochastic Approach.
Hidden Markov Models Reading: Russell and Norvig, Chapter 15, Sections
Introduction of Probabilistic Reasoning and Bayesian Networks
Modeling Human Reasoning About Meta-Information Presented By: Scott Langevin Jingsong Wang.
CSC411Artificial Intelligence1 Chapter 9 Reasoning in Uncertain Situations Contents Uncertain situations Non-monotonic logic and reasoning Certainty Factor.
Belief Propagation by Jakob Metzler. Outline Motivation Pearl’s BP Algorithm Turbo Codes Generalized Belief Propagation Free Energies.
Causal and Bayesian Network (Chapter 2) Book: Bayesian Networks and Decision Graphs Author: Finn V. Jensen, Thomas D. Nielsen CSE 655 Probabilistic Reasoning.
Ch9 Reasoning in Uncertain Situations Dr. Bernard Chen Ph.D. University of Central Arkansas Spring 2011.
Hidden Markov Models M. Vijay Venkatesh. Outline Introduction Graphical Model Parameterization Inference Summary.
HEURISTIC SEARCH ARTIFICIAL INTELLIGENCE 5th edition George F Luger
Part II. Statistical NLP Advanced Artificial Intelligence (Hidden) Markov Models Wolfram Burgard, Luc De Raedt, Bernhard Nebel, Lars Schmidt-Thieme Most.
ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
INTRODUCTION TO Machine Learning ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
December Marginal and Joint Beliefs in BN1 A Hybrid Algorithm to Compute Marginal and Joint Beliefs in Bayesian Networks and its complexity Mark.
Big Ideas in Cmput366. Search Blind Search Iterative deepening Heuristic Search A* Local and Stochastic Search Randomized algorithm Constraint satisfaction.
UNIVERSITY OF SOUTH CAROLINA Department of Computer Science and Engineering CSCE 580 Artificial Intelligence Ch.6 [P]: Reasoning Under Uncertainty Sections.
Data and Process Modeling
Structures and Strategies For Space State Search
Chapter 3: Methods of Inference Expert Systems: Principles and Programming, Fourth Edition.
Automated Reasoning ARTIFICIAL INTELLIGENCE 6th edition George F Luger
Chapter 4.
Knowledge Representation
Artificial Intelligence: Its Roots and Scope
Soft Computing Lecture 17 Introduction to probabilistic reasoning. Bayesian nets. Markov models.
Bayesian Learning By Porchelvi Vijayakumar. Cognitive Science Current Problem: How do children learn and how do they get it right?
The Predicate Calculus
Undirected Models: Markov Networks David Page, Fall 2009 CS 731: Advanced Methods in Artificial Intelligence, with Biomedical Applications.
Understanding Natural Language
Building Control Algorithms For State Space Search.
George F Luger ARTIFICIAL INTELLIGENCE 6th edition Structures and Strategies for Complex Problem Solving Machine Learning: Connectionist Luger: Artificial.
Probabilistic Reasoning ECE457 Applied Artificial Intelligence Spring 2007 Lecture #9.
CS 415 – A.I. Slide Set 5. Chapter 3 Structures and Strategies for State Space Search – Predicate Calculus: provides a means of describing objects and.
Structures and Strategies For Space State Search
Physics Fluctuomatics / Applied Stochastic Process (Tohoku University) 1 Physical Fluctuomatics Applied Stochastic Process 9th Belief propagation Kazuyuki.
George F Luger ARTIFICIAL INTELLIGENCE 5th edition Structures and Strategies for Complex Problem Solving Machine Learning: Social and Emergent Luger: Artificial.
George F Luger ARTIFICIAL INTELLIGENCE 5th edition Structures and Strategies for Complex Problem Solving HEURISTIC SEARCH Luger: Artificial Intelligence,
George F Luger ARTIFICIAL INTELLIGENCE 6th edition Structures and Strategies for Complex Problem Solving HEURISTIC SEARCH Luger: Artificial Intelligence,
George F Luger ARTIFICIAL INTELLIGENCE 6th edition Structures and Strategies for Complex Problem Solving Artificial Intelligence as Empirical Enquiry Luger:
George F Luger ARTIFICIAL INTELLIGENCE 6th edition Structures and Strategies for Complex Problem Solving STOCHASTIC METHODS Luger: Artificial Intelligence,
George F Luger ARTIFICIAL INTELLIGENCE 6th edition Structures and Strategies for Complex Problem Solving Machine Learning: Symbol-Based Luger: Artificial.
Probabilistic Networks Chapter 14 of Dechter’s CP textbook Speaker: Daniel Geschwender April 1, 2013 April 1&3, 2013DanielG--Probabilistic Networks1.
Bayesian Networks Aldi Kraja Division of Statistical Genomics.
INTRODUCTION TO MACHINE LEARNING 3RD EDITION ETHEM ALPAYDIN © The MIT Press, Lecture.
George F Luger ARTIFICIAL INTELLIGENCE 6th edition Structures and Strategies for Complex Problem Solving Machine Learning: Probabilistic Luger: Artificial.
CSC321: Neural Networks Lecture 16: Hidden Markov Models
1 Chapter 15 Probabilistic Reasoning over Time. 2 Outline Time and UncertaintyTime and Uncertainty Inference: Filtering, Prediction, SmoothingInference:
Wei Sun and KC Chang George Mason University March 2008 Convergence Study of Message Passing In Arbitrary Continuous Bayesian.
George F Luger ARTIFICIAL INTELLIGENCE 5th edition Structures and Strategies for Complex Problem Solving Structures and Strategies For Space State Search.
George F Luger ARTIFICIAL INTELLIGENCE 5th edition Structures and Strategies for Complex Problem Solving HEURISTIC SEARCH Luger: Artificial Intelligence,
George F Luger ARTIFICIAL INTELLIGENCE 5th edition Structures and Strategies for Complex Problem Solving STOCHASTIC METHODS Luger: Artificial Intelligence,
Chapter 12. Probability Reasoning Fall 2013 Comp3710 Artificial Intelligence Computing Science Thompson Rivers University.
Bayesian Decision Theory Introduction to Machine Learning (Chap 3), E. Alpaydin.
Chapter 3: Methods of Inference
INTRODUCTION TO Machine Learning 2nd Edition
Machine Learning: Symbol-Based
Maximum Expected Utility
Machine Learning: Symbol-Based
Chapter 3: Methods of Inference
Artificial Intelligence Chapter 19
Hidden Markov Models Part 2: Algorithms
Luger: Artificial Intelligence, 5th edition
Biointelligence Lab School of Computer Sci. & Eng.
Graduate School of Information Sciences, Tohoku University
Chapter14-cont..
Chapter 14 February 26, 2004.
Presentation transcript:

Reasoning in Uncertain Situations 9.0 Introduction 9.1 Logic-Based Abductive Inference 9.2 Abduction: Alternatives to Logic 9.3 The Stochastic Approach to Uncertainty 9.4 Epilogue and References 9.5 Exercises George F Luger ARTIFICIAL INTELLIGENCE 6th edition Structures and Strategies for Complex Problem Solving Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 1

Fig 9.1 A justification network to believe that David studies hard. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 2

Fig 9. 2. 9. 2(a) is a premise justification, and 9 Fig 9.2 9.2(a) is a premise justification, and 9.2 (b) the ANDing of two beliefs, a and not b, to support c (Goodwin 1982). Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 3

Fig 9.3 The new labelling of fig 9.1 associated with the new premise party_person(david). Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 4

Fig 9.4 An ATMS labeling of nodes in a dependency network. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 5

Fig 9. 5. The lattice for the premises of the network of fig 9. 4 Fig 9.5 The lattice for the premises of the network of fig 9.4. Circled sets indicate the hierarchy inconsistencies, after Martins (1991) Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 6

Fig 9.6 the fuzzy set representation for “small integers.” Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 7

Fig 9.7 A fuzzy set representation for the sets short, medium, and tall males. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 8

Fig 9.8 The inverted pendulum and the angle θ and dθ/dt input values. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 9

Fig 9.9 The fuzzy regions for the input values θ (a) and dθ/dt (b). Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 10

Fig 9.10 The fuzzy regions of the output value u, indicating the movement of the pendulum base. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 11

Fig 9.11 The fuzzificzation of the input measures X1 = 1, X2 = -4 Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 12

Fig 9. 10. The Fuzzy Associative Matrix (FAM) for the pendulum problem Fig 9.10 The Fuzzy Associative Matrix (FAM) for the pendulum problem. The input values are on the left and top. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 13

Luger: Artificial Intelligence, 6th edition Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 14

Fig 9. 13. The fuzzy consequents (a) and their union (b) Fig 9.13 The fuzzy consequents (a) and their union (b). The centroid of the union (-2) is the crisp output. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 15

Dempster’s rule states: Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 16

Table 9.1 Using Dempster’s rule to obtain a belief distribution for m3 . Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 17

Table 9.2 Using Dempster’s rule to combine m3 and m4 to get m5. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 18

Fig 9.14 The graphical model for the traffic problem, first introduced in Section 5.3. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 19

Luger: Artificial Intelligence, 6th edition Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 20

Fig 9.15 a is a serial connection of nodes where influence runs between A and B unless V is instantiated. 9.15b is a diverging connection, where influence runs between V’s children, unless V is instantiated. In 9.15c, a converging connection, if nothing is known about V the its parents are independent, otherwise correlations exist between its parents. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 21

Luger: Artificial Intelligence, 6th edition Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 22

Table 9.4 The probability distribution for p(WS), a function of p(W) and p(R) given the effect of S. We calculate the effect for x, where R = t and W = t. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 23

Fig 9. 16. An example of a Bayesian probabilistic network, where the Fig 9.16 An example of a Bayesian probabilistic network, where the probability dependencies are located next to each node. This example is from Pearl (1988). Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 24

A junction tree algorithm. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 25

Fig 9.17 A junction tree (a) for the Bayesian probabilistic network of (b). Note that we started to construct the transition table for the rectangle R, W. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 26

Figure 9.18. The traffic problem, Figure 9.14, represented t - 1 --> t --> t + 1 Figure 9.18. The traffic problem, Figure 9.14, represented as a dynamic Bayesian network. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 27

Figure 9.19 Typical time series data to be analyzed by a dynamic Bayesian network. Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 28

Fig 9.18 A Markov state machine or Markov chain with four states, s1, ..., s4 Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 29

Luger: Artificial Intelligence, 6th edition Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 30

Luger: Artificial Intelligence, 6th edition Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 31

The HMM is discussed further in Chapter 13 Luger: Artificial Intelligence, 6th edition. © Pearson Education Limited, 2009 32