Cooperating Intelligent Systems

Slides:



Advertisements
Similar presentations
Bayesian networks Chapter 14 Section 1 – 2. Outline Syntax Semantics Exact computation.
Advertisements

Probabilistic Reasoning Bayesian Belief Networks Constructing Bayesian Networks Representing Conditional Distributions Summary.
Bayesian Networks CSE 473. © Daniel S. Weld 2 Last Time Basic notions Atomic events Probabilities Joint distribution Inference by enumeration Independence.
Artificial Intelligence Universitatea Politehnica Bucuresti Adina Magda Florea
BAYESIAN NETWORKS. Bayesian Network Motivation  We want a representation and reasoning system that is based on conditional independence  Compact yet.
1 Knowledge Engineering for Bayesian Networks. 2 Probability theory for representing uncertainty l Assigns a numerical degree of belief between 0 and.
Identifying Conditional Independencies in Bayes Nets Lecture 4.
For Monday Read chapter 18, sections 1-2 Homework: –Chapter 14, exercise 8 a-d.
For Monday Finish chapter 14 Homework: –Chapter 13, exercises 8, 15.
1 22c:145 Artificial Intelligence Bayesian Networks Reading: Ch 14. Russell & Norvig.
Bayesian Networks Chapter 14 Section 1, 2, 4. Bayesian networks A simple, graphical notation for conditional independence assertions and hence for compact.
CPSC 322, Lecture 26Slide 1 Reasoning Under Uncertainty: Belief Networks Computer Science cpsc322, Lecture 27 (Textbook Chpt 6.3) March, 16, 2009.
Review: Bayesian learning and inference
Bayesian Networks Chapter 2 (Duda et al.) – Section 2.11
Bayesian Networks. Motivation The conditional independence assumption made by naïve Bayes classifiers may seem to rigid, especially for classification.
Probabilistic Reasoning Copyright, 1996 © Dale Carnegie & Associates, Inc. Chapter 14 (14.1, 14.2, 14.3, 14.4) Capturing uncertain knowledge Probabilistic.
Cooperating Intelligent Systems Bayesian networks Chapter 14, AIMA.
Cooperating Intelligent Systems Bayesian networks Chapter 14, AIMA.
Bayesian networks Chapter 14 Section 1 – 2.
Bayesian Belief Networks
Bayesian Networks. Graphical Models Bayesian networks Conditional random fields etc.
5/25/2005EE562 EE562 ARTIFICIAL INTELLIGENCE FOR ENGINEERS Lecture 16, 6/1/2005 University of Washington, Department of Electrical Engineering Spring 2005.
Bayesian Networks Russell and Norvig: Chapter 14 CMCS424 Fall 2003 based on material from Jean-Claude Latombe, Daphne Koller and Nir Friedman.
Announcements Homework 8 is out Final Contest (Optional)
1 Bayesian Networks Chapter ; 14.4 CS 63 Adapted from slides by Tim Finin and Marie desJardins. Some material borrowed from Lise Getoor.
Bayesian Reasoning. Tax Data – Naive Bayes Classify: (_, No, Married, 95K, ?)
Bayesian networks More commonly called graphical models A way to depict conditional independence relationships between random variables A compact specification.
1 CMSC 471 Fall 2002 Class #19 – Monday, November 4.
EE562 ARTIFICIAL INTELLIGENCE FOR ENGINEERS
Advanced Artificial Intelligence
Bayesian Networks Material used 1 Random variables
Artificial Intelligence CS 165A Tuesday, November 27, 2007  Probabilistic Reasoning (Ch 14)
Read R&N Ch Next lecture: Read R&N
Bayes’ Nets  A Bayes’ net is an efficient encoding of a probabilistic model of a domain  Questions we can ask:  Inference: given a fixed BN, what is.
Bayesian networks Chapter 14. Outline Syntax Semantics.
Bayesian networks Chapter 14 Section 1 – 2. Bayesian networks A simple, graphical notation for conditional independence assertions and hence for compact.
Probabilistic Belief States and Bayesian Networks (Where we exploit the sparseness of direct interactions among components of a world) R&N: Chap. 14, Sect.
Bayesian networks. Motivation We saw that the full joint probability can be used to answer any question about the domain, but can become intractable as.
1 Chapter 14 Probabilistic Reasoning. 2 Outline Syntax of Bayesian networks Semantics of Bayesian networks Efficient representation of conditional distributions.
For Wednesday Read Chapter 11, sections 1-2 Program 2 due.
2 Syntax of Bayesian networks Semantics of Bayesian networks Efficient representation of conditional distributions Exact inference by enumeration Exact.
Baye’s Rule.
1 Monte Carlo Artificial Intelligence: Bayesian Networks.
An Introduction to Artificial Intelligence Chapter 13 & : Uncertainty & Bayesian Networks Ramin Halavati
Announcements Project 4: Ghostbusters Homework 7
1 CMSC 671 Fall 2001 Class #21 – Tuesday, November 13.
The famous “sprinkler” example (J. Pearl, Probabilistic Reasoning in Intelligent Systems, 1988)
Probabilistic Reasoning [Ch. 14] Bayes Networks – Part 1 ◦Syntax ◦Semantics ◦Parameterized distributions Inference – Part2 ◦Exact inference by enumeration.
Marginalization & Conditioning Marginalization (summing out): for any sets of variables Y and Z: Conditioning(variant of marginalization):
Review: Bayesian inference  A general scenario:  Query variables: X  Evidence (observed) variables and their values: E = e  Unobserved variables: Y.
Inference Algorithms for Bayes Networks
1 CMSC 671 Fall 2001 Class #20 – Thursday, November 8.
CPSC 322, Lecture 26Slide 1 Reasoning Under Uncertainty: Belief Networks Computer Science cpsc322, Lecture 27 (Textbook Chpt 6.3) Nov, 13, 2013.
Conditional Independence As with absolute independence, the equivalent forms of X and Y being conditionally independent given Z can also be used: P(X|Y,
PROBABILISTIC REASONING Heng Ji 04/05, 04/08, 2016.
Chapter 12. Probability Reasoning Fall 2013 Comp3710 Artificial Intelligence Computing Science Thompson Rivers University.
CS 2750: Machine Learning Bayesian Networks Prof. Adriana Kovashka University of Pittsburgh March 14, 2016.
Web-Mining Agents Data Mining Prof. Dr. Ralf Möller Universität zu Lübeck Institut für Informationssysteme Karsten Martiny (Übungen)
Bayesian Networks Chapter 2 (Duda et al.) – Section 2.11 CS479/679 Pattern Recognition Dr. George Bebis.
A Brief Introduction to Bayesian networks
CS 2750: Machine Learning Directed Graphical Models
Bayesian Networks Chapter 14 Section 1, 2, 4.
Bayesian networks Chapter 14 Section 1 – 2.
Presented By S.Yamuna AP/CSE
CAP 5636 – Advanced Artificial Intelligence
Class #19 – Tuesday, November 3
Class #16 – Tuesday, October 26
Bayesian networks Chapter 14 Section 1 – 2.
Probabilistic Reasoning
Presentation transcript:

Cooperating Intelligent Systems Bayesian networks Chapter 14, AIMA

Inference Inference in the statistical setting means computing probabilities for different outcomes to be true given the information We need an efficient method for doing this, which is more powerful than the naïve Bayes model.

Bayesian networks A Bayesian network is a directed graph in which each node is annotated with quantitative probability information: A set of random variables, {X1,X2,X3,...}, makes up the nodes of the network. A set of directed links connect pairs of nodes, parent  child Each node Xi has a conditional probability distribution P(Xi | Parents(Xi)) . The graph is a directed acyclic graph (DAG).

The dentist network Weather Cavity Toothache Catch

The alarm network Burglar alarm responds to both earthquakes and burglars. Two neighbors: John and Mary, who have promised to call you when the alarm goes off. John always calls when there’s an alarm, and sometimes when there’s not an alarm. Mary sometimes misses the alarms (she likes loud music). Burglary Earthquake Alarm JohnCalls MaryCalls

The cancer network Age Gender Smoking Toxics Cancer Serum Calcium Lung Tumour Genetic Damage From Breese and Coller 1997

The cancer network P(A,G) = P(A)P(G) Age Gender Toxics Smoking P(C|S,T,A,G) = P(C|S,T) Cancer Genetic Damage Serum Calcium Lung Tumour P(A,G,T,S,C,SC,LT,GD) = P(A)P(G)P(T|A)P(S|A,G) P(C|T,S)P(GD)P(SC|C) P(LT|C,GD) P(SC,C,LT,GD) = P(SC|C)P(LT|C,GD)P(C) P(GD) From Breese and Coller 1997

The product (chain) rule (This is for Bayesian networks, the general case comes later in this lecture)

Bayes network node is a function a∧b a∧¬b ¬a∧b ¬a∧¬b Min 0.1 0.3 0.7 0.0 Max 1.5 1.1 1.9 0.9 P(C|¬a,b) = U[0.7,1.9] 0.7 1.9

Bayes network node is a function A BN node is a conditional distribution function Inputs = Parent values Output = distribution over values Any type of function from values to distributions.

Example: The alarm network Note: Each number in the tables represents a boolean distribution. Hence there is a distribution output for every input. Alarm Burglary Earthquake JohnCalls MaryCalls P(B=b) 0.001 P(E=e) 0.002 B E P(A=a) b e 0.95 ¬e 0.94 ¬b 0.29 0.001 A P(J=j) a 0.90 ¬a 0.05 A P(M=m) a 0.70 ¬a 0.01

Example: The alarm network Burglary Earthquake JohnCalls MaryCalls Probability distribution for ”no earthquake, no burglary, but alarm, and both Mary and John make the call” P(B=b) 0.001 P(E=e) 0.002 B E P(A=a) b e 0.95 ¬e 0.94 ¬b 0.29 0.001 A P(J=j) a 0.90 ¬a 0.05 A P(M=m) a 0.70 ¬a 0.01

Meaning of Bayesian network The general chain rule (always true): The Bayesian network chain rule: The BN is a correct representation of the domain iff each node is conditionally independent of its predecessors, given its parents.

The alarm network The fully correct alarm network might look something like the figure. The Bayesian network (red) assumes that some of the variables are independent (or that the dependecies can be neglected since they are very weak). The correctness of the Bayesian network of course depends on the validity of these assumptions. Alarm Burglary Earthquake JohnCalls MaryCalls Alarm Burglary Earthquake JohnCalls MaryCalls It is this sparse connection structure that makes the BN approach feasible (~linear growth in complexity rather than exponential)

How construct a BN? Add nodes in causal order (”causal” determined from expertize). Determine conditional independence using either (or all) of the following semantics: Blocking/d-separation rule Non-descendant rule Markov blanket rule Experience/your beliefs

Path blocking & d-separation Cancer Serum Calcium Lung Tumour Genetic Damage Intuitively, knowledge about Serum Calcium influences our belief about Cancer, if we don’t know the value of Cancer, which in turn influences our belief about Lung Tumour, etc. However, if we are given the value of Cancer (i.e. C= true or false), then knowledge of Serum Calcium will not tell us anything about Lung Tumour that we don’t already know. We say that Cancer d-separates (direction-dependent separation) Serum Calcium and Lung Tumour.

Path blocking & d-separation Xi and Xj are d-separated if all paths betweeen them are blocked Two nodes Xi and Xj are conditionally independent given a set W = {X1,X2,X3,...} of nodes if for every undirected path in the BN between Xi and Xj there is some node Xk on the path having one of the following three properties: Xi Xj Xk1 Xk2 Xk3 W Xk ∈ W, and both arcs on the path lead out of Xk. Xk ∈ W, and one arc on the path leads into Xk and one arc leads out. Neither Xk nor any descendant of Xk is in W, and both arcs on the path lead into Xk. Xk blocks the path between Xi and Xj Xk1 Xk2 Xk3

Non-descendants A node is conditionally independent of its non-descendants (Zij), given its parents.

Markov blanket X2 X3 X1 A node is conditionally independent of all other nodes in the network, given its parents, children, and children’s parents These constitute the nodes Markov blanket. X4 X5 X6 Xk

Efficient representation of PDs P(C|a,b) ? Boolean  Boolean Boolean  Discrete Boolean  Continuous Discrete  Boolean Discrete  Discrete Discrete  Continuous Continuous  Boolean Continuous  Discrete Continuous  Continuous B

Efficient representation of PDs Boolean  Boolean: Noisy-OR, Noisy-AND Boolean/Discrete  Discrete: Noisy-MAX Bool./Discr./Cont.  Continuous: Parametric distribution (e.g. Gaussian) Continuous  Boolean: Logit/Probit

Noisy-OR example Boolean → Boolean P(E|C1,C2,C3) C1 1 C2 C3 P(E=0) 0.1 0.01 0.001 P(E=1) 0.9 0.99 0.999 The effect (E) is off (false) when none of the causes are true. The probability for the effect increases with the number of true causes. (for this example) Example from L.E. Sucar

Noisy-OR general case Boolean → Boolean q1 P(E|C1,...) C1 C2 Cn q2 qn PROD Example on previous slide used qi = 0.1 for all i. Image adapted from Laskey & Mahoney 1999

Noisy-MAX Boolean → Discrete Observed effect C1 C2 Cn e2 en MAX Effect takes on the max value from different causes Restrictions: Each cause must have an off state, which does not contribute to effect Effect is off when all causes are off Effect must have consecutive escalating values: e.g., absent, mild, moderate, severe. Image adapted from Laskey & Mahoney 1999

Parametric probability densities Boolean/Discr Parametric probability densities Boolean/Discr./Continuous → Continuous Use parametric probability densities, e.g., the normal distribution Gaussian networks (a = input to the node)

Probit & Logit Discrete → Boolean If the input is continuous but output is boolean, use probit or logit P(A|x) x

The cancer network Age Gender Smoking Toxics Cancer Serum Calcium Lung Tumour Discrete Discrete/boolean Age: {1-10, 11-20,...} Gender: {M, F} Toxics: {Low, Medium, High} Smoking: {No, Light, Heavy} Cancer: {No, Benign, Malignant} Serum Calcium: Level Lung Tumour: {Yes, No} Discrete Discrete Discrete Continuous Discrete/boolean

Inference in BN P(Burglary | john_calls, mary_calls) Inference means computing P(X|e), where X is a query (variable) and e is a set of evidence variables (for which we know the values). Examples: P(Burglary | john_calls, mary_calls) P(Cancer | age, gender, smoking, serum_calcium) P(Cavity | toothache, catch)

Exact inference in BN ”Doable” for boolean variables: Look up entries in conditional probability tables (CPTs).

Example: The alarm network What is the probability for a burglary if both John and Mary call? Alarm Burglary Earthquake JohnCalls MaryCalls Evidence variables = {J,M} Query variable = B P(E=e) 0.002 P(B=b) 0.001 B E P(A=a) b e 0.95 ¬e 0.94 ¬b 0.29 0.001 A P(J=j) a 0.90 ¬a 0.05 A P(M=m) a 0.70 ¬a 0.01

Example: The alarm network What is the probability for a burglary if both John and Mary call? Alarm Burglary Earthquake JohnCalls MaryCalls P(E=e) 0.002 P(B=b) 0.001 = 0.001 = 10-3 B E P(A=a) b e 0.95 ¬e 0.94 ¬b 0.29 0.001 A P(J=j) a 0.90 ¬a 0.05 A P(M=m) a 0.70 ¬a 0.01

Example: The alarm network What is the probability for a burglary if both John and Mary call? Alarm Burglary Earthquake JohnCalls MaryCalls P(E=e) 0.002 P(B=b) 0.001 B E P(A=a) b e 0.95 ¬e 0.94 ¬b 0.29 0.001 A P(J=j) a 0.90 ¬a 0.05 A P(M=m) a 0.70 ¬a 0.01

Example: The alarm network What is the probability for a burglary if both John and Mary call? Alarm Burglary Earthquake JohnCalls MaryCalls P(E=e) 0.002 P(B=b) 0.001 B E P(A=a) b e 0.95 ¬e 0.94 ¬b 0.29 0.001 A P(J=j) a 0.90 ¬a 0.05 A P(M=m) a 0.70 ¬a 0.01

Example: The alarm network What is the probability for a burglary if both John and Mary call? Answer: 28% Alarm Burglary Earthquake JohnCalls MaryCalls P(E=e) 0.002 P(B=b) 0.001 B E P(A=a) b e 0.95 ¬e 0.94 ¬b 0.29 0.001 A P(J=j) a 0.90 ¬a 0.05 A P(M=m) a 0.70 ¬a 0.01

Use depth-first search A lot of unneccesary repeated computation...

Complexity of exact inference By eliminating repeated calculation & uninteresting paths we can speed up the inference a lot. Linear time complexity for singly connected networks (polytrees). Exponential for multiply connected networks. Clustering can improve this

Approximate inference in BN Exact inference is intractable in large multiply connected BNs ⇒ use approximate inference: Monte Carlo methods (random sampling). Direct sampling Rejection sampling Likelihood weighting Markov chain Monte Carlo

Markov chain Monte Carlo Fix the evidence variables (E1, E2, ...) at their given values. Initialize the network with values for all other variables, including the query variable. Repeat the following many, many, many times: Pick a non-evidence variable at random (query Xi or hidden Yj) Select a new value for this variable, conditioned on the current values in the variable’s Markov blanket. Monitor the values of the query variables.