Representing Uncertainty

Slides:



Advertisements
Similar presentations
Bayesian Networks CSE 473. © Daniel S. Weld 2 Last Time Basic notions Atomic events Probabilities Joint distribution Inference by enumeration Independence.
Advertisements

Probability: Review The state of the world is described using random variables Probabilities are defined over events –Sets of world states characterized.
PROBABILITY. Uncertainty  Let action A t = leave for airport t minutes before flight from Logan Airport  Will A t get me there on time ? Problems :
Where are we in CS 440? Now leaving: sequential, deterministic reasoning Entering: probabilistic reasoning and machine learning.
Reasoning under Uncertainty: Conditional Prob., Bayes and Independence Computer Science cpsc322, Lecture 25 (Textbook Chpt ) March, 17, 2010.
CPSC 422 Review Of Probability Theory.
Probability.
Uncertainty Copyright, 1996 © Dale Carnegie & Associates, Inc. Chapter 13.
Machine Learning II Ensembles & Cotraining CSE 573 Representing Uncertainty.
Uncertainty Chapter 13. Uncertainty Let action A t = leave for airport t minutes before flight Will A t get me there on time? Problems: 1.partial observability.
KI2 - 2 Kunstmatige Intelligentie / RuG Probabilities Revisited AIMA, Chapter 13.
1 Bayesian Reasoning Chapter 13 CMSC 471 Adapted from slides by Tim Finin and Marie desJardins.
University College Cork (Ireland) Department of Civil and Environmental Engineering Course: Engineering Artificial Intelligence Dr. Radu Marinescu Lecture.
Representing Uncertainty CSE 473. © Daniel S. Weld 2 Many Techniques Developed Fuzzy Logic Certainty Factors Non-monotonic logic Probability Only one.
Ai in game programming it university of copenhagen Welcome to... the Crash Course Probability Theory Marco Loog.
Probability and Information Copyright, 1996 © Dale Carnegie & Associates, Inc. A brief review (Chapter 13)
CSE 590ST Statistical Methods in Computer Science Instructor: Pedro Domingos.
CS 561, Sessions 28 1 Uncertainty Probability Syntax Semantics Inference rules.
CIS 410/510 Probabilistic Methods for Artificial Intelligence Instructor: Daniel Lowd.
CPSC 322, Lecture 24Slide 1 Reasoning under Uncertainty: Intro to Probability Computer Science cpsc322, Lecture 24 (Textbook Chpt 6.1, 6.1.1) March, 15,
Uncertainty Chapter 13.
Uncertainty Chapter 13.
CSE 515 Statistical Methods in Computer Science Instructor: Pedro Domingos.
Probabilistic Reasoning
Uncertainty Chapter 13. Uncertainty Let action A t = leave for airport t minutes before flight Will A t get me there on time? Problems: 1.partial observability.
CSCI 121 Special Topics: Bayesian Network Lecture #1: Reasoning Under Uncertainty.
An Introduction to Artificial Intelligence Chapter 13 & : Uncertainty & Bayesian Networks Ramin Halavati
CS 4100 Artificial Intelligence Prof. C. Hafner Class Notes March 13, 2012.
Uncertainty Chapter 13. Outline Uncertainty Probability Syntax and Semantics Inference Independence and Bayes' Rule.
1 Chapter 13 Uncertainty. 2 Outline Uncertainty Probability Syntax and Semantics Inference Independence and Bayes' Rule.
Bayesian Networks What is the likelihood of X given evidence E? i.e. P(X|E) = ?
An Introduction to Artificial Intelligence Chapter 13 & : Uncertainty & Bayesian Networks Ramin Halavati
CSE PR 1 Reasoning - Rule-based and Probabilistic Representing relations with predicate logic Limitations of predicate logic Representing relations.
Uncertainty Uncertain Knowledge Probability Review Bayes’ Theorem Summary.
Chapter 13 February 19, Acting Under Uncertainty Rational Decision – Depends on the relative importance of the goals and the likelihood of.
Uncertainty. Assumptions Inherent in Deductive Logic-based Systems All the assertions we wish to make and use are universally true. Observations of the.
Probability and Information Copyright, 1996 © Dale Carnegie & Associates, Inc. A brief review.
Uncertainty Chapter 13. Outline Uncertainty Probability Syntax and Semantics Inference Independence and Bayes' Rule.
Uncertainty Chapter 13. Outline Uncertainty Probability Syntax and Semantics Inference Independence and Bayes' Rule.
Uncertainty Let action A t = leave for airport t minutes before flight Will A t get me there on time? Problems: 1.partial observability (road state, other.
CSE 473 Uncertainty. © UW CSE AI Faculty 2 Many Techniques Developed Fuzzy Logic Certainty Factors Non-monotonic logic Probability Only one has stood.
Uncertainty Fall 2013 Comp3710 Artificial Intelligence Computing Science Thompson Rivers University.
Outline [AIMA Ch 13] 1 Uncertainty Probability Syntax and Semantics Inference Independence and Bayes' Rule.
Uncertainty & Probability CIS 391 – Introduction to Artificial Intelligence AIMA, Chapter 13 Many slides adapted from CMSC 421 (U. Maryland) by Bonnie.
Computer Science cpsc322, Lecture 25
CHAPTER 5 Handling Uncertainty BIC 3337 EXPERT SYSTEM.
CMPT 310 CHAPTER 13 Oliver Schulte
Quick Review Probability Theory
Quick Review Probability Theory
Uncertainty Chapter 13 Copyright, 1996 © Dale Carnegie & Associates, Inc.
Where are we in CS 440? Now leaving: sequential, deterministic reasoning Entering: probabilistic reasoning and machine learning.
Uncertainty Chapter 13.
Uncertainty Chapter 13.
Where are we in CS 440? Now leaving: sequential, deterministic reasoning Entering: probabilistic reasoning and machine learning.
Uncertainty.
Probability and Information
Uncertainty in Environments
CSE 515 Statistical Methods in Computer Science
Probability and Information
CS 188: Artificial Intelligence Fall 2008
CS 188: Artificial Intelligence Fall 2007
Class #21 – Monday, November 10
Uncertainty Logical approach problem: we do not always know complete truth about the environment Example: Leave(t) = leave for airport t minutes before.
Uncertainty Chapter 13.
Uncertainty Chapter 13.
Uncertainty Chapter 13.
Bayesian Networks CSE 573.
Representing Uncertainty
Uncertainty Chapter 13.
basic probability and bayes' rule
Presentation transcript:

Representing Uncertainty CSE 573

Many Techniques Developed Fuzzy Logic Certainty Factors Non-monotonic logic Probability Only one has stood the test of time! © Daniel S. Weldd © Daniel S. Weld

Aspects of Uncertainty Suppose you have a flight at 12 noon When should you leave for SEATAC What are traffic conditions? How crowded is security? Leaving 18 hours early may get you there But … ? © Daniel S. Weld

Decision Theory = Probability + Utility Theory Min before noon P(arrive-in-time) 20 min 0.05 30 min 0.25 45 min 0.50 60 min 0.75 120 min 0.98 1080 min 0.99 Depends on your preferences Utility theory: representing & reasoning about preferences © Daniel S. Weld

What Is Probability? Probability: Calculus for dealing with nondeterminism and uncertainty Cf. Logic Probabilistic model: Says how often we expect different things to occur Cf. Function © Daniel S. Weld

What Is Statistics? Statistics 1: Describing data Statistics 2: Inferring probabilistic models from data Structure Parameters © Daniel S. Weld

Why Should You Care? The world is full of uncertainty Logic is not enough Computers need to be able to handle uncertainty Probability: new foundation for AI (& CS!) Massive amounts of data around today Statistics and CS are both about data Statistics lets us summarize and understand it Statistics is the basis for most learning Statistics lets data do our work for us © Daniel S. Weld

Outline Basic notions Bayesian networks Statistical learning Atomic events, probabilities, joint distribution Inference by enumeration Independence & conditional independence Bayes’ rule Bayesian networks Statistical learning Dynamic Bayesian networks (DBNs) Markov decision processes (MDPs) © Daniel S. Weld

Logic vs. Probability Symbol: Q, R … Random variable: Q … Domain: you specify e.g. {heads, tails} [1, 6] Boolean values: T, F State of the world: Assignment to Q, R … Z Atomic event: complete specification of world: Q… Z Mutually exclusive Exhaustive Prior probability (aka Unconditional prob: P(Q) Joint distribution: Prob. of every atomic event © Daniel S. Weld

Syntax for Propositions © Daniel S. Weld

Propositions Assume Boolean variables Propositions: A = true B = false © Daniel S. Weld

Why Use Probability? E.g. P(AB) = ? P(A) + P(B) - P(AB) A  B A True © Daniel S. Weld

Prior Probability Any question can be answered by the joint distribution © Daniel S. Weld

Conditional Probability © Daniel S. Weld

Conditional Probability Def: © Daniel S. Weld

Inference by Enumeration P(toothache)=.108+.012+.016+.064 = .20 or 20% This process is called “Marginalization” © Daniel S. Weld

Inference by Enumeration P(toothachecavity = .20 + ?? .072 + .008 .28 © Daniel S. Weld

Inference by Enumeration © Daniel S. Weld

Problems ?? Worst case time: O(nd) Space complexity also O(nd) Where d = max arity And n = number of random variables Space complexity also O(nd) Size of joint distribution How get O(nd) entries for table?? Value of cavity & catch irrelevant - When computing P(toothache) © Daniel S. Weld