Decision Support Systems. Rule based Systems if A then B If pump failure then the pressure is low If pump failure then check oil level If power failure.

Slides:



Advertisements
Similar presentations
Uncertainty in Expert Systems (Certainty Factors).
Advertisements

Uncertainty Everyday reasoning and decision making is based on uncertain evidence and inferences. Classical logic only allows conclusions to be strictly.
Bayesian Decision Theory
Back-propagation Chih-yun Lin 5/16/2015. Agenda Perceptron vs. back-propagation network Network structure Learning rule Why a hidden layer? An example:
Causal and Bayesian Network (Chapter 2) Book: Bayesian Networks and Decision Graphs Author: Finn V. Jensen, Thomas D. Nielsen CSE 655 Probabilistic Reasoning.
Data Mining Classification: Naïve Bayes Classifier
Probabilities Random Number Generators –Actually pseudo-random –Seed Same sequence from same seed Often time is used. Many examples on web. Custom random.
1 Chapter 12 Probabilistic Reasoning and Bayesian Belief Networks.
Bayesian networks Chapter 14 Section 1 – 2.
Bayesian Belief Networks
Neural Networks Marco Loog.
Artificial Intelligence and Lisp Lecture 7 LiU Course TDDC65 Autumn Semester, 2010
Representing Uncertainty CSE 473. © Daniel S. Weld 2 Many Techniques Developed Fuzzy Logic Certainty Factors Non-monotonic logic Probability Only one.
5/25/2005EE562 EE562 ARTIFICIAL INTELLIGENCE FOR ENGINEERS Lecture 16, 6/1/2005 University of Washington, Department of Electrical Engineering Spring 2005.
Bayesian networks practice. Semantics e.g., P(j  m  a   b   e) = P(j | a) P(m | a) P(a |  b,  e) P(  b) P(  e) = … Suppose we have the variables.
Lesson 5.2 (PART 2) FUNCTION NOTATION.
CS 561, Sessions 28 1 Uncertainty Probability Syntax Semantics Inference rules.
For Monday after Spring Break Read Homework: –Chapter 13, exercise 6 and 8 May be done in pairs.
Jeff Howbert Introduction to Machine Learning Winter Classification Bayesian Classifiers.
An example of a critical system
Quiz 4: Mean: 7.0/8.0 (= 88%) Median: 7.5/8.0 (= 94%)
DATA MINING : CLASSIFICATION. Classification : Definition  Classification is a supervised learning.  Uses training sets which has correct answers (class.
Anomaly detection with Bayesian networks Website: John Sandiford.
Midterm Review Rao Vemuri 16 Oct Posing a Machine Learning Problem Experience Table – Each row is an instance – Each column is an attribute/feature.
Soft Computing Lecture 17 Introduction to probabilistic reasoning. Bayesian nets. Markov models.
Digital Statisticians INST 4200 David J Stucki Spring 2015.
Bayesian Networks Martin Bachler MLA - VO
Bayesian Networks for Data Mining David Heckerman Microsoft Research (Data Mining and Knowledge Discovery 1, (1997))
Bayesian Classification. Bayesian Classification: Why? A statistical classifier: performs probabilistic prediction, i.e., predicts class membership probabilities.
© Tan,Steinbach, Kumar Introduction to Data Mining 4/18/ Statistical Inference (By Michael Jordon) l Bayesian perspective –conditional perspective—inferences.
Section 6-5 The Central Limit Theorem. THE CENTRAL LIMIT THEOREM Given: 1.The random variable x has a distribution (which may or may not be normal) with.
Mathematics. Session Definite Integrals –1 Session Objectives  Fundamental Theorem of Integral Calculus  Evaluation of Definite Integrals by Substitution.
CS621 : Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 30 Uncertainty, Fuizziness.
METU Informatics Institute Min720 Pattern Classification with Bio-Medical Applications Lecture notes 9 Bayesian Belief Networks.
1 Chapter 12 Probabilistic Reasoning and Bayesian Belief Networks.
Chapter 6 Bayesian Learning
4 Proposed Research Projects SmartHome – Encouraging patients with mild cognitive disabilities to use digital memory notebook for activities of daily living.
12/7/20151 Math b Conditional Probability, Independency, Bayes Theorem.
 Probability in Propagation. Transmission Rates  Models discussed so far assume a 100% transmission rate to susceptible individuals (e.g. Firefighter.
Analytical Toolbox Integral CalculusBy Dr J.P.M. Whitty.
Mathematics. Session Indefinite Integrals -1 Session Objectives  Primitive or Antiderivative  Indefinite Integral  Standard Elementary Integrals 
Clinical Decision Support 1 Historical Perspectives.
International Conference on Fuzzy Systems and Knowledge Discovery, p.p ,July 2011.
1 Bayesian Networks: A Tutorial. 2 Introduction Suppose you are trying to determine if a patient has tuberculosis. You observe the following symptoms:
Quiz 3: Mean: 9.2 Median: 9.75 Go over problem 1.
Ch 9 – Properties and Attributes of Functions 9.4 – Operations with Functions.
Bayesian Learning Bayes Theorem MAP, ML hypotheses MAP learners
The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL Classification COMP Seminar BCB 713 Module Spring 2011.
Matching ® ® ® Global Map Local Map … … … obstacle Where am I on the global map?                                   
Chapter 12. Probability Reasoning Fall 2013 Comp3710 Artificial Intelligence Computing Science Thompson Rivers University.
Bayesian Classification 1. 2 Bayesian Classification: Why? A statistical classifier: performs probabilistic prediction, i.e., predicts class membership.
Bayes’ Theorem Suppose we have estimated prior probabilities for events we are concerned with, and then obtain new information. We would like to a sound.
Bayesian networks Chapter 14 Section 1 – 2.
What is Probability? Quantification of uncertainty.
Quick Review Probability Theory
Quick Review Probability Theory
Calculus section 1.1 – 1.4 Review algebraic concepts
Component 11: Configuring EHRs
Take it Easy with your Diabetes
Type 1 Diabetes: Meters, Pumps, and Transitions to Adulthood
Bayesian Classification
Representing Uncertainty
Operational Research (OR)
Data Mining: Concepts and Techniques (3rd ed.) — Chapter 8 —
Chapter14-cont..
FUNCTION NOTATION.
Bayesian networks Chapter 14 Section 1 – 2.
Chapter 14 February 26, 2004.
basic probability and bayes' rule
Presentation transcript:

Decision Support Systems

Rule based Systems if A then B If pump failure then the pressure is low If pump failure then check oil level If power failure then pump failure Uncertainty If A (with certainty x) then B (with certainty f(x)) If C (with certainty x) then B (with certainty g(x) If we now get the information that A holds with certainty a and C holds with certainty c, what is the certainty of B?

Rule based Systems – cont. If blood glucose is low before lunch, then take less insulin in the morning Model of the doctor Easy to build ? Easy to maintain ? Easy to understand for clinicians and patients ? Problems with uncertainty and variability

Rule based Systems – cont.

Neural Networks

Bayesian Networks If tonsillitis then P(temp>37.9) = 0.75 If whooping cough then P(temp>37.9) = 0.65 One could be lead to read this as rules. They shouldn't be. So a different notation is used: P(temp>37.9 | whooping cough) = 0.65 P(temp>37.9 | whooping cough, tonsillitis)

Bayesian Networks - cont Bayes' theorem: P(A | B)P(B) = P(B | A)P(A) uses a global perspective calculates the new probabilities correctly in rule based systems you try to model the experts way of reasoning (hence the name expert systems), while with Bayesian networks you try to model dependencies in the domain itself

Example diabetes Predictions of blood glucose levels based on mathematical models of the carbohydrate metabolism Illustrate the effect of changing e.g. insulin Model of the patient Can handle uncertainty and variability ? Problems with various factors, e.g. stress, fever, alcohol, exercise etc.

Comparing Neural Networks and Bayesian Networks The fundamental difference between the two types of networks is that a perceptrone in the hidden layers does not in itself have an interpretation in the domain of the system, whereas all the nodes of a Bayesian network represent concepts that are well defined with respect to the domain.