Introduction to Model- Based Diagnosis Meir Kalech Partially based on the slides of Peter Struss.

Slides:



Advertisements
Similar presentations
Recognising Languages We will tackle the problem of defining languages by considering how we could recognise them. Problem: Is there a method of recognising.
Advertisements

Completeness and Expressiveness
Using UML, Patterns, and Java Object-Oriented Software Engineering Chapter 1: Introduction.
Naïve Bayes. Bayesian Reasoning Bayesian reasoning provides a probabilistic approach to inference. It is based on the assumption that the quantities of.
Lecture 24 MAS 714 Hartmut Klauck
Consistency-Based Diagnosis
1 Fault Diagnosis for Timed Automata Stavros Tripakis VERIMAG.
MBD and CSP Meir Kalech Partially based on slides of Jia You and Brian Williams.
UIUC CS 497: Section EA Lecture #2 Reasoning in Artificial Intelligence Professor: Eyal Amir Spring Semester 2004.
The Logic of Intelligence Pei Wang Department of Computer and Information Sciences Temple University.
CPSC 502, Lecture 15Slide 1 Introduction to Artificial Intelligence (AI) Computer Science cpsc502, Lecture 15 Nov, 1, 2011 Slide credit: C. Conati, S.
MBD in real-world system… Self-Configuring Systems Meir Kalech Partially based on slides of Brian Williams.
Parallel Scheduling of Complex DAGs under Uncertainty Grzegorz Malewicz.
Resolution Theorem Prover in First-Order Logic
© C. Kemke1Reasoning - Introduction COMP 4200: Expert Systems Dr. Christel Kemke Department of Computer Science University of Manitoba.
1 Lecture 4 Topics –Problem solving Subroutine Theme –REC language class The class of solvable problems Closure properties.
UNIVERSITY OF SOUTH CAROLINA Department of Computer Science and Engineering CSCE 580 Artificial Intelligence Ch.5 [P]: Propositions and Inference Sections.
Knowledge Representation & Reasoning.  Introduction How can we formalize our knowledge about the world so that:  We can reason about it?  We can do.
Measurements Meir Kalech Partially Based on slides of Brian Williams and Peter struss.
Firewall Policy Queries Author: Alex X. Liu, Mohamed G. Gouda Publisher: IEEE Transaction on Parallel and Distributed Systems 2009 Presenter: Chen-Yu Chang.
Knowledge Acquisitioning. Definition The transfer and transformation of potential problem solving expertise from some knowledge source to a program.
Models -1 Scientists often describe what they do as constructing models. Understanding scientific reasoning requires understanding something about models.
1 Learning Entity Specific Models Stefan Niculescu Carnegie Mellon University November, 2003.
Introduction to Computational Natural Language Learning Linguistics (Under: Topics in Natural Language Processing ) Computer Science (Under:
Automated Reasoning Matt Whipple and Brian Vees. Overview What is automated reasoning? What is automated reasoning? Properties of inference procedures.
Data Mining with Decision Trees Lutz Hamel Dept. of Computer Science and Statistics University of Rhode Island.
Scientific Thinking - 1 A. It is not what the man of science believes that distinguishes him, but how and why he believes it. B. A hypothesis is scientific.
Theoretical Computer Science COMP 335 Fall 2004
Artificial Intelligence Chapter 17 Knowledge-Based Systems Biointelligence Lab School of Computer Sci. & Eng. Seoul National University.
Syntactic Pattern Recognition Statistical PR:Find a feature vector x Train a system using a set of labeled patterns Classify unknown patterns Ignores relational.
October 17-19, 2001ESA Workshop “On-Board Autonomy” Efficiency Issues in Model-Based Approaches to On-Board Diagnosis P.Torasso, C.Picardi and L. Console.
Knowledge Representation and Reasoning University "Politehnica" of Bucharest Department of Computer Science Fall 2010 Adina Magda Florea
Structural Abstraction for Strong Fault Models Diagnosis (DX 2014 BISFAI 2015) Roni SternMeir KalechOrel Elimelech Ben Gurion University of the Negev,
Inductive Logic Programming Includes slides by Luis Tari CS7741L16ILP.
Knowledge representation
 Knowledge Acquisition  Machine Learning. The transfer and transformation of potential problem solving expertise from some knowledge source to a program.
1 TMS and ATMS Philippe Dague and Yuhong YAN NRC-IIT
Ming Fang 6/12/2009. Outlines  Classical logics  Introduction to DL  Syntax of DL  Semantics of DL  KR in DL  Reasoning in DL  Applications.
INTRODUCTION TO THE THEORY OF COMPUTATION INTRODUCTION MICHAEL SIPSER, SECOND EDITION 1.
1 ISAT 252: Analytical Methods IV Knowledge-Based Systems (KBS) and Declarative Programming KBS development and KBSDT Details Reading Assignment: Corvid.
Pattern-directed inference systems
Advanced Topics in Propositional Logic Chapter 17 Language, Proof and Logic.
1 Knowledge Representation. 2 Definitions Knowledge Base Knowledge Base A set of representations of facts about the world. A set of representations of.
Dr. Shazzad Hosain Department of EECS North South Universtiy Lecture 04 – Part A Knowledge Representation and Reasoning.
CS344: Introduction to Artificial Intelligence Lecture: Herbrand’s Theorem Proving satisfiability of logic formulae using semantic trees (from Symbolic.
Kansas State University Department of Computing and Information Sciences CIS 830: Advanced Topics in Artificial Intelligence Monday, January 22, 2001 William.
Reading and Writing Mathematical Proofs Spring 2015 Lecture 4: Beyond Basic Induction.
Induction Proof. Well-ordering A set S is well ordered if every subset has a least element. [0, 1] is not well ordered since (0,1] has no least element.
Machine Learning Chapter 5. Artificial IntelligenceChapter 52 Learning 1. Rote learning rote( โรท ) n. วิถีทาง, ทางเดิน, วิธีการตามปกติ, (by rote จากความทรงจำ.
March 1999Dip HI KBS1 Knowledge-based Systems Alternatives to Rules.
Kansas State University Department of Computing and Information Sciences CIS 730: Introduction to Artificial Intelligence Lecture 13 of 41 Monday, 20 September.
Complexity and Computability Theory I Lecture #2 Rina Zviel-Girshin Leah Epstein Winter
Kansas State University Department of Computing and Information Sciences CIS 730: Introduction to Artificial Intelligence Lecture 9 of 42 Wednesday, 14.
ICS 253: Discrete Structures I Induction and Recursion King Fahd University of Petroleum & Minerals Information & Computer Science Department.
THEORY OF COMPUTATION Komate AMPHAWAN 1. 2.
Chapter 17. Assertions State Assertion – predicate intended to express that a descriptive or prescriptive property holds in an arbitrarily chose current.
1 Consistent-based Diagnosis Yuhong YAN NRC-IIT. 2 Main concepts in this paper  (Minimal) Diagnosis  Conflict Set  Proposition 3.3  Corollary 4.5.
Functional Dependencies CIS 4301 Lecture Notes Lecture 8 - 2/7/2006.
MA/CSSE 474 Theory of Computation Minimizing DFSMs.
Transparency No. 4-1 Formal Language and Automata Theory Chapter 4 Patterns, Regular Expressions and Finite Automata (include lecture 7,8,9) Transparency.
Concept Learning and The General-To Specific Ordering
Assumption-based Truth Maintenance Systems: Motivation n Problem solvers need to explore multiple contexts at the same time, instead of a single one (the.
Section Recursion 2  Recursion – defining an object (or function, algorithm, etc.) in terms of itself.  Recursion can be used to define sequences.
Network Management Lecture 13. MACHINE LEARNING TECHNIQUES 2 Dr. Atiq Ahmed Université de Balouchistan.
CS 9633 Machine Learning Concept Learning
REASONING WITH UNCERTANITY
Chapter 9 TURING MACHINES.
MA/CSSE 474 More Math Review Theory of Computation
Logics for Data and Knowledge Representation
Knowledge Representation
Presentation transcript:

Introduction to Model- Based Diagnosis Meir Kalech Partially based on the slides of Peter Struss

Outline  Last lecture: 1. What is a diagnosis? 2. Expert systems 3. Model-based systems 4. Case Based Reasoning (CBR) 5. Inductive learning 6. Probabilistic reasoning  Today’s lecture: 1. Knowledge-based systems and diagnosis 2. Some definitions for model-based diagnosis 3. Reiter’s MBD algorithm using HS-trees 4. Causal form

Knowledge-based Systems are not simply  Systems based on knowledge are not simply  Systems based on knowledge but  Systems grounding their solution on a knowledge base but  Systems grounding their solution on a knowledge base Problem solver Knowledge base  Model-based systems are knowledge-based systems

Knowledge base:  an explicit  declarative  formal representation  of knoweldge about a certain domain and/or class of tasks Knowledge base:  an explicit  declarative  formal representation  of knoweldge about a certain domain and/or class of tasks Provlem solver:  A usually task-specific,  possibly domain-independent  algorithm which can process the represented knowledge Provlem solver:  A usually task-specific,  possibly domain-independent  algorithm which can process the represented knowledge Knowledge Base and Problem Solver Problem solver Knowledge base

For instance: diagnosis Observations:  “When braking with ABS, car is yawing to the right, and brake pedal feels harder than normally”  “Yawing”:  under-braking at left side  over-braking at right side Observations:  “When braking with ABS, car is yawing to the right, and brake pedal feels harder than normally”  “Yawing”:  under-braking at left side  over-braking at right side under- braked under- braked over- braked over- braked harder

under- braked under- braked over- braked over- braked harder Knowledge about the subject  „How is it structured?”  “How does it work?”  Knowledge about  Structure  Componenten behavior Knowledge about the subject  „How is it structured?”  “How does it work?”  Knowledge about  Structure  Componenten behavior Diagnosis Algorithm  From knowledge about the subject  and observations of the system behavior  infer diagnosis hypotheses Diagnosis Algorithm  From knowledge about the subject  and observations of the system behavior  infer diagnosis hypotheses Diagnosis: „What“ and „How“

 Notation entails does not entail  inconsistency, “false” is consistent is inconsistent ^ 

Diagnosis OBS ? Task:  Determine, based on a set of observations:  What`s going on in the system?

Model-based Diagnosis Task:  Determine system models  that are consistent with the observations OBS ? MODEL

Outline  Last lecture: 1. What is a diagnosis? 2. Expert systems 3. Model-based systems 4. Case Based Reasoning (CBR) 5. Inductive learning 6. Probabilistic reasoning  Today’s lecture: 1. Knowledge-based systems and diagnosis 2. Some definitions for model-based diagnosis 3. Reiter’s MBD algorithm using HS-trees

Model-Based Diagnosis – Formal Based on: R. Reiter, A theory of diagnosis from first principles, Artificial Intelligence 32 (1) (1987)

Definition: System A system is a pair (SD, COMP) where:  (1) SD (system description), is a set of first-order sentences.  (2) COMP={C 1,…,C n }, the system components, is a finite set of constants.

Example: System

Etc…

Definition: Observation An observation of a system is a finite set of first-order sentences. We shall write (SD, COMP, OBS) for system (SD, COMP) with observation OBS. Example:

Definition: Diagnosis Problem Given SD, COMP and OBS, the observation conflicts with the system description assuming all its components behaving correctly. Formally: SD  {¬AB(Ci)|Ci  COMP}  OBS ⊢⊥

Example: System is faulty

Definition: Diagnosis A diagnosis for (SD, COMP, OBS) is a minimal set ∆ ∈ COMP such that: SD  {AB(C i )|C i ∈ Δ}  {¬AB(C i )|C i ∈ COMP- Δ}  OBS ⊢⊥ Example: ∆ 1 ={X 1 }, ∆ 2 ={X 2, O 1 }, ∆ 3 ={X 2, A 2 }

Example: ∆ 1 ={X 1 }

Example: ∆ 2 ={X 2, O 1 }

Example: ∆ 3 ={X 2, A 2 }

Definition: Conflict set A conflict set for (SD, COMP, OBS) is a set {c 1 …c k }  COMP such that: SD  OBS  {¬AB(C 1 )…¬AB(C k )} ⊢⊥ A conflict set is minimal iff no proper subset of it is a conflict set.

The relation between conflict set and diagnosis Δ  COMP is a diagnosis for (SD, COMP, OBS) iff Δ is a minimal set such that COMP- Δ is not a conflict set for (SD,COMP, OBS). In other words: 1. the components that are normal ( ¬AB(C i )) could not be a conflict set 2. a conflict set must contain at least one component of the diagnosis.

Definition: Hitting set Suppose C is a collection of sets. A hitting set for C is a set H   S ∈ C S such that H  S  { } for each S ∈ C. A hitting set for C is minimal iff no proper subset of it is a hitting set for C. Example: S1={1,2,3}S2={2,4,5}S3={4,6} Minimal: H1={1,5,6}, H2={2,4}, H3={2,6} Not minimal: H4={2,4,6}

Δ  COMP is a diagnosis for (SD,COMP, OBS) iff Δ is a minimal hitting set for the collection of minimal conflict sets for (SD, COMP, OBS). Example: The full adder has two minimal conflict sets: {X1, X2} and {X1, A2, O1} There are three diagnoses, given by these minimal hitting sets: {X1}, {X2, A2}, {X2, O1}. Theorem of diagnosis

Example: conflict set {X1, X2}

Example: conflict set {X1,A2,O1}

How to compute 1. Conflict sets 2. Diagnosis

Outline  Last lecture: 1. What is a diagnosis? 2. Expert systems 3. Model-based systems 4. Case Based Reasoning (CBR) 5. Inductive learning 6. Probabilistic reasoning  Today’s lecture: 1. Knowledge-based systems and diagnosis 2. Some definitions for model-based diagnosis 3. Reiter’s MBD algorithm using HS-trees

Computing diagnosis Assume conflict sets: {2,4,5},{1,2,3},{1,3,5}, {2,4,6},{2,4},{2,3,5},{1,6}. HS-tree:

Pruning 1. If node n is labelled by √ and node n’ is such that H(n)  H(n'), close n’.

Pruning 1 n3={1,2}, n9={1,3,2}, H(n3)H(n9): close n9.

Pruning 1. If node n is labelled by √ and node n’ is such that H(n)  H(n') then close n’. 2. If node n has been generated and node n' is such that H(n')= H(n) then close n'.

Pruning 2 n6={5,4}, n8={4,5}, H(n6)=H(n8): close n8.

Pruning 1. If node n is labelled by √ and node n’ is such that H(n)  H(n'), close n’. 2. If node n has been generated and node n' is such that H(n')= H(n) then close n'. 3. If nodes n and n' have been respectively labelled by sets S and S' of F, and if S'  S, then for each  S-S' mark as redundant the edge from node n labelled by .

Pruning 3 n10={2,4}, n0={2,4,5}, n10  n0: mark 5 as redundant since {2,4} is not hit by it.

Finally tree after pruning

Diagnosis: {H(n)|n is labelled by √ }

Computing conflict sets Using “resolution theorem prover”. See the next slides. Homework: 1. Analyse the complexity of the diagnosis process. 2. Read Reiter’s paper (bib 1), describe the algorithm he proposes for calculating the diagnosis and the conflict sets together.