Resolution versus Search: Two Strategies for SAT Brad Dunbar Shamik Roy Chowdhury.

Slides:



Advertisements
Similar presentations
Automated Theorem Proving
Advertisements

Computational Complexity
Verification/constraints workshop, 2006 From AND/OR Search to AND/OR BDDs Rina Dechter Information and Computer Science, UC-Irvine, and Radcliffe Institue.
Propositional Satisfiability (SAT) Toby Walsh Cork Constraint Computation Centre University College Cork Ireland 4c.ucc.ie/~tw/sat/
Comparative Succinctness of KR Formalisms Paolo Liberatore.
Time-Space Tradeoffs in Resolution: Superpolynomial Lower Bounds for Superlinear Space Chris Beck Princeton University Joint work with Paul Beame & Russell.
UIUC CS 497: Section EA Lecture #2 Reasoning in Artificial Intelligence Professor: Eyal Amir Spring Semester 2004.
Methods of Proof Chapter 7, second half.. Proof methods Proof methods divide into (roughly) two kinds: Application of inference rules: Legitimate (sound)
Methods of Proof Chapter 7, Part II. Proof methods Proof methods divide into (roughly) two kinds: Application of inference rules: Legitimate (sound) generation.
Anagh Lal Tuesday, April 08, Chapter 9 – Tree Decomposition Methods- Part II Anagh Lal CSCE Advanced Constraint Processing.
Generating Hard Satisfiability Problems1 Bart Selman, David Mitchell, Hector J. Levesque Presented by Xiaoxin Yin.
1 NP-Complete Problems. 2 We discuss some hard problems:  how hard? (computational complexity)  what makes them hard?  any solutions? Definitions 
INHERENT LIMITATIONS OF COMPUTER PROGRAMS CSci 4011.
S. J. Shyu Chap. 1 Introduction 1 The Design and Analysis of Algorithms Chapter 1 Introduction S. J. Shyu.
Artificial Intelligence Chapter 14. Resolution in the Propositional Calculus Artificial Intelligence Chapter 14. Resolution in the Propositional Calculus.
PCPs and Inapproximability Introduction. My T. Thai 2 Why Approximation Algorithms  Problems that we cannot find an optimal solution.
02/01/11CMPUT 671 Lecture 11 CMPUT 671 Hard Problems Winter 2002 Joseph Culberson Home Page.
1 Directional consistency Chapter 4 ICS-179 Spring 2010 ICS Graphical models.
Proof methods Proof methods divide into (roughly) two kinds: –Application of inference rules Legitimate (sound) generation of new sentences from old Proof.
Willis Lemasters Grant Conklin. Searching a tree recursively one branch at a time, abandoning any branch which does not satisfy the search constraints.
Methods of Proof Chapter 7, second half.
Technion 1 Generating minimum transitivity constraints in P-time for deciding Equality Logic Ofer Strichman and Mirron Rozanov Technion, Haifa, Israel.
M. HardojoFriday, February 14, 2003 Directional Consistency Dechter, Chapter 4 1.Section 4.4: Width vs. Local Consistency Width-1 problems: DAC Width-2.
1 Understanding the Power of Clause Learning Ashish Sabharwal, Paul Beame, Henry Kautz University of Washington, Seattle IJCAI ConferenceAug 14, 2003.
The community-search problem and how to plan a successful cocktail party Mauro SozioAris Gionis Max Planck Institute, Germany Yahoo! Research, Barcelona.
1 Hybrid of search and inference: time- space tradeoffs chapter 10 ICS-275A Fall 2003.
Stochastic greedy local search Chapter 7 ICS-275 Spring 2007.
Knowledge Representation II (Inference in Propositional Logic) CSE 473 Continued…
Artificial Intelligence Chapter 14 Resolution in the Propositional Calculus Artificial Intelligence Chapter 14 Resolution in the Propositional Calculus.
1 Paul Beame University of Washington Phase Transitions in Proof Complexity and Satisfiability Search Dimitris Achlioptas Michael Molloy Microsoft Research.
SAT Solving Presented by Avi Yadgar. The SAT Problem Given a Boolean formula, look for assignment A for such that.  A is a solution for. A partial assignment.
Boolean Satisfiability and SAT Solvers
SAT and SMT solvers Ayrat Khalimov (based on Georg Hofferek‘s slides) AKDV 2014.
CHAPTERS 7, 8 Oliver Schulte Logical Inference: Through Proof to Truth.
The Complexity of Optimization Problems. Summary -Complexity of algorithms and problems -Complexity classes: P and NP -Reducibility -Karp reducibility.
INTRODUCTION TO ARTIFICIAL INTELLIGENCE COS302 MICHAEL L. LITTMAN FALL 2001 Satisfiability.
Explorations in Artificial Intelligence Prof. Carla P. Gomes Module 3 Logic Representations (Part 2)
Explorations in Artificial Intelligence Prof. Carla P. Gomes Module Logic Representations.
Logical Agents Chapter 7. Knowledge bases Knowledge base (KB): set of sentences in a formal language Inference: deriving new sentences from the KB. E.g.:
1 Directional consistency Chapter 4 ICS-275 Spring 2009 ICS Constraint Networks.
NP-Complete Problems. Running Time v.s. Input Size Concern with problems whose complexity may be described by exponential functions. Tractable problems.
On the Relation between SAT and BDDs for Equivalence Checking Sherief Reda Rolf Drechsler Alex Orailoglu Computer Science & Engineering Dept. University.
Stochastic greedy local search Chapter 7 ICS-275 Spring 2009.
Finding Models for Blocked 3-SAT Problems in Linear Time by Systematical Refinement of a Sub- Model Gábor Kusper Eszterházy Károly.
Accelerating Random Walks Wei Wei and Bart Selman.
1 CPSC 320: Intermediate Algorithm Design and Analysis July 30, 2014.
1 Propositional Logic Limits The expressive power of propositional logic is limited. The assumption is that everything can be expressed by simple facts.
CSE 6311 – Spring 2009 ADVANCED COMPUTATIONAL MODELS AND ALGORITHMS Lecture Notes – Feb. 3, 2009 Instructor: Dr. Gautam Das notes by Walter Wilson.
Logical Agents Chapter 7. Outline Knowledge-based agents Propositional (Boolean) logic Equivalence, validity, satisfiability Inference rules and theorem.
SAT Solving As implemented in - DPLL solvers: GRASP, Chaff and
Inference in Propositional Logic (and Intro to SAT) CSE 473.
1 Boolean Satisfiability (SAT) Class Presentation By Girish Paladugu.
Proof Methods for Propositional Logic CIS 391 – Intro to Artificial Intelligence.
Knowledge Repn. & Reasoning Lecture #9: Propositional Logic UIUC CS 498: Section EA Professor: Eyal Amir Fall Semester 2005.
Inference in Propositional Logic (and Intro to SAT)
Inference and search for the propositional satisfiability problem
Planning as Search State Space Plan Space Algorihtm Progression
EA C461 – Artificial Intelligence Logical Agent
Resolution in the Propositional Calculus
Summary of lectures Introduction to Algorithm Analysis and Design (Chapter 1-3). Lecture Slides Recurrence and Master Theorem (Chapter 4). Lecture Slides.
Directional Resolution: The Davis-Putnam Procedure, Revisited
ECE 667 Synthesis and Verification of Digital Circuits
DLL Algorithm.
Biointelligence Lab School of Computer Sci. & Eng.
Artificial Intelligence: Agents and Propositional Logic.
Chapter 11 Limitations of Algorithm Power
NP-Complete Problems.
Biointelligence Lab School of Computer Sci. & Eng.
Advanced consistency methods Chapter 8
Methods of Proof Chapter 7, second half.
Presentation transcript:

Resolution versus Search: Two Strategies for SAT Brad Dunbar Shamik Roy Chowdhury

Propositional Satisfiability Problems Propositional satisfiability Algorithms with good average performance has been focus of extensive research. Davis Putnam Algorithm for deciding propositional satisfiability  Directional Resolution. Worst Case Time /Space complexity of DR : – O( n.exp(w * ) ) where – n : number of variables – W * : induced width

Backtracking Vs Resolution

What makes DR a good algorithm: – Decides satisfiability and finds solution ( model ). – Given input theory and a variable ordering Knowledge Compilation Algorithm : Generation equivalent theory ( directional extension )  Each model can be found in linear time. All models can be found in the time linear in the number of models. – Performs better on structured algorithms. k-tree embeddings having induced width. – w * < n ( generally ) DR ( worst case bound) < DP ( worst case bound )

An Example Resolution : Resolution over A Node : Each propositional variable. Edge : Between variables of the same clause. Resolution over clauses ( a V Q ) and ( b V ~Q ) => a V b ( Resolvent ). Resolution over A ( adj. Fig. ) => (B V C V E ) … introduces edge C – E.

Directional Resolution – An ordering based algorithm

Execution of Directional Resolution (DR): Knowledge Compilation & model generation

Complexity of Directional Resolution(DR) Algorithm: Change of E(Q) with ordering BUCKET CLAUSES A(B v A ), ( C V ~A), ( D V A), ( E V ~A ) D( C V D ), ( D V E ) CB V C BB V E E Theory(B V A ), ( C V ~A), ( D V A), (E V ~A) Ordering{ E, B, C, D, A } E8 BUCKET CLAUSES EE V ~A DD V A CC V ~A BB V A A Theory(B V A ), ( C V ~A), ( D V A), (E V ~A) Ordering{ A, B, C, D, E} E4

Complexity : Induced Width

Dependence of complexity on Induced Width Theorem 4: Given Theory(Q) and an ordering of its variables (o). Directional Resolution(DR) time complexity along ‘o’ Size of at most where is the induced width of interaction graph.

Change of Induced Width with Variable Ordering BUCKET CLAUSES B( A V B V C ), ( ~A V B V E), ( ~B V C V D) A( ~A V C V D V E ), ( A V C V D ) C~C, ( C V D V E ) DD V E E Theory( ~C ), ( A V B V C ), ( ~A V B V E ), ( ~B V C V D) Ordering{ E, D, C, A, B }

Change of Induced Width with Variable Ordering BUCKET CLAUSES A( A V B V C ), (~A V B V E), B( ~B V C V D ) ( B V C V E ) C~C, ( C V D V E ) DD V E E Theory( ~C ), ( A V B V C ), ( ~A V B V E ), ( ~B V C V D) Ordering{ E, D, C, B, A }

Change of Induced Width with Variable Ordering BUCKET CLAUSES E (~A V B V E), D( ~B V C V D ) C~C, ( A V B V C ) BA V B A Theory( ~C ), ( A V B V C ), ( ~A V B V E ), ( ~B V C V D) Ordering{ A, B, C, D, E }

Ordering Heuristics : Which Ordering gives Minimum Induced Width ? Finding an ordering which yields smallest induced width is NP- HARD. Ordering Heuristics : – Polynomial Time Greedy Algorithm.  – Computation/Generatio n of min-width ordering. 

Diversity Upper bound on the number of resolution operation. Based on fact : Proposition resolved only when it appears both positively and negatively in different clauses. Div(o) – largest diversity of its variables relative to ‘o’. Div(of a theory) – minimum diversity among all orderings bounds number of clauses generated in each bucket. Eg: If ordering (o) has 0 diversity, then algorithm DR adds no clauses to the theory regardless of its induced width.

Diversity computation Bucket CLAUSES G(G V E V ~F),(GV~EVD) F( ~A V F ) E( A V ~E ), (~B V C V~E) DB V C V D C B A Theory{(G V E V ~F), (G V ~E V D), (~A V F), (A V ~E),(~B V C V ~E)} Diversity : div(o) = 0 Ordering( A, B, C, D, E, F, G )

Ordering Heuristics : Algorithm to generate ordering giving minimum Diversity Finding an ordering which yields minimum- induced diversity is NP- HARD. Ordering Heuristics : – Polynomial Time Greedy Algorithm.  – Computation/Generatio n of min-diversity ordering.  –

Directional Resolution and Tree Clustering

BUCKET CLAUSES E C V D V E D ~B V D C A V ~C B ~A V B A Theory{ ( ~A V B ), ( A V ~C), (~B V D), ( C V D V E) } Ordering( A, B, C, D, E )

Directional Resolution and Tree Clustering

Backtracking (DP) Algorithm

Comparison of Backtracking and Resolution

Random Problem Generators

DR vs DP, 3-cnf Chains

DR vs DP, > 5000 Dead-Ends

DP vs DR, Uniform Random 3-cnfs

DR and DP on 3-cnf Chains, Different Ordering

Numer of Deadends

DP vs Tableau (Uniform Random)

DP vs Tableau (Chains)

Bounded Directional Resolution - BDR(i)

Dynamic Conditioning + Directional Resolution - DCDR(b)

Conclusions DP Performs much better on random uniform k- cnfs DR Performs much better on k-cnf chains and (k,m) trees A hybrid model can perform better than DR and DP for certain cases

References Rish and Dechter (Irina Rish and Rina Dechter. "Resolution versus Search: Two Strategies for SAR." Journal of Automated Reasoning, 24, 215— 259, 2000.) "Resolution versus Search: Two Strategies for SAR." (Davis, M. and Putnam, H. (1960). "A computing procedure for quantification theory." Journal of the ACM, 7(3): ) (Davis, M., Logemann, G., and Loveland, D. (1962). "A machine program for theorem proving." Communications of the ACM, 5(7): )