Constraint Propagation

Constraint Propagation … … is the process of determining how the possible values of one variable affect the possible values of other variables Constraint Propagation

Constraint Propagation Forward Checking After a variable X is assigned a value v, look at each unassigned variable Y that is connected to X by a constraint and deletes from Y’s domain any value that is inconsistent with v Constraint Propagation

Constraint Propagation Map Coloring T WA NT SA Q NSW V WA NT Q NSW V SA T RGB Constraint Propagation

Constraint Propagation Map Coloring T WA NT SA Q NSW V WA NT Q NSW V SA T RGB R GB Constraint Propagation

Constraint Propagation Map Coloring T WA NT SA Q NSW V WA NT Q NSW V SA T RGB R GB B G RB Constraint Propagation

Constraint Propagation Map Coloring T WA NT SA Q NSW V Impossible assignments that forward checking do not detect WA NT Q NSW V SA T RGB R GB B G RB Constraint Propagation

Constraint Propagation

Edge Labeling in Computer Vision Russell and Norvig: Chapter 24, pages 745-749 Constraint Propagation

Constraint Propagation Edge Labeling Constraint Propagation

Constraint Propagation Edge Labeling Constraint Propagation

Constraint Propagation Edge Labeling + – Constraint Propagation

Constraint Propagation Edge Labeling + - Constraint Propagation

Constraint Propagation Junction Label Sets + - - + + - - + (Waltz, 1975; Mackworth, 1977) Constraint Propagation

Constraint Propagation Edge Labeling as a CSP A variable is associated with each junction The domain of a variable is the label set of the corresponding junction Each constraint imposes that the values given to two adjacent junctions give the same label to the joining edge Constraint Propagation

Constraint Propagation Edge Labeling + - + - Constraint Propagation

Constraint Propagation Edge Labeling + + + - Constraint Propagation

Constraint Propagation Edge Labeling + + + - + + Constraint Propagation

Constraint Propagation Edge Labeling + - + + + - + Constraint Propagation

Removal of Arc Inconsistencies REMOVE-ARC-INCONSISTENCIES(J,K) removed  false X  label set of J Y  label set of K For every label y in Y do If there exists no label x in X such that the constraint (x,y) is satisfied then Remove y from Y If Y is empty then contradiction  true removed  true Label set of K  Y Return removed Constraint Propagation

CP Algorithm for Edge Labeling Associate with every junction its label set contradiction  false Q  stack of all junctions while Q is not empty and not contradiction do J  UNSTACK(Q) For every junction K adjacent to J do If REMOVE-ARC-INCONSISTENCIES(J,K) then STACK(K,Q) (Waltz, 1975; Mackworth, 1977) Constraint Propagation

General CP for Binary Constraints Algorithm AC3 contradiction  false Q  stack of all variables while Q is not empty and not contradiction do X  UNSTACK(Q) For every variable Y adjacent to X do If REMOVE-ARC-INCONSISTENCIES(X,Y) then STACK(Y,Q) Constraint Propagation

General CP for Binary Constraints Algorithm AC3 contradiction  false Q  stack of all variables while Q is not empty and not contradiction do X  UNSTACK(Q) For every variable Y adjacent to X do If REMOVE-ARC-INCONSISTENCY(X,Y) then STACK(Y,Q) REMOVE-ARC-INCONSISTENCY(X,Y) removed  false For every value y in the domain of Y do If there exists no value x in the domain of X such that the constraints on (x,y) is satisfied then Remove y from the domain of Y If Y is empty then contradiction  true removed  true Return removed Constraint Propagation

Complexity Analysis of AC3 n = number of variables d = number of values per variable s = maximum number of constraints on a pair of variables Each variables is inserted in Q up to d times REMOVE-ARC-INCONSISTENCY takes O(d2) time CP takes O(n s d3) time Constraint Propagation

Constraint Propagation Is AC3 All What is Needed? NO! X Y Z X  Y X  Z Y  Z {1, 2} Constraint Propagation

Constraint Propagation Solving a CSP Interweave constraint propagation, e.g., forward checking AC3 and backtracking + Take advantage of the CSP structure Constraint Propagation

Constraint Propagation 4-Queens Problem X1 {1,2,3,4} X3 X4 X2 1 3 2 4 Constraint Propagation

Constraint Propagation 4-Queens Problem X1 {1,2,3,4} X3 X4 X2 1 3 2 4 Constraint Propagation

Constraint Propagation 4-Queens Problem X1 {1,2,3,4} X3 X4 X2 1 3 2 4 Constraint Propagation

Constraint Propagation 4-Queens Problem X1 {1,2,3,4} X3 X4 X2 1 3 2 4 Constraint Propagation

Constraint Propagation 4-Queens Problem X1 {1,2,3,4} X3 X4 X2 1 3 2 4 Constraint Propagation

Constraint Propagation 4-Queens Problem X1 {1,2,3,4} X3 X4 X2 1 3 2 4 Constraint Propagation

Constraint Propagation 4-Queens Problem X1 {1,2,3,4} X3 X4 X2 1 3 2 4 Constraint Propagation

Constraint Propagation 4-Queens Problem X1 {1,2,3,4} X3 X4 X2 1 3 2 4 Constraint Propagation

Constraint Propagation 4-Queens Problem X1 {1,2,3,4} X3 X4 X2 1 3 2 4 Constraint Propagation

Constraint Propagation 4-Queens Problem X1 {1,2,3,4} X3 X4 X2 1 3 2 4 Constraint Propagation

Constraint Propagation Structure of CSP If the constraint graph contains multiple components, then one independent CSP per component T WA NT SA Q NSW V Constraint Propagation

Constraint Propagation Structure of CSP If the constraint graph contains multiple components, then one independent CSP per component If the constraint graph is a tree (no loop), then the CSP can be solved efficiently Constraint Propagation

Constraint Propagation Constraint Tree X Y Z U V W  (X, Y, Z, U, V, W) Constraint Propagation

Constraint Propagation Constraint Tree Order the variables from the root to the leaves  (X1, X2, …, Xn) For j = n, n-1, …, 2 do REMOVE-ARC-INCONSISTENCY(Xj, Xi) where Xi is the parent of Xj Assign any legal value to X1 For j = 2, …, n do assign any value to Xj consistent with the value assigned to Xi, where Xi is the parent of Xj Constraint Propagation

Constraint Propagation Structure of CSP If the constraint graph contains multiple components, then one independent CSP per component If the constraint graph is a tree, then the CSP can be solved efficiently Whenever a variable is assigned a value by the backtracking algorithm, propagate this value and remove the variable from the constraint graph WA NT SA Q NSW V Constraint Propagation

Constraint Propagation Structure of CSP If the constraint graph contains multiple components, then one independent CSP per component If the constraint graph is a tree, then the CSP can be solved in linear time Whenever a variable is assigned a value by the backtracking algorithm, propagate this value and remove the variable from the constraint graph WA NT Q NSW V Constraint Propagation

Over-Constrained Problems Weaken an over-constrained problem by: Enlarging the domain of a variable Loosening a constraint Removing a variable Removing a constraint Constraint Propagation

Non-Binary Constraints So far, all constraints have been binary (two variables) or unary (one variable) Constraints with more than 2 variables would be difficult to propagate Theoretically, one can reduce a constraint with k>2 variables to a set of binary constraints by introducing additional variables Constraint Propagation

When to Use CSP Techniques? When the problem can be expressed by a set of variables with constraints on their values When constraints are relatively simple (e.g., binary) When constraints propagate well (AC3 eliminates many values) When the solutions are “densely” distributed in the space of possible assignments Constraint Propagation

Constraint Propagation Summary Forward checking Constraint propagation Edge labeling in Computer Vision Interweaving CP and backtracking Exploiting CSP structure Weakening over-constrained CSP Constraint Propagation

Game Playing

Games as search problems Chess, Go Simulation of war (war game) 스타크래프트의 전투 Claude Shannon, Alan Turing  Chess program (1950년대) Constraint Propagation

Constraint Propagation Contingency problems The opponent introduces uncertainty 마이티에서는 co-work이 필요 고스톱에서는 co-work방지가 필요 Hard to solve  in chess, 35100 possible nodes, 1040 different legal positions Time limits  how to make the best use of time to reach good decisions Pruning, heuristic evaluation function Constraint Propagation

Perfect decisions in two person games The initial state, A set of operators, A terminal test, A utility function (payoff function) Mini-max algorithm, Negmax algorithms Constraint Propagation

Mini-max algorithm (AND-OR tree) Constraint Propagation

Constraint Propagation 상대방의 관점 Constraint Propagation

Constraint Propagation Negmax Knuth and Moore (1975) F(n) = f(n), if n has no successors F(n) = max{-F(n1), …, -F(nk)}, if n has successors n1, …, nk Constraint Propagation

Constraint Propagation The Negmax formalism Constraint Propagation

Constraint Propagation Imperfect Decisions utility function  evaluation terminal test  cutoff test Evaluation function ::: an estimate of the utility of the game from a given position Chess  material value (장기도 유사) Weighted linear function  w1f1+w2f2+….+wnfn Constraint Propagation

Constraint Propagation Cutting off search To set a fixed depth limit, so that the cutoff test succeeds for all nodes at or below depth d  iterative deepening until time runs out  위험이 있을 수 있다 Quiescent posiiton ::: unlikely to exhibit wild swings in value in near future Quiescent search :: Non-quiescent search  extra search to find quiescent position Horizon problem Constraint Propagation

Constraint Propagation Alpha-beta pruning Eliminate unnecessary evaluations Pruning Constraint Propagation

Constraint Propagation Alpha-beta pruning Alpha cutoff Beta cutoff Constraint Propagation

Negmax representation Constraint Propagation

Constraint Propagation Example Constraint Propagation

Constraint Propagation Games with Chance Chance nodes  expected value Backgammon, 윷놀이 Expectimax value Constraint Propagation

Constraint Propagation A backgammon position Constraint Propagation

Constraint Propagation Comparision MAX A A A A 2 1 2 1 1.3 21 40.9 DICE 2.1 .9 .1 .9 .1 .9 .1 .9 .1 MIN 20 30 1 400 2 3 1 4 20 20 30 30 1 1 400 400 2 2 3 3 1 1 4 4 Constraint Propagation

Constraint Propagation 숙제 5.6, 5.8, 5.11, 5.15, 5.16, 5.17 Constraint Propagation