1. Constraint Networks ( slides courtesy of Natalia Flerova, based on slides courtesy of Rina Dechter)

2. Reading Russell and Norvig Chapter 6 (3 rd ed.); Chapter 5 (2 nd ed.) For next week: Chapter 7 (for Tuesday) Chapter 8 (for Thursday)

3. 3 Good source of advanced information Rina Dechter, Constraint Processing, Morgan Kaufmann

4. 4 Outline Constraint Satisfaction Problems (CSPs): Definition, and simple modeling examples Representing constraints Consistency algorithms (arc-, path- and i-consistency) General search strategy  Look-ahead methods

5. AB redgreen redblack greenred greenblack blackgreen black red Constraint Satisfaction Example: map coloring Variables - countries (A,B,C,etc.) Values - colors (e.g., red, green, black) Constraints: C A B D E F G

6. 6 Constraint Network; Definition A constraint network is: R= (X,D,C) X variables D domains C constraints R expresses allowed tuples over scopes A solution is an assignment to all variables that satisfies all constraints (join of all relations). Tasks: consistency?, one or all solutions, counting, optimization

7. Spring 20097 Example: The N-queens problem The network has four variables, all with domains Di = {1, 2, 3, 4}. (a) The labeled chess board. (b) The constraints between variables.

8. Example The 4-queen problem Q Q Q Q Q Q Q Q Place 4 Queens on a chess board of 4x4 such that no two queens reside in the same row, column or diagonal. Standard CSP formulation of the problem: Variables: each row is a variable. Q Q Q Q 1 2 3 4 Domains: Constraints: There are = 6 constraints involved: 4 2 ( ) Constraint Graph :

9. A solution and a partial consistent tuple Spring 20099 Not all consistent instantiations are part of a solution: (a)A consistent instantiation that is not part of a solution. (b) The placement of the queens corresponding to the solution (2, 4, 1,3). c) The placement of the queens corresponding to the solution (3, 1, 4, 2).

10. Spring 200910 Example: configuration and design

11. Spring 200911 Configuration and design Want to build: recreation area, apartments, houses, cemetery, dump Recreation area near lake Steep slopes avoided except for recreation area Poor soil avoided for developments Highway far from apartments, houses and recreation Dump not visible from apartments, houses and lake Lots 3 and 4 have poor soil Lots 3, 4, 7, 8 are on steep slopes Lots 2, 3, 4 are near lake Lots 1, 2 are near highway

12. 12 Outline CSP: Definition, and simple modeling examples Representing constraints Consistency algorithms (arc-, path- and i-consistency) General search strategy  Look-ahead methods

13. Spring 200913 Constraint’s representations Relation: allowed tuples Algebraic expression: Propositional formula:

14. 14 Operations with relations Intersection Union Difference Selection Projection Join Composition

15. Spring 200915 Figure 1.8: Example of set operations intersection, union, and difference applied to relations.

16. Spring 200916 selection, projection, and join operations on relations.

17. Spring 200917 Constraint Graphs: Primal, Dual and Hypergraphs A (primal) constraint graph: a node per variable arcs connect constrained variables. A dual constraint graph: a node per constraint’s scope, an arc connect nodes sharing variables =hypergraph

18. 18 Outline CSP: Definition, and simple modeling examples Representing constraints Consistency algorithms (arc-, path- and i-consistency) General search strategy  Look-ahead methods

19. 19 Consistency methods Constraint propagation – inferring new constraints Can get such an explicit network that the search will find the solution without dead-ends. Approximation of inference:  Arc, path and i-consistency Methods that transform the original network into a tighter and tighter representations

20. 20 Arc-consistency 32,1, 32,1,32,1, 1  X, Y, Z, T  3 X  Y Y = Z T  Z X  T XY TZ 32,1,  =   - infer constraints based on pairs of variables Insures that every legal value in the domain of a single variable has a legal match In the domain of any other selected variable

21. 21 1  X, Y, Z, T  3 X  Y Y = Z T  Z X  T XY TZ  =   13 23 Arc-consistency

22. 22 Arc-consistency

23. 23 Revise for arc-consistency

24. 24 AC-1 Complexity ( Mackworth and Freuder, 1986 ): e = number of arcs, n variables, k values (ek^2, each loop, nk number of loops), best-case = ek, Arc-consistency is:

25. 25 AC-3 Complexity: Best case O(ek), since each arc may be processed in O(2k) e = number of arcs, n variables, k values

26. 26 Distributed arc-consistency (Constraint propagation) Implement AC-1 distributedly. Node x_j sends the message to node x_i Node x_i updates its domain: Messages can be sent asynchronously or scheduled in a topological order

27. 27 Distributed Arc-Consistency  Arc-consistency can be formulated as a distributed algorithm: A BC DF G a Constraint network

28. 28 A 1 2 3 AC 12 32 AB 12 13 21 23 31 32 BCF 123 321 ABD 123 132 213 231 312 321 DFG 123 213 Relational Arc-consistency A BC DF G The message that R2 sends to R1 is R1 updates its relation and domains and sends messages to neighbors

29. 29 A 1 2 3 AC 12 32 AB 12 13 21 23 31 32 BCF 123 321 ABD 123 132 213 231 312 321 DFG 123 213 A ABAC ABDBCF DFG B 4 5 3 6 2 B D F A A A C 1 DRAC on the dual join-graph

30. 30 Sudoku – Constraint Satisfaction Each row, column and major block must be alldifferent “Well posed” if it has unique solution: 27 constraints 2 3 4 6 2 Variables: empty slots Domains = {1,2,3,4,5,6,7,8,9} Constraints: 27 all-different Constraint Propagation Inference

31. 31 Path-consistency

32. 32 Path-consistency

33. 33 Revise-3 Complexity: O(k^3) Best-case: O(t) Worst-case O(tk) e = number of arcs, n variables, k values, t = tightness: number of tuples in the constraint relation

34. 34 PC-1 Complexity: e = number of arcs, n variables, k values, t = tightness: number of tuples in the constraint relation

35. 35 PC-2 Complexity: Optimal PC-4: (each pair deleted may add: 2n-1 triplets, number of pairs: O(n^2 k^2)  size of Q is O(n^3 k^2), processing is O(k^3)) e = number of arcs, n variables, k values, t = tightness: number of tuples in the constraint relation

36. 36 Example: before and after path- consistency PC-1 requires 2 processings of each arc while PC-2 may not Can we do path-consistency distributedly?

37. 37 I-consistency

38. 38 Outline CSP: Definition, and simple modeling examples Representing constraints Consistency algorithms (arc-, path- and i-consistency) General search strategy  Look-ahead methods

39. 39 Backtracking algorithm No matter how much we reason about the problem – we are still left with choices → need to search the space of possible choices. Backtracking search – assign values to each variable in turn, making sure each assigned value is consistent with values assigned thus far. Encounter variable with no domain value consistent with previous assignment – dead-end → backtrack – change the value of previous variables.

40. Backtracking

45. The search space A tree of all partial solutions A partial solution: (a1,…,aj) satisfying all relevant constraints The size of the underlying search space depends on:  Variable ordering  Level of consistency possessed by the problem

46. Search space and the effect of ordering 20 legal states 1 dead-end leaf 48 legal states 18 dead-end leaves Z evenly divides x,y,l

47. Dependency on consistency level After arc-consistency z=5 and l=5 are removed After path-consistency  R’_zx  R’_zy  R’_zl  R’_xy  R’_xl  R’_yl

48. Backtrack-free network

49. Backtracking Complexity of extending a partial solution:  Complexity of consistent O(e log t), t bounds tuples, e constraints  Complexity of selectvalue O(e k log t)

50. Improving backtracking Before search: (reducing the search space)  Arc-consistency, path-consistency  Variable ordering (fixed) During search :  Look-ahead schemes: value ordering, variable ordering (if not fixed)  Look-back schemes: Backjump Constraint recording Dependency-directed backtracking

51. 51 Outline CSP: Definition, and simple modeling examples Representing constraints Consistency algorithms (arc-, path- and i-consistency) General search strategy  Look-ahead methods

52. Improving backtracking Before search: (reducing the search space)  Arc-consistency, path-consistency  Variable ordering (fixed) During search:  Look-ahead schemes: value ordering - first assign value that maximizes the number of options for future assignments variable ordering (if not fixed)- first instantiate most highly constrained variable

53. Look-ahead: value orderings Intuition:  Choose value least likely to yield a dead-end  Approach: apply propagation at each node in the search tree Forward-checking  (check each unassigned variable separately) Maintaining arc-consistency (MAC)  (apply full arc-consistency) Full look-ahead  One pass of arc-consistency (AC-1) Partial look-ahead  directional-arc-consistency

54. Generalized look-ahead

55. Forward-checking The most limited form of constraint propagation during search Propagates the effect of a tentative value selection to each future variable separately If domain of one of the future variables becomes empty – value is not selected → try next value.

56. Forward-checking example

57. Forward-checking Complexity of selectValue-forward-checking at each node:

58. Arc-consistency look-ahead (Gashnig, 1977) Applies full arc-consistency on all un-instantiated variables following each value assignment to the current variable. Complexity:  If optimal arc-consistency is used: SelectValue-Arc-Consistency: The repeat...until loop – essentially AC-1 with some variables instantiated. Maintaining-Arc-Consistency (MAC): Performs full arc-consistency after each domain value is rejected.

59. Arc-consistency look-ahead: (maintaining arc-consistency MAC)

60. Full and partial look-ahead Full looking ahead:  Make one full pass through future variables (remove repeat-until from selectValue-arc- consistency) Partial look-ahead:  Applies (similar-to) directional arc-consistency to future variables. - future variables are only compared with those variables following them.  Complexity: also  More efficient than MAC

61. Example of partial look-ahead

62. 62 Outline CSP: Definition, and simple modeling examples Representing constraints Consistency algorithms (acr-, path- and i-consistency) General search strategy  Look-ahead methods  Branching-ahead

63. Branching-ahead: Dynamic Value Ordering Rank order the promise in non-rejected values  Rank functions MC (min conflict) – chooses value that removes the smallest number of values from domains of future variables MD (min domain) – chooses value that creates the largest minimum domain size in future variables SC (expected solution counts) – computes upper bound on number of solutions by multiplying the domains sizes of each future variable after incompatible values are removed.

64. Branching-ahead: Dynamic Variable Ordering (DVO) Following constraint propagation, choose the most constrained variable Intuition: early discovery of dead-ends Highly effective: the single most important heuristic to cut down search space Most popular with FC Dynamic search rearrangement (Bitner and Reingold, 1975) (Purdon,1983)