1 Combinatorial Problems in Cooperative Control: Complexity and Scalability Carla P. Gomes and Bart Selman Cornell University Muri Meeting June 2002.

Slides:



Advertisements
Similar presentations
1 Integration of Artificial Intelligence and Operations Research Techniques for Combinatorial Problems Carla P. Gomes Cornell University
Advertisements

1 Constraint Satisfaction Problems A Quick Overview (based on AIMA book slides)
© Imperial College London Eplex: Harnessing Mathematical Programming Solvers for Constraint Logic Programming Kish Shen and Joachim Schimpf IC-Parc.
1 University of Southern California Keep the Adversary Guessing: Agent Security by Policy Randomization Praveen Paruchuri University of Southern California.
1 Backdoor Sets in SAT Instances Ryan Williams Carnegie Mellon University Joint work in IJCAI03 with: Carla Gomes and Bart Selman Cornell University.
EE 553 Integer Programming
Dynamic Restarts Optimal Randomized Restart Policies with Observation Henry Kautz, Eric Horvitz, Yongshao Ruan, Carla Gomes and Bart Selman.
Lecture 10: Integer Programming & Branch-and-Bound
© 2011 IBM Corporation 1 Guiding Combinatorial Optimization with UCT Ashish Sabharwal and Horst Samulowitz IBM Watson Research Center (presented by Raghuram.
Progress in Linear Programming Based Branch-and-Bound Algorithms
4 Feb 2004CS Constraint Satisfaction1 Constraint Satisfaction Problems Chapter 5 Section 1 – 3.
Statistical Regimes Across Constrainedness Regions Carla P. Gomes, Cesar Fernandez Bart Selman, and Christian Bessiere Cornell University Universitat de.
CP Formal Models of Heavy-Tailed Behavior in Combinatorial Search Hubie Chen, Carla P. Gomes, and Bart Selman
1 Optimisation Although Constraint Logic Programming is somehow focussed in constraint satisfaction (closer to a “logical” view), constraint optimisation.
Heavy-Tailed Behavior and Search Algorithms for SAT Tang Yi Based on [1][2][3]
Impact of Structure on Complexity Carla Gomes Bart Selman Cornell University Intelligent Information Systems.
Ryan Kinworthy 2/26/20031 Chapter 7- Local Search part 1 Ryan Kinworthy CSCE Advanced Constraint Processing.
Solvable problem Deviation from best known solution [%] Percentage of test runs ERA RDGR RGR LS Over-constrained.
AAAI00 Austin, Texas Generating Satisfiable Problem Instances Dimitris Achlioptas Microsoft Carla P. Gomes Cornell University Henry Kautz University of.
Formal Complexity Analysis of Mobile Problems & Communication and Computation in Distributed Sensor Networks in Distributed Sensor Networks Carla P. Gomes.
Wireless Distributed Sensor Tracking: Computation and Communication Bart Selman, Carla Gomes, Scott Kirkpatrick, Ramon Bejar, Bhaskar Krishnamachari, Johannes.
1 Backdoors To Typical Case Complexity Ryan Williams Carnegie Mellon University Joint work with: Carla Gomes and Bart Selman Cornell University.
Carla P. Gomes CS4700 CS 4700: Foundations of Artificial Intelligence Carla P. Gomes Module: Randomization in Complete Tree Search.
Structure and Phase Transition Phenomena in the VTC Problem C. P. Gomes, H. Kautz, B. Selman R. Bejar, and I. Vetsikas IISI Cornell University University.
Carla P. Gomes CS4700 CS 4700: Foundations of Artificial Intelligence Carla P. Gomes Module: CSP2 (Reading R&N: Chapter 5)
Carla P. Gomes CS4700 CS 4700: Foundations of Artificial Intelligence Carla P. Gomes Module: Instance Hardness and Phase Transitions.
CP-AI-OR-02 Gomes & Shmoys 1 The Promise of LP to Boost CSP Techniques for Combinatorial Problems Carla P. Gomes David Shmoys
1 CS 4700: Foundations of Artificial Intelligence Carla P. Gomes Module: Satisfiability (Reading R&N: Chapter 7)
Modeling the Covering Test Problem Brahim Hnich, Steven Prestwich, and Evgeny Selensky Cork Constraint Computation Center UCC Supported by SFI.
Distributed Combinatorial Optimization
Carla P. Gomes School on Optimization CPAIOR02 Exploiting Structure and Randomization in Combinatorial Search Carla P. Gomes
Distributed Scheduling. What is Distributed Scheduling? Scheduling: –A resource allocation problem –Often very complex set of constraints –Tied directly.
Global Constraints for Lexicographic Orderings Alan Frisch, Ian Miguel (University of York) Brahim Hnich, Toby Walsh (4C) Zeynep Kiziltan (Uppsala University)
Controlling Computational Cost: Structure and Phase Transition Carla Gomes, Scott Kirkpatrick, Bart Selman, Ramon Bejar, Bhaskar Krishnamachari Intelligent.
1 Combinatorial Problems in Cooperative Control: Complexity and Scalability Carla Gomes and Bart Selman Cornell University Muri Meeting March 2002.
Daniel Kroening and Ofer Strichman Decision Procedures An Algorithmic Point of View Deciding ILPs with Branch & Bound ILP References: ‘Integer Programming’
Metaheuristics The idea: search the solution space directly. No math models, only a set of algorithmic steps, iterative method. Find a feasible solution.
Lecture: 5 Optimization Methods & Heuristic Strategies Ajmal Muhammad, Robert Forchheimer Information Coding Group ISY Department.
Decision Procedures An Algorithmic Point of View
Distributions of Randomized Backtrack Search Key Properties: I Erratic behavior of mean II Distributions have “heavy tails”.
CP Summer School Modelling for Constraint Programming Barbara Smith 1.Definitions, Viewpoints, Constraints 2.Implied Constraints, Optimization,
Structure and Phase Transition Phenomena in the VTC Problem C. P. Gomes, H. Kautz, B. Selman R. Bejar, and I. Vetsikas IISI Cornell University University.
June 21, 2007 Minimum Interference Channel Assignment in Multi-Radio Wireless Mesh Networks Anand Prabhu Subramanian, Himanshu Gupta.
ANTs PI Meeting, Nov. 29, 2000W. Zhang, Washington University1 Flexible Methods for Multi-agent distributed resource Allocation by Exploiting Phase Transitions.
Constraint Satisfaction Problems (CSPs) CPSC 322 – CSP 1 Poole & Mackworth textbook: Sections § Lecturer: Alan Mackworth September 28, 2012.
Constraint Satisfaction Problems Chapter 6. Review Agent, Environment, State Agent as search problem Uninformed search strategies Informed (heuristic.
Logical Topology Design
Computational Complexity Jang, HaYoung BioIntelligence Lab.
CP Summer School Modelling for Constraint Programming Barbara Smith 2. Implied Constraints, Optimization, Dominance Rules.
Decision Diagrams for Sequencing and Scheduling Andre Augusto Cire Joint work with David Bergman, Willem-Jan van Hoeve, and John Hooker Tepper School of.
Heavy-Tailed Phenomena in Satisfiability and Constraint Satisfaction Problems by Carla P. Gomes, Bart Selman, Nuno Crato and henry Kautz Presented by Yunho.
Chapter 5: Constraint Satisfaction ICS 171 Fall 2006.
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
Explorations in Artificial Intelligence Prof. Carla P. Gomes Module Logic Representations.
Quality of LP-based Approximations for Highly Combinatorial Problems Lucian Leahu and Carla Gomes Computer Science Department Cornell University.
SAT 2009 Ashish Sabharwal Backdoors in the Context of Learning (short paper) Bistra Dilkina, Carla P. Gomes, Ashish Sabharwal Cornell University SAT-09.
CPSC 422, Lecture 21Slide 1 Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 21 Oct, 30, 2015 Slide credit: some slides adapted from Stuart.
Implicit Hitting Set Problems Richard M. Karp Erick Moreno Centeno DIMACS 20 th Anniversary.
CHAPTER 5 SECTION 1 – 3 4 Feb 2004 CS Constraint Satisfaction 1 Constraint Satisfaction Problems.
Optimization Problems
Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.
Lecture 8 Randomized Search Algorithms Part I: Backtrack Search CSE 573 Artificial Intelligence I Henry Kautz Fall 2001.
Formal Complexity Analysis of RoboFlag Drill & Communication and Computation in Distributed Negotiation Algorithms in Distributed Negotiation Algorithms.
1 Chapter 5 Branch-and-bound Framework and Its Applications.
Keep the Adversary Guessing: Agent Security by Policy Randomization
Introduction to Operations Research
Chapter 6. Large Scale Optimization
Area Coverage Problem Optimization by (local) Search
Chapter 6. Large Scale Optimization
Presentation transcript:

1 Combinatorial Problems in Cooperative Control: Complexity and Scalability Carla P. Gomes and Bart Selman Cornell University Muri Meeting June 2002

2 Identify Phase Transitions In Problem Hardness Leverage Randomization In Computation Develop procedures that recognize and react to Structure in Problem Hardness Goal Principled dynamic control of communication and computational resources in large distributed autonomous systems, allowing for: Scalability Time critical applications Robustness guarantees - Overview Overall Approach Use findings in both the design and operation of complex (distributed) systems Hardness Aware Systems (Computationally)

3 Outline ROBOFLAG Drill – Computational Issues Capturing Structure in Combinatorial Problems Randomization and Approximations Conclusions

4 ROBOFLAG Drill Problem is hybrid, combining discrete and continuous components, with multiple constraints. Overall the Roboflag control problem provides an excellent test bed for the development of scalable techniques for complex optimization.

5 Problem Representation ROBOFLAG Drill Formulation by Raff D’Andrea and Matt Earl. Represented as a mixed logical system (MLD) in which the objective is to compute optimal control policies that minimize the total score of the game. Mathematical Formulation of the Optimization Problem  Mixed Integer Linear Program

6. We are investigating how to scale up solutions of the ROBOFLAG Drill focusing on: - Mixed Integer Program (MIP) formulations - Randomization and Approximation methods - Combining MIP and constraint search techniques. - Portfolios of Algorithms

7 Scaling Up Mixed Integer Linear Program Formulations (MILP) Standard approach for solving MILP: Branch and Bound How can we improve upon Branch and Bound strategies? Ideas: Different search strategies for node selection Randomization Portfolios of algorithms

8 Branch & Bound: Depth First vs. Best bound Critical to performance of Branch & Bound is the way in which the next node to be expanded is selected. Standard approach: Best-bound --- select the node with the best LP bound Alternative: Depth-first --- often quickly reaches an integer solution (may take longer to produce an overall optimal value) Tradeoffs between these choices depend on underlying problem stucture (Gomes et al. 2001).

9 ROBOFLAG Testbed Hybrid node selection - Best Bound and Depth First Depth First search works well. Problems that could not be solved before with best bound using were solved with depth first. Current largest problem solved with CPLEX using Depth First Search (8 attackers and 3 defenders): Integer variables = 4040 Continuous variables 400 Constraints constraints Time secs (Matt Earl 2002)

10 Much room for improvement… We are not yet using other problem formulations, Nor are we yet exploiting randomization and parallelism. Doing so should allow us to solve problems at least one or two orders of magnitude larger. (100,000 to 500,000 vars and 1,000,000+ constraints) Also, we should be able to include more complex constraints.

11 Capturing Structure in Combinatorial Problems the importance of problem representation…

12 Completing Latin Squares: An Abstraction for Real World Applications Latin Square (Order 4) 32% preassignment Gomes and Selman 96 A Latin Square is an n-by-n matrix such that each row and column is a permutation of the same n colors

13 Switches in Fiber Optic Networks Dynamic wavelength routing in Fiber Optic Networks can be directly mapped into the Latin Square Problem. (Barry and Humblet 93, Cheung et al. 90, Green 92, Kumar et al. 99) each channel cannot be repeated in the same input port (row constraints); each channel cannot be repeated in the same output port (column constraints); CONFLICT FREE LATIN ROUTER Input ports Output ports Input PortOutput Port

14 LP Based Formulations

15 Assignment Formulation Cubic representation of QCP Columns Rows Colors

16 QCP Assignment Formulation Row/color line Column/color line Row/column line Max number of colored cells

17 Using a MIP formulation and Branch and Bound we can only find solutions for Latin Squares up to Order 15 (15 x 15)  we can do better, even with an LP based formulation using a less obvious encoding

18 Packing formulation Max number of colored cells in the selected patterns s.t. one pattern per family a cell is covered at most by one pattern Families of patterns (partial patterns are not shown) Gomes and Shmoys 2002

19 Packing Formulation Definitions: Compatible matching for color k – any extension of a partial solution with respect to color k. family of all compatible matchings for color k - variable denoting each compatible matching M in |M| number of colored cells in a compatible matching

20 QCP Packing Formulation one pattern per color at most one pattern covering each cell Max number of colored cells

21 Any feasible solution to the packing LP relaxation is also a solution to the assignment LP relaxation  The value of the assignment relaxation is at least the bound implied by the packing formulation => the packing formulation provides a tighter upper bound than the assignment formulation  Limitation – size of formulation is exponential in n. (one may apply column generation techniques)

22 Approximation Based on Packing Formulation Randomization scheme: for each color K choose a pattern with probability (so that some matching is selected for each color) As a result we have a pattern per color. Problem: some patterns may overlap, even though in expectation, the constraints imply that the number of matchings in which a cell is involved is 1.

23 Packing formulation Max number of colored cells in the selected patterns s.t. one pattern per family a cell is covered at most by one pattern

24 (1-1/e)- Approximation Based on Packing Formulation Let’s assume that the PLS is completable Z*=h What is the expected number of cells uncolored by our randomized procedure due to overlapping conflicts? From we can compute So, the desired probability corresponds to the probability of a cell not be colored with any color, i.e.:

25 (1-1/e)- Approximation Based on Packing Formulation This expression is maximized when all the are equal therefore: So the expected number of uncolored cells is at most  at least holes are expected to be filled by this technique. 1- 1/e ~ This is a very good guarantee for a polynomial time algorithm!

26 Another Formulation Constraint Satisfaction Problem

27 QCP as a CSP Variables - Constraints - row column

28 Exploiting Structure for Domain Reduction A very successful strategy for domain reduction in CSP is to exploit the structure of groups of constraints and treat them as global constraints. Example using Network Flow Algorithms: All-different constraints

29 Exploiting Structure in QCP ALLDIFF as Global Constraint Two solutions: we can update the domains of the column variables Analogously, we can update the domains of the other variables Matching on a Bipartite graph All-different constraint

30 Pure CSP approaches solve QCP instances up to order 33 (1089 variables) relatively well. (LP based – only up to order 15 – 125 variables)

31 We are exploring more direct encodings for the ROBOFLAG DRILL Representations avoiding discretization based on time.  constraint based abstractions closer to the physical system, e.g., based movements / trajectories.

32 Randomization

33 Background Stochastic strategies have been very successful in the area of local search. Simulated annealing Genetic algorithms Tabu Search Walksat and variants. Limitation: inherent incomplete nature of local search methods.

34 Randomized variable and/or value selection – lots of different ways. Example: randomly breaking ties in variable and/or value selection. Compare with standard lexicographic tie-breaking. Note: No problem maintaining the completeness of the algorithm! Randomized backtrack search

35 Sample mean Erratic Behavior of Mean Number runs Empirical Evidence of Heavy-Tails (*) no solution found - reached cutoff: 2000 Time:(*)3011(*)7 Easy instance – 15 % preassigned cells Gomes et al Median = 1 !

36 Decay of Distributions Standard Exponential Decay e.g. Normal: Heavy-Tailed Power Law Decay e.g. Pareto-Levy: Power Law Decay Standard Distribution (finite mean & variance) Exponential Decay Infinite variance, infinite mean

37 Exploiting Heavy-Tailed Behavior Heavy Tailed behavior has been observed in several domains: QCP, Graph Coloring, Planning, Scheduling, Circuit synthesis, Decoding, etc. Consequence for algorithm design: Use restarts or parallel / interleaved runs to exploit the extreme variance performance. Restarts provably eliminate heavy-tailed behavior (Gomes et al. 2000) 70% unsolved 1-F(x) Unsolved fraction Number backtracks (log) 250 (62 restarts) 0.001% unsolved

38 Using randomization and restarts we can solve considerably larger instances up to order QCP instances up to order 40 (1600 variables). Note: this problem is highly exponential – instances of order 40 are much more difficult than instances of order 33! We are also experimenting with randomization in the ROBOFLAG DRILL

39 Hybrid MIP/CSP Approaches

40 CSP Model LP Model + LP Randomized Rounding Heavy-tails We want to maintain completeness How do we combine all these ingredients? A HYBRID COMPLETE CSP/LP RANDOMIZED ROUNDING BACKTRACK SEARCH

41 HYBRID CSP/LP RANDOMIZED ROUNDING BACKTRACK SEARCH Central features of algorithm: Complete Backtrack search algorithm It maintains two formulations CSP model Relaxed LP model LP Randomized rounding  for setting values at the top of the tree CSP + LP inference

42 Variable setting controlled by LP Randomized Rounding CSP & LP Inference Search & Inference controlled by CSP %LP Interleave-LP HYBRID CSP/LP RANDOMIZED ROUNDING BACKTRACK SEARCH Populate CSP Model Perform propagation Populate LP solver Solve LP Adaptive CUTOFF

43 1.Initialize CSP model and perform propagation of constraints (Ilog Solver); 2.Solve LP model (Ilog Cplex Barrier) LP provides good heuristic guidance and pruning information for the search. However solving the LP is relatively expensive. 3.Two parameters control the LP effort %LP – this parameter controls the percentage of variables set based on the LP rounding (%LP=0  pure CSP strategy) Interleave-LP – sets the frequency in which we re-solve the LP. 4.Randomized rounding scheme: rank variables according to the LP value. Select the highest ranked variable and set its value to 1 with probability p given by its LP value. With probability (1-p), randomly select a color form the colors allowed in the CSP model. 5.Perform propagation CSP propagation after each variable setting. (A total of Interleave-LP variables is assigned this way without resolving the LP) 6.Use a cutoff value to restart the sercah (keep increasing it to maintain completeness) HYBRID CSP/LP RANDOMIZED ROUNDING BACKTRACK SEARCH

44 Empirical Results

45 Time Performance Order 35

46 Performance With the hybrid strategy we also solve instances of order 40 in critically constrained area – out of reach for pure CSP; We even solved a few balanced instances of order 50 in the critically constrained order! more systematic experimentation is required to better understand limitations and strengths of approach.

47 Conclusions

48 Conclusions Approximations based on LP randomized rounding (variable/value setting) + constraint propagation --- very powerful. Combatting heavy-tails of backtrack search through randomization. Consequence: New ways of designing algorithms --- aim for strategies which have highly asymmetric distributions that can be exploited using restarts, portfolios of algorithms, and interleaved/parallel runs. General approach --- holds promise for a range of hard combinatorial problems.

49 Scaling up ROBOFLAG - Other Formulations for Solving the Control Optimization Problem Encodings that provide “tighter” relaxations for the LP problem. Approximate representations using abstractions (“synthesize larger movements / trajectories”). Avoid discretization based on time. Less compact representations may allow for more propagation and scale up better. Constraint Satisfaction Problem (CSP) formulations. Hybrid CSP/LP formulations. Approximations based on LP randomized rounding. Goal: At least two orders of magnitude scale-up over current state-of-the-art.

Check also: Check also: Demos, papers, etc.