Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.

Slides:



Advertisements
Similar presentations
Iterative Rounding and Iterative Relaxation
Advertisements

The Primal-Dual Method: Steiner Forest TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A AA A A A AA A A.
Great Theoretical Ideas in Computer Science
C&O 355 Lecture 23 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
1 Matching Polytope x1 x2 x3 Lecture 12: Feb 22 x1 x2 x3.
Approximation Algorithms Chapter 14: Rounding Applied to Set Cover.
C&O 355 Mathematical Programming Fall 2010 Lecture 22 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
Introduction to Algorithms
How should we define corner points? Under any reasonable definition, point x should be considered a corner point x What is a corner point?
EMIS 8373: Integer Programming Valid Inequalities updated 4April 2011.
Combinatorial Algorithms
Basic Feasible Solutions: Recap MS&E 211. WILL FOLLOW A CELEBRATED INTELLECTUAL TEACHING TRADITION.
Introduction to Approximation Algorithms Lecture 12: Mar 1.
Integer Programming 3 Brief Review of Branch and Bound
Approximation Algorithms
Approximation Algorithms: Combinatorial Approaches Lecture 13: March 2.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
Approximation Algorithm: Iterative Rounding Lecture 15: March 9.
Math443/543 Mathematical Modeling and Optimization
Approximation Algorithms
1 Maximum matching Max Flow Shortest paths Min Cost Flow Linear Programming Mixed Integer Linear Programming Worst case polynomial time by Local Search.
Job Scheduling Lecture 19: March 19. Job Scheduling: Unrelated Multiple Machines There are n jobs, each job has: a processing time p(i,j) (the time to.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
Integer Programming Difference from linear programming –Variables x i must take on integral values, not real values Lots of interesting problems can be.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
(work appeared in SODA 10’) Yuk Hei Chan (Tom)
Approximation Algorithms Motivation and Definitions TSP Vertex Cover Scheduling.
1 Spanning Tree Polytope x1 x2 x3 Lecture 11: Feb 21.
Daniel Kroening and Ofer Strichman Decision Procedures An Algorithmic Point of View Deciding ILPs with Branch & Bound ILP References: ‘Integer Programming’
Decision Procedures An Algorithmic Point of View
1.3 Modeling with exponentially many constr.  Some strong formulations (or even formulation itself) may involve exponentially many constraints (cutting.
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
Lecture 6 – Integer Programming Models Topics General model Logic constraint Defining decision variables Continuous vs. integral solution Applications:
Princeton University COS 423 Theory of Algorithms Spring 2001 Kevin Wayne Approximation Algorithms These lecture slides are adapted from CLRS.
Chap 10. Integer Prog. Formulations
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
Branch-and-Cut Valid inequality: an inequality satisfied by all feasible solutions Cut: a valid inequality that is not part of the current formulation.
Integer Programming (정수계획법)
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
CSE 589 Part V One of the symptoms of an approaching nervous breakdown is the belief that one’s work is terribly important. Bertrand Russell.
8/14/04 J. Bard and J. W. Barnes Operations Research Models and Methods Copyright All rights reserved Lecture 6 – Integer Programming Models Topics.
Lecture 6 – Integer Programming Models Topics General model Logic constraint Defining decision variables Continuous vs. integral solution Applications:
Iterative Rounding in Graph Connectivity Problems Kamal Jain ex- Georgia Techie Microsoft Research Some slides borrowed from Lap Chi Lau.
C&O 355 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Common Intersection of Half-Planes in R 2 2 PROBLEM (Common Intersection of half- planes in R 2 ) Given n half-planes H 1, H 2,..., H n in R 2 compute.
Approximation Algorithms by bounding the OPT Instructor Neelima Gupta
COSC 3101A - Design and Analysis of Algorithms 14 NP-Completeness.
Approximation Algorithms based on linear programming.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
::Network Optimization:: Minimum Spanning Trees and Clustering Taufik Djatna, Dr.Eng. 1.
EMIS 8373: Integer Programming Combinatorial Optimization Problems updated 27 January 2005.
Discrete Optimization MA2827 Fondements de l’optimisation discrète Material from P. Van Hentenryck’s course.
Lap Chi Lau we will only use slides 4 to 19
Integer Programming An integer linear program (ILP) is defined exactly as a linear program except that values of variables in a feasible solution have.
Optimization problems such as
Topics in Algorithms Lap Chi Lau.
1.3 Modeling with exponentially many constr.
Chapter 6. Large Scale Optimization
Integer Programming (정수계획법)
Approximation Algorithms
András Sebő and Anke van Zuylen
1.3 Modeling with exponentially many constr.
Integer Programming (정수계획법)
Cynthia Phillips (Sandia National Laboratories)
Chapter 6. Large Scale Optimization
Presentation transcript:

Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract DE-AC04-94AL Reconnect ‘04 A Few Topics in Polyhedral Combinatorics Cynthia Phillips, Sandia National Laboratories

Slide 2 Strengthen Linear Program with Cutting Planes Original LP Feasible region LP optimal solution Cutting plane (valid inequality) Integer optimal Make LP polytope closer to integer polytope Use families of constraints too large to explicitly list –Exponential, pseudopolynomial, polynomial (n 4, n 5 )

Slide 3 Separation Consider a family of cutting planes –Abbreviate as (a i,b i ) A separation algorithm takes this family and an x* and in polynomial time either –Returns a member of the family (a i,b i ) such that x* violates (a i,b i ) –Says (truthfully) that x* violates no member of the family If we iteratively add the cuts returned by the separation algorithm, in polynomial time, we will have an optimal LP solution that satisfies the whole family (Ellipsoid algorithm)

Slide 4 Example: Traveling Salesman Problem Input: a set of n cities,, distance d ij between cities i and j –Can travel between any pair (automatic with the triangle inequality) Goal: Visit each city exactly once so as to minimize the total distance Variable x ij = 1 if edge (i,j) in the tour, 0 otherwise Undirected formulation (x ij has i < j) Enforce all nodes have degree 2 in the tour

Slide 5 Subtours Degree constraints aren’t sufficient for an IP formulation because we can have disconnected cycles

Slide 6 Eliminate Subtours Force 2 edges to cross every (nontrivial) cut

Slide 7 Subtour Elimination Constraints If we give each edge e weight x e *, then the separation algorithm is looking for a cut of capacity less than 2 Just run a standard minimum cut code

Slide 8 The Power of Separation For 300 cities, there are over subtour elimination constraints! But we can enforce them all for instances with thousands of cities. Adding classes of cutting planes can provably reduce the integrality gap (ratio between best IP solution and best LP solution)

Slide 9 Compact Formulations When the separation algorithm is itself an LP we can sometimes represent the entire separation process as a single LP (with polynomially more variables)

Slide 10 Valid Inequality An inequality is valid for a polytope if it contains the whole polytope feasible

Slide 11 Facet Let be a valid inequality for polyhedron P Then is a face of the polyhedron If, then F supports P If F is exactly one dimension smaller than P, then it is a facet Families of facet-defining inequalities are optimal in a sense feasible

Slide 12 Convex Combinations A point x is a convex combination of two others x 1 and x 2 if (componentwise) x1x1 x x2x2

Slide 13 Extreme Points Another definition of an extreme point (corner of a polyhedron): is an extreme point if and only if there are no such that x is a convex combination of x 1 and x 2 x x2x2 x1x1

Slide 14 Convex Decomposition x* = optimal solution to the LP relaxation Find feasible integer solutions Convex combination: Implies one of the S i has cost at most  * LP optimal (one is as good as group average) gradient LP  * LP Integer polytope

Slide 15 Convex Decomposition We have Order the S i such that Since Suppose Then Contradiction

Slide 16 Decomposition Precisely Defines Integrality Gap An IP has a solution within  times the LP bound if and only if  x* can be decomposed into a convex combination of feasible solutions. Definition: A  -approximation algorithm for a minimization problem guarantees a solution no more than  times the optimal solution for all instances.

Slide 17 LP-Relaxation-Based Approximation for IP Compute LP relaxation (lower bound). Common technique: –Use structural information from LP solution to find feasible IP solution (use parallelism if possible) –Bound quality using LP bound Integrality gap = max I (IP (I))/(LP(I)) This technique cannot prove anything better than integrality gap

Slide 18 Example: Vertex Cover Find a minimum-size set of vertices such that each edge has at least one endpoint in the set

Slide 19 Example: Vertex Cover

Slide 20 2-Approximation algorithm for Vertex Cover Solve the LP relaxation for vertex cover: Select all vertices i such that v i ≥ 1/2. This covers all edges: at least one endpoint will have value at least 1/2. Each such vertex contributed as least 1/2 to the optimal LP solution, so rounding to 1 at most doubles cost.

Slide 21 Capacitated Network Design Each pair (v i, v j ) has a demand (required connectivity) d ij –Min cut separating v i and v j is at least d ij Choose min-cost subgraph s.t. all pairwise demands satisified All/none decision for each edge. 12 (4) s (6) 9 (15) 2 (7) 5 (1)5 (17) 3 (10) t (2) 20 (30) 2 (8) 1 (4) Capacity u e (cost c e )

Slide 22 Network Reinforcement - Communication Network message packets take “all” paths, must capture all packets to compromise (Franklin) Capacity = attacker cost to compromise edge Min cut = attacker cost to eavesdrop Pay to protect all communication at desired level. 12 (4) s (6) 9 (15) 2 (7) 5 (1)5 (17) 3 (10) t (2) 20 (30) 2 (8) 1 (4) Capacity u e (cost c e )

Slide 23 Special Case - Minimum Knapsack Problem Given: Set of objects: Object i has cost c i, value v i Required value V Find: minimum-cost set of objects with total value at least V st v 1 (c 1 ) v 2 (c 2 ) v m (c m )......

Slide 24 Generalization - Capacitated Covering All entries of c,U,d are nonnegative.

Slide 25 Definition: Bond A bond is a minimal set of edges whose removal disconnects a pair with positive demand. Count multiedges as 1. Max bond of graph G,  (G) is max cardinality of any bond in G s 1 4 t Card(Bond) = 4

Slide 26 Integer Program (IP) for capacitated network design Where d(C) is the maximum demand d ij for any pair that crosses cut C x e = 1 if edge e is selected

Slide 27 Simple Network Reinforcement IP has Bad Integrality Gap u=D-1 c=0 st u=D c=1 st u=D-1 u=D c=0 c=1 st u=D c=1 IP cost = 1 x e = 1 x e = 1/D LP cost = 1/D Ratio OPT(IP)/OPT(LP) = D

Slide 28 Effective Capacities Can assume C is a cut, i j

Slide 29 Inhibiting One Form of Cheating New problem with remaining edges and residual Demand D - (D-1) = 1 u=D-1 u=D c=1 u=D-1 st u=D c=0 Demand D u=D-1 u=D c=1 u=D-1 st u=D c=1 c=0 Residual Demand 1 u=1 x e = 1

Slide 30 Knapsack Cover (KC) Inequalities A C

Slide 31 Knapsack Cover (KC) Cuts for General Graphs

Slide 32 New Integrality Gaps 2 for Knapsack  (G) + 1 for general graphs Proof: Find feasible integer solution with cost 2 (or  (G) + 1) times LP optimal