Iterative Methods in Combinatorial Optimization

Slides:



Advertisements
Similar presentations
Iterative Rounding and Iterative Relaxation
Advertisements

The Primal-Dual Method: Steiner Forest TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A AA A A A AA A A.
1 LP, extended maxflow, TRW OR: How to understand Vladimirs most recent work Ramin Zabih Cornell University.
Network Design with Degree Constraints Guy Kortsarz Joint work with Rohit Khandekar and Zeev Nutov.
Submodular Set Function Maximization via the Multilinear Relaxation & Dependent Rounding Chandra Chekuri Univ. of Illinois, Urbana-Champaign.
C&O 355 Lecture 23 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
Approximation Algorithms Chapter 14: Rounding Applied to Set Cover.
Approximating Maximum Subgraphs Without Short Cycles Guy Kortsarz Join work with Michael Langberg and Zeev Nutov.
Approximation Algorithms for TSP Mohit Singh McGill University (in lieu of Amin Saberi)
Introduction to Approximation Algorithms Lecture 12: Mar 1.
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
Algorithms for Max-min Optimization
Instructor Neelima Gupta Table of Contents Lp –rounding Dual Fitting LP-Duality.
Linear Programming and Approximation
Totally Unimodular Matrices Lecture 11: Feb 23 Simplex Algorithm Elliposid Algorithm.
Semidefinite Programming
1 Approximation Algorithms for Demand- Robust and Stochastic Min-Cut Problems Vineet Goyal Carnegie Mellon University Based on, [Golovin, G, Ravi] (STACS’06)
Introduction to Linear and Integer Programming Lecture 7: Feb 1.
Approximation Algorithm: Iterative Rounding Lecture 15: March 9.
Approximation Algorithms
An Approximation Algorithm for Requirement cut on graphs Viswanath Nagarajan Joint work with R. Ravi.
On the Crossing Spanning Tree Vineet Goyal Joint work with Vittorio Bilo, R. Ravi and Mohit Singh.
Job Scheduling Lecture 19: March 19. Job Scheduling: Unrelated Multiple Machines There are n jobs, each job has: a processing time p(i,j) (the time to.
An Algebraic Algorithm for Weighted Linear Matroid Intersection
On Stochastic Minimum Spanning Trees Kedar Dhamdhere Computer Science Department Joint work with: Mohit Singh, R. Ravi (IPCO 05)
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
Randomness in Computation and Communication Part 1: Randomized algorithms Lap Chi Lau CSE CUHK.
1 Introduction to Approximation Algorithms Lecture 15: Mar 5.
(work appeared in SODA 10’) Yuk Hei Chan (Tom)
Packing Element-Disjoint Steiner Trees Mohammad R. Salavatipour Department of Computing Science University of Alberta Joint with Joseph Cheriyan Department.
1 Spanning Tree Polytope x1 x2 x3 Lecture 11: Feb 21.
Approximation Algorithms: Bristol Summer School 2008 Seffi Naor Computer Science Dept. Technion Haifa, Israel TexPoint fonts used in EMF. Read the TexPoint.
Primal-Dual Meets Local Search: Approximating MST’s with Non-uniform Degree Bounds Author: Jochen Könemann R. Ravi From CMU CS 3150 Presentation by Dan.
C&O 355 Mathematical Programming Fall 2010 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
Topics in Algorithms 2005 Constructing Well-Connected Networks via Linear Programming and Primal Dual Algorithms Ramesh Hariharan.
Edge-disjoint induced subgraphs with given minimum degree Raphael Yuster 2012.
Packing Rectangles into Bins Nikhil Bansal (CMU) Joint with Maxim Sviridenko (IBM)
Approximation Algorithms
Approximation Algorithms for Prize-Collecting Forest Problems with Submodular Penalty Functions Chaitanya Swamy University of Waterloo Joint work with.
CPSC 536N Sparse Approximations Winter 2013 Lecture 1 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAAAAAAA.
Chapter 2. Optimal Trees and Paths Combinatorial Optimization
Lecture.6. Table of Contents Lp –rounding Dual Fitting LP-Duality.
Iterative Rounding in Graph Connectivity Problems Kamal Jain ex- Georgia Techie Microsoft Research Some slides borrowed from Lap Chi Lau.
Approximation Algorithms Duality My T. UF.
Approximation Algorithms based on linear programming.
Multiroute Flows & Node-weighted Network Design Chandra Chekuri Univ of Illinois, Urbana-Champaign Joint work with Alina Ene and Ali Vakilian.
Introduction to Approximation Algorithms
Approximation Algorithms for Min-cost Chain-Constrained Spanning Trees
Data Driven Resource Allocation for Distributed Learning
Lap Chi Lau we will only use slides 4 to 19
Topics in Algorithms Lap Chi Lau.
Maximum Matching in the Online Batch-Arrival Model
Chapter 5. Optimal Matchings
A note on the Survivable Network Design Problem
1.3 Modeling with exponentially many constr.
Chapter 6. Large Scale Optimization
Integer Programming (정수계획법)
Linear Programming and Approximation
Linear Programming Duality, Reductions, and Bipartite Matching
2. Generating All Valid Inequalities
András Sebő and Anke van Zuylen
1.3 Modeling with exponentially many constr.
Integer Programming (정수계획법)
Flow Feasibility Problems
Chapter 1. Formulations.
Chapter 6. Large Scale Optimization
Presentation transcript:

Iterative Methods in Combinatorial Optimization Mohit Singh McGill University joint works with L.C. Lau, F. Grandoni, T. Kiraly, S. Naor, R. Ravi and M. Salavatipour

Combinatorial Optimization “Easy” Problems : polynomial time solvable (P) Spanning Trees Matchings Matroid Intersection “Hard” Problems : NP-hard Survivable Network Design Facility Location Scheduling Problems Natural dichotomy: easy and hard Easy problems: LP has been the most powerful tool. Hard problems: NP-hard. Unlikely they are solvable in polynomial time. One aims for an approximation algorithm for the problem: define rho approximation. LP has been one of the most generic tools for these problems as well. The general technique to is to formulate a linear programming relaxation for this problem. Do not expect this LP to be integral. General techniques have been developed In this talk, I will talk about the iterative rounding technique and its extensions that we have developed in our work. These extensions allow us to obtain strong results for a large class of problems. We show that iterative methods are well-suited for poly time solvable problems. This will act as basic groundwork for analyzing hard problems as well.

Formulate Linear Program Linear Programming Formulate Linear Program P NP-hard Show Integrality Round the fractional solution to obtain approximation algorithm Natural dichotomy: easy and hard Easy problems: LP has been the most powerful tool. Hard problems: NP-hard. Unlikely they are solvable in polynomial time. One aims for an approximation algorithm for the problem: define rho approximation. LP has been one of the most generic tools for these problems as well. The general technique to is to formulate a linear programming relaxation for this problem. Do not expect this LP to be integral. General techniques have been developed In this talk, I will talk about the iterative rounding technique and its extensions that we have developed in our work. These extensions allow us to obtain strong results for a large class of problems. We show that iterative methods are well-suited for poly time solvable problems. This will act as basic groundwork for analyzing hard problems as well. Randomized Rounding Primal-Dual Schema Iterative Rounding …

Iterative Rounding (Jain’98): ½-element ) 2-approximation Typical Rounding: LP Solver Rounding Procedure Optimal Fractional Solution Integer Solution Problem Instance Iterative Rounding (Jain’98): ½-element ) 2-approximation LP Solver Good Part Part Integer Optimal Fractional Solution Problem Instance Iterative Rounding limitations (SNDP undirected and directed graphs) Lots of techniques (uncrossing) were similar to techniques used in combinatorial optimization for analyzing LP formulations of exact problems. Residual Problem Too Fractional

Minimum Bounded Degree Spanning Tree Design a spanning tree Low cost Low degree at all nodes min c(T) s.t. T is a spanning tree deg (v) · B Checking feasibility is NP-hard problem is simple to state but captures the structure of more complicated problems. Our work shows that this will see that this is indeed true to some extent. Feasibility problem is NP-hard. 8 v 11/12/2018 11/12/2018 5

Base Problem and Constrained Problem MBDST problem Spanning Tree Problem min c(T) s.t. T is a spanning tree deg(v) · B 8 v2 V 11/12/2018

Iterative Rounding and Relaxation Iterative Rounding works for “easy” problems. Iterative proofs of integrality of spanning tree, arborescene, matroid, matching, matroid intersection … Iterative Relaxation Relax complicating constraints and bound violations. Extend these integrality results to approximation algorithms. mainly concentrate on degree bounded network design problems most well-studied being the MBDST problem. Tighter results for 2-criteria problems. Integral formulations. 11/12/2018

Result Theorem [S., Lau ’07]: There exists a polynomial time algorithm for MBDST problem which returns a tree of c(T) · c(OPT) maximum degree · B+1. OPT is the cheapest tree with maximum degree B. Resolved a conjecture of Goemans ’91 and improved on Goemans’06. Generalizes a result of Furer and Raghavachari ’92.

Outline Integrality of Spanning Tree B+1 result Extensions Conclusion and Open Problems Illustrate the iterative method on MBDST problem. 11/12/2018 9 9

Spanning Tree Polyhedron Integer program min e2 E ce xe s.t. e2 E(V) xe= |V|-1 xe 2 {0,1} Any tree has n-1 edges Seperation 11/12/2018

Spanning Tree Polyhedron Integer program min e2 E ce xe s.t. e2 E(V) xe= |V|-1 e2 E(S) xe· |S|-1 8 S½ V, |S|¸ 2 xe 2 {0,1} E(S): set of edges with both endpoints in S. Any tree has n-1 edges Subtour elimination constraints Seperation 11/12/2018

Spanning Tree Polyhedron Linear Integer program min e2 E ce xe s.t. e2 E(V) xe= |V|-1 e2 E(S) xe· |S|-1 8 S½ V, |S|¸ 2 xe 2 {0,1} 0· xe ·1 (Edmonds ‘71) Any tree has n-1 edges Subtour elimination constraints Equivalent compact formulations [Wong ’80] Polynomial time separation [Cunningham ’84] Seperation 11/12/2018

(Iterative) Rounding Spanning Trees Solve LP to obtain optimum extreme point x Remove all edges s.t. xe = 0 Return E (the non-zero edges) Claim: If |E|=|V|-1 then E is a MST. Proof: E feasible ) x(E)=|V|-1 ) xe=1 8 e2 E ) E is a tree. Edges included in F will form a spanning tree in the end. 11/12/2018

Extreme Points and Uncrossing Fact: x extreme ) d linearly independent tight constraints. Claim: x is extreme ) |E| · n-1 Put References, Put in 1-slide. (Looking Ahead) No 1-edge implies many fractional edges. Extreme point with few side constraints will imply few fractional edges. A contradiction. Put line later. 11/12/2018

Extreme Points and Uncrossing Fact: x extreme ) d linearly independent tight constraints. Claim: x is extreme ) |E| · n-1 e2 E(S) xe=|S|-1 Standard uncrossing ) linearly independent set of constraints defining x can be chosen to form a laminar family. Put References, Put in 1-slide. (Looking Ahead) No 1-edge implies many fractional edges. Extreme point with few side constraints will imply few fractional edges. A contradiction. Put line later. A[B B A AÅB 11/12/2018 11/12/2018

Extreme Points and Uncrossing Fact: x extreme ) d linearly independent tight constraints. Claim: x is extreme ) |E| · n-1 e2 E(S) xe=|S|-1 Standard uncrossing ) linearly independent set of constraints defining x can be chosen to form a laminar family. Put References, Put in 1-slide. (Looking Ahead) No 1-edge implies many fractional edges. Extreme point with few side constraints will imply few fractional edges. A contradiction. Put line later. 11/12/2018

Extreme Points and Uncrossing Claim: x is extreme ) |E| · n-1 Number of variables (dimension) = |E| Number of constraints = |L| ) |E|=|L| |L| is laminar ) |L|· n-1 ) |E|· n-1 Put References, Put in 1-slide. (Looking Ahead) No 1-edge implies many fractional edges. Extreme point with few side constraints will imply few fractional edges. A contradiction. Put line later. Theorem [Edmonds]: Spanning tree polyhedron is integral. 11/12/2018

Outline Integrality of Spanning Tree B+1 result Extensions Conclusion and Open Problems Illustrate the iterative method on MBDST problem. 11/12/2018 18 18

Base Problem and Constrained Problem MBDST problem Spanning Tree Problem min c(T) s.t. T is spanning tree degT(v) · Bv 8 v2W 11/12/2018

Bounded Degree Spanning Trees Extend spanning tree polyhedron min e2 E ce xe s.t. e2 E(V) xe= |V|-1 e2 E(S) xe· |S|-1 8 S ½ V e2 (v)xe· Bv 8 v 2 W xe¸ 0 Here W½V. Spanning tree Degree bounds Outline : 11/12/2018

Obtaining B+1 Algorithm Solve LP to obtain extreme point x. Remove all edges e s.t. xe=0. Return E. Pursued in LNSS. 11/12/2018

Obtaining B+1 Algorithm Relaxation Step While W  Solve LP to obtain extreme point x. Remove all edges e s.t. xe=0. If 9 v2 W such that degE(v)· Bv+1, then remove the degree constraint of v. Return E Lemma: Solution returned is a tree Optimal cost degE(v)· Bv+1 Pursued in LNSS.

Main Lemma Lemma: There exists v2 W such that degE(v)· Bv+1 where E is the support of x. Proof: Tight constraints = 1. Laminar Family: L 2 . Degree constraints: W Will show |E|> |L|+|W| ) contradiction Variables: Edges E Collect 1 token for Each member of L Each vertex in W Extra token Redistribute 1 token for each edge. |E| total token. See [Bansal, Khandekar, Nagarajan’08] 11/12/2018

Charging Argument Simpler argument due to Bansal, Khandekar and Nagarajan ‘08. Redistribution: Degree constraint for u and v get (1-xuv)/2 tokens each. u v $1 (1-xuv)/2 (1-xuv)/2 11/12/2018

Charging Argument Simpler argument due to Bansal, Khandekar and Nagarajan ‘08. Redistribution: Degree constraint for u and v get (1-xuv)/2 tokens each. u v xuv Smallest set containing u and v gets xuv tokens $1 Collection: w Tokens received : e2 (w) (1-xe)/2 ¸ (degE(w)-Bw)/2 ¸ 1 (since degree constraint present) 11/12/2018

Charging Argument Simpler argument due to Bansal, Khandekar and Nagarajan ‘08. Redistribution: Degree constraint for u and v get (1-xuv)/2 tokens each. u v xuv Smallest set containing u and v gets xuv tokens $1 Collection: S R2 R1 x(E(S))=|S|-1 - x(E(Ri))=|Ri|-1 Tokens to S= Integer 11/12/2018

General Methodology Constrained Problem Base Problem Side Constraints 11/12/2018

Minimum Bounded Spanning Tree Degree Constraints Thm[S, Lau ‘07]: (1,B+1)-approximation 11/12/2018

Degree Bounded Steiner Tree Iterative Rounding [Jain]: ½-edge ) 2-approximation Steiner Tree Degree Constraints Thm [LNSS ‘07]: Obtain (2,2B+3)-approximation 11/12/2018

Degree Bounded Steiner Tree Iterative Rounding [Jain]: ½-edge ) 2-approximation Steiner Tree Degree Constraints Thm [LS ‘08]: Obtain (2,B+3)-approximation 11/12/2018

Degree Bounded Arboresence Degree Constraints Thm [LNSS ‘07]: Obtain (2,2B+2)-approximation Thm [BKN ’08]: Obtain (B+4)-approximation. 11/12/2018

Bipartite Matching Bipartite Matching Bipartite Matching Multi-criteria Makespan Constraints Thm[S]: 2-approximation for scheduling unrelated parallel machines. Thm[FRS]: (1+²)-approximation for Multi-criteria bipartite matching. 11/12/2018

More General Structures Matroid Submodular Flow Degree Constraints Degree Constraints Thm[Kiraly, Lau, S ’08]: Additive approximation for degree constrained matroid basis and degree constrained submodular flow problem. See BKNP ’10 for more general structures. 11/12/2018

Multi-Criteria Spanning Tree lengthi (T) · Li Thm [Grandoni, Ravi, S. ’09]: Iterative Relaxation gives (1+²)-approximation for fixed ² 11/12/2018

General Methodology Base Problem Side Constraints “Structured” side constraints in “structured” problems are easy to handle Base Problem Side Constraints 11/12/2018

Applications* Topolgy Control for Future Airborne Networks, Krishnamurthi et al 2009. Deploying Mesh Nodes under non-uniform propogation, Robinson et al, 2009 11/12/2018

Conclusion Iterative Rounding and Relaxation Open Problems Obtain new iterative proofs of classical integrality results Extend these integrality results to multi-criteria optimization and obtain additive approximations Open Problems OPT+1 for Bin Packing? OPT + log2 n. Karp Karmarkar ’82. Discrepancy of Sets? Beck, Fiala ’81, Bansal ’10. Primal-Dual Algorithms? 11/12/2018

Thank You!