Linear Programming Relaxations for MaxCut Wenceslas Fernandez de la Vega Claire Kenyon -Mathieu.

Slides:



Advertisements
Similar presentations
Lower Bounds for Additive Spanners, Emulators, and More David P. Woodruff MIT and Tsinghua University To appear in FOCS, 2006.
Advertisements

The Primal-Dual Method: Steiner Forest TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A AA A A A AA A A.
Great Theoretical Ideas in Computer Science
Linear Round Integrality Gaps for the Lasserre Hierarchy Grant Schoenebeck.
Gillat Kol joint work with Ran Raz Locally Testable Codes Analogues to the Unique Games Conjecture Do Not Exist.
C&O 355 Lecture 23 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
1 Matching Polytope x1 x2 x3 Lecture 12: Feb 22 x1 x2 x3.
GRAPH BALANCING. Scheduling on Unrelated Machines J1 J2 J3 J4 J5 M1 M2 M3.
Approximation Algorithms Chapter 14: Rounding Applied to Set Cover.
C&O 355 Mathematical Programming Fall 2010 Lecture 22 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
Totally Unimodular Matrices
1 of 56 Linear Programming-Based Approximation Algorithms Shoshana Neuburger Graduate Center, CUNY May 13, 2009.
EMIS 8373: Integer Programming Valid Inequalities updated 4April 2011.
Basic Feasible Solutions: Recap MS&E 211. WILL FOLLOW A CELEBRATED INTELLECTUAL TEACHING TRADITION.
Gillat Kol joint work with Ran Raz Locally Testable Codes Analogues to the Unique Games Conjecture Do Not Exist.
Approximation Algorithm for Multicut
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
A Linear Round Lower Bound for Lovasz-Schrijver SDP relaxations of Vertex Cover Grant Schoenebeck Luca Trevisan Madhur Tulsiani UC Berkeley.
Linear Programming and Approximation
Totally Unimodular Matrices Lecture 11: Feb 23 Simplex Algorithm Elliposid Algorithm.
Semidefinite Programming
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
A general approximation technique for constrained forest problems Michael X. Goemans & David P. Williamson Presented by: Yonatan Elhanani & Yuval Cohen.
Approximation Algorithms
Michael Bender - SUNY Stony Brook Dana Ron - Tel Aviv University Testing Acyclicity of Directed Graphs in Sublinear Time.
Semidefinite Programming Based Approximation Algorithms Uri Zwick Uri Zwick Tel Aviv University UKCRC’02, Warwick University, May 3, 2002.
Yet another algorithm for dense max cut - go greedy Claire Mathieu Warren Schudy (presenting) Brown University Computer Science SODA 2008.
Job Scheduling Lecture 19: March 19. Job Scheduling: Unrelated Multiple Machines There are n jobs, each job has: a processing time p(i,j) (the time to.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
Lower Bounds for Property Testing Luca Trevisan U C Berkeley.
Integer Programming Difference from linear programming –Variables x i must take on integral values, not real values Lots of interesting problems can be.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
1 Introduction to Approximation Algorithms Lecture 15: Mar 5.
(work appeared in SODA 10’) Yuk Hei Chan (Tom)
Tight Integrality Gaps for Lovász-Schrijver LP relaxations of Vertex Cover Grant Schoenebeck Luca Trevisan Madhur Tulsiani UC Berkeley.
Finding Almost-Perfect
Approximation Algorithms: Bristol Summer School 2008 Seffi Naor Computer Science Dept. Technion Haifa, Israel TexPoint fonts used in EMF. Read the TexPoint.
1 The Santa Claus Problem (Maximizing the minimum load on unrelated machines) Nikhil Bansal (IBM) Maxim Sviridenko (IBM)
Approximation Algorithms for Stochastic Combinatorial Optimization Part I: Multistage problems Anupam Gupta Carnegie Mellon University.
MCS312: NP-completeness and Approximation Algorithms
Design Techniques for Approximation Algorithms and Approximation Classes.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
Testing the independence number of hypergraphs
Semidefinite Programming
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
1/19 Minimizing weighted completion time with precedence constraints Nikhil Bansal (IBM) Subhash Khot (NYU)
CPSC 536N Sparse Approximations Winter 2013 Lecture 1 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAAAAAAA.
CSCI-256 Data Structures & Algorithm Analysis Lecture Note: Some slides by Kevin Wayne. Copyright © 2005 Pearson-Addison Wesley. All rights reserved. 29.
Lecture.6. Table of Contents Lp –rounding Dual Fitting LP-Duality.
Unique Games Approximation Amit Weinstein Complexity Seminar, Fall 2006 Based on: “Near Optimal Algorithms for Unique Games" by M. Charikar, K. Makarychev,
Constraints Feasible region Bounded/ unbound Vertices
Iterative Rounding in Graph Connectivity Problems Kamal Jain ex- Georgia Techie Microsoft Research Some slides borrowed from Lap Chi Lau.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Instructor: Shengyu Zhang 1. Optimization Very often we need to solve an optimization problem.  Maximize the utility/payoff/gain/…  Minimize the cost/penalty/loss/…
Approximation Algorithms based on linear programming.
Discrete Optimization MA2827 Fondements de l’optimisation discrète Material from P. Van Hentenryck’s course.
Lap Chi Lau we will only use slides 4 to 19
Polynomial integrality gaps for
Topics in Algorithms Lap Chi Lau.
Joint work with Frans Schalekamp and Anke van Zuylen
Maximum Matching in the Online Batch-Arrival Model
Chapter 5. Optimal Matchings
EMIS 8373: Integer Programming
Instructor: Shengyu Zhang
Linear Programming and Approximation
András Sebő and Anke van Zuylen
Presentation transcript:

Linear Programming Relaxations for MaxCut Wenceslas Fernandez de la Vega Claire Kenyon -Mathieu

Technique for approximation  IP formulation with 0-1 variables  LP relaxation  algorithm  Strengthen LP: add valid inequalities  Reduce integrality gap =  Better approximation

Example: Min Cost Perfect (non-bipartite) Matching Unbounded gap LP: Edge e is taken with probability x(e) Every vertex has exactly one adjacent edge [Edmonds 1965] Reduce gap to 1 by adding: Every odd vertex set has at least one edge to the outside outside

Lift and Project (L&P) [BCC, LS, SA, L] Systematic way to strengthen LPs. Rounds: After 0 rounds: basic LP After k rounds: contains all valid inequalities with support k After n rounds: IP Poly-time solvable for any fixed k.

L&P and int gaps Vertex cover [KG’98,AB,L’02,C’02STT’06] Max 3 SAT, Set cover, Hypergraph vertex cover [BOGH+03,AAT05] Here: Maxcut Because: Theory people like Maxcut!

L&P for MaxCut LP relaxation has gap=2 [PT’94] Thm [here]: gap is still 2 even after log(n)ˆc rounds of Sherali-Adams L&P Thm [STT]: (for another LP) gap is still 2 even after a linear number of rounds of Lovasz- Shrijver L&P. The moral: for MaxCut, SDP is better than LP, even if the LPs are greatly enhanced.

Questions Definition of L&P? Differences Lovasz-Shrijver vs. Sherali- Adams vs. others? SDP variant of L&P? Compare proof to other lower bound proofs for L&P? No answers in this talk.

What I like about this work Not the result: somewhat unsurprising Not the “broader impacts”… The proof: Relatively clean: few short calculations, all driven by intuition Next: some key ideas for a simple case No need to know about lift and project!

MaxCut LP relaxation… x(i,j) indicates whether {i,j} crosses the cut x(i,j)+x(j,k)+x(k,i) ≤ 2 x(i,j) ≤ x(j,k)+x(k,i) Gap = 2 ij k

… enhanced Additional valid inequalities: x(a,b)+x(a,c)+…+x(d,e) ≤ 6 We will prove that we still have Gap = 2. I cut at most 6 edges a c e b d

Graph: sparse random, altered for large girth. MaxCut ≈|E|/2 w.h.p. To define x(i,j): threshold T. if distance > T then x(i,j)=1/2; else, construct a random labeling on the shortest path, and let x(i,j)=Pr(labels differ). Such that x(i,j)=1-  for i and j adjacent  FRAC ≈ |E| Gap=2!

Core of proof: feasibility (x(i,j)) satisfies every constraint: let S be the vertices involved in . Define a distribution over labels of S only, and let y(i,j)=Pr(labels differ). y is a fractional cut, and constraint is valid inequality, so by definition ay-b ≥ 0: no calculations needed for this! Observe that y(i,j) ≈ x(i,j) Thus: ax-b ≈ ay-b ≥ 0.

Defining x(i,j)

Defining y(i,j) when S={i,j,k,u,v}

Coupling x(i,j) and y(i,j)

Positive results Without SDP, is L&P actually useful? Thm [here]: in dense graphs, gap~1 after O(1) rounds of Sherali-Adams L&P Note: this is not surprising since there already exist at least 3 PTAS for MaxCut in dense graphs.

Conclusion L&P is potentially an attractive alternative to ad hoc fumbling with existing LPs Unfortunately, most results so far are negative if we don’t use SDP. To justify continued work on L&P, we need some positive results: for some problem, find a new, better approximation algorithm by using L&P explicitly and voluntarily.

That’s it The end

Makespan minimization Independent jobs, m parallel machines LP: x(i,j) indicates whether job j goes on machine i, and t=makespan. Constraints: Every job must go on some machine Makespan greater than load on each machine Unbounded gap Add: “makespan≥p(j) for every job” reduces gap to 2, but this does not appear in L&P until after m rounds.

Proof(1/1) based on [AFKK]

Proof(4/4) Given S set of 5 vertices or less, define (y(i,j)) over cuts of S Subgraph H(S)={edges on some i-to-j path with i,j in S and distance < T} Large girth  H(S) is a forest Remove each edge of H(S) w.p. 2  independently; In each connected component, label vertices alternating 1 and 0 from a random starting point Set Y(i,j)=1 iff i and j have different labels. set y(i,j)=Expectation of Y(i,j).