Linear Round Integrality Gaps for the Lasserre Hierarchy Grant Schoenebeck.

Slides:



Advertisements
Similar presentations
Arora: SDP + Approx Survey Semidefinite Programming and Approximation Algorithms for NP-hard Problems: A Survey Sanjeev Arora Princeton University
Advertisements

Lower Bounds for Additive Spanners, Emulators, and More David P. Woodruff MIT and Tsinghua University To appear in FOCS, 2006.
Iterative Rounding and Iterative Relaxation
The Primal-Dual Method: Steiner Forest TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A AA A A A AA A A.
Tight integrality gaps for vertex-cover semidefinite relaxations in the Lovász-Schrijver Hierarchy Avner Magen Joint work with Costis Georgiou, Toni Pitassi.
Primal Dual Combinatorial Algorithms Qihui Zhu May 11, 2009.
How to Round Any CSP Prasad Raghavendra University of Washington, Seattle David Steurer, Princeton University (In Principle)
Proof of correctness; More reductions
A threshold of ln(n) for approximating set cover By Uriel Feige Lecturer: Ariel Procaccia.
Approximability & Sums of Squares Ryan O’Donnell Carnegie Mellon.
Satyen Kale (Yahoo! Research) Joint work with Sanjeev Arora (Princeton)
Deterministic vs. Non-Deterministic Graph Property Testing Asaf Shapira Tel-Aviv University Joint work with Lior Gishboliner.
Dana Moshkovitz MIT Joint work with Subhash Khot, NYU 1.
C&O 355 Lecture 23 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
On the Unique Games Conjecture Subhash Khot Georgia Inst. Of Technology. At FOCS 2005.
Approximation Algorithms Chapter 14: Rounding Applied to Set Cover.
Theory of Computing Lecture 18 MAS 714 Hartmut Klauck.
Approximating Maximum Subgraphs Without Short Cycles Guy Kortsarz Join work with Michael Langberg and Zeev Nutov.
Semi-Definite Algorithm for Max-CUT Ran Berenfeld May 10,2005.
Inapproximability from different hardness assumptions Prahladh Harsha TIFR 2011 School on Approximability.
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
Venkatesan Guruswami (CMU) Yuan Zhou (CMU). Satisfiable CSPs Theorem [Schaefer'78] Only three nontrivial Boolean CSPs for which satisfiability is poly-time.
A Linear Round Lower Bound for Lovasz-Schrijver SDP relaxations of Vertex Cover Grant Schoenebeck Luca Trevisan Madhur Tulsiani UC Berkeley.
Semidefinite Programming
CPSC 689: Discrete Algorithms for Mobile and Wireless Systems Spring 2009 Prof. Jennifer Welch.
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
Approximation Algorithms
Last class Decision/Optimization 3-SAT  Independent-Set Independent-Set  3-SAT P, NP Cook’s Theorem NP-hard, NP-complete 3-SAT  Clique, Subset-Sum,
Computability and Complexity 24-1 Computability and Complexity Andrei Bulatov Approximation.
Integer Programming Difference from linear programming –Variables x i must take on integral values, not real values Lots of interesting problems can be.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
Linear Programming Relaxations for MaxCut Wenceslas Fernandez de la Vega Claire Kenyon -Mathieu.
On the hardness of approximating Sparsest-Cut and Multicut Shuchi Chawla, Robert Krauthgamer, Ravi Kumar, Yuval Rabani, D. Sivakumar.
(work appeared in SODA 10’) Yuk Hei Chan (Tom)
Tight Integrality Gaps for Lovász-Schrijver LP relaxations of Vertex Cover Grant Schoenebeck Luca Trevisan Madhur Tulsiani UC Berkeley.
Finding Almost-Perfect
Dana Moshkovitz, MIT Joint work with Subhash Khot, NYU.
Integrality Gaps for Sparsest Cut and Minimum Linear Arrangement Problems Nikhil R. Devanur Subhash A. Khot Rishi Saket Nisheeth K. Vishnoi.
1 Min-cut for Undirected Graphs Given an undirected graph, a global min-cut is a cut (S,V-S) minimizing the number of crossing edges, where a crossing.
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
Topics in Algorithms 2005 Constructing Well-Connected Networks via Linear Programming and Primal Dual Algorithms Ramesh Hariharan.
Yuan Zhou Carnegie Mellon University Joint works with Boaz Barak, Fernando G.S.L. Brandão, Aram W. Harrow, Jonathan Kelner, Ryan O'Donnell and David Steurer.
Lower Bounds for Property Testing Luca Trevisan U.C. Berkeley.
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
1/19 Minimizing weighted completion time with precedence constraints Nikhil Bansal (IBM) Subhash Khot (NYU)
Shorter Long Codes and Applications to Unique Games 1 Boaz Barak (MSR, New England) Parikshit Gopalan (MSR, SVC) Johan Håstad (KTH) Prasad Raghavendra.
Unique Games Approximation Amit Weinstein Complexity Seminar, Fall 2006 Based on: “Near Optimal Algorithms for Unique Games" by M. Charikar, K. Makarychev,
Yuan Zhou, Ryan O’Donnell Carnegie Mellon University.
Iterative Rounding in Graph Connectivity Problems Kamal Jain ex- Georgia Techie Microsoft Research Some slides borrowed from Lap Chi Lau.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Instructor: Shengyu Zhang 1. Optimization Very often we need to solve an optimization problem.  Maximize the utility/payoff/gain/…  Minimize the cost/penalty/loss/…
Approximation Algorithms based on linear programming.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Yuan Zhou Carnegie Mellon University Joint works with Boaz Barak, Fernando G.S.L. Brandão, Aram W. Harrow, Jonathan Kelner, Ryan O'Donnell and David Steurer.
Approximation algorithms
The Theory of NP-Completeness
Finding Almost-Perfect
Polynomial integrality gaps for
Maximum Matching in the Online Batch-Arrival Model
Exact Algorithms via Monotone Local Search
Sum of Squares, Planted Clique, and Pseudo-Calibration
Possibilities and Limitations in Computation
Richard Anderson Lecture 28 Coping with NP-Completeness
Introduction to PCP and Hardness of Approximation
Dániel Marx (slides by Daniel Lokshtanov)
The Theory of NP-Completeness
Topics in Algorithms 2005 Max Cuts
Instructor: Aaron Roth
Presentation transcript:

Linear Round Integrality Gaps for the Lasserre Hierarchy Grant Schoenebeck

Max Cut IP Given graph G Partition vertices into two sets to Maximize # edges crossing partition

Max Cut IP Homogenized

Max Cut SDP [GW94] Integrality Gap = min Integrality Gap =  )  – Approximation Algorithm Integrality Gap ¸.878… (rounding)[GW] Integrality Gap ·.878… (bad instance) [FS] Integral Solution SDP Solution

Max Cut SDP v0v0 v1v1 v4v4 v2v2 v3v3

Max Cut SDP and ▲ inequality

SDP value of 5-cycle = 4 General Integrality Gap Remains 0.878… [KV05]

Max Cut IP r-juntas Homogenized

Max Cut Lasserre r-rounds

CSP Maximization IP

CSP Maximization Lasserre r-rounds SDP

CSP Satisfaction IP

CSP Satisfiablity Lasserre r-rounds SDP

Lasserre Facts Runs in time n r Strength of Lasserre Tighter than other hieracheis Serali-Adams Lavasz-Schrijver (LP and SDP) r-rounds imply all valid constraints on r variables tight after n rounds Few rounds often work well 1-round ) Lovasz  function 1-round ) Goemans-Williamson 3-rounds ) ARV sparsest cut 2-rounds ) MaxCut with ▲inequality In general unknown and a great open question

Main Result Theorem: Random 3XOR instance not refuted by  n) rounds of Lasserre 3XOR:  =

Previous LS+ Results 3-SAT 7/8+   (n) LS+ rounds [AAT] Vertex Cover 7/6-   rounds [FO] 7/6-  (n) LS+ rounds [STT] 2-   (√log(n)/loglog(n)) LS+ rounds [GMPT]

LB for Random 3XOR Theorem: Random 3XOR instance not refuted by  n) rounds of Lasserre Proof: Random 3XOR cannot be refuted by width-w resolutions for w =  n) [BW] No width-w resolution ) no w/4-Lasserre refutation

Width w-Resolution Combine if result has · w variables

Width w-Resolution Combine if result has · w variables

Idea / Proof  ) width-2r Res )  F = linear functions “in”  L (r) = linear function of r-variables L 1, L 2 2 F Å  ) L 1 Δ L 2 2  ξ=L (r) /F = {[Ø][L * 2 ], [L * 2 ], …} Good-PA = Partial assignment that satisfies   ~ , for every Good-PA:  =  for every Good-PA:   

Idea / Proof L (r) = linear function of r-variables F = linear functions in C ξ = L (r) /F = {[Ø][L * 2 ], [L * 2 ], …}

Multiplication Check ^

Corollaries Meta-Corollary: Reductions easy The  (n) level of Lasserre: Cannot refute K-SAT IG of ½ +  for Max-k-XOR IG of 1 – ½ k +  for Max-k-SAT IG of 7/6 +  for Vertex Cover IG ½ +  for UniformHGVertexCover IG any constant for UniformHGIndependentSet

Pick random 3SAT formula  Pretend it is a 3XOR formula Use vectors from 3XOR SDP to satisfy 3SAT SDP Corollary I Random 3SAT instances not refuted by  n) rounds of Lasserre

Corollary II, III Integrality gap of ½ + ε after  (n) rounds of Lasserre for Random 3XOR instance Integrality gap of 7/8 + ε after  (n) rounds of Lasserre for Random 3SAT instance

Vertex Cover Corollary Integrality gap of 7/6 - ε after  (n) rounds of Lasserre for Vertex Cover FGLSS graphs from Random 3XOR formula (m = cn clauses) (y 1, …, y n )  Las r (VC)  (1-y 1, …, 1-y n )  Las r (IS) Transformation previously constructed vectors x 1 + x 2 + x 3 = x 3 + x 4 + x 5 =

SDP Hierarchies from a Distance Approximation Algorithms Unconditional Lower Bounds Proof Complexity Local-Global Tradeoffs

Future Directions Other Lasserre Integrality Gaps Positive Results Relationship to Resolution