Boaz Barak (MSR New England) Fernando G.S.L. Brandão (Universidade Federal de Minas Gerais) Aram W. Harrow (University of Washington) Jonathan Kelner (MIT)

Slides:



Advertisements
Similar presentations
The Complexity of Linear Dependence Problems in Vector Spaces David Woodruff IBM Almaden Joint work with Arnab Bhattacharyya, Piotr Indyk, and Ning Xie.
Advertisements

Iterative Rounding and Iterative Relaxation
Hypercontractive inequalities via SOS, and the Frankl-Rödl graph Manuel Kauers (Johannes Kepler Universität) Ryan ODonnell (Carnegie Mellon University)
Parallel Repetition of Two Prover Games Ran Raz Weizmann Institute and IAS.
The Unique Games Conjecture and Graph Expansion School on Approximability, Bangalore, January 2011 Joint work with S Prasad Raghavendra Georgia Institute.
Shortest Vector In A Lattice is NP-Hard to approximate
Subexponential Algorithms for Unique Games and Related Problems School on Approximability, Bangalore, January 2011 David Steurer MSR New England Sanjeev.
Approximability & Proof Complexity Ryan O’Donnell Carnegie Mellon.
Boaz Barak – Microsoft Research Partially based on joint work with Jonathan Kelner (MIT) and David Steurer (Cornell) Sum of Squares Proofs and The Quest.
Approximability & Sums of Squares Ryan O’Donnell Carnegie Mellon.
Gillat Kol joint work with Ran Raz Locally Testable Codes Analogues to the Unique Games Conjecture Do Not Exist.
On Combinatorial vs Algebraic Computational Problems Boaz Barak – MSR New England Based on joint works with Benny Applebaum, Guy Kindler, David Steurer,
Understanding the Power of Convex Relaxation Hierarchies: Effectiveness and Limitations Yuan Zhou Computer Science Department Carnegie Mellon University.
Separable states, unique games and monogamy Aram Harrow (MIT) TQC 2013 arXiv: based on work with Boaz Barak (Microsoft) Fernando Brandão (UCL)
The Unique Games Conjecture with Entangled Provers is False Julia Kempe Tel Aviv University Oded Regev Tel Aviv University Ben Toner CWI, Amsterdam.
Constraint Satisfaction over a Non-Boolean Domain Approximation Algorithms and Unique Games Hardness Venkatesan Guruswami Prasad Raghavendra University.
Optimization problems, subexponential time, & Lasserre algorithms Featuring work by: Ryan O’DonnellCMU Venkat GuruswamiCMU Ali K. SinopCMU David WitmerCMU.
Games, Proofs, Norms, and Algorithms Boaz Barak – Microsoft Research Based (mostly) on joint works with Jonathan Kelner and David Steurer.
Subexponential Algorithms for Unique Games and Related Problems Barriers II Workshop, Princeton, August 2010 David Steurer MSR New England Sanjeev Arora.
Rounding Sum of Squares Relaxations Boaz Barak – Microsoft Research Joint work with Jonathan Kelner (MIT) and David Steurer (Cornell) workshop on semidefinite.
Boaz Barak – Microsoft Research Partially based on joint work with Jonathan Kelner (MIT) and David Steurer (Cornell) Sum of Squares Proofs and The Quest.
Introduction to PCP and Hardness of Approximation Dana Moshkovitz Princeton University and The Institute for Advanced Study 1.
Gillat Kol joint work with Ran Raz Locally Testable Codes Analogues to the Unique Games Conjecture Do Not Exist.
Inapproximability from different hardness assumptions Prahladh Harsha TIFR 2011 School on Approximability.
New Variants of the Quantum de Finetti Theorem with Applications Fernando G.S.L. Brandão ETH Zürich Based on joint work with Aram Harrow Arxiv:
Dictator tests and Hardness of approximating Max-Cut-Gain Ryan O’Donnell Carnegie Mellon (includes joint work with Subhash Khot of Georgia Tech)
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
Venkatesan Guruswami (CMU) Yuan Zhou (CMU). Satisfiable CSPs Theorem [Schaefer'78] Only three nontrivial Boolean CSPs for which satisfiability is poly-time.
Semidefinite Programming
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
Ryan O'Donnell (CMU, IAS) Yi Wu (CMU, IBM) Yuan Zhou (CMU)
Computational Complexity, Physical Mapping III + Perl CIS 667 March 4, 2004.
Integer Programming Difference from linear programming –Variables x i must take on integral values, not real values Lots of interesting problems can be.
On the hardness of approximating Sparsest-Cut and Multicut Shuchi Chawla, Robert Krauthgamer, Ravi Kumar, Yuval Rabani, D. Sivakumar.
(work appeared in SODA 10’) Yuk Hei Chan (Tom)
Finding Almost-Perfect
Pablo A. Parrilo ETH Zürich Semialgebraic Relaxations and Semidefinite Programs Pablo A. Parrilo ETH Zürich control.ee.ethz.ch/~parrilo.
Dana Moshkovitz, MIT Joint work with Subhash Khot, NYU.
Integrality Gaps for Sparsest Cut and Minimum Linear Arrangement Problems Nikhil R. Devanur Subhash A. Khot Rishi Saket Nisheeth K. Vishnoi.
Diophantine Approximation and Basis Reduction
Bypassing the Unique Games Conjecture for two geometric problems Yi Wu IBM Almaden Research Based on joint work with Venkatesan Guruswami Prasad Raghavendra.
Products of Functions, Graphs, Games & Problems Irit Dinur Weizmann.
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
Monogamy of non- signalling correlations Aram Harrow (MIT) Simons Institute, 27 Feb 2014 based on joint work with Fernando Brandão (UCL) arXiv:
Curve-Fitting Regression
Yuan Zhou Carnegie Mellon University Joint works with Boaz Barak, Fernando G.S.L. Brandão, Aram W. Harrow, Jonathan Kelner, Ryan O'Donnell and David Steurer.
The Complexity of Quantum Entanglement Fernando G.S.L. Brandão ETH Zürich Based on joint work with M. Christandl and J. Yard Journees Deferation de Reserche.
NP-COMPLETE PROBLEMS. Admin  Two more assignments…  No office hours on tomorrow.
1/19 Minimizing weighted completion time with precedence constraints Nikhil Bansal (IBM) Subhash Khot (NYU)
Sarah R. Allen Ryan O’Donnell David Witmer Carnegie Mellon University.
Section 5.5 The Real Zeros of a Polynomial Function.
Subexponential Algorithms for Unique Games and Related Problems Approximation Algorithms, June 2011 David Steurer MSR New England Sanjeev Arora Princeton.
Shorter Long Codes and Applications to Unique Games 1 Boaz Barak (MSR, New England) Parikshit Gopalan (MSR, SVC) Johan Håstad (KTH) Prasad Raghavendra.
Unique Games Approximation Amit Weinstein Complexity Seminar, Fall 2006 Based on: “Near Optimal Algorithms for Unique Games" by M. Charikar, K. Makarychev,
Prasad Raghavendra Georgia Institute of Technology, Atlanta, GA Complexity of Constraint Satisfaction Problems Exact and Approximate TexPoint fonts used.
SDP hierarchies and quantum states Aram Harrow (MIT)Simons Institute
Yuan Zhou, Ryan O’Donnell Carnegie Mellon University.
Topics in Algorithms 2005 The Turnpike Problem Ramesh Hariharan.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Approximation Algorithms based on linear programming.
Yuan Zhou Carnegie Mellon University Joint works with Boaz Barak, Fernando G.S.L. Brandão, Aram W. Harrow, Jonathan Kelner, Ryan O'Donnell and David Steurer.
Fernando G.S.L. Brandão MSR -> Caltech Faculty Summit 2016
8.1 Determine whether the following statements are correct or not
Finding Almost-Perfect
Polynomial integrality gaps for
Quantum de Finetti theorems for local measurements
Sam Hopkins Cornell Tselil Schramm UC Berkeley Jonathan Shi Cornell
Polynomial Norms Amir Ali Ahmadi (Princeton University) Georgina Hall
Sum of Squares, Planted Clique, and Pseudo-Calibration
CSCI B609: “Foundations of Data Science”
Presentation transcript:

Boaz Barak (MSR New England) Fernando G.S.L. Brandão (Universidade Federal de Minas Gerais) Aram W. Harrow (University of Washington) Jonathan Kelner (MIT) David Steurer (MSR New England) Yuan Zhou (CMU)

Motivation Unique Games Conjecture (UGC) [Khot'02] –For every constant ε, the following problem is NP-Hard –UG(ε) : given a set of linear modulo equations in the form –Distinguish YES case: at least (1-ε) of the equations are satisfiable NO case: at most ε of the equations are satisfiable

Motivation (cont'd) Unique Games Conjecture [Khot'02] Implications of UGC –For large class of problems, BASIC-SDP (semidefinite programming relaxation) achieves optimal approximation Examples: Max-Cut, Vertex-Cover, any Max-CSP [KKMO '07, MOO '10, KV '03, Rag '08] Open question: Is UGC true?

Previous results Evidences in favor of UGC –(Certain) strong SDP relaxation hierarchies cannot solve UG in polynomial time [RS'09, KPS'10, BGHMRS'11] Evidences opposing UGC –Subexponential time algorithms solve UG [ABS '10]

Our results Evidences in favor of UGC –(Certain) strong SDP relaxation hierarchies cannot solve UG in polynomial time [RS'09, KPS'10, BGHMRS'11] Evidences opposing UGC –Subexponential time algorithms solve UG [ABS '10] 1.New evidence: a natural SDP hierarchy solves all previous "hard instances" for UG 2.New (indirect) evidence: natural generalization of UG still has ABS-type subexp-time algorithm cannot be solved in poly-time assuming ETH

More about our first result 1.New evidence: a natural SDP hierarchy solves all previous "hard instances" for UG

Semidefinite programming (SDP) relaxation hierarchies … ? rounds SDP relaxation in roughly time e.g. [SA'90,LS'91] UG(ε) For certain SDP relaxation hierarchies –Upper bound : rounds suffice [ABS'10,BRS'11,GS'11] –Lower bound : rounds needed [RS'09,BGHMRS'11]

Semidefinite programming (SDP) relaxation hierarchies … ? UG(ε) Theorem. –Sum-of-Squares (SoS) hierarchy (a.k.a. Lasserre hierarchy [Par'00, Las'01]) solves all known UG instances within 8 rounds (cont'd) rounds SDP relaxation in roughly time e.g. [SA'90,LS'91]

Proof overview Integrality gap instance –SDP completeness: a good vector solution –Integral soundness: no good integral solution A common method to construct gaps (e.g. [RS'09]) –Use the instance derived from a hardness reduction –Lift the completeness proof to vector world –Use the soundness proof directly

Proof overview (cont'd) Our goal: to prove there is no good vector solution –Rounding algorithms? Instead, –we bound the value of the dual of the SDP –interpret the dual of the SDP as a proof system –lift the soundness proof to the proof system

Sum-of-Squares proof system AxiomsGoal derive Rules – – – – all intermediate polynomials have bounded degree d ("level-d" SoS proof system) "Positivstellensatz" [Stengle'74]

Example SoS proof: AxiomsGoal derive Axiom squared term Formulate UG as a polynomial optimization problem, and re-write the existing soundness proof in a SoS fashion (as above) !

Components of the soundness proof "Easy" parts –Cauchy-Schwarz/Hölder's inequality –Influence decoding "Hard" parts –Hypercontractivity inequality –Invariance Principle (of known UG instances)

SoS proof of hypercontractivity The 2->4 hypercontractivity inequality: for low degree polynomial we have The goal of an SoS proof is to show is sum of squares Prove by induction (very similar to the well- known inductive proof of the inequality itself)...

Components of the soundness proof "Easy" parts –Cauchy-Schwarz/Hölder's inequality –Influence decoding –Independent rounding "Hard" parts –Hypercontractivity inequality –Invariance Principle trickier "bump function" is used in the original proof --- not a polynomial! but... a polynomial substitution is enough for UG (of known UG instances)

(A little) more about our second result 2.New (indirect) evidence: natural generalization of UG still has ABS-type subexp-time algorithm cannot be solved in poly-time assuming ETH

Hypercontractive Norm Problem For any matrix A, q > 2 (even number), define Problem: to approximate A natural generalization of the Small Set Expansion (SSE) problem, which is closely related to UG [RS '09] Theorem. Constant approximation for 2->q norm is as hard as SSE

Hypercontractive Norm Problem (cont'd) Theorem. 2->q norm can be "well approximated" in time exp(n^(2/q)). Moreover, the algorithm can be used to recover the subexp time algorithm for SSE. –Proof idea: subspace enumeration Theorem. Assuming the Exponential Time Hypothesis (i.e. 3-SAT does not have subexp time algorithm), there is no poly-time constant approximation algorithm for 2->q norm. –Proof idea: through quantum information theory [BCY '10]

Summary SoS hierarchy refutes all known UG instances –certain types of soundness proof does not work for showing a gap of SoS hierarchy New connection between hypercontractivity, small set expansion and... quantum separability

Open problems Show SoS hierarchy refutes Max-Cut instances? More study on 2->q norms... –New UG hard instances from hardness of 2->q norms? –Stronger 2->q hardness results (NP- Hardness)? –dequantumize the current 2->q hardness proof?

Thank you!