Vol.1: Geometry Subhash Khot IAS Elchanan Mossel UC Berkeley Guy Kindler DIMACS Ryan O’Donnell IAS.

Slides:



Advertisements
Similar presentations
Guy Kindler Weizmann Institute. Well try to understand some notions, and their relations: Combinatorial optimization problems Combinatorial optimization.
Advertisements

Uri Feige Microsoft Understanding Parallel Repetition Requires Understanding Foams Guy Kindler Weizmann Ryan ODonnell CMU.
Subhash Khot IAS Elchanan Mossel UC Berkeley Guy Kindler DIMACS Ryan O’Donnell IAS.
Inapproximability of MAX-CUT Khot,Kindler,Mossel and O ’ Donnell Moshe Ben Nehemia June 05.
Dana Moshkovitz MIT Joint work with Subhash Khot, NYU 1.
The Max-Cut problem: Election recounts? Majority vs. Electoral College? 7812.
On the Unique Games Conjecture Subhash Khot Georgia Inst. Of Technology. At FOCS 2005.
Approximation Algorithms Chapter 14: Rounding Applied to Set Cover.
Approximating NP-hard Problems Efficient Algorithms and their Limits Prasad Raghavendra University of Washington Seattle.
Ryan O’Donnell Carnegie Mellon University analysisofbooleanfunctions.org.
Gillat Kol joint work with Irit Dinur Covering CSPs.
MaxClique Inapproximability Seminar on HARDNESS OF APPROXIMATION PROBLEMS by Dr. Irit Dinur Presented by Rica Gonen.
Prasad Raghavendra University of Washington Seattle Optimal Algorithms and Inapproximability Results for Every CSP?
Approximating Maximum Subgraphs Without Short Cycles Guy Kortsarz Join work with Michael Langberg and Zeev Nutov.
Parallel Repetition From Fortification Dana Moshkovitz MIT.
Constraint Satisfaction over a Non-Boolean Domain Approximation Algorithms and Unique Games Hardness Venkatesan Guruswami Prasad Raghavendra University.
3-Query Dictator Testing Ryan O’Donnell Carnegie Mellon University joint work with Yi Wu TexPoint fonts used in EMF. Read the TexPoint manual before you.
Subhash Khot Georgia Tech Ryan O’Donnell Carnegie Mellon SDP Gaps and UGC-Hardness for Max-Cut-Gain &
Metric embeddings, graph expansion, and high-dimensional convex geometry James R. Lee Institute for Advanced Study.
Probabilistically Checkable Proofs (and inapproximability) Irit Dinur, Weizmann open day, May 1 st 2009.
Semi-Definite Algorithm for Max-CUT Ran Berenfeld May 10,2005.
The Probabilistic Method Shmuel Wimer Engineering Faculty Bar-Ilan University.
Introduction to PCP and Hardness of Approximation Dana Moshkovitz Princeton University and The Institute for Advanced Study 1.
A 3-Query PCP over integers a.k.a Solving Sparse Linear Systems Prasad Raghavendra Venkatesan Guruswami.
1/17 Optimal Long Test with One Free Bit Nikhil Bansal (IBM) Subhash Khot (NYU)
Inapproximability from different hardness assumptions Prahladh Harsha TIFR 2011 School on Approximability.
Dictator tests and Hardness of approximating Max-Cut-Gain Ryan O’Donnell Carnegie Mellon (includes joint work with Subhash Khot of Georgia Tech)
The number of edge-disjoint transitive triples in a tournament.
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
Venkatesan Guruswami (CMU) Yuan Zhou (CMU). Satisfiable CSPs Theorem [Schaefer'78] Only three nontrivial Boolean CSPs for which satisfiability is poly-time.
Semidefinite Programming
On the Unique Games Conjecture Subhash Khot NYU Courant CCC, June 10, 2010.
Computer Assisted Proof of Optimal Approximability Results Uri Zwick Uri Zwick Tel Aviv University SODA’02, January 6-8, San Francisco.
Analysis of Boolean Functions Fourier Analysis, Projections, Influence, Junta, Etc… Slides prepared with help of Ricky Rosen.
Ryan O'Donnell (CMU, IAS) Yi Wu (CMU, IBM) Yuan Zhou (CMU)
Semidefinite Programming Based Approximation Algorithms Uri Zwick Uri Zwick Tel Aviv University UKCRC’02, Warwick University, May 3, 2002.
Fourier Analysis of Boolean Functions Juntas, Projections, Influences Etc.
On the hardness of approximating Sparsest-Cut and Multicut Shuchi Chawla, Robert Krauthgamer, Ravi Kumar, Yuval Rabani, D. Sivakumar.
E3-LIN-2 is hard to approximate Hastad Speaker : Guy Kindler.
Ryan ’Donnell Carnegie Mellon University O. Ryan ’Donnell Carnegie Mellon University.
Dana Moshkovitz, MIT Joint work with Subhash Khot, NYU.
Integrality Gaps for Sparsest Cut and Minimum Linear Arrangement Problems Nikhil R. Devanur Subhash A. Khot Rishi Saket Nisheeth K. Vishnoi.
Arora: SDP + Approx Survey Semidefinite Programming and Approximation Algorithms for NP-hard Problems: A Survey Sanjeev Arora Princeton University.
Subhash Khot’s work and its impact Sanjeev Arora Computer Science Dept, Princeton University ICM 2014 Nevanlinna Prize Laudatio.
1 Graphs with tiny vector chromatic numbers and huge chromatic numbers Michael Langberg Weizmann Institute of Science Joint work with U. Feige and G. Schechtman.
Ryan O’Donnell Carnegie Mellon University. Part 1: A. Fourier expansion basics B. Concepts: Bias, Influences, Noise Sensitivity C. Kalai’s proof of Arrow’s.
Ryan ’Donnell Carnegie Mellon University O. f : {−1, 1} n → {−1, 1} is “quasirandom” iff fixing O(1) input coords changes E[f(x)] by only o (1)
Primer on Fourier Analysis Dana Moshkovitz Princeton University and The Institute for Advanced Study.
Semidefinite Programming
C&O 355 Mathematical Programming Fall 2010 Lecture 16 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
1/19 Minimizing weighted completion time with precedence constraints Nikhil Bansal (IBM) Subhash Khot (NYU)
CS 3343: Analysis of Algorithms Lecture 25: P and NP Some slides courtesy of Carola Wenk.
Shorter Long Codes and Applications to Unique Games 1 Boaz Barak (MSR, New England) Parikshit Gopalan (MSR, SVC) Johan Håstad (KTH) Prasad Raghavendra.
C&O 355 Lecture 24 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A.
Unique Games Approximation Amit Weinstein Complexity Seminar, Fall 2006 Based on: “Near Optimal Algorithms for Unique Games" by M. Charikar, K. Makarychev,
Yuan Zhou, Ryan O’Donnell Carnegie Mellon University.
1 2 Introduction In this lecture we’ll cover: Definition of PCP Prove some classical hardness of approximation results Review some recent ones.
Why almost all satisfiable k - CNF formulas are easy? Danny Vilenchik Joint work with A. Coja-Oghlan and M. Krivelevich.
Yuan Zhou Carnegie Mellon University Joint works with Boaz Barak, Fernando G.S.L. Brandão, Aram W. Harrow, Jonathan Kelner, Ryan O'Donnell and David Steurer.
Non Linear Invariance Principles with Applications Elchanan Mossel U.C. Berkeley
Finding Almost-Perfect
Reconstruction on trees and Phylogeny 1
Sum of Squares, Planted Clique, and Pseudo-Calibration
Possibilities and Limitations in Computation
Noise stability of functions with low influences:
Subhash Khot Dept of Computer Science NYU-Courant & Georgia Tech
Linear sketching with parities
Linear sketching with parities
Small Set Expansion in The Johnson Graph
Presentation transcript:

Vol.1: Geometry Subhash Khot IAS Elchanan Mossel UC Berkeley Guy Kindler DIMACS Ryan O’Donnell IAS

It is impossible to improve the MAX-CUT approximation of Goemans and Williamson. It is impossible to improve the MAX-CUT approximation of Goemans and Williamson. (assuming two unproven conjectures…): 1.The Unique Games conjecture [Khot02] 2.The “Majority is Stablest” conjecture. We show:

Conjectures? What? Usual modus operandi in Mathematics: Prove theorem, give talk. Non-usual modus operandi in Mathematics: Fail to prove two theorems, give talk.

What is MAX-CUT? G = (V,E) C = (S,S), partition of V w(C) = |(SxS)  E| w : E ―> R + weighted  unweighted

What is MAX-CUT? OPT = OPT(G) = max c {|C|} MAX-CUT problem: find C with w(C)= OPT  -approximation: find C with w(C) ≥  ·OPT

HistoryHistory [Karp ’72] MAX-CUT is NP-complete. [Shani-Gonzalez ’76] ½-approximation (partition vertices randomly) [’76-’94] no progress… (½+o(1) approx.) [Goemans-Williamson ’94]  GW -approximation,  GW = min ≈.878 (arccos ρ) / π ½ - ½ ρ -1 < ρ < 1 ½ 1 10 ρ −1 −.69 = : ρ* 87.8%

HistoryHistory [Goemans-Williamson ’94]  GW -approximation,  GW = min ≈.878 (arccos ρ) / π ½ - ½ ρ -1 < ρ < 1 G = (V,E) ―> geometric problem ―> geometric problem ―> random cut ―> random cut Intrinsic? Coincidence?

HistoryHistory [Bellare-Goldreich-Sudan ’92] more than 83/84 is NP-hard [Håstad ’97] 16/17  is NP-hard [  GW = > easy > hard ] other results: [Karloff ’99, Feige-Schechtman ’99] GW does not perform any better than  GW. [Alon Sudakov ’98] Same holds even for the discrete cube

the conjectures Unique Games conjecture:  MAX-2LIN(q) is hard. Input: two-variable linear equations mod q=10 ⁶. You know that 99% can be satisfied. Goal: satisfy 1%. status: MAX-2LIN(2) is hard for some parameters… Majority is Stablest conjecture: among balanced f:{1,-1} n  {1,-1}, where each coordinate has “small influence,” the Majority function is least sensitive to noise. status: everybody knows it’s true!

“Beating Goemans-Williamson “Beating Goemans-Williamson – i.e., approximating MAX-CUT to a factor.879 – is formally harder* than the problem of is formally harder* than the problem of satisfying 1% of a given set of 99%-satisfiable two-variable linear equations mod 10 ⁶.” So, Uri Zwick et al, please work on this problem, rather than this problem. How we want you to interpret our result

oProvides insight to Unique Games conjecture. oFourier methods and related results independently interesting. oMotivates algorithmic progress on MAX-2SAT, MAX- 2LIN(q) More motivation for result

What’s next in this talk o“Maj is Stablest”  long-code test with soundness/completeness=  GW, and the relation to the geometry in GW algorithm. and if times permits: and if times permits: oHardness for MAX-CUT, from Unique Games conjecture + long-code test oDiscussion of “Maj is Stablest” and partial results. oDiscussion of Unique Games conjecture.

The long-code Encodes elements in {1,2,..,q} The encoding of 2  {1,2,3}: ….. In general, i  {1,..,q} is encoded by f:{1,-1} q  {-1,1}, defined by f(x)=x i

the GW algorithm v G=(V,E): xuxu xuxu u xvxv xvxv (unit sphere in R n )

the GW algorithm v G=(V,E): xuxu xuxu u In S 0, this is Max-Cut! xvxv xvxv

the GW algorithm v xvxv xvxv G=(V,E): xuxu xuxu u

GW algorithm: performance x v  S n-1 xuxu xuxu xvxv xvxv xuxu xuxu xuxu xvxv arccos( ) donation to (*) Pr[(x u,x v ) is cut]= arccos( )/  arccos( )/ 

GW algorithm: performance Pr[(x u,x v ) is cut]= arccos( )/  arccos( )/  xuxu xvxv arccos( ) donation to (*) Actually this is tight.. Tight, if all inner products are ρ*

Important example: G ρ V = S n-1 E = {(x,y) :  ρ} [FS] a hyperplane cut is optimal for G ρ size of cut: (arccos ρ)/π ρ - negative

More important example: D ρ V = {-1,1} n  S n-1 a random edge (x,y): x~{-1,1} n, w(x,y) = P[(x,y) is chosen] w(x,y) = P[(x,y) is chosen] E[ ] = ρ higher probability tightly concentrated well, actually {-n -½,n ½ } n y: y i = x i w.p. ½ + ½ρ -x i w.p. ½ - ½ρ

OPT(D ρ ) = OPT(G ρ ) = (arccos ρ)/π? no… For f(x) = x 7, w( f -1 (1),f -1 (-1) ) = P[x 7 ≠ y 7 ] = ½ - ½ ρ = ½ - ½ ρ For f(x) = sign(  x i ) = Maj(x), w( f -1 (1),f(-1) )=P[Maj(x)≠Maj(y)] ≈ (arccos ρ)/π ≈ (arccos ρ)/π Are D ρ and G ρ similar? Dictatorship not at all a dictatorship

Do D ρ and G ρ act the same?  non dictatorship: f : {-1,1} n ―> {-1,1} s.t. for all n dictatorships, “correlation” with f is at most  for all n dictatorships, “correlation” with f is at most  conjecture: If f is  non dictatorship, w( (f -1 (1),f -1 (-1) )  (arccos ρ)/π +o  (1) +o  (1)

A dictatorship test the test: f : {-1,1} n ―> {-1,1}, pick x,y as before, pick x,y as before, verify that f(x)≠f(y). verify that f(x)≠f(y). dictatorships: pass w.p. ½ - ½ρ non-dictatorships: pass w.p. conjecture: If f is  non dictatorship, w( (f -1 (1),f(-1) )  (arccos ρ)/π +o  (1) +o  (1)

A dictatorship test the test: f : {-1,1} n ―> {-1,1}, pick x,y as before, pick x,y as before, verify that f(x)≠f(y). verify that f(x)≠f(y). dictatorships: pass w.p. ½ - ½ρ non-dictatorships: pass w.p.  (arccos ρ)/π  (arccos ρ)/π. long-code words a long-code test completeness soundness gap: soundnesscompleteness (arccos ρ)/π ½ - ½ρ ≈.878 (for ρ = ρ*) =

Guy Kindler DIMACS Ryan O’Donnell IAS Guy Kindler DIMACS Ryan O’Donnell IAS Subhash Khot IAS Elchanan Mossel UC Berkeley Subhash Khot IAS Elchanan Mossel UC Berkeley Vol.2: Main results

Unique Games Conjecture “Unique Label Cover” with q colors: n Labels [q] π uv π uv : Bijections Input π uv

Unique Games Conjecture “Unique Label Cover” with q colors: n Labels [q] π uv π uv : Bijections Assignment π uv

Unique Games Conjecture n Labels [q] π uv π uv : Bijections π uv Conjecture: satisfying  fraction of edges is hard, even if 1-  of them can be satisfied. Assignment

Unique Games Conjecture Conjecture: satisfying  fraction of edges is hard, even if 1-  of them can be satisfied. oUGC is stronger than AS+ALMSS+Raz altogether. oUGC is stronger than AS+ALMSS+Raz altogether. UGC implies oMIN-2SAT-Deletion hard to approximate to within any constant factor [Hastad, Khot ’02] oVertex-Cover hard to approximate to within any factor smaller than 2 [Khot-Regev ’03] oThese results need long-code tests, relying on theorems in Fourier analysis. [Bourgain ’02; Friedgut ’98]

Main theorem – proof overview π uv Assignment --> Cut fufu fvfv Max-Cut Test: Verify f v (x)≠f u (y)

Main theorem – proof overview π uv Assignment --> Cut fufu fvfv Max-Cut Test: Verify f v (x)≠f u (y) Max-Cut Test: Verify f v (x)≠f u ( π uv ( y)) x π uv (y) Completeness:  at least (1-  )(1-ρ)/2 Soundness:  at most (1-  `)(arccos ρ)/ 

More results thm: “Majority is Stablest” holds for threshold functions. thm: among balanced functions where each coordinate has small influence, Majority has the most weight on level 1. corr: Assuming UGC alone, MAX-CUT is hard to approx. to within.909 < 16/17 =.941 thm: Assuming UGC, MAX-2LIN(q) is hard to approx. to within any constant factor.

QuestionsQuestions Prove Majority Is Stablest Conjecture. What balanced q-ary function f : [q]ⁿ  [q] is stablest? Plurality? Thm [us]: Noise stability of Plurality is q (ρ-1)/(ρ+1) + o(1). If q-ary stability is o q (1), then UGC implies hardness of (hence, essentially, equivalence with) MAX-2LIN(q). A sharp bound for the q-ary stability problem would give strong results for the UGC w.r.t. how big q needs to be as a function of ε.