Subhash Khot’s work and its impact Sanjeev Arora Computer Science Dept, Princeton University ICM 2014 Nevanlinna Prize Laudatio.

Slides:



Advertisements
Similar presentations
Uri Feige Microsoft Understanding Parallel Repetition Requires Understanding Foams Guy Kindler Weizmann Ryan ODonnell CMU.
Advertisements

The Unique Games Conjecture and Graph Expansion School on Approximability, Bangalore, January 2011 Joint work with S Prasad Raghavendra Georgia Institute.
Subhash Khot IAS Elchanan Mossel UC Berkeley Guy Kindler DIMACS Ryan O’Donnell IAS.
Subexponential Algorithms for Unique Games and Related Problems School on Approximability, Bangalore, January 2011 David Steurer MSR New England Sanjeev.
Hardness of Approximating Multicut S. Chawla, R. Krauthgamer, R. Kumar, Y. Rabani, D. Sivakumar (2005) Presented by Adin Rosenberg.
Inapproximability of MAX-CUT Khot,Kindler,Mossel and O ’ Donnell Moshe Ben Nehemia June 05.
The Max-Cut problem: Election recounts? Majority vs. Electoral College? 7812.
On the Unique Games Conjecture Subhash Khot Georgia Inst. Of Technology. At FOCS 2005.
Approximating NP-hard Problems Efficient Algorithms and their Limits Prasad Raghavendra University of Washington Seattle.
Prasad Raghavendra University of Washington Seattle Optimal Algorithms and Inapproximability Results for Every CSP?
Recent Progress in Approximability. Administrivia Most agreeable times: Monday 2:30-4:00 Wednesday 4:00-5:30 Thursday 4:00-5:30 Friday 1:00-2:30 Please.
Constraint Satisfaction over a Non-Boolean Domain Approximation Algorithms and Unique Games Hardness Venkatesan Guruswami Prasad Raghavendra University.
Metric embeddings, graph expansion, and high-dimensional convex geometry James R. Lee Institute for Advanced Study.
Geometric embeddings and graph expansion James R. Lee Institute for Advanced Study (Princeton) University of Washington (Seattle)
Subexponential Algorithms for Unique Games and Related Problems Barriers II Workshop, Princeton, August 2010 David Steurer MSR New England Sanjeev Arora.
Probabilistically Checkable Proofs (and inapproximability) Irit Dinur, Weizmann open day, May 1 st 2009.
Introduction to PCP and Hardness of Approximation Dana Moshkovitz Princeton University and The Institute for Advanced Study 1.
A 3-Query PCP over integers a.k.a Solving Sparse Linear Systems Prasad Raghavendra Venkatesan Guruswami.
1/17 Optimal Long Test with One Free Bit Nikhil Bansal (IBM) Subhash Khot (NYU)
Inapproximability from different hardness assumptions Prahladh Harsha TIFR 2011 School on Approximability.
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
Venkatesan Guruswami (CMU) Yuan Zhou (CMU). Satisfiable CSPs Theorem [Schaefer'78] Only three nontrivial Boolean CSPs for which satisfiability is poly-time.
Sparsest Cut S S  G) = min |E(S, S)| |S| S µ V G = (V, E) c- balanced separator  G) = min |E(S, S)| |S| S µ V c |S| ¸ c ¢ |V| Both NP-hard.
Semidefinite Programming
On the Unique Games Conjecture Subhash Khot NYU Courant CCC, June 10, 2010.
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
Vol.1: Geometry Subhash Khot IAS Elchanan Mossel UC Berkeley Guy Kindler DIMACS Ryan O’Donnell IAS.
Generic Rounding Schemes for SDP Relaxations
NP-Complete Problems Reading Material: Chapter 10 Sections 1, 2, 3, and 4 only.
The Theory of NP-Completeness
SDP Based Approach for Graph Partitioning and Embedding Negative Type Metrics into L 1 Subhash Khot (Georgia Tech) Nisheeth K. Vishnoi (IBM Research and.
Spectral clustering between friends. spectral clustering (a la Ng-Jordan-Weiss) datasimilarity graph edges have weights w ( i, j ) e.g.
Finding Almost-Perfect
Dana Moshkovitz, MIT Joint work with Subhash Khot, NYU.
Volume distortion for subsets of R n James R. Lee Institute for Advanced Study & University of Washington Symposium on Computational Geometry, 2006; Sedona,
Integrality Gaps for Sparsest Cut and Minimum Linear Arrangement Problems Nikhil R. Devanur Subhash A. Khot Rishi Saket Nisheeth K. Vishnoi.
Arora: SDP + Approx Survey Semidefinite Programming and Approximation Algorithms for NP-hard Problems: A Survey Sanjeev Arora Princeton University.
Approximations for Isoperimetric and Spectral Profile and Related Parameters Prasad Raghavendra MSR New England S David Steurer Princeton University Prasad.
A Counterexample to Strong Parallel Repetition Ran Raz Weizmann Institute.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
Approximation Algorithms
Yuan Zhou Carnegie Mellon University Joint works with Boaz Barak, Fernando G.S.L. Brandão, Aram W. Harrow, Jonathan Kelner, Ryan O'Donnell and David Steurer.
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
C&O 355 Mathematical Programming Fall 2010 Lecture 16 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
NP-COMPLETE PROBLEMS. Admin  Two more assignments…  No office hours on tomorrow.
1/19 Minimizing weighted completion time with precedence constraints Nikhil Bansal (IBM) Subhash Khot (NYU)
Lecture 6 NP Class. P = ? NP = ? PSPACE They are central problems in computational complexity.
CS 3343: Analysis of Algorithms Lecture 25: P and NP Some slides courtesy of Carola Wenk.
CSE 589 Part V One of the symptoms of an approaching nervous breakdown is the belief that one’s work is terribly important. Bertrand Russell.
Subexponential Algorithms for Unique Games and Related Problems Approximation Algorithms, June 2011 David Steurer MSR New England Sanjeev Arora Princeton.
Shorter Long Codes and Applications to Unique Games 1 Boaz Barak (MSR, New England) Parikshit Gopalan (MSR, SVC) Johan Håstad (KTH) Prasad Raghavendra.
C&O 355 Lecture 24 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A.
Unique Games Approximation Amit Weinstein Complexity Seminar, Fall 2006 Based on: “Near Optimal Algorithms for Unique Games" by M. Charikar, K. Makarychev,
Prasad Raghavendra Georgia Institute of Technology, Atlanta, GA Complexity of Constraint Satisfaction Problems Exact and Approximate TexPoint fonts used.
Yuan Zhou, Ryan O’Donnell Carnegie Mellon University.
NPC.
CSC 413/513: Intro to Algorithms
Boaz Barak (MSR New England) Fernando G.S.L. Brandão (Universidade Federal de Minas Gerais) Aram W. Harrow (University of Washington) Jonathan Kelner (MIT)
Yuan Zhou Carnegie Mellon University Joint works with Boaz Barak, Fernando G.S.L. Brandão, Aram W. Harrow, Jonathan Kelner, Ryan O'Donnell and David Steurer.
Approximation algorithms
Lecture 2-2 NP Class.
Generalized Sparsest Cut and Embeddings of Negative-Type Metrics
Dana Moshkovitz The Institute For Advanced Study
Possibilities and Limitations in Computation
Noise stability of functions with low influences:
Structural Properties of Low Threshold Rank Graphs
Subhash Khot Dept of Computer Science NYU-Courant & Georgia Tech
Introduction to PCP and Hardness of Approximation
Embedding Metrics into Geometric Spaces
Presentation transcript:

Subhash Khot’s work and its impact Sanjeev Arora Computer Science Dept, Princeton University ICM 2014 Nevanlinna Prize Laudatio

Main points from Nevanlinna Prize Citation… Defined “unique games” problem between P and NP-complete and conjectured it is hard. Showed how this leads to precise characterization of approximation ratios achievable for various NP-complete problems. Unconditional new results in isoperimetry, analysis of boolean functions, distortions of metric space embeddings,… New connections to Math.

Computational complexity Goal: Characterize computation time needed to solve a problem Ideally, should (a) design algorithm running in time T. (b) show no other algorithm running in << T time solves the problem Very little progress on (b), so we try to prove (b) modulo famous conjectures.

Example: P vs NP P P NP solution can be found in polynomial time i.e. n c (n = “input size”) a good solution can be checked in n c time. NP-complete: Every NP problem reducible to instance of this problem in n c time. (e.g Traveling Salesman,MAX-CUT, Satisfiability, Integer Programming, 1000s of others) P =? NP “Can brilliance/creativity be automated?” P ≠ NP  NP-complete problems cannot be solved in n c time. (Limits on math/science/social science theories)

An NP-complete problem: MAX-CUT Goal: Partition vertices into two sets to maximize number of “cut” edges Decision version: Given (G, K), does G have a cut with at least K edges? Qs: What is complexity of finding approximately optimal solutions?? (For this and thousands of other problems) Of great practical & mathematical interest (“Approximate characterizations”).

Approximability seems problem-dependent Traveling salesman: Can find tour of cost ≤ 1.5 OPT. [Christofides’76] Vertex Cover: Can find cover of size ≤ 2 OPT [folklore] Hundreds other such “approximation algorithms.” (Tremendous effort in last 25 years.) Are there limits to how well we can approximate?? (Great progress in last 25 years ---modulo conjectures) Approximation ratio is 1.5

Example: Approximability of MAXCUT MAXCUT: Partition vertices into two sets to maximize number of “cut” edges [Goemans,Williamson93] : Can find cut s.t. # cut edges > MAX-CUT(G) [Hastad97] Achieving approx. ratio 0.95 implies P =NP. “ Hastad’s PCP Theorem”. [Khot, Kindler, Mossel, O’Donnell’04, Mossel, O’Donnell, Oleskiewicz’05] Achieving approx. ratio  implies unique games conjecture (UGC) of [Khot02] is false. “Threshold result” “Inapproximability result”

Story in a nutshell Interesting approximation algorithms for many NP-complete problems Vast literature on inapproximability results (“PCP Theorems”; goes back to early 1990s). Work of Khot + others (post-2002)  For significant group of problems,“threshold of approximability” determined (assuming Unique Games Conjecture)

Unique Game Problem E2LIN mod p Given a set of linear equations of the form: X i – X j = c ij mod p Find solution that satisfies the maximum number of equations. x-y = 11 (mod 17) x-z = 13 (mod 17) … …. z-w = 15(mod 17) Unique Games Conjecture (KKMO’04 version): Given instance in which 0.99 fraction of equations are satisfiable, it is NP-hard to satisfy more than 0.01 fraction.

UGC  standard approximation algorithms (SDP or LP based) optimal for…. UGC Constraint Satisfaction Problems [Raghavendra`08] M AX C UT, M AX 2S AT Grothendieck Problems [KNS`08, RS`09] Metric Labeling Problems [MNRS`08] M ULTIWAY C UT, 0- EXTENSION Strictly Monotone CSPs [KMTV`10] V ERTEX C OVER, H YPERGRAPH V ERTEX C OVER … Kernel Clustering Problems [Khot Naor`08,10] Vertex cover [Khot-Regev’03] In many cases, failure of the standard algorithm (on a single instance) can be converted into an inapproximability result!! Told ya

Efforts to apply/prove/disprove UGC have also yielded a treasure trove of new (unconditional) results in: Analysis of Boolean Functions, Harmonic Analysis Isoperimetry, Invariance principles etc. High dimensional geometry Embeddability of metric spaces into each other…

Analysis of boolean functions (and why it is relevant) [Kahn-Kalai-Linial’88, Hastad’98,Khot-Kindler-Mossel-O’Donnell’04] N voters; i’th one votes x i ε 0/1 Voting scheme: f : {0,1} N  {0,1} Collective decision = f(x 1, x 2,.. x N ) Noise stability  : Probability this decision doesn’t change if random subset of  fraction of voters flip their votes For Dictatorship (ie f(x 1, x 2,.. x N ) = x i ): this is 1- . What is stablest function that is “not close” to dictatorship? Answer: Majority! ( [Mossel, O’Donnell, Oleskiewicz’05] : invariance principles; isoperimetry)

(  -approx to MAX-CUT  poly-time algorithm for UG [KKMO’04] Convert UG instance into a graph. If the constraint is, say, x-y =11 (mod 17) 17 Dimension hypercube 17 Dimension hypercube Connect point p of x with q of y iff p, q make the angle  GW. (Coordinate i of x identifies with coordinate (i+ 11)mod 17 of y.) “Majority is stablest” + Harmonic analysis  approximately optimum cuts in the graph “decodable” to good solution for UG instance (Aside: corresponds to noise stability of majority) x-y = 11 (mod 17) x-z = 13 (mod 17) … …. z-w = 15(mod 17) 17-dimensional hypercube for each variable “Hard instance” for [GW93] algorithm for MAXCUT!

Low-distortion embeddings of metric spaces How similar are two metric spaces (X, d 1 ) and (Y, d 2 )? Important in analysis, also in algorithm design (e.g. if input is from X and our algorithm works for Y). Distortion of f: X  Y is smallest C s.t. d 1 (x 1, x 2 ) ≤ d 2 (f(x 1 ), f(x 2 )) ≤ C d 1 (x 1, x 2 ) [Bourgain’85] Every n-point metric space has an embedding into l 2 with distortion O(log n). (Many algorithmic applications after [Linial, London, Rabinovich’94]; big research area ) XY f

Goemans-Linial Conjecture “Every finite metric space of negative type embeds into l 1 with distortion O(1)” (“negative type”: Euclidean and d(x 1, x 2 ) 2 + d(x 2, x 3 ) 2 ≥ d(x 1, x 3 ) 2 ) If true, would yield O(1)-approximation for graph partitioning problems via semidefinite programming. (Also, would disprove UGC [Khot + others] ) [Khot-Vishnoi’05] False; Distortion ≥ log log n. (Improved to (log n)  by [Cheeger, Kleiner, Naor 09] ) (Main idea: Cleverly constructed negative type metric, motivated by insights from UG. Greatly generalized by [Khot-Naor’05] to apply to other metric embedding problems.)

Foams, parallel repetition, unique games What is smallest surface area of shape  in R d such  + Z d tiles R d ? (“Foam” problem; posed by Kelvin for d=3) Unit cube  2d is an upper bound. Unit sphere   (√d) is a lower bound. [Kindler, O’Donnell, Rao, Wigderson’12] Foam construction with area O(√d); also best construction for d =3. (“Spherical cubes”) Construction inspired by a counterexample of Raz to a well-studied approach for proving UGC. d=2

New analyses of Semidefinite programs; Higher-order spectral graph theory. SDP: subcase of convex programming. [Khot02] suggested it as a way to try to disprove UGC (i.e., give a good approximation to UG problem) [Arora, Khot, Kolla, Steurer, Tulsiani, Vishnoi’08 ]Used SDP to show that UG problem is easy when constraint graph is random or random-like (“expander”); SDP + eigenvalue methods (“high order spectral graph theory”) lead to subexponential algorithms for UG problem [Arora, Barak, Steurer’10], [Barak,Raghavendra, Steurer ‘11], [Guruswami- Sinop’11]. Many recent results about connection of higher eigenvalues to graph expansion…

Other contributions of Khot Inapproximability results that don’t rely on UGC (only on P ≠NP): Shortest Vector in Integer Lattice, Max-Clique, Hypergraph Vertex Cover and Coloring, Metric Labeling, Learning parities with noise,… Lowerbounds for approximation ratios achieved by SDP hierarchies… Best progress to date on proving UGC (NP-completeness for a similar problem over R). [Khot-Moshkovitz’11]

In conclusion… Khot’s 2002 definition of UG problem and UGC proved very prescient and subsequent work (including his significant contributions) led to an exciting decade of new discoveries in theoretical CS and math, with more to come. (Unanticipated by most experts, certainly by me.). Congratulations, Subhash!!