Parallel Repetition From Fortification Dana Moshkovitz MIT.

Slides:



Advertisements
Similar presentations
Uri Feige Microsoft Understanding Parallel Repetition Requires Understanding Foams Guy Kindler Weizmann Ryan ODonnell CMU.
Advertisements

Linear-Degree Extractors and the Inapproximability of Max Clique and Chromatic Number David Zuckerman University of Texas at Austin.
Parallel Repetition of Two Prover Games Ran Raz Weizmann Institute and IAS.
Russell Impagliazzo ( IAS & UCSD ) Ragesh Jaiswal ( Columbia U. ) Valentine Kabanets ( IAS & SFU ) Avi Wigderson ( IAS ) ( based on [IJKW08, IKW09] )
Direct Product : Decoding & Testing, with Applications Russell Impagliazzo (IAS & UCSD) Ragesh Jaiswal (Columbia) Valentine Kabanets (SFU) Avi Wigderson.
Direct-Product testing Parallel Repetitions And Foams Avi Wigderson IAS.
A Parallel Repetition Theorem for Any Interactive Argument Or On the Benefits of Cutting Your Argument Short Iftach Haitner Microsoft Research New England.
A threshold of ln(n) for approximating set cover By Uriel Feige Lecturer: Ariel Procaccia.
Approximate List- Decoding and Hardness Amplification Valentine Kabanets (SFU) joint work with Russell Impagliazzo and Ragesh Jaiswal (UCSD)
Inapproximability of MAX-CUT Khot,Kindler,Mossel and O ’ Donnell Moshe Ben Nehemia June 05.
Gillat Kol joint work with Ran Raz Locally Testable Codes Analogues to the Unique Games Conjecture Do Not Exist.
Complexity Theory Lecture 9 Lecturer: Moni Naor. Recap Last week: –Toda’s Theorem: PH  P #P. –Program checking and hardness on the average of the permanent.
AM With Multiple Merlins Scott Aaronson MIT Scott Aaronson (MIT) Dana Moshkovitz (MIT) Russell Impagliazzo (UCSD)
MaxClique Inapproximability Seminar on HARDNESS OF APPROXIMATION PROBLEMS by Dr. Irit Dinur Presented by Rica Gonen.
The Unique Games Conjecture with Entangled Provers is False Julia Kempe Tel Aviv University Oded Regev Tel Aviv University Ben Toner CWI, Amsterdam.
Constraint Satisfaction over a Non-Boolean Domain Approximation Algorithms and Unique Games Hardness Venkatesan Guruswami Prasad Raghavendra University.
Dana Moshkovitz. Back to NP L  NP iff members have short, efficiently checkable, certificates of membership. Is  satisfiable?  x 1 = truex 11 = true.
Two Query PCP with Subconstant Error Dana Moshkovitz Princeton University and The Institute for Advanced Study Ran Raz The Weizmann Institute 1.
Derandomized parallel repetition theorems for free games Ronen Shaltiel, University of Haifa.
Probabilistically Checkable Proofs (and inapproximability) Irit Dinur, Weizmann open day, May 1 st 2009.
Food verb transportation animal verb furniture Find!Find! Fill out letters on the right, to satisfy as much of the constraints on the left.
Probabilistically Checkable Proofs Madhu Sudan MIT CSAIL 09/23/20091Probabilistic Checking of Proofs TexPoint fonts used in EMF. Read the TexPoint manual.
Introduction to PCP and Hardness of Approximation Dana Moshkovitz Princeton University and The Institute for Advanced Study 1.
A 3-Query PCP over integers a.k.a Solving Sparse Linear Systems Prasad Raghavendra Venkatesan Guruswami.
1/17 Optimal Long Test with One Free Bit Nikhil Bansal (IBM) Subhash Khot (NYU)
Complexity ©D.Moshkovits 1 Hardness of Approximation.
Umans Complexity Theory Lectures Lecture 15: Approximation Algorithms and Probabilistically Checkable Proofs (PCPs)
Gillat Kol joint work with Ran Raz Locally Testable Codes Analogues to the Unique Games Conjecture Do Not Exist.
Inapproximability from different hardness assumptions Prahladh Harsha TIFR 2011 School on Approximability.
Two Query PCP with Sub-constant Error Dana Moshkovitz Princeton University Ran Raz Weizmann Institute 1.
Introductions for the “Weizmann Distinguished Lectures Day” by Oded Goldreich.
PCPs and Inapproximability Introduction. My T. Thai 2 Why Approximation Algorithms  Problems that we cannot find an optimal solution.
Thomas Holenstein Microsoft Research, SVC Dagstuhl
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
A Parallel Repetition Theorem for Any Interactive Argument Iftach Haitner Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual before.
1 Adapted from Oded Goldreich’s course lecture notes.
Semidefinite Programming
EXPANDER GRAPHS Properties & Applications. Things to cover ! Definitions Properties Combinatorial, Spectral properties Constructions “Explicit” constructions.
1 CSE 417: Algorithms and Computational Complexity Winter 2001 Lecture 23 Instructor: Paul Beame.
1 Tight Hardness Results for Some Approximation Problems [mostly Håstad] Adi Akavia Dana Moshkovitz S. Safra.
Zero Knowledge Proofs. Interactive proof An Interactive Proof System for a language L is a two-party game between a verifier and a prover that interact.
CS151 Complexity Theory Lecture 15 May 18, CS151 Lecture 152 Outline IP = PSPACE Arthur-Merlin games –classes MA, AM Optimization, Approximation,
Complexity 1 Hardness of Approximation. Complexity 2 Introduction Objectives: –To show several approximation problems are NP-hard Overview: –Reminder:
The Power of Randomness in Computation 呂及人中研院資訊所.
Lecture 20: April 12 Introduction to Randomized Algorithms and the Probabilistic Method.
Complexity ©D.Moshkovits 1 Hardness of Approximation.
1 Joint work with Shmuel Safra. 2 Motivation 3 Motivation.
Foundations of Cryptography Lecture 2 Lecturer: Moni Naor.
Dana Moshkovitz MIT.  Take-home message: Prove hardness results assuming The Projection Games Conjecture (PGC)! Theorem: If SAT requires exponential.
Dana Moshkovitz, MIT Joint work with Subhash Khot, NYU.
A Counterexample to Strong Parallel Repetition Ran Raz Weizmann Institute.
Correlation testing for affine invariant properties on Shachar Lovett Institute for Advanced Study Joint with Hamed Hatami (McGill)
HARDNESS OF APPROXIMATIONS. Gap Introducing Reduction For simplicity we assume that we are always reducing from SAT(or any other NP- hard problem). Let.
Products of Functions, Graphs, Games & Problems Irit Dinur Weizmann.
Sub-Constant Error Low Degree Test of Almost-Linear Size Dana Moshkovitz Weizmann Institute Ran Raz Weizmann Institute.
Why Extractors? … Extractors, and the closely related “Dispersers”, exhibit some of the most “random-like” properties of explicitly constructed combinatorial.
Direct-product testing, and a new 2-query PCP Russell Impagliazzo (IAS & UCSD) Valentine Kabanets (SFU) Avi Wigderson (IAS)
1 Approximate Algorithms (chap. 35) Motivation: –Many problems are NP-complete, so unlikely find efficient algorithms –Three ways to get around: If input.
15-853:Algorithms in the Real World
1/19 Minimizing weighted completion time with precedence constraints Nikhil Bansal (IBM) Subhash Khot (NYU)
Amplification and Derandomization Without Slowdown Dana Moshkovitz MIT Joint work with Ofer Grossman (MIT)
Unique Games Approximation Amit Weinstein Complexity Seminar, Fall 2006 Based on: “Near Optimal Algorithms for Unique Games" by M. Charikar, K. Makarychev,
1 Introduction to Quantum Information Processing CS 467 / CS 667 Phys 467 / Phys 767 C&O 481 / C&O 681 Richard Cleve DC 3524 Course.
Introduction to Randomized Algorithms and the Probabilistic Method
Approximate Algorithms (chap. 35)
Dana Moshkovitz The Institute For Advanced Study
Direct product testing
How to Delegate Computations: The Power of No-Signaling Proofs
Introduction to PCP and Hardness of Approximation
2-to-2 Games Theorem via Expansion in the Grassmann Graph
Presentation transcript:

Parallel Repetition From Fortification Dana Moshkovitz MIT

Coloring Two Prover Projection Game: Given graph G=(V,E), 1.Pick uniformly v  V and two edges {v,u},{v,u’}  E. 2.Each prover gets an edge. Answers: colors for endpoints. 3.Check that the two provers agree on the color of v. {v,u}{v,u’} v, uv, u’ val( G ) = max P(verifier accepts) NP-hardness: It is NP-hard, given a game, to distinguish between val( G )=1 and val( G )<1. PCP Theorem: It is NP-hard, given a game, to distinguish between val( G )=1 and val( G )< ?

Parallel Repetition: Sequential repetition with two provers?? Product game G k e 1,…,e k e 1 ’,…,e k ’ a 1,…,a k a 1 ’,…,a k ’ val( G k )  val( G ) k The Parallel Repetition Problem: val( G k ) ≤ val( G ) k ??

Raz:  2 is tight! Special cases analyzed Twenty Five Years of Parallel Repetition Research Problem posed by Fortnow, Rompel, Sipser Feige,Kilian: Engineer G so val( G k )  poly(1/k). Raz: If val( G )=1-  & players’ answers in , val( G k )  (1-  (  32 )) k/2log|  | Holenstein simplifies! If val( G )=1-  & players’ answers in , val( G k )  (1-  (  3 )) k/2log|  |. Rao: For projection games, if val( G )=1-  & players’ answers in , val( G k )  (1-  (  2 )) Ω(k). Impagliazzo,Kabanets,Wigderson: Feige-Kilian engineering of G yields val( G k )  exp(-Ω(  k)) Partial results Dinur,Steurer: For projection games, val( G k )  (2val( G )) k/2. Current result: Can engineer projection G so val( G k )  val( G ) k +  Raz-Rosen: If G projection game on expander & val( G )=1- , val( G k )  (1-  ) Ω(k).

Basics of Two Prover games [BGKW’88] Hardness of approximation is based on projection games (aka Label Cover). Val( G ) – determines the hardness factor. Size( G )=|R|- determines reduction blow-up. Alphabet size = |  | - also effects the blow-up. R = randomness strings. PickTest : R  X  X.  : R      {accept,reject}. A game G is defined by: X = set of questions.  = set of answers. there is a set Y, labels L for Y, a bipartite graph G=(X,Y,E), and functions {f e :  L}. PickTest picks a random y  Y and two random neighbors x,x’  X ;  (r,a,a’) accepts if f (x,y) (a)=f (x’,y) (a’).

Parallel Repetition Might Not Decrease Value Feige’s Non-Interactive Agreement Verifier picks random bits as x, x’. Each player should respond (player,bit). Verifier accepts if both answered same player and his input bit. 01 Wang,0 Wang,0 WangMang val(NIA) = ½. val(NIA 2 ) = ?

val(NIA 2 ) = val(NIA) = 1/2 x 1,x 2 Wang,x 1 Mang,x 1 Wang,x 2 ’ Mang,x 2 ’ WangMang x 1 ’,x 2 ’ Verifier accepts in first round with prob 1/2. Conditioned on acceptance in first round, x 1 =x 2 ’, i.e., probability 1 of acceptance in second round.

Parallel Repetition is Subt le val( G 2 )=P(x 1,x 1 ’ agree)  P(x 2,x 2 ’ agree|x 1,x 1 ’ agree) We focus on a sub-game of G w here x 1,x 1 ’ agree. Its value might be much higher than val( G ).

Compare to val(NIA k )  val(NIA) k/2 This Work: Engineer The Game so Parallel Repetition  Sequential Repetition  -Fortification: Simple, natural, transformation on projection games; maintains the value of the game, somewhat increases size and alphabet. Parallel repetition theorem: for  -fortified G,  ≤ poly(  )(#labels) -k  val( G k ) ≤ (val( G )+O(k  )) k No Round Left Behind® Combinatorial fortified G G repeat

Implication to PCP – Combinatorial PCP with Low Error Starting from [Dinur 05]: combinatorial projection PCP with arbitrarily arbitrarily small constant error. – Implies that for any  >0, it is NP-hard to approximate Max-SAT to within 7/8 +  [Håstad 97]. – In general: sufficient to determine approximation threshold for many optimization problems.

Fortification The verifier picks questions to provers x, x’ as before. Picks extra questions {x 1,…,x w }, x  {x 1,…,x w } and {x 1 ’,…,x w ’}, x’  {x 1 ’,…,x w ’}, where w=poly(1/  ). – Sets of questions picked using extractor on X. – E.g., random walk on a constant-degree expander on X. The provers answer all questions; the verifier only checks the answers to x, x’. x 1,…,x w x 1 ’,…,x w ’ a 1,…,a w a 1 ’,…,a w ’ - In Feige-Kilian’s “Confuse and Compare” w=2. - In parallel repetition independence between the k tests seems essential.

Dfn: Fraction  rectangular sub-games: questions of each prover restricted to fraction  subset. Dfn:  -fortified: value of all fraction  rectangular sub-games of G at most val( G )+ . Lem: The transformed game is  -fortified (from extractor property). Extractors: Not every projection game on extractor is fortified. Size: Fortification increases size before repeating, but (size  poly(1/  )) k less than size 2k. Alphabet: Provers give w times more answers where w=poly(1/  ). In repetition only k  log(1/  ) times more answers. Projection: Fortification preserves projection, but not necessarily uniqueness.

Squaring: For  -fortified G,  ≤  /(2 #colors )  val( G 2 ) ≤ val( G ) 2 +2  Proof: Assume by way of contradiction a strategy for G 2 that does better. 1.Consider questions x 1,x 1 ’,y 1 & label  to y 1. Define: S:= { x 2 | (x 1,x 2 ) assigns y 1  } T:= { x 2 ‘| (x 1 ’, x 2 ‘) assigns y 1  } 2.Small Prob Events: Probability of (|S|<  |X| & x 2  S) or (|T|<  |X| & x 2 ’  T) is 2  #colors ≤ . 3.Conditioning: P(agree on y 2 & |S|   |X|& |T|   |X| |agree on y 1 ) > val( G )+ . 4.Fortification: If |S|   |X|& |T|   |X|, value of G restricted to S,T is ≤ val( G )+ . 5.Overall: P(agree on y 2 & agree on y 1 )≤val( G ) 2 +2 .

The Influence of Parallel Repetition PCP and Hardness of Approximation: Soundness amplification [Raz]. Cryptography: zero-knowledge two prover protocols [BenOr-Goldwasser-Kilian-Wigderson], arguments [Haitner]. Quantum Computing: Amplifying Bell’s inequality. Communication complexity: Direct sum theorems [Krachmer-Raz-Wigderson], compression [Barak-Braverman-Chen-Rao]. Geometry: Tiling of R n by volume 1 tiles with surface area  sphere [Feige-Kindler-O’Donnell, Kindler-O’Donnell-Rao-Wigderson].