Direct product testing

Slides:



Advertisements
Similar presentations
Routing Complexity of Faulty Networks Omer Angel Itai Benjamini Eran Ofek Udi Wieder The Weizmann Institute of Science.
Advertisements

Hardness Amplification within NP against Deterministic Algorithms Parikshit Gopalan U Washington & MSR-SVC Venkatesan Guruswami U Washington & IAS.
Lower Bounds for Additive Spanners, Emulators, and More David P. Woodruff MIT and Tsinghua University To appear in FOCS, 2006.
Russell Impagliazzo ( IAS & UCSD ) Ragesh Jaiswal ( Columbia U. ) Valentine Kabanets ( IAS & SFU ) Avi Wigderson ( IAS ) ( based on [IJKW08, IKW09] )
The Contest between Simplicity and Efficiency in Asynchronous Byzantine Agreement Allison Lewko The University of Texas at Austin TexPoint fonts used in.
Direct Product : Decoding & Testing, with Applications Russell Impagliazzo (IAS & UCSD) Ragesh Jaiswal (Columbia) Valentine Kabanets (SFU) Avi Wigderson.
Direct-Product testing Parallel Repetitions And Foams Avi Wigderson IAS.
Shortest Vector In A Lattice is NP-Hard to approximate
Inapproximability of Hypergraph Vertex-Cover. A k-uniform hypergraph H= : V – a set of vertices E - a collection of k-element subsets of V Example: k=3.
Approximate List- Decoding and Hardness Amplification Valentine Kabanets (SFU) joint work with Russell Impagliazzo and Ragesh Jaiswal (UCSD)
Many-to-one Trapdoor Functions and their Relations to Public-key Cryptosystems M. Bellare S. Halevi A. Saha S. Vadhan.
Talk for Topics course. Pseudo-Random Generators pseudo-random bits PRG seed Use a short “ seed ” of very few truly random bits to generate a long string.
Inapproximability of MAX-CUT Khot,Kindler,Mossel and O ’ Donnell Moshe Ben Nehemia June 05.
Gillat Kol joint work with Ran Raz Locally Testable Codes Analogues to the Unique Games Conjecture Do Not Exist.
Foundations of Cryptography Lecture 10 Lecturer: Moni Naor.
Foundations of Cryptography Lecture 11 Lecturer: Moni Naor.
Approximation Algorithms Chapter 14: Rounding Applied to Set Cover.
Heuristics for the Hidden Clique Problem Robert Krauthgamer (IBM Almaden) Joint work with Uri Feige (Weizmann)
Parallel Repetition From Fortification Dana Moshkovitz MIT.
How to Delegate Computations: The Power of No-Signaling Proofs Ron Rothblum Weizmann Institute Joint work with Yael Kalai and Ran Raz.
Derandomized parallel repetition theorems for free games Ronen Shaltiel, University of Haifa.
Probabilistically Checkable Proofs (and inapproximability) Irit Dinur, Weizmann open day, May 1 st 2009.
Introduction to PCP and Hardness of Approximation Dana Moshkovitz Princeton University and The Institute for Advanced Study 1.
A 3-Query PCP over integers a.k.a Solving Sparse Linear Systems Prasad Raghavendra Venkatesan Guruswami.
1/17 Optimal Long Test with One Free Bit Nikhil Bansal (IBM) Subhash Khot (NYU)
Gillat Kol joint work with Ran Raz Locally Testable Codes Analogues to the Unique Games Conjecture Do Not Exist.
Inapproximability from different hardness assumptions Prahladh Harsha TIFR 2011 School on Approximability.
Dictator tests and Hardness of approximating Max-Cut-Gain Ryan O’Donnell Carnegie Mellon (includes joint work with Subhash Khot of Georgia Tech)
1 By Gil Kalai Institute of Mathematics and Center for Rationality, Hebrew University, Jerusalem, Israel presented by: Yair Cymbalista.
Why almost all k-colorable graphs are easy A. Coja-Oghlan, M. Krivelevich, D. Vilenchik.
A Parallel Repetition Theorem for Any Interactive Argument Iftach Haitner Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual before.
Graph Sparsifiers by Edge-Connectivity and Random Spanning Trees Nick Harvey University of Waterloo Department of Combinatorics and Optimization Joint.
Derandomized DP  Thus far, the DP-test was over sets of size k  For instance, the Z-Test required three random sets: a set of size k, a set of size k-k’
Tirgul 10 Rehearsal about Universal Hashing Solving two problems from theoretical exercises: –T2 q. 1 –T3 q. 2.
Arithmetic Hardness vs. Randomness Valentine Kabanets SFU.
Hunting for Sharp Thresholds Ehud Friedgut Hebrew University.
CS151 Complexity Theory Lecture 10 April 29, 2004.
1 Constructing Pseudo-Random Permutations with a Prescribed Structure Moni Naor Weizmann Institute Omer Reingold AT&T Research.
Hardness amplification proofs require majority Emanuele Viola Columbia University Work done at Harvard, IAS, and Columbia Joint work with Ronen Shaltiel.
In a World of BPP=P Oded Goldreich Weizmann Institute of Science.
1 Joint work with Shmuel Safra. 2 Motivation 3 Motivation.
Dana Moshkovitz, MIT Joint work with Subhash Khot, NYU.
Correlation testing for affine invariant properties on Shachar Lovett Institute for Advanced Study Joint with Hamed Hatami (McGill)
A Parallel Repetition Theorem for Entangled Projection Games Thomas Vidick Simons Institute, Berkeley Joint work with Irit Dinur (Weizmann) and David Steurer.
Ragesh Jaiswal Indian Institute of Technology Delhi Threshold Direct Product Theorems: a survey.
Products of Functions, Graphs, Games & Problems Irit Dinur Weizmann.
Sub-Constant Error Low Degree Test of Almost-Linear Size Dana Moshkovitz Weizmann Institute Ran Raz Weizmann Institute.
Hardness of Learning Halfspaces with Noise Prasad Raghavendra Advisor Venkatesan Guruswami.
Direct-product testing, and a new 2-query PCP Russell Impagliazzo (IAS & UCSD) Valentine Kabanets (SFU) Avi Wigderson (IAS)
Independence and Bernoulli Trials. Sharif University of Technology 2 Independence  A, B independent implies: are also independent. Proof for independence.
1/19 Minimizing weighted completion time with precedence constraints Nikhil Bansal (IBM) Subhash Khot (NYU)
Polynomials Emanuele Viola Columbia University work partially done at IAS and Harvard University December 2007.
Artur Czumaj DIMAP DIMAP (Centre for Discrete Maths and it Applications) Computer Science & Department of Computer Science University of Warwick Testing.
Honest-Verifier Statistical Zero-Knowledge Equals General Statistical Zero-Knowledge Oded Goldreich (Weizmann) Amit Sahai (MIT) Salil Vadhan (MIT)
List Decoding Using the XOR Lemma Luca Trevisan U.C. Berkeley.
6.853: Topics in Algorithmic Game Theory Fall 2011 Constantinos Daskalakis Lecture 8.
Locality in Coding Theory II: LTCs
New Characterizations in Turnstile Streams with Applications
Lecture 18: Uniformity Testing Monotonicity Testing
Dana Moshkovitz The Institute For Advanced Study
Pseudorandomness when the odds are against you
Locally Decodable Codes from Lifting
How to Delegate Computations: The Power of No-Signaling Proofs
Introduction to PCP and Hardness of Approximation
On the effect of randomness on planted 3-coloring models
Locality in Coding Theory II: LTCs
Imperfectly Shared Randomness
Every set in P is strongly testable under a suitable encoding
Small Set Expansion in The Johnson Graph
Small Set Expansion in The Johnson Graph
Presentation transcript:

Direct product testing Irit Dinur, Inbal Livni Navon Weizmann Institute

Direct product operation 𝑓 ⊗𝑘 𝑥 1 , 𝑥 2 ,…, 𝑥 𝑘 =𝑓 𝑥 1 ,𝑓 𝑥 2 ,…𝑓 𝑥 𝑘 Direct product operation Basic operation on functions Useful for hardness amplification “one new instance is as hard as k”

Testing direct products Given a function, 𝑓: 𝑛 𝑘 → 0,1 𝑘 is it a direct product? Related to parallel repetition: the honest players’ strategy is a direct product; if we knew that the player strategy is a DP then perfect parallel repetition is immediate, with perfectly exponential decay Natural test:

Testing direct products How good is this test? Suppose it succeeds with probability 99%, how close is f to DP ? This is a property testing question. Hope: f is 99% close to DP Warmup: for each 𝑧∈[𝑛] choose the most popular value An averaging argument shows that for 90% of tuples ( 𝑧 1 ,…, 𝑧 𝑘 ), f outputs the popular value on about 90% of the coordinates Aside: [D-Steurer 14] showed a stronger result: for 99% of the tuples, f agrees with m on every entry

Testing direct products Studied and used for some PCP constructions; initially suggested as a combinatorial alternative to “low degree test” [Goldreich-Safra, D-Reingold, D-Goldenberg, Impagliazzon-Kabanets- Wigderson, D-Steurer] Main interest: the 1% regime, aka “small soundness” or “list decoding“ regime

The 1% regime Suppose f passes the test with probability 1%, can anything be said about its structure? [unlike standard property testing set-up, we cannot afford boosting success by repetition] …cannot expect a conclusion of the form “there is a single DP g that approximates f”. we must allow a mix of several valid DP functions (aka a “list”) Examples of properties that have 1% tests: Low degree tests Long code tests Gowers norm and additive combinatorics (these are related to low degree tests) Direct product tests For what properties do we have tests that imply meaningful structure even if they pass with low “1%” probability? (Can be viewed as a stronger form of property testing) For which value of “1%” can structure be found? Ultimately= anything above random

The 1% regime for Direct Product tests D-Goldenberg: if f passes the V test with probability 𝜖 > 1/𝑝𝑜𝑙𝑦(𝑘), then it is 𝑝𝑜𝑙𝑦(𝜖) correlated to a DP Cannot expect such structure for 𝜖 below 1/𝑝𝑜𝑙𝑦(𝑘) : There is a function f that is not close to any DP, but passes the test w prob 𝜖 Impagliazzo Kabanets Wigderson: add a third query, and the counter-example goes away IKW theorem: for any 𝜖 > exp⁡(−√𝑘), if f passes the Z test with probability ≥𝜖, it is 𝑝𝑜𝑙𝑦(𝜖) correlated to a DP New (almost a decade later): same holds for all 𝜖 > exp⁡(−𝑘),

Main Result If 𝑓: 𝑛 𝑘 → 0,1 𝑘 passes the Z-test with probability 𝜖≥ exp −𝑘 , then it is 𝑝𝑜𝑙𝑦(𝜖) close to a direct product function The result is “ballpark” tight Number of queries: it is impossible with 2 queries, as per [DG] example; so 3 is it Soundness: cannot go below exp⁡(−𝑘) a random function where 𝑓(𝑥) is chosen independently for each 𝑥∈ 𝑛 𝑘 passes the test with probability exp −𝑘 Open: can we get soundness test down to the randomness threshold? ( 2 −𝑘 +𝛿 and not only (1.001) −𝑘 ) “close to DP” : there is approximate closeness, and exact closeness,

Proof Given 𝑓: 𝑛 𝑘 → 0,1 𝑘 that passes the Z-test with probability 𝜖 ≥ exp −𝑘 The proof will construct a DP that is close to f. How? Taking a popularity vote on a restricted set of x’s Choose a random restriction A= 𝑥 1 , 𝑥 2 , 𝑥 3 , 𝑥 4 ,∗, ∗,∗,∗ Choose a fixed answer 𝛼 ∈ 0,1 𝐴 , e.g. “1001”, Consider only 𝑥’s that 𝑓 𝑥 𝐴 =𝛼 Take a majority vote on these x’s, (assume for now that f is invariant for permutations) 𝑔 𝑦 =𝑝𝑜𝑝𝑢𝑙𝑎𝑟 𝑓 𝑥 1 , 𝑥 2 , 𝑥 3 , 𝑥 4 ,𝑦,∗,∗,∗ Need to prove that inside this restriction, indeed f is a DP, i.e. the value of f on the i-th coordinate, depends only on the i-th coordinate.

Proof IKW: used sampling properties of k-sets and t-sets, which hold as long as 𝜖≥ exp − 𝑘 𝑡≤ 𝑘 When 𝜖≈ exp −𝑘 this fails. Instead, we perform “densification”

Inside the restriction: We have partial function 𝑓: 𝑛 𝑘 ′ → 0,1 𝑘 ′ ∪{⊥}, that is defined on some 𝜖≥exp −𝑘′ fraction of the inputs We know that whenever the function is defined on two “intersecting” inputs, the answers agree whp “densify” the function by using majority on small balls Prove that the densified function has similar properties to the original function, (using: reverse hyper-contractivity to reason about expansion of small sets in the test graph) With the dense function we can finish like before

Restriction decoding Assuming success 99%  Unique decoding List decoding ? Restriction decoding and “zoom ins” Third query – brings us back to list decoding

(possibly: some form of high dimensional expansion) Agreement tests The question of DP testing belongs to a family of testing questions called “agreement testing” Given a collection of partial views of a domain, that typically pairwise agree, is there a global view they all agree on? E.g. plane vs. plane low degree test E.g. tuple vs. tuple tests that we saw today Such agreement theorems are an important ingredient in all PCPs What is the connection between these questions and the geometry of the set of “local views” ? (possibly: some form of high dimensional expansion)