Ryan ODonnell Carnegie Mellon University Karl Wimmer CMU & Duquesne Amir Shpilka Technion Rocco Servedio Columbia Parikshit Gopalan UW & Microsoft SVC.

Slides:



Advertisements
Similar presentations
Fast Moment Estimation in Data Streams in Optimal Space Daniel Kane, Jelani Nelson, Ely Porat, David Woodruff Harvard MIT Bar-Ilan IBM.
Advertisements

How to Solve Longstanding Open Problems In Quantum Computing Using Only Fourier Analysis Scott Aaronson (MIT) For those who hate quantum: The open problems.
Agnostically Learning Decision Trees Parikshit Gopalan MSR-Silicon Valley, IITB00. Adam Tauman Kalai MSR-New England Adam R. Klivans UT Austin
Reductions to the Noisy Parity Problem TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAA A A A A Vitaly Feldman Parikshit.
Parikshit Gopalan Georgia Institute of Technology Atlanta, Georgia, USA.
Hardness of Reconstructing Multivariate Polynomials. Parikshit Gopalan U. Washington Parikshit Gopalan U. Washington Subhash Khot NYU/Gatech Rishi Saket.
Polynomial Interpolation over Composites. Parikshit Gopalan Georgia Tech.
LEARNIN HE UNIFORM UNDER DISTRIBUTION – Toward DNF – Ryan ODonnell Microsoft Research January, 2006.
Ryan Donnell Carnegie Mellon University O. 1. Describe some TCS results requiring variants of the Central Limit Theorem. Talk Outline 2. Show a flexible.
Testing Surface Area Ryan O’Donnell Carnegie Mellon & Boğaziçi University joint work with Pravesh Kothari (UT Austin), Amir Nayyeri (Oregon), Chenggang.
8.3 Inverse Linear Transformations
Computational Applications of Noise Sensitivity Ryan O’Donnell.
DNF Sparsification and Counting Raghu Meka (IAS, Princeton) Parikshit Gopalan (MSR, SVC) Omer Reingold (MSR, SVC)
Splash Screen.
Ryan O’Donnell - Microsoft Mike Saks - Rutgers Oded Schramm - Microsoft Rocco Servedio - Columbia.
An Efficient Membership-Query Algorithm for Learning DNF with Respect to the Uniform Distribution Jeffrey C. Jackson Presented By: Eitan Yaakobi Tamar.
Extremal properties of polynomial threshold functions Ryan O’Donnell (MIT / IAS) Rocco Servedio (Columbia)
A UNIFIED FRAMEWORK FOR TESTING LINEAR-INVARIANT PROPERTIES ARNAB BHATTACHARYYA CSAIL, MIT (Joint work with ELENA GRIGORESCU and ASAF SHAPIRA)
Kevin Matulef MIT Ryan O’Donnell CMU Ronitt Rubinfeld MIT Rocco Servedio Columbia.
Learning Juntas Elchanan Mossel UC Berkeley Ryan O’Donnell MIT Rocco Servedio Harvard.
Linear Systems With Composite Moduli Arkadev Chattopadhyay (University of Toronto) Joint with: Avi Wigderson TexPoint fonts used in EMF. Read the TexPoint.
Learning intersections and thresholds of halfspaces Adam Klivans (MIT/Harvard) Ryan O’Donnell (MIT) Rocco Servedio (Harvard)
Quantum Spectrum Testing Ryan O’Donnell John Wright (CMU)
Dictator tests and Hardness of approximating Max-Cut-Gain Ryan O’Donnell Carnegie Mellon (includes joint work with Subhash Khot of Georgia Tech)
New Algorithms and Lower Bounds for Monotonicity Testing of Boolean Functions Rocco Servedio Joint work with Xi Chen and Li-Yang Tan Columbia University.
Complexity 11-1 Complexity Andrei Bulatov Space Complexity.
Asaf Shapira (Georgia Tech) Joint work with: Arnab Bhattacharyya (MIT) Elena Grigorescu (Georgia Tech) Prasad Raghavendra (Georgia Tech) 1 Testing Odd-Cycle.
Testing of ‘massively parametrized problems’ - Ilan Newman Haifa University Based on joint work with: Sourav Chakraborty, Eldar Fischer, Shirley Halevi,
Yi Wu (CMU) Joint work with Parikshit Gopalan (MSR SVC) Ryan O’Donnell (CMU) David Zuckerman (UT Austin) Pseudorandom Generators for Halfspaces TexPoint.
Proclaiming Dictators and Juntas or Testing Boolean Formulae Michal Parnas Dana Ron Alex Samorodnitsky.
Chapter 5 Orthogonality
Analysis of Boolean Functions Fourier Analysis, Projections, Influence, Junta, Etc… And (some) applications Slides prepared with help of Ricky Rosen.
Learning, testing, and approximating halfspaces Rocco Servedio Columbia University DIMACS-RUTCOR Jan 2009.
An Algorithm for Polytope Decomposition and Exact Computation of Multiple Integrals.
Putting a Junta to the Test Joint work with Eldar Fischer, Dana Ron, Shmuel Safra, and Alex Samorodnitsky Guy Kindler.
Putting a Junta to the Test Joint work with Eldar Fischer & Guy Kindler.
On the Fourier Tails of Bounded Functions over the Discrete Cube Irit Dinur, Ehud Friedgut, and Ryan O’Donnell Joint work with Guy Kindler Microsoft Research.
Fourier Analysis, Projections, Influences, Juntas, Etc…
1 COMPOSITION PCP proof by Irit Dinur Presentation by Guy Solomon.
On Proximity Oblivious Testing Oded Goldreich - Weizmann Institute of Science Dana Ron – Tel Aviv University.
Correlation Immune Functions and Learning Lisa Hellerstein Polytechnic Institute of NYU Brooklyn, NY Includes joint work with Bernard Rosell (AT&T), Eric.
1 On approximating the number of relevant variables in a function Dana Ron & Gilad Tsur Tel-Aviv University.
Fourier Analysis of Boolean Functions Juntas, Projections, Influences Etc.
On Testing Computability by small Width OBDDs Oded Goldreich Weizmann Institute of Science.
Some 3CNF Properties are Hard to Test Eli Ben-Sasson Harvard & MIT Prahladh Harsha MIT Sofya Raskhodnikova MIT.
Dana Moshkovitz, MIT Joint work with Subhash Khot, NYU.
7.2 Solving Recurrence Relations. Definition 1 (p. 460)- LHRR-K Def: A linear homogeneous recurrence relations of degree k with constant coefficients.
Correlation testing for affine invariant properties on Shachar Lovett Institute for Advanced Study Joint with Hamed Hatami (McGill)
Ryan O’Donnell Carnegie Mellon University. Part 1: A. Fourier expansion basics B. Concepts: Bias, Influences, Noise Sensitivity C. Kalai’s proof of Arrow’s.
Ryan ’Donnell Carnegie Mellon University O. f : {−1, 1} n → {−1, 1} is “quasirandom” iff fixing O(1) input coords changes E[f(x)] by only o (1)
Succinct representation of codes with applications to testing Elena Grigorescu Tali Kaufman Madhu Sudan.
AN ORTHOGONAL PROJECTION
Key Concept 1. Example 1 Leading Coefficient Equal to 1 A. List all possible rational zeros of f (x) = x 3 – 3x 2 – 2x + 4. Then determine which, if any,
2.4 – Real Zeros of Polynomial Functions
Potential-Based Agnostic Boosting Varun Kanade Harvard University (joint work with Adam Tauman Kalai (Microsoft NE))
1 Lecture 21: Hash Tables Wednesday, November 17, 2004.
Smooth Boolean Functions are Easy: Efficient Algorithms for Low-Sensitivity Functions Rocco Servedio Joint work with Parikshit Gopalan (MSR) Noam Nisan.
Learnability of DNF with Representation-Specific Queries Liu Yang Joint work with Avrim Blum & Jaime Carbonell Carnegie Mellon University 1© Liu Yang 2012.
Dana Ron Tel Aviv University
Log-Sobolev Inequality on the Multislice (and what those words mean)
Local Decoding and Testing Polynomials over Grids
Tight Fourier Tails for AC0 Circuits
Linear sketching with parities
Locally Decodable Codes from Lifting
Linear sketching over
Learning, testing, and approximating halfspaces
Linear sketching with parities
Every set in P is strongly testable under a suitable encoding
Zeros of polynomial functions
Explicit near-Ramanujan graphs of every degree
Presentation transcript:

Ryan ODonnell Carnegie Mellon University Karl Wimmer CMU & Duquesne Amir Shpilka Technion Rocco Servedio Columbia Parikshit Gopalan UW & Microsoft SVC joint with

Outline 1. Testing boolean functions overview 2. Statement & proof sketch of Result 2 3. Statements of other results

Property Testing Boolean Functions Query access to Say YES whp if f has property P Say NO whp if f is -far from all g w/ ppty P P testable if doable with # queries depending only on

Property Testing Characterizing testability fairly well-understood for graphs [AS05a,AS05b,AFNS06,AT08,…] &codes [KS07,KS08,…]. But wide open for boolean functions.

Testable boolean function properties Linearity (f(x) = λx) [BLR90] Degree k [AKKLR03] Dicatators [BGS95] Conjunctions, size-s mono. DNF [PRS01] s-juntas ( s relevant vbls) [FKKRS03,B09] size-s DNFs, DTs, BPs, formulas, ckts, polynomials [DLMORSW07] Halfspaces [MORS09] poly(s/) qs

Characterization?? Fischers survey [Fis01] suggests Fourier may be key. This paper: Having concise Fourier representation is testable.

Fourier analysis of boolean functions

There are 2 n linear functions, Every uniquely expressible as a real #

Fourier sparsity Def: f is s-sparse # of nonzero is s Eg:Linear functions are 1-sparse. k-juntas are 2 k -sparse.

Result #2 Thm: Is s-sparse? is -testable with poly(s/) nonadaptive queries.

Proof ingredients Hashing Fourier coefficients to affine subspaces [FGKP06] New structural facts about s-sparse boolean functions

Physical spaceFourier space

Physical spaceFourier space – ¾0

Fourier space

Hashing Fourier coefficients idea s 2 buckets

Hashing Fourier coefficients idea Birthday Paradox s Fourier coeffs split Test that at most s buckets are nonzero? s 2 buckets

Hashing to affine subspaces Pick α 1, …, α d at random, d = 2 log s. α 1 λ = 0 α 2 λ = 0 α d λ = 0 λ : subpace of codimension d

Hashing to affine subspaces Pick α 1, …, α d at random, d = 2 log s. α 1 λ = b 1 α 2 λ = b 2 α d λ = b d λ : subpace of codimension d affine b

Hashing Fourier coefficients idea Birthday Paradox? OK, by pairwise independence. 2 d = s 2 buckets (aff. subsps.) indexed by F2

Projection functions

b

Physical to Fourier link b ex:

Physical to Fourier link b ex: P b f(x) = avg. of ±f on 2 d = s 2 strings reld to x

Projection functions We can compute P b f(x) exactly, for any bucket b, with s 2 queries P b f(x) is always

The Test 1.Hash to a random 2 d = s 2 buckets b. 2.For each b, 3.-test if P b f(x) 0, for = poly(/s) 4.Let B = {b : P b f wasnt 0} 5.Say NO if |B| > s

The Test 1.Hash to a random 2 d = s 2 buckets b. 2.For each b, 3.-test if P b f(x) 0, for = poly(/s) 4.Let B = {b : P b f wasnt 0} 5.Say NO if |B| > s 6.Say YES

The Test 1.Hash to a random 2 d = s 2 buckets b. 2.For each b, 3.-test if P b f(x) 0, for = poly(/s) 4.Let B = {b : P b f wasnt 0} 5.Say NO if |B| > s 6.Say YES poly(s/) nonadapt. queries

The Test Recall that for b B we should have P b f = Analysis easier if you also do: 6.For each b B, 7.Test |P b f| constant 8.Test sgn(P b f) is linear, using [BLR90]

The Test Recall that for b B we should have P b f = Analysis easier if you also do: 6.For each b B, 7.Test |P b f| constant 8.Test sgn(P b f) is linear, using [BLR90]

Key for analysis Granularity Theorem: If is s-sparse, then for all λ. (hence 0 or > 1/s)

Other results Def: f is k-dimensional if { } lies in a k-dimensional subspace. f is a k-junta of parities Result 1: Is f k-dimensional? is -testable with 2 O(k) / nonadaptive queries.

Other results Result 3: Lower bounds. Even for nonadaptive testers, =.49, queries needed for s-sparsity 2 Ω(k) queries need for k-dimensionality Improves on [AKKLR03, BFNR08].

Other results Result 4: Exact, proper learning algorithm for s-sparse functions under unif. (Easy consequence of Granularity Theorem.)

Other results Result 5: Every subclass of k-dimensional functions is testable with 2 O(k) / nonadaptive queries. (Uses Testing by implicit learning [DLMORSW07] )

Open problems More on characterizing testability of boolean function properties. Test functions with (cf [GS06] ) Characterize s-sparse boolean functions. Are they disj. unions of poly(s) many affine subspaces of codimension O(log s)?