Endre Szemerédi & TCS Avi Wigderson IAS, Princeton.

Slides:



Advertisements
Similar presentations
Randomness Conductors Expander Graphs Randomness Extractors Condensers Universal Hash Functions
Advertisements

Parikshit Gopalan Georgia Institute of Technology Atlanta, Georgia, USA.
Linear-Degree Extractors and the Inapproximability of Max Clique and Chromatic Number David Zuckerman University of Texas at Austin.
COMPLEXITY THEORY CSci 5403 LECTURE XVI: COUNTING PROBLEMS AND RANDOMIZED REDUCTIONS.
Circuit and Communication Complexity. Karchmer – Wigderson Games Given The communication game G f : Alice getss.t. f(x)=1 Bob getss.t. f(y)=0 Goal: Find.
Time-Space Tradeoffs in Resolution: Superpolynomial Lower Bounds for Superlinear Space Chris Beck Princeton University Joint work with Paul Beame & Russell.
DNF Sparsification and Counting Raghu Meka (IAS, Princeton) Parikshit Gopalan (MSR, SVC) Omer Reingold (MSR, SVC)
Extractors: applications and constructions Avi Wigderson IAS, Princeton Randomness.
FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY
The Theory of NP-Completeness
1 NP-Complete Problems. 2 We discuss some hard problems:  how hard? (computational complexity)  what makes them hard?  any solutions? Definitions 
© The McGraw-Hill Companies, Inc., Chapter 8 The Theory of NP-Completeness.
The zigzag product, Expander graphs & Combinatorics vs. Algebra Avi Wigderson IAS & Hebrew University ’00 Reingold, Vadhan, W. ’01 Alon, Lubotzky, W. ’01.
Randomized Algorithms Kyomin Jung KAIST Applied Algorithm Lab Jan 12, WSAC
Introduction to PCP and Hardness of Approximation Dana Moshkovitz Princeton University and The Institute for Advanced Study 1.
Complexity 15-1 Complexity Andrei Bulatov Hierarchy Theorem.
CS151 Complexity Theory Lecture 7 April 20, 2004.
CS151 Complexity Theory Lecture 5 April 13, 2004.
NP-complete and NP-hard problems Transitivity of polynomial-time many-one reductions Definition of complexity class NP –Nondeterministic computation –Problems.
Derandomization: New Results and Applications Emanuele Viola Harvard University March 2006.
1 Polynomial Church-Turing thesis A decision problem can be solved in polynomial time by using a reasonable sequential model of computation if and only.
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
Constant Degree, Lossless Expanders Omer Reingold AT&T joint work with Michael Capalbo (IAS), Salil Vadhan (Harvard), and Avi Wigderson (Hebrew U., IAS)
NP-complete and NP-hard problems
EXPANDER GRAPHS Properties & Applications. Things to cover ! Definitions Properties Combinatorial, Spectral properties Constructions “Explicit” constructions.
Derandomizing LOGSPACE Based on a paper by Russell Impagliazo, Noam Nissan and Avi Wigderson Presented by Amir Rosenfeld.
Chapter 11: Limitations of Algorithmic Power
The Power of Randomness in Computation 呂及人中研院資訊所.
February 20, 2015CS21 Lecture 191 CS21 Decidability and Tractability Lecture 19 February 20, 2015.
The Design and Analysis of Algorithms
DAST, Spring © L. Joskowicz 1 Data Structures – LECTURE 1 Introduction Motivation: algorithms and abstract data types Easy problems, hard problems.
Expander graphs – Constructions, Connections and Applications Avi Wigderson IAS & Hebrew University ’00 Reingold, Vadhan, W. ’01 Alon, Lubotzky, W. ’01.
1 L is in NP means: There is a language L’ in P and a polynomial p so that L 1 ≤ L 2 means: For some polynomial time computable map r : x: x L 1 iff r(x)
Complexity Theory Lecture 2 Lecturer: Moni Naor. Recap of last week Computational Complexity Theory: What, Why and How Overview: Turing Machines, Church-Turing.
1 The Theory of NP-Completeness 2012/11/6 P: the class of problems which can be solved by a deterministic polynomial algorithm. NP : the class of decision.
Theory of Computing Lecture 15 MAS 714 Hartmut Klauck.
Happy 60 th B’day Mike. Lower bounds, anyone? Avi Wigderson Institute for Advanced Study.
The Complexity of Optimization Problems. Summary -Complexity of algorithms and problems -Complexity classes: P and NP -Reducibility -Karp reducibility.
Why Extractors? … Extractors, and the closely related “Dispersers”, exhibit some of the most “random-like” properties of explicitly constructed combinatorial.
RANDOMNESS AND PSEUDORANDOMNESS Omer Reingold, Microsoft Research and Weizmann.
Logic Circuits Chapter 2. Overview  Many important functions computed with straight-line programs No loops nor branches Conveniently described with circuits.
One-way multi-party communication lower bound for pointer jumping with applications Emanuele Viola & Avi Wigderson Columbia University IAS work done while.
Extractors: applications and constructions Avi Wigderson IAS, Princeton Randomness Seeded.
1 The Theory of NP-Completeness 2 Cook ’ s Theorem (1971) Prof. Cook Toronto U. Receiving Turing Award (1982) Discussing difficult problems: worst case.
1 P P := the class of decision problems (languages) decided by a Turing machine so that for some polynomial p and all x, the machine terminates after at.
Fall 2013 CMU CS Computational Complexity Lectures 8-9 Randomness, communication, complexity of unique solutions These slides are mostly a resequencing.
Amplification and Derandomization Without Slowdown Dana Moshkovitz MIT Joint work with Ofer Grossman (MIT)
My Favorite Ten Complexity Theorems of the Past Decade II Lance Fortnow University of Chicago.
Hashing 1 Hashing. Hashing 2 Hashing … * Again, a (dynamic) set of elements in which we do ‘search’, ‘insert’, and ‘delete’ n Linear ones: lists, stacks,
The zigzag product, Expander graphs & Combinatorics vs. Algebra Avi Wigderson IAS, Princeton ’00 Reingold, Vadhan, W. ’01 Alon, Lubotzky, W. ’01 Capalbo,
Final Review Chris and Virginia. Overview One big multi-part question. (Likely to be on data structures) Many small questions. (Similar to those in midterm.
Happy 60 th B’day Noga. Elementary problems encoding computational hardness Avi Wigderson IAS, Princeton or Some problems Noga never solved.
Pseudo-random generators Talk for Amnon ’ s seminar.
CSCI 2670 Introduction to Theory of Computing December 2, 2004.
RANDOMNESS AND PSEUDORANDOMNESS Omer Reingold, Microsoft Research and Weizmann.
Almost SL=L, and Near-Perfect Derandomization Oded Goldreich The Weizmann Institute Avi Wigderson IAS, Princeton Hebrew University.
1 SAT SAT: Given a Boolean function in CNF representation, is there a way to assign truth values to the variables so that the function evaluates to true?
Chapter 10 NP-Complete Problems.
Probabilistic Algorithms
New Characterizations in Turnstile Streams with Applications
NP-Completeness (36.4-5/34.4-5)
Umans Complexity Theory Lectures
Branching Programs Part 3
Intro to Theory of Computation
Complexity of Expander-Based Reasoning and the Power of Monotone Proofs Sam Buss (UCSD), Valentine Kabanets (SFU), Antonina Kolokolova.
Bin Fu Department of Computer Science
Richard Anderson Lecture 25 NP-Completeness
DNF Sparsification and Counting
Hashing.
CS151 Complexity Theory Lecture 5 April 16, 2019.
Presentation transcript:

Endre Szemerédi & TCS Avi Wigderson IAS, Princeton

Happy Birthday Endre !

Selection of omitted results [Babai-Hajnal-Szemerédi-Turan] Lower bounds on Branching Programs [Ajtai-Iwaniec-Komlós-Pintz-Szemerédi] Explicit  -biased set over Z m [Nisan-Szemerédi-W] Undirected connectivity in (log n) 3/2 space [Komlós-Ma-Szemerédi] Matching nuts and bolts in O(n log n) time ……….

The dictionary problem Storage, retrieval, and the power of universal hashing

The Dictionary Problem Store a set U={u 1, u 2, …, u n }  {0,1} k (n  2 k ) using O(n) time & space (each unit is k-bit word). - Minimize # of queries to determine if x  U? Classic: log n Sort U and use a search tree. u 5 < u n < … < u 7 Question[Yao] “Should tables be sorted?” Thm[Yao] No! (for many k,n). Use hashing! Thm[Fredman-Komlós-Szemerédi’82] Never! 2 queries always suffice! x<u i

hihi h1h1 h3h3 hnhn ni2ni2 n12n12 - Birthday paradox - Storage: O(n) - Search: 2 queries h i :[2 k ]  [n i 2 ]h:[2 k ]  [n] universal hash h(x)=ax+b( mod n) E[  i n i 2 ] = O(n) [2k][2k] h n1n1 nini n2n2 n3n3 u2u2 u1u1 unun n i

Sorting networks The mamnoth of all expander applications

Sorting networks [Ajtai-Komlós-Szemerédi] n inputs (real numbers), n outputs (sorted) Many sorting algorithms of O(n log n) comparisons Several sorting networks of O(n log 2 n) comparators Thm:[AKS’83] Explicit network with O(n log n) comparators, and depth O(log n) Proof: Extremely sophisticated use & analysis of expanders MIN MAX

Monotone Threshold Formulae n inputs (bits), n outputs (sorted) Thm: [AKS’83] Size O(n log n), depth O(log n) network. Cor[AKS]: Monotone Majority formula of size n O(1) (derandomizing a probabilistic existence proof of Valiant) Open : Find a simple polynomial size Majority formula Open : Prove size lower bound >> n 2 (best upper bound n 5.3 ) AND OR Threshold

Derandomization The mother of all randomness extractors

Derandomized error reduction [CW,IZ] Algxx rr {0,1} n random strings Thm[Chernoff] r 1 r 2 …. r k independent Thm[Ajtai-Komlós-Szemerédi’87] r 1 …. r k random path Algxx rkrk xx r1r1 Majority G explicit d-regular expander graph BxBx Pr[error] < 1/3 then Pr[error] = Pr[|{r 1 r 2 …. r k }  B x }| > k/2] < exp(-k) |B x |<2 n /3 Random bits kn n+O(k)

Derandomization of sampling via expander walks G d-regular expander. f: V(G)  R, |f(v)|  1, E[f]=0 Thm [Chernoff] r 1 r 2 …. r k independent in V(G) Thm [AKS,Gilman] r 1 r 2 …. r k random path in G then Pr[|  i f(r i ) | >  k] < exp(-  2 k) f: V(G)  M d (R), ||f(v)||  1, E[f]=0 Thm [Ahlswede-Winter] r 1 r 2 …. r k independent Conjecture: r 1 r 2 …. r k random path then Pr[   i f(r i )  >  k] < d exp(-  2 k)

Black-box groups and computational group theory

Black-box groups [Babai-Szemerédi’84] G a finite group (of permutations, matrices, …) Think of the elements as n-bit strings (|G|  2 n ) Black-box B G representation of G is B G xyxy x -1 xy Membership problem: Given g 1, g 2, …, g d, h  G, does h   g 1, g 2, …, g d  ? Standard proof: word (can be exponentially long!) e.g. m=2 n,  g  = C m, h=g m/2 = ggggg…….gggggggg Clever proof: SLP (Straight Line Program)

Straight-line programs [Babai-Szemerédi] An SLP for h   S  with S = {g 1, g 2, …, g d } is g 1, g 2, …, g d, g d+1, g d+2, …, g t =h where for k>d g k =g i -1 or g k =g i g j (i,j<k). Let SLP S (h) denote the smallest such t Thm[BS] Membership  NP For every G, every generators  g 1, g 2,…, g d  =G and every, h  G, SLP S (h) < (log |G|) 2 Open: Is it tight, or perhaps O(log |G|) possible? Thm[Babai, Cooperman, Dixon] Random generation  BPP

Proof complexity Resolution of random formulae

The Resolution proof system A CNF over Boolean variables {x 1, x 2, …, x n } is a conjunction of clauses f= C 1  C 2  …  C m, with every clause C i of the form x i 1  x i 2  …  x i k Assume f=FALSE. How can we prove it? A resolution proof is a sequence of clauses C 1, C 2, …, C m, C m+1, C m+2, …, C t =  with (C  x, D  x)  C  D (Resolution Rule) Let Res(f) denote the smallest such t Thm[Haken’85] Res(PHP n ) > exp (n) Thm[Chvátal-Szemerédi’88] Res(f) > exp(n) for almost all 3-CNFs f on m=20n clauses. Open: Extend to the Frege proof system. axioms

The Frege proof system A CNF over Boolean variables {x 1, x 2, …, x n } is a conjunction of clauses f= C 1  C 2  …  C m Assume f=FALSE. How can we prove it? A Frege proof is a sequence of formulae C 1, C 2, …, C m, G m+1, G m+2, …, G t =  with (G, G  H)  H (Modus Ponens) Let Fre(f) denote the smallest such t Thm[Buss] Fre(PHP n ) = poly(n) Open: Is there any f for which Fre(f)  poly(n) axioms

Determinism vs. Non-determinism Separators and segregators in k-page graphs

Determinism vs. non-determinism in linear time [Paul-Pippenger-Szemerédi-Trotter] Conj: NP  P ( NTIME(n O(1) )  DTIME(n O(1) ) ) Conj: SAT has no polynomial time algorithm Thm[PPST]: SAT has no linear time algorithm Cor [PPST]: NTIME(n)  DTIME(n) Proof: - Block-respecting computation - Simulation of alternating time. - Diagonalization - k-page graphs describe TM computation

k-page graphs (k constant) n Thm[PPST]: k-page graphs have o(n) segregators ( Remove o(n) nodes. Each node has o(n) descendents ) Conj[GKS]: k-page graphs have o(n) separators Thm[Bourgain]: k-page graphs can be expanders! - Vertices on spine - Planar per page - k pages

Point-Line configurations & locally correctable codes

Point-Line configurations P={p 1, p 2, …, p n } points in R n (or C n ). A line is special if it passes through ≥3 points. L i : special lines through p i Thm[Silvester-Gallai-Melchior’40]: If  i, L i covers all of P, then P is 1-dimensional ( over C, 2-dim) Thm[Szemerédi-Trotter’83]: If  i, L i covers (1-  0 )-fraction of P, then P is 1-dimensional Thm[Barak-Dvir-W-Yehudayoff’10]: If  i L i covers a  –fraction of P, then P is O(1/  2 )-dim.

Happy Birthday Endre !