The zigzag product, Expander graphs & Combinatorics vs. Algebra Avi Wigderson IAS & Hebrew University ’00 Reingold, Vadhan, W. ’01 Alon, Lubotzky, W. ’01.

Slides:



Advertisements
Similar presentations
Randomness Conductors Expander Graphs Randomness Extractors Condensers Universal Hash Functions
Advertisements

The Weizmann Institute
Walk the Walk: On Pseudorandomness, Expansion, and Connectivity Omer Reingold Weizmann Institute Based on join works with Michael Capalbo, Kai-Min Chung,
Randomness Conductors (II) Expander Graphs Randomness Extractors Condensers Universal Hash Functions
Parikshit Gopalan Georgia Institute of Technology Atlanta, Georgia, USA.
Computing with Polynomials over Composites Parikshit Gopalan Algorithms, Combinatorics & Optimization. Georgia Tech.
An Introduction to Randomness Extractors Ronen Shaltiel University of Haifa Daddy, how do computers get random bits?
Linear-Degree Extractors and the Inapproximability of Max Clique and Chromatic Number David Zuckerman University of Texas at Austin.
A Combinatorial Construction of Almost-Ramanujan Graphs Using the Zig-Zag product Avraham Ben-Aroya Avraham Ben-Aroya Amnon Ta-Shma Amnon Ta-Shma Tel-Aviv.
Randomness Extractors: Motivation, Applications and Constructions Ronen Shaltiel University of Haifa.
Approximate List- Decoding and Hardness Amplification Valentine Kabanets (SFU) joint work with Russell Impagliazzo and Ragesh Jaiswal (UCSD)
Theoretical Computer Science methods in asymptotic geometry
Expander Graphs, Randomness Extractors and List-Decodable Codes Salil Vadhan Harvard University Joint work with Venkat Guruswami (UW) & Chris Umans (Caltech)
List decoding and pseudorandom constructions: lossless expanders and extractors from Parvaresh-Vardy codes Venkatesan Guruswami Carnegie Mellon University.
Extractors: applications and constructions Avi Wigderson IAS, Princeton Randomness.
1/26 Constructive Algorithms for Discrepancy Minimization Nikhil Bansal (IBM)
Multicut Lower Bounds via Network Coding Anna Blasiak Cornell University.
Probabilistically Checkable Proofs Madhu Sudan MIT CSAIL 09/23/20091Probabilistic Checking of Proofs TexPoint fonts used in EMF. Read the TexPoint manual.
Symmetric Groups and Ramanujan Graphs Mike Krebs, Cal State LA (joint work with A. Shaheen)
Asaf Shapira (Georgia Tech) Joint work with: Arnab Bhattacharyya (MIT) Elena Grigorescu (Georgia Tech) Prasad Raghavendra (Georgia Tech) 1 Testing Odd-Cycle.
(Omer Reingold, 2005) Speaker: Roii Werner TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A AA A A A A AA A.
Learning Submodular Functions Nick Harvey, Waterloo C&O Joint work with Nina Balcan, Georgia Tech.
An Elementary Construction of Constant-Degree Expanders Noga Alon *, Oded Schwartz * and Asaf Shapira ** *Tel-Aviv University, Israel **Microsoft Research,
Linear-time encodable and decodable error-correcting codes Daniel A. Spielman Presented by Tian Sang Jed Liu 2003 March 3rd.
Constant Degree, Lossless Expanders Omer Reingold AT&T joint work with Michael Capalbo (IAS), Salil Vadhan (Harvard), and Avi Wigderson (Hebrew U., IAS)
Hard Metrics from Cayley Graphs Yuri Rabinovich Haifa University Joint work with Ilan Newman.
Undirected ST-Connectivity 2 DL Omer Reingold, STOC 2005: Presented by: Fenghui Zhang CPSC 637 – paper presentation.
1 COMPOSITION PCP proof by Irit Dinur Presentation by Guy Solomon.
Graph Theory in CS Route Search in Online Map Services
EXPANDER GRAPHS Properties & Applications. Things to cover ! Definitions Properties Combinatorial, Spectral properties Constructions “Explicit” constructions.
Undirected ST-Connectivity in Log-Space By Omer Reingold (Weizmann Institute) Year 2004 Presented by Maor Mishkin.
Zig-Zag Expanders Seminar in Theory and Algorithmic Research Sashka Davis UCSD, April 2005 “ Entropy Waves, the Zig-Zag Graph Product, and New Constant-
For slideshow: click “Research and Talks” from slideshow: click “Research and Talks”
Ramanujan Graphs of Every Degree Adam Marcus (Crisply, Yale) Daniel Spielman (Yale) Nikhil Srivastava (MSR India)
Linear-Time Encodable and Decodable Error-Correcting Codes Jed Liu 3 March 2003.
For slideshow: click “Research and Talks” from slideshow: click “Research and Talks”
Expander graphs – Constructions, Connections and Applications Avi Wigderson IAS & Hebrew University ’00 Reingold, Vadhan, W. ’01 Alon, Lubotzky, W. ’01.
1 Entropy Waves, The Zigzag Graph Product, and New Constant-Degree Expanders Omer Reingold Salil Vadhan Avi Wigderson Lecturer: Oded Levy.
Expander graphs – applications and combinatorial constructions Avi Wigderson IAS, Princeton [Hoory, Linial, W. 2006] “Expander graphs and applications”
Plan Lecture 3: 1. Fraisse Limits and Their Automaticity: a. Random Graphs. a. Random Graphs. b. Universal Partial Order. b. Universal Partial Order. 2.
An introduction to expander families and Ramanujan graphs
Spectral Graph Theory and Applications Advanced Course WS2011/2012 Thomas Sauerwald He Sun Max Planck Institute for Informatics.
Information and Coding Theory Linear Block Codes. Basic definitions and some examples. Juris Viksna, 2015.
Endre Szemerédi & TCS Avi Wigderson IAS, Princeton.
The sum-product theorem and applications Avi Wigderson School of Mathematics Institute for Advanced Study.
296.3Page :Algorithms in the Real World Error Correcting Codes III (expander based codes) – Expander graphs – Low density parity check (LDPC) codes.
Extractors: applications and constructions Avi Wigderson IAS, Princeton Randomness Seeded.
15-853:Algorithms in the Real World
Markov Chains and Random Walks. Def: A stochastic process X={X(t),t ∈ T} is a collection of random variables. If T is a countable set, say T={0,1,2, …
The countable character of uncountable graphs François Laviolette Barbados 2003.
15-853Page :Algorithms in the Real World Error Correcting Codes III (expander based codes) – Expander graphs – Low density parity check (LDPC) codes.
Some Computation Problems in Coding Theory
Expander graphs – a ubiquitous pseudorandom structure (applications & constructions) Avi Wigderson IAS, Princeton Monograph: [Hoory, Linial, W. 2006] “Expander.
Spectral Partitioning: One way to slice a problem in half C B A.
The zigzag product, Expander graphs & Combinatorics vs. Algebra Avi Wigderson IAS, Princeton ’00 Reingold, Vadhan, W. ’01 Alon, Lubotzky, W. ’01 Capalbo,
The sum-product theorem and applications Avi Wigderson School of Mathematics Institute for Advanced Study.
Presented by Alon Levin
Almost SL=L, and Near-Perfect Derandomization Oded Goldreich The Weizmann Institute Avi Wigderson IAS, Princeton Hebrew University.
1 Entropy Waves, The Zigzag Graph Product, and New Constant-Degree Expanders Omer Reingold Salil Vadhan Avi Wigderson Lecturer: Oded Levy.
Expanders and Ramanujan Graphs Mike Krebs, Cal State LA For slideshow: click “Research and Talks” from
1 IAS, Princeton ASCR, Prague. The Problem How to solve it by hand ? Use the polynomial-ring axioms ! associativity, commutativity, distributivity, 0/1-elements.
Coding, Complexity and Sparsity workshop
Exercises set #1 The notation refers to the lecture slides.
Structural Properties of Low Threshold Rank Graphs
Complexity of Expander-Based Reasoning and the Power of Monotone Proofs Sam Buss (UCSD), Valentine Kabanets (SFU), Antonina Kolokolova.
Expanders, groups and representations
Probabilistic existence of regular combinatorial objects
The Zig-Zag Product and Expansion Close to the Degree
The Weizmann Institute
Zeev Dvir (Princeton) Shachar Lovett (IAS)
Presentation transcript:

The zigzag product, Expander graphs & Combinatorics vs. Algebra Avi Wigderson IAS & Hebrew University ’00 Reingold, Vadhan, W. ’01 Alon, Lubotzky, W. ’01 Capalbo, Reingold, Vadhan, W. ’02 Meshulam, W.

Expanding Graphs - Properties Combinatorial: no small cuts, high connectivity Probabilistic: rapid convergence of random walk Algebraic: small second eigenvalue Theorem. [C,T,AM,A,JS] All properties are equivalent!

Expanders - Definition Undirected, regular (multi)graphs. Definition. The 2 nd eigenvalue of a d-regular G Definition. {G i } is an expander family if (G i )   <1 Theorem [P] Most 3-regular graphs are expanders. Challenge: Explicit (small degree) expanders! G is [n,d]-graph: n vertices, d-regular G is [n,d,  ]-graph: (G)  . (G)  [0,1] (G) = max { || (A G /d) v || : ||v||=1, v  1 }

Applications of Expanders In CS Derandomization Circuit Complexity Error Correcting Codes … Computational Information Approximate Counting Communication Networks

Applications of Expanders In Pure Math Graph Theory - … Group Theory – generating random gp elements [Ba,LP] Number Theory – Thin Sets [AIKPS] Measure Theory – Ruziewicz Problem [D,LPS], F-spaces [KR] Topology – expanding manifolds [Br,G] …

Algebraic explicit constructions [M,GG,AM,LPS,L,…] Many such constructions are Cayley graphs. A a finite group, S a set of generators. Def. C(A,S) has vertices A and edges (a, as) for all a  A, s  S  S -1. Theorem. [L] C(A,S) is an expander family. Proof: “The mother group approach”: - Use SL 2 (Z) to define a manifold N. - Bound the e-value of (the Laplacian of) N [Sel] - Show that the above graphs “well approximate” N. Works with any finite generating set, other groups, group actions… Theorem. [LPS,M] Optimal d (G) = 2  (d-1) [AB] A = SL 2 (p) : group 2 x 2 matrices of det 1 over Z p. S = { M 1, M 2 } : M 1 = ( ), M 2 = ( )

Is expantion a group property? A constant number of generators. Annoying questions:  non-expanding generators for SL 2 (p)?  Expanding generators for the family S n ?  expanding generators for Z n ? No! [K] Basic question [LW]: Is expansion a group property? Is C(G i,S i ) an expander family if C(G i,S i ’) is? Theorem. [ALW] No!! Note: Easy for nonconstant number of generators: C(F 2 m,{e 1, e 2, …,e m }) is not an expander (This is just the Boolean cube) But  v 1,v 2, …,v 2m for which C(F 2 m,{v 1,v 2, …,v 2m }) is an expander (This is just a good linear error-correcting code)

Explicit Constructions (Combinatorial) -Zigzag Product [RVW] G an [n, m,  ]-graph. H an [m, d,  ]-graph. Combinatorial construction of expanders. H v-cloud Edges in clouds between clouds v u u-cloud (v,k)(v,k) Theorem. [RVW] G z H is an [nm,d+1,f( ,  )]-graph, and  <1,  <1  f( ,  )<1. Definition. G z H has vertices {(v,k) : v  G, k  H}. G z H is an expander iff G and H are.

Example G=B 2 m, the Boolean m-dim cube ([2 m,m]-graph). H=C m, the m-cycle ([m,2]-graph). m=3 G z H is the cube-connected-cycle ([m2 m,3]-graph)

Iterative Construction of Expanders G an [n,m,  ]-graph. H an [m,d,  ] -graph. Proof: Follows simple information theoretic intuition. The construction: Start with a constant size H a [d 4,d,1/4]-graph. G 1 = H 2 Theorem. [RVW] G k is a [d 4k, d 2, ½]-graph. Proof: G k 2 is a [d 4k,d 4, ¼]-graph. H is a [d 4, d, ¼]-graph. G k+1 is a [d 4(k+1), d 2, ½]-graph. A stronger product z’ : Theorem. [RVW] G z’ H is an [nm,d 2,  +  ]-graph. G k+1 = G k 2 z’ H

Beating e-value expansion In the following a is a large constant. Task: Construct an [n,d]-graph s.t. every two sets of size n/a are connected by an edge. Minimize d Ramanujan graphs: d=  (a 2 ) Random graphs: d=O(a log a) Zig-zag graphs: [RVW] d=O(a(log a) O(1) ) Uses zig-zag product on extractors!

Lossless expanders [CRVW] Task: Construct an [n,d]-graph in which every set of size at most n/a expands by a factor c. Maximize c. Upper bound: c  d Ramanujan graphs: [K] c  d/2 Random graphs: c  (1-  )d Lossless Zig-zag graphs: [CRVW] c  (1-  )d Lossless Use zig-zag product on conductors!! Extends to unbalanced bipartite graphs. Applications (where the factor of 2 matters): Data structures, Network routing, Error-correcting codes

Error Correcting Codes [Shannon, Hamming] C: {0,1} k  {0,1} n C=Im(C) Rate (C) = k/n Dist (C) = min d(C(x),C(y)) C good if Rate (C) =  (1), Dist (C) =  (n) Find good, explicit, efficient codes. Graph-based codes [G,M,T,SS,S,LMSS,…] z  C iff Pz=0 C is a linear code Trivial Rate (C)  k/n, Encoding time = O(n 2 ) G lossless  Dist (C) =  (n), Decoding time = O(n) n n-k z Pz

Decoding Thm [CRVW] Can explicitly construct graphs: k=n/2, bottom deg = 10,  B  [n], |B|  n/200, |  (B)|  9|B| B = set of corrupted positions |B|  n/200 B’ = set of corrupted positions after flip Decoding alg [SS]: while Pw  0 flip all w i with i in FLIP = { i :  (i) has more 1’s than 0’s } Claim [SS] : |B’|  |B|/2 Proof: |B \ FLIP |  |B|/4, |FLIP \ B |  |B|/4 n n-k w Pw

Semi-direct Product of groups A, B groups. B acts on A as automorphisms. Let a b denote the action of b on a. Definition. A  B has elements {(a,b) : a  A, b  B}. group mult (a’,b’) (a,b) = (a’a b, b’b) Main Connection Assume = B, = A, S = s B (S is a single B-orbit) Large expanding Cayley graphs from small ones. Proof: (of Thm) (a,b)(1,t) = (a,bt) (Step in a cloud) (a,b)(s,1) = (as b,b) (Step between clouds) Extends to more orbits Theorem [ALW] C(A x B, {s}  T ) = C (A,S ) z C (B,T )

Example A=F 2 m, the vector space, S={e1, e2, …, em}, the unit vectors B=Z m, the cyclic group, T={1}, shift by 1 B acts on A by shifting coordinates. S=e 1 B. G =C(A,S), H = C(B,T), and Expansion is not a group property! [ALW] C(A, e 1 B ) is not an expander. C(A, u B  v B ) is an expander for most u,v  A. [MW] C(A x B, {e1 }  {1 } ) is not an expander. C(A x B, {u B  v B }  {1 } ) is an expander (almost…) G z H = C(A x B, {e 1 }  {1 } )

Dimensions of Representations in Expanding Groups [MW] G naturally acts on F q G (|G|,q)=1 Assume: G is expanding Want: G x F q G expanding Lemma. If G is monomial, so is G x F q G F q G expands with constant many orbits Thm 1  G has at most exp(d) irreducible reps of dimension d. G is expanding and monomial. Thm 2 

Iterative construction of near-constant degree expanding Cayley graphs Iterate: G’ = G x F q G Start with G 1 = Z 3 Get G 1, G 2,…, G n,… S 1, S 2,…, S n,… = G n Theorem. [MW] (C(G n, S n ))  ½ (expanding Cayley graphs) |S n |  O(log (n/2) |G n |) (deg “approaching” constant) Theorem [LW] This is tight!

Open Questions  Expanding Cayley graphs of constant degree “from scratch”.  Construct expanding generators with few orbits (= highly symmetric linear codes) - In other group actions. - Explicit instead of probabilistic.  Prove or disprove: every expanding group G has < exp (d) I irreducuble representations of dimension d.  Are SL 2 (p) always expanding?  Are S n never expanding?  Explicit undirected, const degree, lossless expanders