1 Entropy Waves, The Zigzag Graph Product, and New Constant-Degree Expanders Omer Reingold Salil Vadhan Avi Wigderson Lecturer: Oded Levy.

Slides:



Advertisements
Similar presentations
Walk the Walk: On Pseudorandomness, Expansion, and Connectivity Omer Reingold Weizmann Institute Based on join works with Michael Capalbo, Kai-Min Chung,
Advertisements

A Combinatorial Construction of Almost-Ramanujan Graphs Using the Zig-Zag product Avraham Ben-Aroya Avraham Ben-Aroya Amnon Ta-Shma Amnon Ta-Shma Tel-Aviv.
10.4 Complex Vector Spaces.
1 Decomposing Hypergraphs with Hypertrees Raphael Yuster University of Haifa - Oranim.
Ch 7.7: Fundamental Matrices
Totally Unimodular Matrices
CHRISTOPHER M. P. TOMASZEWSKI 30 JULY MMIX A Spectral Analysis of Cyclic and Elementary Abelian Subgroup Lattices.
What are primes in graphs and how many of them have a given length? Audrey Terras Math. Club Oct. 30, 2008.
The Structure of Polyhedra Gabriel Indik March 2006 CAS 746 – Advanced Topics in Combinatorial Optimization.
Entropy Rates of a Stochastic Process
(Omer Reingold, 2005) Speaker: Roii Werner TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A AA A A A A AA A.
Eigenvalues and Eigenvectors
Undirected ST-Connectivity in Log-Space Author: Omer Reingold Presented by: Yang Liu.
Chapter 5 Orthogonality
Totally Unimodular Matrices Lecture 11: Feb 23 Simplex Algorithm Elliposid Algorithm.
Constant Degree, Lossless Expanders Omer Reingold AT&T joint work with Michael Capalbo (IAS), Salil Vadhan (Harvard), and Avi Wigderson (Hebrew U., IAS)
Undirected ST-Connectivity 2 DL Omer Reingold, STOC 2005: Presented by: Fenghui Zhang CPSC 637 – paper presentation.
Ch 7.3: Systems of Linear Equations, Linear Independence, Eigenvalues
EXPANDER GRAPHS Properties & Applications. Things to cover ! Definitions Properties Combinatorial, Spectral properties Constructions “Explicit” constructions.
Undirected ST-Connectivity in Log-Space By Omer Reingold (Weizmann Institute) Year 2004 Presented by Maor Mishkin.
Zig-Zag Expanders Seminar in Theory and Algorithmic Research Sashka Davis UCSD, April 2005 “ Entropy Waves, the Zig-Zag Graph Product, and New Constant-
Dirac Notation and Spectral decomposition Michele Mosca.
Expanders Eliyahu Kiperwasser. What is it? Expanders are graphs with no small cuts. The later gives several unique traits to such graph, such as: – High.
Lecture 18 Eigenvalue Problems II Shang-Hua Teng.
Orthogonality and Least Squares
Ramanujan Graphs of Every Degree Adam Marcus (Crisply, Yale) Daniel Spielman (Yale) Nikhil Srivastava (MSR India)
Undirected ST-Connectivity In Log Space
Dirac Notation and Spectral decomposition
Undirected ST-Connectivity In Log Space Omer Reingold Slides by Sharon Bruckner.
Correlation. The sample covariance matrix: where.
Stats & Linear Models.
Network Measures Social Media Mining. 2 Measures and Metrics 2 Social Media Mining Network Measures Klout.
5.1 Orthogonality.
5  Systems of Linear Equations: ✦ An Introduction ✦ Unique Solutions ✦ Underdetermined and Overdetermined Systems  Matrices  Multiplication of Matrices.
Orthogonal Matrices and Spectral Representation In Section 4.3 we saw that n  n matrix A was similar to a diagonal matrix if and only if it had n linearly.
Final Exam Review II Chapters 5-7, 9 Objectives and Examples.
1 February 24 Matrices 3.2 Matrices; Row reduction Standard form of a set of linear equations: Chapter 3 Linear Algebra Matrix of coefficients: Augmented.
Wei Wang Xi’an Jiaotong University Generalized Spectral Characterization of Graphs: Revisited Shanghai Conference on Algebraic Combinatorics (SCAC), Shanghai,
Physical Mapping of DNA Shanna Terry March 2, 2004.
CHAPTER FIVE Orthogonality Why orthogonal? Least square problem Accuracy of Numerical computation.
CS774. Markov Random Field : Theory and Application Lecture 08 Kyomin Jung KAIST Sep
Cryptographic hash functions from expander graphs Denis Charles, Microsoft Research Eyal Goren, McGill University Kristin Lauter, Microsoft Research ECC.
Edge-disjoint induced subgraphs with given minimum degree Raphael Yuster 2012.
1 Chapter 5 – Orthogonality and Least Squares Outline 5.1 Orthonormal Bases and Orthogonal Projections 5.2 Gram-Schmidt Process and QR Factorization 5.3.
Computing Eigen Information for Small Matrices The eigen equation can be rearranged as follows: Ax = x  Ax = I n x  Ax - I n x = 0  (A - I n )x = 0.
Chapter 5 Eigenvalues and Eigenvectors 大葉大學 資訊工程系 黃鈴玲 Linear Algebra.
Vector Norms and the related Matrix Norms. Properties of a Vector Norm: Euclidean Vector Norm: Riemannian metric:
Elementary Linear Algebra Anton & Rorres, 9th Edition
11/6/20151 ENM 503Linear Algebra Review 1. u = (2, -4, 3) and v = (-5, 1, 2). u + v = (2-5, -4+1, 3 +2) = (-3, -3, 5). 2u = (4, -8, 6); -v = (5, -1, -2);
15-853:Algorithms in the Real World
Spectral Sequencing Based on Graph Distance Rong Liu, Hao Zhang, Oliver van Kaick {lrong, haoz, cs.sfu.ca {lrong, haoz, cs.sfu.ca.
Elementary Linear Algebra Anton & Rorres, 9 th Edition Lecture Set – 07 Chapter 7: Eigenvalues, Eigenvectors.
Mathematical Tools of Quantum Mechanics
Complexity and Efficient Algorithms Group / Department of Computer Science Testing the Cluster Structure of Graphs Christian Sohler joint work with Artur.
4.8 Rank Rank enables one to relate matrices to vectors, and vice versa. Definition Let A be an m  n matrix. The rows of A may be viewed as row vectors.
Presented by Alon Levin
5 5.1 © 2016 Pearson Education, Ltd. Eigenvalues and Eigenvectors EIGENVECTORS AND EIGENVALUES.
(CSC 102) Lecture 30 Discrete Structures. Graphs.
Matrices. Matrix - a rectangular array of variables or constants in horizontal rows and vertical columns enclosed in brackets. Element - each value in.
Theory of Computational Complexity Probability and Computing Ryosuke Sasanuma Iwama and Ito lab M1.
1 Entropy Waves, The Zigzag Graph Product, and New Constant-Degree Expanders Omer Reingold Salil Vadhan Avi Wigderson Lecturer: Oded Levy.
Matrix Representation of Graphs
Coding, Complexity and Sparsity workshop
5 Systems of Linear Equations and Matrices
Distinct Distances in the Plane
Degree and Eigenvector Centrality
Complexity of Expander-Based Reasoning and the Power of Monotone Proofs Sam Buss (UCSD), Valentine Kabanets (SFU), Antonina Kolokolova.
Undirected ST-Connectivity In Log Space
Great Theoretical Ideas In Computer Science
ENM 500 Linear Algebra Review
Presentation transcript:

1 Entropy Waves, The Zigzag Graph Product, and New Constant-Degree Expanders Omer Reingold Salil Vadhan Avi Wigderson Lecturer: Oded Levy

2 Introduction Most random constant degree graphs are good expanders. Most applications need explicit constructions. This lecture deals with the Zigzag product which is used in order to explicitly build expanders.

3 The zigzag product G A = (N A, D A, λ A ), G B = (D A, D B, λ B ). We define their zigzag product as a graph which Its vertices are N A × N B (each vertex is represented as a pair (v, u) such that v  N A and u  N B. For each vertex (v, k) we put an edge between a pair (v, k) to (v[k[i]], k[i][j]).

4 Example

5

6 We can separate it to three steps: Move from one vertex to another vertex at the same cloud. Jump between clouds. Move from one vertex to another vertex at the same cloud

7 Theorem G = G A Z G B = (N A × D A, D B 2, f(λ A, λ B )). f(λ A’ λ B ) ≤ λ A + λ B + λ B 2. λ A, λ B < 1→ f(λ A, λ B ) < 1. We know that. We aim to show that for each

8 Why does it work? Given a distribution vector π over G ’s vertices, we distinguish between two cases of π :  uniform within clouds.  non-uniform within clouds. We aim to show that after one step in G, π becomes more uniform.

9 Step 2 is a random walk on G A.Step 3 is a random walk on G B.  uniform within clouds. Step 1 does not change anything.

10 Step 1 is a random walk on G B.Step 2 is a permutation.Step 3 is a random step on a regular graph.  non-uniform within clouds.

11 Proof Let M be G ’s normalized adjacency matrix. We’ll decompose M into three matrices, corresponding to three steps as defined before. Then is a normalized matrix where we connect vertices within each cloud. is a normalized matrix where we connect clouds.

12 The relation between and B is The relation between and A will be defined later.

13 Decomposing α

14 Recall that we want to bound Since G B is a regular graph, (1, 1, …, 1) is an eigenvector of B with eigenvalue 1,

15

16 Thus Combining it with previous results our expression becomes Opening the inner product we get

17 Using triangular inequality we get Since à is a permutation matrix, it is unitary thus preserves length Using Cauchy-Schwartz inequality

18 We’ll first bound. Decomposing α  to its components we have By the expansion of G B we get Thus

19 For our analysis we’ll define linear map C such that:

20

21 It is easy to see that In addition

22 Now we’ll bound. We’ll first relate A to Ã. Claim:

23

24 Hence Since Cα is orthogonal to Combining these claims we have

25 pq gets maximum value of ½ (when), thus

26 It remains to show that if both λ 1 and λ 2 are smaller than 1, f(λ 1,λ 2 ) is also smaller than 1. Case I

27 Case II

28 Finally

29 We can show that we the bound may be reduced to f(λ, 0)= f(0, λ)=0 f(λ, 1)= f(1, λ)=1 f is strictly increasing in both λ 1 and λ 2. If λ 1 <1 and λ 2 <1 then f(λ 1, λ 2 )<1. f(λ 1, λ 2 )≤ λ 1 + λ 2

30 Families of expanders In this section we’ll introduce two families of expanders: Basic construction More efficient construction

31 Basic family construction Let H = (D 4, D, 1/5). We build a family of graph in the following way: G 1 = H 2 G i+1 = G i 2 Z H G i is an infinite family of expanders such that G i = (D 4i, D 2, 2/5)

32 Vertices. Degree. Expansion Bounded by 2/5 since the limit of the series λ n = λ 2 n-1 + 6/25 is 2/5.

33 More efficient construction We use tensoring in order to make the construction in more efficient by reducing the depth of the recursion. Let H = (D 8, D, λ). For every t we define

34 For each t ≥ 0, G t = (D 8t, D 2, λ t ) such that λ t = λ + O(λ 2 ). Vertices. Degree. Expansion Let μ t = max{λ i | 1 ≤ i ≤ t}. We have μ t = max{μ t-1, μ t λ + λ 2 }. Solving this yields μ t < λ + O(λ 2 ).

35 Can we do better? The best possible 2 nd largest eigenvalues of infinite families of graph is 2(D – 1) ½ / D. Ramanujan graphs meet this bound. In this section we’ll try to get closer to this bound.

36 Derandomizing the Zigzag product In order to improve the bound we’ll make two steps within the zig part and two steps within the zag part. In order to save on the degree, we’ll correlate the second part of the zig part and the first part of the zag part.

37 Example

38 We ’ ll map each step within each cloud to a step on other cloud. Given a step in the initial cloud and a target cloud, the permutation will return a step in the target cloud. We’ll use a matrix to represent this permutation.

39 Each edge on the improved Zigzag product can be separated into six steps: 1. Move one step within the first cloud. 2. Move one step within the first cloud. 3. Jump between clouds. 4. Move one step within the second cloud according to the step made in step Move one step within the second cloud.

40 Claim: A Z’ B = (N A D A, D B 3, λ A +2 λ B 2 ) Let B i a D A ×D A permutation matrix Note that the normalized adjacency matrix corresponding to steps 2-4 is Thus

41 B i is a permutation matrix thus We can now decompose M’α || Substitutting this in the formula we get that

42 All the eigenvalues of M’ are smaller than 1 since they are eigenvalues of an normalized adjacency matrix of an undirected regular graph. Thus M’ does not increase the length of any vector.

43 Using the same techniques from previous results we get the desired result.

44 The affine plane Consider field F q such that q = p t for some prime number t. We define AF q be a F q × F q graph such that each vertex is a pair. We put an edge between (a, b) and (c, d) if and only if ac = b + d, i.e. we connect for all the points on the line y = ax - b.

45 Example (4, 4)(4, 3)(4, 2)(4, 1) (1, 4) (1, 3) (1, 2) (1, 1) (2, 1)(2, 2)(2, 3)(2, 4) (3, 1) (3, 2) (3, 3) (3, 4)

46 Lemma: AF q = (q 2, q, q -½ ). Proof : An entry in the square of the normalized adjacency matrix of AF q in row (a, b) and column (c, d) holds the number of common neighbors of (a, b) and (c, d). Since each vertex neighbor is a line, the common neighbors of (a, b) and (c, d) is |L a,b  L c,d | / q 2.

47 We distinguish between 3 cases: a ≠ c The two lines intersect in exactly one point. a = c and b ≠ d The two lines does not intersect. a = c and b = d The two lines intersect in exactly q points. Denote I q the identity matrix in size q Denote J q the all one’s matrix in size q

48 Obviously Since eigenvalues of J q are q (one time) and 0 ( q - 1 times), (J q - I q )  J q eigenvalues are q(q – 1), -q and 0. I q  q qI q contribute s q to each eigenvalue. Dividing it by q we get that M 2 eigenvalues are 1, 0 and 1/q, thus the 2 nd largest eigenvalue is q -1, and M’ s 2 nd largest eigenvalue is q -½.

49 Define the following graph family: (APq) 1 = (APq)  APq) (APq) i+1 = (APq) i Z (APq) Combining it with the previous theorem we get that (APq) i = (q 2(i+1), q 2, O(iq -½ ))