Undirected ST-Connectivity In Log Space

Slides:



Advertisements
Similar presentations
Walk the Walk: On Pseudorandomness, Expansion, and Connectivity Omer Reingold Weizmann Institute Based on join works with Michael Capalbo, Kai-Min Chung,
Advertisements

Pseudorandom Walks: Looking Random in The Long Run or All The Way? Omer Reingold Weizmann Institute.
Undirected ST-Connectivity in Log-Space Omer Reingold Weizmann Institute.
1 NP-Complete Problems. 2 We discuss some hard problems:  how hard? (computational complexity)  what makes them hard?  any solutions? Definitions 
Theory of Computing Lecture 16 MAS 714 Hartmut Klauck.
Complexity 12-1 Complexity Andrei Bulatov Non-Deterministic Space.
Complexity 15-1 Complexity Andrei Bulatov Hierarchy Theorem.
(Omer Reingold, 2005) Speaker: Roii Werner TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A AA A A A A AA A.
Undirected ST-Connectivity in Log-Space Author: Omer Reingold Presented by: Yang Liu.
1 Mazes In The Theory of Computer Science Dana Moshkovitz.
Undirected ST-Connectivity 2 DL Omer Reingold, STOC 2005: Presented by: Fenghui Zhang CPSC 637 – paper presentation.
EXPANDER GRAPHS Properties & Applications. Things to cover ! Definitions Properties Combinatorial, Spectral properties Constructions “Explicit” constructions.
Undirected ST-Connectivity in Log-Space By Omer Reingold (Weizmann Institute) Year 2004 Presented by Maor Mishkin.
Derandomizing LOGSPACE Based on a paper by Russell Impagliazo, Noam Nissan and Avi Wigderson Presented by Amir Rosenfeld.
2-Layer Crossing Minimisation Johan van Rooij. Overview Problem definitions NP-Hardness proof Heuristics & Performance Practical Computation One layer:
Zig-Zag Expanders Seminar in Theory and Algorithmic Research Sashka Davis UCSD, April 2005 “ Entropy Waves, the Zig-Zag Graph Product, and New Constant-
Expanders Eliyahu Kiperwasser. What is it? Expanders are graphs with no small cuts. The later gives several unique traits to such graph, such as: – High.
Complexity 1 Mazes And Random Walks. Complexity 2 Can You Solve This Maze?
Complexity ©D.Moshkovitz 1 Paths On the Reasonability of Finding Paths in Graphs.
Undirected ST-Connectivity In Log Space
Undirected ST-Connectivity In Log Space Omer Reingold Slides by Sharon Bruckner.
1 Entropy Waves, The Zigzag Graph Product, and New Constant-Degree Expanders Omer Reingold Salil Vadhan Avi Wigderson Lecturer: Oded Levy.
Randomized Algorithms Morteza ZadiMoghaddam Amin Sayedi.
Theory of Computing Lecture 15 MAS 714 Hartmut Klauck.
Lecture 22 More NPC problems
CSC 413/513: Intro to Algorithms NP Completeness.
Markov Chains and Random Walks. Def: A stochastic process X={X(t),t ∈ T} is a collection of random variables. If T is a countable set, say T={0,1,2, …
Graph Colouring L09: Oct 10. This Lecture Graph coloring is another important problem in graph theory. It also has many applications, including the famous.
NP-COMPLETE PROBLEMS. Admin  Two more assignments…  No office hours on tomorrow.
NP-Complete problems.
Artur Czumaj DIMAP DIMAP (Centre for Discrete Maths and it Applications) Computer Science & Department of Computer Science University of Warwick Testing.
Given this 3-SAT problem: (x1 or x2 or x3) AND (¬x1 or ¬x2 or ¬x2) AND (¬x3 or ¬x1 or x2) 1. Draw the graph that you would use if you want to solve this.
The NP class. NP-completeness Lecture2. The NP-class The NP class is a class that contains all the problems that can be decided by a Non-Deterministic.
1 Entropy Waves, The Zigzag Graph Product, and New Constant-Degree Expanders Omer Reingold Salil Vadhan Avi Wigderson Lecturer: Oded Levy.
Space Complexity Guy Feigenblat Based on lecture by Dr. Ely Porat Complexity course Computer science department, Bar-Ilan university December 2008.
TU/e Algorithms (2IL15) – Lecture 10 1 NP-Completeness, II.
Hamiltonian Graphs Graphs Hubert Chan (Chapter 9.5)
The NP class. NP-completeness
Umans Complexity Theory Lectures
Lap Chi Lau we will only use slides 4 to 19
Markov Chains and Random Walks
Randomized Min-Cut Algorithm
Topics in Algorithms Lap Chi Lau.
Computability and Complexity
Markov Chains Mixing Times Lecture 5
Umans Complexity Theory Lectures
Algorithms and Networks
Algorithms and networks
HIERARCHY THEOREMS Hu Rui Prof. Takahashi laboratory
Structural Properties of Low Threshold Rank Graphs
Complexity of Expander-Based Reasoning and the Power of Monotone Proofs Sam Buss (UCSD), Valentine Kabanets (SFU), Antonina Kolokolova.
CS154, Lecture 16: More NP-Complete Problems; PCPs
Planarity Testing.
Enumerating Distances Using Spanners of Bounded Degree
Complexity 6-1 The Class P Complexity Andrei Bulatov.
Parameterised Complexity
Instructor: Shengyu Zhang
Algorithms and networks
Lectures on Graph Algorithms: searching, testing and sorting
CSE838 Lecture notes copy right: Moon Jung Chung
On the effect of randomness on planted 3-coloring models
Chapter 34: NP-Completeness
Great Theoretical Ideas In Computer Science
CS154, Lecture 16: More NP-Complete Problems; PCPs
CSE 589 Applied Algorithms Spring 1999
The Greedy Approach Young CS 530 Adv. Algo. Greedy.
Richard Anderson Winter 2019 Lecture 5
CS151 Complexity Theory Lecture 5 April 16, 2019.
Concepts of Computation
CS151 Complexity Theory Lecture 4 April 8, 2004.
Presentation transcript:

Undirected ST-Connectivity In Log Space Omer Reingold Slides by Sharon Bruckner

Today Some history What are we adding to the mix? In conclusion Connectivity in expanders Making expanders: powering it up and cutting it down Putting it together in Log-Space In conclusion

What is ST-Connectivity? For an instance (G,s,t) YES if there is a s-t path in graph G NO otherwise Two flavors : STCON: G is directed USTCON G is undirected. Today we’ll talk about USTCON Less text

What do we know about it? Solved easily with BFS But – polynomial space! USTCON is in NL (=NSPACE(log)) Just guess the path USTCON is in DSPACE(log2n) (Savitch) Guess a vertex on the path, recurse USTCON is complete for SL USTCON is in RL Random walk Randomness is a resource! Too busy? Remove explanations?

What are we trying to accomplish? We would like an algorithm for USTCON which is deterministic and works in space logarithmic in the size of the graph

Bits N’ Pieces The adjacency matrix of a graph G We’ll use D regular graphs and the normalized adjancecy matrix: (1/D)M ,

Bits N’ Pieces M is a stochastic matrix, the “random walk” matrix. Largest eigenvalue of M is 1, with eigenvector (1,1,…,1)єRn ,2nd largest eigenvalue is λ(G). Define (N,D,λ) : a D regular graph over N vertices with λ(G) ≤ λ

Expanders – a Reminder Two equivalent definitions of expander (N,D, λ) is an expander iff the spectral gap, 1- λ > 0 (N,D, λ) is an expander if ε>0 s.t. for , at least (1+ ε)|S| vertices of G are connected to some vertex in S.

Expanders – a Reminder If there are c|S| edges out of S: Check with Oded

Connectivity in Expanders What would happen if each connected component of our graph was an expander? We could decide USTCON in logspace!

Every expander has a O(log(N)) diameter Theorem: For any s and t in an expander, there’s a path from s to t of length O(log(N))

Proof

Logspace Algorithm for paths in an expander For (N,D, λ) there is a a space O(logD·logN) algorithm which decides USTCON. Idea: From any vertex s there are Dl=O(logN) different paths. enumerate and check if any of them reach t.

How much does it cost? At each vertex we have a choice of D vertices, log(D) to represent 1…D. Each path is log(N) long. Need log(D) at each stage of a log(N) path, altogether O(logD·logN)

So far We now know that if our graph G was an expander graph, USTCON can be solved in Log-Space. How can we turn G into a graph of expanders?

What do we want from the expander graph G’? There is an s-t path in G iff there is an s’-t’ path in G’. Each connected component is an expander, with constant expansion Construction in Log-Space. 1. Say its’ a reduction.

The Plan New tools for our toolbox The actual construction Rotation Maps Powering Zig Zag products The actual construction Why we got what we wanted Why we got it in Log-Space הרכבה של Logspace אפשרק לעשות ב Logspace

Overview Series of powering by 8 and zig zag products, one increases the spectral gap and the other one decreases it, but not by much. 8 Zig Zag Powering Say that it can all be done in logspace. Fix animation O(Log(N))

Rotation Maps G is D regular, undirected. The rotation map Graph representation we’ll use G is D regular, undirected. The rotation map If the edge (v,w) exists and is the ith edge coming out of v and the jth edge coming out of w

Rotation Map Example … … v … … u 28 17 3 2 4 1 1 2 3 4 54 54 55 55 Draw this on the board, too?

Powering No limitations on the degree → can expenderize with powering: The k-th power of the D-regular graph G is Gk where there is an edge (u,v) iff there is a path of length k between u and v in G. I get a clique if I raise by N. Mention it’s a multigraph. (make sure I get this really down) (add self loops) Not sure about my explanation of the definition with the Rot. Probably need example here, too. Talk about why it’s an expander and why the degree is not constant. Powering improves the 2nd eigenvalue (makes it smaller) =k

Powering What is it good for? GN is an N-clique an expander If G = (N,D, λ) then Gk is a (N,Dk, λk) λ(G) The spectral gap Why is this not enough? How do I work with multi-graphs? This is not enough because the degree is not constant?

Zig Zag Product If G is a D-regular graph with N vertices and H is a d-regular graph with D vertices, replace each v in G with a copy of H, Hv. Our new graph has [N]x[D] vertices. v is now Hv Part of G v H

Zig-Zag Product The resulting graph is a d2 regular graph, with edges as follows: v a’ Hv a a’ i i’ b’ b’ G w Hw b j j’ G Z H a b i j Change direction of diagonals in squares.

The zig-zag product doesn’t hurt the spectral gap too badly! Lemma: If G is an (N,D,λ) graph and H is a (D,d,) graph: Look it up in Reingold’s other article The zig-zag product doesn’t hurt the spectral gap too badly!

Question Is a connected component in G a connected component in G z H ?

Rotation Map for Powering u w v G 3 12 5 8 u w G2 3,5 8,12 u w … a1 a2 ak b1 b(k-1) bk G u w a1,..,ak bk,..,b1 Gk 3,5 8, 12

Rotation Map for ig ag G Rot ((v,a), (i,j)) = Hv (v,a) (v,a’) i i’ v G z G H a’ b’ G w Hw j j’ (w,b’) (w,b) On the board.

The Actual Construction Show a transformation that turns every connected component of a graph into an expander. But! Not any graph, but a D16 regular graph. How to construct such a graph - later Add drawing (?)

Gi is a D16 regular graph, with N*(D16)i vertices Main Transformation On input G and H, where G is a D16 regular graph on N vertices, and H is a D-regular graph on D16 vertices Say that all this happens in logspace Gi is a D16 regular graph, with N*(D16)i vertices

Technical Lemma For D-reg, connected, non-bipartite G on [N] Proof:

Details Set l to be the smallest integer s.t. If D is constant, then this number is O(logN). Transforming the entire graph is equivalent to transforming each connected component separately Need to introduce lemma before first bullet

 More Details    S2 S3 S1 S2 S3 S1 Make sure I can explain this well S1 

Why ? Show that this is true for a single iteration. Both powering and zig zag maintain the block structure Powering: block matrix remains the same Zig Zag: for reasons I explained before Adjacency matrix sorted by connected components

Why is this an expander? G and H are inputs of  above. If and G is connected and non-bipartite then Which means that the output of  is indeed an expander.

Proof G0=G, connected and non-bipartite, It’s enough to show and from the lemma we get Do I need to prove the “known fact”? Have it in Eli’s lecture (the first inequality) Add the z between.

Proof Continued Recall: if G = (N,D,λ) then Gt = (N,Dt,λt) = We can bound λ(Gi) by For each i, one of two cases occurs: Otherwise, it’s always true that Need to show that property of powering? Need to show “elementary calculation”

What do we want from the expander graph G’? There is an s-t path in G iff there is an s’-t’ path in G’. Each connected component is an expander. Construction in Log-Space.

Log Space Construction Prove that for any D,  can be calculated in space O(log(N)). RotG RotH Input Tape Rewrite what we’re going to prove Output Tape

The Work Tape v a Build this on the board

A step in H Use the last vertex of H and the first instruction This is the direction! Use the last vertex of H and the first instruction

A step in Gl-1 Use the same variables for the recursion!

Another Step in H Use the next instruction and the new vertex to finish the zig zag The next instruction

All Together Repeat 8 times to get powering 8

Why is this LogSpace? Idea: All evaluations are done in place. We use the same l+1 variables. v O(logN) ai O(log(D16)) = const counters O(logN) Is this constant?

Vertex v cycle length N. Add self loops as needed O(logN) Convert G into a D16 regular graph Transform into an expander graph with  Enumerate all Dl paths Check for path between (s,1…1) and (t,1…1)

To Conclude Composition of a Constant number of logspace machines is in logspace, We decide USTCON in logspace!