Randomized Algorithms for Cuts and Colouring David Pritchard, NSERC Post-doctoral Fellow.

Slides:



Advertisements
Similar presentations
Lower Bounds for Additive Spanners, Emulators, and More David P. Woodruff MIT and Tsinghua University To appear in FOCS, 2006.
Advertisements

Iterative Rounding and Iterative Relaxation
The Primal-Dual Method: Steiner Forest TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A AA A A A AA A A.
C&O 355 Lecture 23 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
C&O 355 Mathematical Programming Fall 2010 Lecture 22 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
Approximations of points and polygonal chains
Chapter 15 Basic Asynchronous Network Algorithms
Lecture 7: Synchronous Network Algorithms
Approximating the Domatic Number Feige, Halldorsson, Kortsarz, Srinivasan ACM Symp. on Theory of Computing, pages , 2000.
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
Distributed Message Passing for Large Scale Graphical Models Alexander Schwing Tamir Hazan Marc Pollefeys Raquel Urtasun CVPR2011.
Graph Sparsifiers by Edge-Connectivity and Random Spanning Trees Nick Harvey University of Waterloo Department of Combinatorics and Optimization Joint.
Approximation Algorithms: Combinatorial Approaches Lecture 13: March 2.
Semidefinite Programming
CPSC 689: Discrete Algorithms for Mobile and Wireless Systems Spring 2009 Prof. Jennifer Welch.
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
Approximation Algorithm: Iterative Rounding Lecture 15: March 9.
Perfect Graphs Lecture 23: Apr 17. Hard Optimization Problems Independent set Clique Colouring Clique cover Hard to approximate within a factor of coding.
AT&T Labs1 The Sensor Cover Problem Alon Efrat (U. Arizona) Adam Buchsbaum (AT&T Labs) Shaili Jain (Harvard) Suresh Venkatasubramanian (AT&T Labs) Ke Yi.
An Approximation Algorithm for Requirement cut on graphs Viswanath Nagarajan Joint work with R. Ravi.
On the Crossing Spanning Tree Vineet Goyal Joint work with Vittorio Bilo, R. Ravi and Mohit Singh.
Job Scheduling Lecture 19: March 19. Job Scheduling: Unrelated Multiple Machines There are n jobs, each job has: a processing time p(i,j) (the time to.
1 University of Denver Department of Mathematics Department of Computer Science.
1 Introduction to Approximation Algorithms Lecture 15: Mar 5.
(work appeared in SODA 10’) Yuk Hei Chan (Tom)
Antimagic Labellings of Graphs Torsten Mütze Joint work with Dan Hefetz and Justus Schwartz.
Packing Element-Disjoint Steiner Trees Mohammad R. Salavatipour Department of Computing Science University of Alberta Joint with Joseph Cheriyan Department.
CPSC 689: Discrete Algorithms for Mobile and Wireless Systems Spring 2009 Prof. Jennifer Welch.
Dana Moshkovitz, MIT Joint work with Subhash Khot, NYU.
C&O 355 Mathematical Programming Fall 2010 Lecture 17 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
C&O 355 Lecture 2 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
David Pritchard Princeton Computer Science Department & Béla Bollobás, Thomas Rothvoß, Alex Scott.
Complexity Theory Lecture 2 Lecturer: Moni Naor. Recap of last week Computational Complexity Theory: What, Why and How Overview: Turing Machines, Church-Turing.
Correlation testing for affine invariant properties on Shachar Lovett Institute for Advanced Study Joint with Hamed Hatami (McGill)
Approximation Algorithms for Stochastic Combinatorial Optimization Part I: Multistage problems Anupam Gupta Carnegie Mellon University.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
Graph Sparsifiers Nick Harvey University of British Columbia Based on joint work with Isaac Fung, and independent work of Ramesh Hariharan & Debmalya Panigrahi.
Equality Function Computation (How to make simple things complicated) Nitin Vaidya University of Illinois at Urbana-Champaign Joint work with Guanfeng.
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
Edge-disjoint induced subgraphs with given minimum degree Raphael Yuster 2012.
Expanders via Random Spanning Trees R 許榮財 R 黃佳婷 R 黃怡嘉.
Graph Sparsifiers Nick Harvey Joint work with Isaac Fung TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
An algorithmic proof of the Lovasz Local Lemma via resampling oracles Jan Vondrak IBM Almaden TexPoint fonts used in EMF. Read the TexPoint manual before.
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
Theoretical Computer Science in a Nutshell David Pritchard CCC Second Stage 2008.
Implicit Hitting Set Problems Richard M. Karp Erick Moreno Centeno DIMACS 20 th Anniversary.
1 Design of LDPC codes Codes from finite geometries Random codes: Determine the connections of the bipartite Tanner graph by using a (pseudo)random algorithm.
Iterative Rounding in Graph Connectivity Problems Kamal Jain ex- Georgia Techie Microsoft Research Some slides borrowed from Lap Chi Lau.
C&O 355 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
ETH Zurich – Distributed Computing Group Stephan HolzerSODA Stephan Holzer Silvio Frischknecht Roger Wattenhofer Networks Cannot Compute Their Diameter.
The Message Passing Communication Model David Woodruff IBM Almaden.
Approximation Algorithms Greedy Strategies. I hear, I forget. I learn, I remember. I do, I understand! 2 Max and Min  min f is equivalent to max –f.
Introduction Wireless Ad-Hoc Network  Set of transceivers communicating by radio.
An algorithmic proof of the Lovasz Local Lemma via resampling oracles Jan Vondrak IBM Almaden TexPoint fonts used in EMF. Read the TexPoint manual before.
Honors Track: Competitive Programming & Problem Solving Seminar Topics Kevin Verbeek.
Theory of Computational Complexity Probability and Computing Chapter Hikaru Inada Iwama and Ito lab M1.
Stochastic Streams: Sample Complexity vs. Space Complexity
New Characterizations in Turnstile Streams with Applications
A Quantum Local Lemma Or Sattath TAU and HUJI Andris Ambainis
Approximating the MST Weight in Sublinear Time
A note on the Survivable Network Design Problem
MST in Log-Star Rounds of Congested Clique
Introduction Wireless Ad-Hoc Network
András Sebő and Anke van Zuylen
1.3 Modeling with exponentially many constr.
Flow Feasibility Problems
Lecture 19 Linear Program
Locality In Distributed Graph Algorithms
Presentation transcript:

Randomized Algorithms for Cuts and Colouring David Pritchard, NSERC Post-doctoral Fellow

What Can Randomness Do? Part 1: Check 3-edge-connectivity in a distributed network Joint with Ramakrishna Thurimella (Denver) Part 2: Find many disjoint set covers as a function of min degree Joint w/ Béla Bollobás (Cambridge & Memphis), Thomas Rothvoß (MIT), Alex Scott (Oxford)

Distributed Computation Vertices are computers that communicate using edges ♫ initially, local/no knowledge ♫ goal: compute global graph property

Distributed Computation Message passing happens in rounds ♫ time complexity: # rounds elapsed Diameter := maximum distance (# hops) between two nodes e.g., Diam = 5

Distributed Computation Message passing happens in rounds ♫ time complexity: # rounds elapsed Diameter := maximum distance (# hops) between two nodes ♫ if message lengths are unrestricted, we can compute anything in O(Diameter) rounds ♫ “ CONGEST ” model: limit message lengths to O(log |V|) bits

Known Time Complexities Synchronizer w/polylog overhead, AP’90 Breadth-first spanning tree: ♫ O(Diam) time ♫ “Universally optimal”

Known Time Complexities Synchronizer w/polylog overhead, AP’90 Breadth-first spanning tree: ♫ O(Diam) time ♫ “Universally optimal” Depth-first spanning tree: ♫ O(|V|) time; no good lower bound Min-cost spanning tree (KP’98, PR’99): ♫ O(√V log*V + Diam), Ω(√V/log V)

Main Result Distributed algorithm to check 3-edge- connectivity in O(Diam) time ♫ explicit: finds 2-edge-cuts ♫ application: reinforcement ♫ beats prior O(Diam+V 2 ); optimal Main tool: sample cycle space randomly

Main Tool: Cycle Space connected network/graph (V, E) ♫ (V, F) Eulerian if ∀ v, deg F (v) is even Cycle space := the vector space {F : (V, F) is Eulerian} ♫ notation abuse: F is a subset of E and also its characteristic vector ∈ {0, 1} E ♫ why is it a vector space? ♫ even deg. ⊕ even deg. ≡ even deg. ⊕ =

Random Sampling Claim: if T is a spanning tree, any 0-1 vector on E\T extends uniquely to an Eulerian subgraph F Corollary: sampling from the cycle space uniformly is as easy as sampling 2 E\T thick: T green: in F red: not in F grey: undecided

Cuts and Cycles Claim. |δ(S)∩F| is even for all Eulerian F ♫ use Euler tour(s)! Claim. Unless E’ = δ(S) for some S, for a random F from the cycle space, |E’ ∩ F| is even exactly ½ of the time.

Finding 2-Edge Cuts? 2 edges {e, e’} form a cut ♫ Implies transitivity: if {e, f} and {f, g} are 2-edge cuts, so is {e, g} ♫ Call equivalence classes “cut classes” some edges not in any 2-edge-cuts cut class ⇔ |{e, e’} ∩ F| even for all Eulerian F ⇔ e and e’ always both or neither in F

Algorithm for 2-Edge Cuts Set k = O(log |V|). Sample F 1, F 2,… F k from cycle space. Group equal rows and output them as cut classes. ♫ {e i, e j } is a 2-edge-cut ⇔ e i, e j have equal rows, with error probability 2 -k ♫ Pr[any error] ≤ |E| 2 2 -k = 1/poly(V) F 1 F 2 F 3 F 4 F 5 F 6 … … … … … ⋮ ⋮ ⋮ ⋮ ⋮ ⋮ e1e2e3e4e5e1e2e3e4e ⋮10110 ⋮

Questions ♫ Leads to O(Diam + Δ/log V)-time algorithm for cut vertices ♫ O(Diam + √V log*V) known before (Thurimella ’97) ♫ Is O(Diam) possible or not? ♫ Can this be derandomized? ♫ in a distributed way?

Festival Scheduling ♫ Set V of musicians, list of bands ⊆ V ♫ A schedule maps each band to a day ♫ Each musician must play every day ♫ What is max # days in schedule?

The Basic Question

cd: Cover-Decomposition Number

Cover-Decomposition in Graphs δ=2 cd=1 δ=3 cd=2 … δ=4 cd=3

Ground set = finite X ⊆ R d, edges = subsets of X covered by shapes Cover-Decomposition in Geometry

cd = Ω(δ) not cover-decomposable Translates of any convex polygon Translates of any non- convex quadrilateral Axis-aligned stripsAxis-aligned rectangles Halfspaces in 2DUnit strips in 2D 3D orthants4D orthants Cover-Decomposition in Geometry Do all hypergraph families* satisfy this dichotomy? [Pálvölgyi, Keszegh] * closed under edge deletion, duplication Conjecture [Pach, 1980]: ♫ for any fixed convex set S, there is δ S, so that hypergraphs with a finite ground set in R 2 and translates of S as edges, with δ ≥ δ S, have cd(H) ≥ 2. ♪ “The family is cover-decomposable.”

Our Results Hypergraphs with bounded edge size R ♫ cd ≳ δ/log R; this is tight Techniques: LLL, discrepancy, LPs Hypergraphs of paths in trees ♫ cd ≥ δ/5 Hypergraphs of VC-dimension ≤ D ♫ cover-decomposable only for D = 1 Goal: find out how cover-decomposition number (cd) depends on minimum degree (δ) in as many natural hypergraph families as possible.

Lovasz Local Lemma: There are any number of “bad” events, but each is independent of all but D others. ♫ LLL: If each bad event has individual probability at most 1/eD, then Pr[no “bad” events happen] > 0. Natural to try in our setting: randomly k-colour the edges /

Edge size ≤ R v SS\{v} →

Splitting the Hypergraph Ω(δ/log Rδ) is already Ω(δ/log R) if δ ≤ poly(R) ♫ Idea: partition edges to H 1,H 2,…,H M with δ(H i ) ≤ poly(R), δ(H i ) ~ δ(H)/M =Ω(δ(H)/M/log R) covers Ω(δ(H)/M/log R) covers M=3 ~δ/log R covers Ω(δ(H i )/log R) covers

Beck-Fiala 1981: there is an assignment with discrepancy ≤ 2R Iterated Pairwise Splitting

Beck-Fiala Algorithm LP variables: ∀ S: 0 ≤ x S = 1 - y S ≤ 1 ∀ v: Σ S:v ∈ S x S ≥ δ/2, Σ S:v ∈ S y S ≥ δ/2 1. find extreme point LP solution 2. “fix” variables with values 0 or 1 3. discard all constraints involving ≤ R non-fixed variables ♫ Termination lemma ♪ basis of tight degree constraints has size ≤ |H nonfixed |; each var is in ≤R constraints

Remarks Maximum edge size R: ♫ use better discrepancy bound to get right multiplicative constant ♫ Concentration/LLL instead of B-F cd ≥ δ /5 for paths in trees: ♫ B-F, different termination lemma ♪ linear independence of basis

Sparse Hypergraphs [Alon-Berke-Buchin 2 -Csorba-Shannigrahi-Speckmann-Zumstein] (α, β)-sparse hypergraph := incidences(U ⊆ V, F ⊆ H) ≤ α|U|+β|F| ♫ ⇔ : “α-vertex-sparse” incidences “β-edge-sparse” incidences ♫ idea: shrink off β-edge-sparse ones, obtaining cd ≳ (δ-α)/log β vertices hyperedges bipartite incidence graph ≤ α ≤ β

Cover Scheduling