Algorithms to Approximately Count and Sample Conforming Colorings of Graphs Sarah Miracle and Dana Randall Georgia Institute of Technology (B,B)(B,B) (R,B)(R,B)

Slides:



Advertisements
Similar presentations
Slow and Fast Mixing of Tempering and Swapping for the Potts Model Nayantara Bhatnagar, UC Berkeley Dana Randall, Georgia Tech.
Advertisements

Clustering in Interfering Binary Mixtures Sarah Miracle, Dana Randall, Amanda Streib Georgia Institute of Technology.
Domino Tilings of the Chessboard An Introduction to Sampling and Counting Dana Randall Schools of Computer Science and Mathematics Georgia Tech.
Bart Jansen 1.  Problem definition  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least k leaves?
Gibbs sampler - simple properties It’s not hard to show that this MC chain is aperiodic. Often is reversible distribution. If in addition the chain is.
1 Partition Into Triangles on Bounded Degree Graphs Johan M. M. van Rooij Marcel E. van Kooten Niekerk Hans L. Bodlaender.
Bart Jansen, Utrecht University. 2  Max Leaf  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least.
Approximation Algorithms Chapter 28: Counting Problems 2003/06/17.
 Graph Graph  Types of Graphs Types of Graphs  Data Structures to Store Graphs Data Structures to Store Graphs  Graph Definitions Graph Definitions.
1 The Monte Carlo method. 2 (0,0) (1,1) (-1,-1) (-1,1) (1,-1) 1 Z= 1 If  X 2 +Y 2  1 0 o/w (X,Y) is a point chosen uniformly at random in a 2  2 square.
CS774. Markov Random Field : Theory and Application Lecture 17 Kyomin Jung KAIST Nov
Mixing Dana Randall Georgia Tech A tutorial on Markov chains ( Slides at: )
Approximate Counting via Correlation Decay Pinyan Lu Microsoft Research.
Complexity 16-1 Complexity Andrei Bulatov Non-Approximability.
Last time: terminology reminder w Simple graph Vertex = node Edge Degree Weight Neighbours Complete Dual Bipartite Planar Cycle Tree Path Circuit Components.
Why almost all k-colorable graphs are easy A. Coja-Oghlan, M. Krivelevich, D. Vilenchik.
On Approximating the Average Distance Between Points Kfir Barhum, Oded Goldreich and Adi Shraibman Weizmann Institute of Science.
UMass Lowell Computer Science Analysis of Algorithms Prof. Karen Daniels Fall, 2001 Wednesday, 9/26/01 Graph Basics.
Graph Colouring Lecture 20: Nov 25.
Structure and Phase Transition Phenomena in the VTC Problem C. P. Gomes, H. Kautz, B. Selman R. Bejar, and I. Vetsikas IISI Cornell University University.
Computability and Complexity 24-1 Computability and Complexity Andrei Bulatov Approximation.
CSE 421 Algorithms Richard Anderson Lecture 27 NP Completeness.
1 On the Computation of the Permanent Dana Moshkovitz.
Sampling and Approximate Counting for Weighted Matchings Roy Cagan.
Approximating The Permanent Amit Kagan Seminar in Complexity 04/06/2001.
Accelerating Simulated Annealing for the Permanent and Combinatorial Counting Problems.
Mixing Times of Markov Chains for Self-Organizing Lists and Biased Permutations Prateek Bhakta, Sarah Miracle, Dana Randall and Amanda Streib.
Mixing Times of Self-Organizing Lists and Biased Permutations Sarah Miracle Georgia Institute of Technology.
Coloring 3/16/121. Flight Gates flights need gates, but times overlap. how many gates needed? 3/16/122.
9.8 Graph Coloring. Coloring Goal: Pick as few colors as possible so that two adjacent regions never have the same color. See handout.
Algorithmic Game Theory and Internet Computing Vijay V. Vazirani Georgia Tech Dispelling an Old Myth about an Ancient Algorithm.
Counting Euler tours? Qi Ge Daniel Štefankovi č University of Rochester.
1 MCMC Style Sampling / Counting for SAT Can we extend SAT/CSP techniques to solve harder counting/sampling problems? Such an extension would lead us to.
An FPTAS for #Knapsack and Related Counting Problems Parikshit Gopalan Adam Klivans Raghu Meka Daniel Štefankovi č Santosh Vempala Eric Vigoda.
Indian Institute of Technology Kharagpur PALLAB DASGUPTA Graph Theory: Introduction Pallab Dasgupta, Professor, Dept. of Computer Sc. and Engineering,
CS774. Markov Random Field : Theory and Application Lecture 02
Markov Chains and Random Walks. Def: A stochastic process X={X(t),t ∈ T} is a collection of random variables. If T is a countable set, say T={0,1,2, …
Data Structures & Algorithms Graphs
1/24 Introduction to Graphs. 2/24 Graph Definition Graph : consists of vertices and edges. Each edge must start and end at a vertex. Graph G = (V, E)
Approximate Inference: Decomposition Methods with Applications to Computer Vision Kyomin Jung ( KAIST ) Joint work with Pushmeet Kohli (Microsoft Research)
Graph.
Some NP-complete Problems in Graph Theory Prof. Sin-Min Lee.
Graph Colouring Lecture 20: Nov 25. This Lecture Graph coloring is another important problem in graph theory. It also has many applications, including.
CS 484 Load Balancing. Goal: All processors working all the time Efficiency of 1 Distribute the load (work) to meet the goal Two types of load balancing.
Seminar on random walks on graphs Lecture No. 2 Mille Gandelsman,
The Markov Chain Monte Carlo Method Isabelle Stanton May 8, 2008 Theory Lunch.
Introduction to Graph Theory
Date: 2005/4/25 Advisor: Sy-Yen Kuo Speaker: Szu-Chi Wang.
Exponential random graphs and dynamic graph algorithms David Eppstein Comp. Sci. Dept., UC Irvine.
Faster Symmetry Discovery using Sparsity of Symmetries Paul T. Darga Karem A. Sakallah Igor L. Markov The University of Michigan.
Counting and Sampling in Lattices: The Computer Science Perspective Dana Randall Advance Professor of Computing Georgia Institute of Technology.
Hongyu Liang Institute for Theoretical Computer Science Tsinghua University, Beijing, China The Algorithmic Complexity.
1 Data Structures and Algorithms Graphs. 2 Graphs Basic Definitions Paths and Cycles Connectivity Other Properties Representation Examples of Graph Algorithms:
Domino Tilings of the Chessboard Dana Randall Computer Science and Mathematics Depts. Georgia Institute of Technology.
Xuding Zhu National Sun Yat-sen University Circular chromatic index.
Equitable Rectangular Dissections Dana Randall Georgia Institute of Technology Joint with: Sarah Cannon and Sarah Miracle.
Theory of Computational Complexity Probability and Computing Chapter Hikaru Inada Iwama and Ito lab M1.
Algorithms for Finding Distance-Edge-Colorings of Graphs
Proof technique (pigeonhole principle)
Sequential Algorithms for Generating Random Graphs
Path Coupling And Approximate Counting
R. Srikant University of Illinois at Urbana-Champaign
Reconstruction on trees and Phylogeny 1
Weighted counting of k-matchings is #W[1]-hard
Computability and Complexity
Synthesis of MCMC and Belief Propagation
Problem Solving 4.
Bart M. P. Jansen Jesper Nederlof
Slow Mixing of Local Dynamics via Topological Obstructions
Richard Anderson Lecture 5 Graph Theory
Presentation transcript:

Algorithms to Approximately Count and Sample Conforming Colorings of Graphs Sarah Miracle and Dana Randall Georgia Institute of Technology (B,B)(B,B) (R,B)(R,B) (G,R)(G,R) (R,G)(R,G) (R,B)(R,B)

Given: a (multi) graph G = (V,E) a set of colors [k] = {1,...,k} a set of edge constraints F: E  [k] x [k] A coloring C of the vertices of G is conforming to F if for every edge e=(u,v), F(e) ≠ ( C(v), C(u) ). “Conforming Colorings”

A coloring C of the vertices of G is conforming to F if for every edge e=(u,v), F(e)≠(C(v),C(u)). Conforming Colorings (B,B)(B,B) (R,B)(R,B) (G,R)(G,R) (R,G)(R,G) (R,B)(R,B) (B,B)(B,B) (R,B)(R,B) (G,R)(G,R) (R,G)(R,G) (R,B)(R,B) (B,B)(B,B) (R,B)(R,B) (G,R)(G,R) (R,G)(R,G) (R,B)(R,B)

1.Resource Allocation – Colors are Resources – Vertices are Jobs – Edge Constraints are Incompatible Scheduling Assignments 2.Generalizes Graph Theoretic Concepts Applications

Conforming colorings generalize the following: – Independent sets – Vertex colorings – List colorings – H-colorings – Adapted colorings Examples in Graph Theory

Conforming colorings generalize the following: – Independent sets – Vertex colorings – List colorings – H-colorings – Adapted colorings Examples in Graph Theory

Adapted (or Adaptable) Colorings Given: a (multi) graph G = (V,E) an edge coloring F A coloring C of the vertices of G is adapted to F if there is no edge e = (u,v) with F(e) = C(v) = C(u). (B,B)(B,B) (R,R)(R,R) (G,G)(G,G) (R,R)(R,R) (G,G)(G,G)

Adapted (or Adaptable) Colorings Adaptable Chromatic Number introduced [Hell & Zhu, 2008] Adapted List colorings of Planar Graphs [Esperet et al., 2009] Adaptable chromatic number of graph products [Hell et al., 2009] Polynomial algorithm for finding adapted 3-coloring given edge 3- coloring of complete graph [Cygan et al., SODA ‘11] Given: a (multi) graph G = (V,E) an edge coloring F A coloring C of the vertices of G is adapted to F if there is no edge e = (u,v) with F(e) = C(v) = C(u).

Conforming colorings generalize Independent Sets Set k = 2 Color each edge (B,B) Each conforming coloring is an independent set Independent Sets

Extensive work using Monte Carlo approaches to count and sample for special cases. Design a Markov chain for sampling configurations that is rapidly mixing (i.e. independent sets, colorings) These chains can be slow. Non-local ones can be more effective but harder to analyze. (i.e. Wang-Swendsen-Kotecký ) Approximately Counting and Sampling

–A new “component” chain M C –Provide conditions under which we have a polynomial time algorithm to find a conforming coloring M C mixes rapidly a FPRAS for approximately counting –An example where M C and M L are slow Our Results k ≥ max(Δ,3) –A polynomial time algorithm to find a conforming coloring –The local chain M L connects the state space –M L mixes rapidly –A FPRAS for approximately counting k = 2 (Δ = max degree including multi-edges and self-loops)

Definitions A Markov chain is rapidly mixing if τ(ε) is poly(n, log(ε -1 )). (Δ x (t) is the total variation distance) Definition: Given ε, the mixing time is τ(ε) = max min {t: Δ x (t’) < ε, for all t’ ≥ t}. x A Markov chain is slowly mixing if τ(ε) is at least exp(n). Definition: A Fully Polynomial Randomized Approximation Scheme (FPRAS) is a randomized algorithm that given a graph G with n vertices, edge coloring F and error parameter 0< ε ≤ 1 produces a number N such that P[(1-ε)N ≤ A(G,F) ≤ (1+ε)N] ≥ ¾

Finding a Conforming Coloring k ≥ max(Δ,3) Thm: When k ≥ max(Δ,3) and Ω is not degenerate, there exists a conforming k-coloring and we give an O(Δn 2 ) algorithm for finding one. Example: k = 3 Flower Color-fixed (R,G)(R,G) (B,R)(B,R) (G,B)(G,B)(G,B)(G,B) How to determine if Ω is degenerate?

The Markov chain M L : Starting at σ 0, Repeat: - With prob. ½ do nothing; - Pick v  V and c  {1,…,k}; - Recolor v color c if it results in a valid conforming coloring. The Local Markov Chain M L k ≥ max(Δ,3) Example: k = 2

When does M L connect Ω ? k ≥ max(Δ,3) Thm: If k ≥ max(Δ,3), M L connects the state space Ω.

Use path coupling [Dyer, Greenhill ‘98] to show M L is rapidly mixing. Use M L to design a FPRAS [Jerrum, Valiant, Vazirani ‘86] Rapid Mixing of M L and a FPRAS k ≥ max(Δ,3) Thm: If k ≥ max(Δ,3), then M L is rapidly mixing and there exists a FPRAS for counting the number of conforming k-colorings.

–A new “component” chain M C –Provide conditions under which we have a polynomial time algorithm to find a conforming coloring M C mixes rapidly a FPRAS for approximately counting –An example where M C and M L are slow Our Results k ≥ max(Δ,3) –A polynomial time algorithm to find a conforming coloring –The local chain M L connects the state space –M L mixes rapidly –A FPRAS for approximately counting k = 2 (Δ = max degree including multi-edges and self-loops)

k = 2 What’s Special about k = 2? Generalizes independent sets The local chain M L does not connect the state space Ω

The Component Chain M C k = 2 A path P = v 1, v 2, …, v x is b-alternating if 1.F 1 (v 1,v 2 ) = b 2.For all 1 ≤ i ≤ x-2, F i+1 (v i,v i+1 )≠F i+1 (v i+1,v i+2 ) Vertices u and v are color-implied if there is a 1-alternating and a 2-alternating path from u to v or u=v Color-implied is an equivalence relation and defines a partition of the vertices into color-implied components Defining Color-Implied Components

k = 2 Each color implied component C has at most 2 colorings α(C) and β(C). Components become vertices Edges reflect the edges and coloring constraints from F The Color-Implied Component Graph (α coloring ) (α,β) (β,α) (α,β) The Component Chain M C

The Markov chain M C : Starting at σ 0, Repeat: - Pick a component C i in C u.a.r.; - With prob. ½ color C i : ρ(C i ), if valid; - With prob. ½ color C i : ρ’(C i ), if valid; - Otherwise, do nothing. k = 2 The Component Chain M C

Positive Results k = 2 1.We give an O(n 3 ) algorithm for finding a 2- coloring 2.The chain M C is rapidly mixing 3.We give a FPRAS for approximately counting If every vertex v in the color-implied component graph satisfies one of the following d(v) ≤ 2 (d(v) = the degree of v) d(v) ≤ 4 and v is monochromatic Rapid Mixing Proof: Uses path coupling and comparison with a similar chain which selects an edge in the component graph and recolors both vertices.

Slow Mixing of M C on Other Graphs k = 2 Thm: There exists a bipartite graph G with Δ = 4 and edge 2-coloring F for which M C and M L take exponential time to converge. (α coloring ) (α,β) (β, α )

The “Bottleneck” G colored α. S 1 colored α. G colored α. S 1 colored α. G colored β. S 2 colored β. G colored β. S 2 colored β. S 1 colored α. S 2 colored β. S 1 colored α. S 2 colored β. k = 2 (α,β) (β, α )

Open Problems 1.When k > 2, is there an analog to M C that is faster? 2.Other approaches to sampling when k ≥ 2? 3.Can conforming/adapted colorings give insights into phase transitions for independent sets and colorings?

Thank you!