C&O 355 Mathematical Programming Fall 2010 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.

Slides:



Advertisements
Similar presentations
The Primal-Dual Method: Steiner Forest TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A AA A A A AA A A.
Advertisements

C&O 355 Lecture 22 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
C&O 355 Lecture 15 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A.
Weighted Matching-Algorithms, Hamiltonian Cycles and TSP
Min-Max Relations, Hall’s Theorem, and Matching-Algorithms Graphs & Algorithms Lecture 5 TexPoint fonts used in EMF. Read the TexPoint manual before you.
C&O 355 Lecture 8 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
C&O 355 Lecture 9 N. Harvey TexPoint fonts used in EMF.
C&O 355 Lecture 23 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
Bipartite Matching, Extremal Problems, Matrix Tree Theorem.
C&O 355 Mathematical Programming Fall 2010 Lecture 22 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
Totally Unimodular Matrices
C&O 355 Lecture 4 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
C&O 355 Mathematical Programming Fall 2010 Lecture 20 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
C&O 355 Mathematical Programming Fall 2010 Lecture 21 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
C&O 355 Mathematical Programming Fall 2010 Lecture 15 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
C&O 355 Lecture 20 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
How should we define corner points? Under any reasonable definition, point x should be considered a corner point x What is a corner point?
Complexity 16-1 Complexity Andrei Bulatov Non-Approximability.
Introduction to Approximation Algorithms Lecture 12: Mar 1.
Instructor Neelima Gupta Table of Contents Lp –rounding Dual Fitting LP-Duality.
Linear Programming and Approximation
Approximation Algorithm: Iterative Rounding Lecture 15: March 9.
Duality Lecture 10: Feb 9. Min-Max theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum Cut Both.
Perfect Graphs Lecture 23: Apr 17. Hard Optimization Problems Independent set Clique Colouring Clique cover Hard to approximate within a factor of coding.
Matchings Lecture 3: Jan 18. Bipartite matchings revisited Greedy method doesn’t work (add an edge with both endpoints free)
Approximation Algorithms
The max flow problem
1 Bipartite Matching Lecture 3: Jan Bipartite Matching A graph is bipartite if its vertex set can be partitioned into two subsets A and B so that.
Matching Polytope, Stable Matching Polytope Lecture 8: Feb 2 x1 x2 x3 x1 x2 x3.
Computability and Complexity 24-1 Computability and Complexity Andrei Bulatov Approximation.
Job Scheduling Lecture 19: March 19. Job Scheduling: Unrelated Multiple Machines There are n jobs, each job has: a processing time p(i,j) (the time to.
1 Introduction to Approximation Algorithms Lecture 15: Mar 5.
1 Spanning Tree Polytope x1 x2 x3 Lecture 11: Feb 21.
Approximation Algorithms: Bristol Summer School 2008 Seffi Naor Computer Science Dept. Technion Haifa, Israel TexPoint fonts used in EMF. Read the TexPoint.
C&O 355 Mathematical Programming Fall 2010 Lecture 17 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
C&O 355 Lecture 2 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
C&O 355 Mathematical Programming Fall 2010 Lecture 2 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A.
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
C&O 355 Mathematical Programming Fall 2010 Lecture 4 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
Theory of Computing Lecture 13 MAS 714 Hartmut Klauck.
C&O 355 Mathematical Programming Fall 2010 Lecture 18 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A Image:
C&O 355 Mathematical Programming Fall 2010 Lecture 16 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
C&O 355 Mathematical Programming Fall 2010 Lecture 5 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A.
Hon Wai Leong, NUS (CS6234, Spring 2009) Page 1 Copyright © 2009 by Leong Hon Wai CS6234: Lecture 4  Linear Programming  LP and Simplex Algorithm [PS82]-Ch2.
C&O 355 Lecture 7 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
CPSC 536N Sparse Approximations Winter 2013 Lecture 1 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAAAAAAA.
Lecture.6. Table of Contents Lp –rounding Dual Fitting LP-Duality.
C&O 355 Lecture 24 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A.
1 Approximation algorithms Algorithms and Networks 2015/2016 Hans L. Bodlaender Johan M. M. van Rooij TexPoint fonts used in EMF. Read the TexPoint manual.
C&O 355 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
12. Lecture WS 2012/13Bioinformatics III1 V12 Menger’s theorem Borrowing terminology from operations research consider certain primal-dual pairs of optimization.
MCS 312: NP Completeness and Approximation Algorithms Instructor Neelima Gupta
Approximation Algorithms based on linear programming.
TU/e Algorithms (2IL15) – Lecture 8 1 MAXIMUM FLOW (part II)
Lap Chi Lau we will only use slides 4 to 19
Topics in Algorithms Lap Chi Lau.
Computability and Complexity
Analysis of Algorithms
Linear Programming and Approximation
Vertex Covers, Matchings, and Independent Sets
Linear Programming Duality, Reductions, and Bipartite Matching
Problem Solving 4.
Algorithms (2IL15) – Lecture 7
V12 Menger’s theorem Borrowing terminology from operations research
Vertex Covers and Matchings
Presentation transcript:

C&O 355 Mathematical Programming Fall 2010 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A

Topics Vertex Covers in Bipartite Graphs Konig’s Theorem Vertex Covers in Non-bipartite Graphs

Maximum Bipartite Matching Let G=(V, E) be a bipartite graph. We’re interested in maximum size matchings. How do I know M has maximum size? Is there a 5-edge matching? Is there a certificate that a matching has maximum size? Blue edges are a maximum-size matching M

Vertex covers Let G=(V, E) be a graph. A set C µ V is called a vertex cover if every edge e 2 E has at least one endpoint in C. Claim: If M is a matching and C is a vertex cover then |M| · |C|. Proof: Every edge in M has at least one endpoint in C. Since M is a matching, its edges have distinct endpoints. So C must contain at least |M| vertices. ¤ Red vertices form a vertex cover C Blue edges are a maximum-size matching M

Vertex covers Let G=(V, E) be a graph. A set C µ V is called a vertex cover if every edge e 2 E has at least one endpoint in C. Claim: If M is a matching and C is a vertex cover then |M| · |C|. Proof: Every edge in M has at least one endpoint in C. Since M is a matching, its edges have distinct endpoints. So C must contain at least |M| vertices. ¤ Suppose we find a matching M and vertex cover C s.t. |M|=|C|. Then M must be a maximum cardinality matching: every other matching M’ satisfies |M’| · |C| = |M|. And C must be a minimum cardinality vertex cover: every other vertex cover C’ satisfies |C’| ¸ |M| = |C|. Then M certifies optimality of C and vice-versa.

Vertex covers & matchings Let G=(V, E) be a graph. A set C µ V is called a vertex cover if every edge e 2 E has at least one endpoint in C. Claim: If M is a matching and C is a vertex cover then |M| · |C|. Suppose we find a matching M and vertex cover C s.t. |M|=|C|. Then M certifies optimality of C and vice-versa. Do such M and C always exist? No… Maximum size of a matching = 1 Minimum size of a vertex cover = 2

Vertex covers & matchings Let G=(V, E) be a graph. A set C µ V is called a vertex cover if every edge e 2 E has at least one endpoint in C. Claim: If M is a matching and C is a vertex cover then |M| · |C|. Suppose we find a matching M and vertex cover C s.t. |M|=|C|. Then M certifies optimality of C and vice-versa. Do such M and C always exist? No… unless G is bipartite! Theorem (Konig’s Theorem): If G is bipartite then there exists a matching M and a vertex cover C s.t. |M|=|C|.

Earlier Example Let G=(V, E) be a bipartite graph. We’re interested in maximum size matchings. How do I know M has maximum size? Is there a 5-edge matching? Is there a certificate that a matching has maximum size? Blue edges are a maximum-size matching M Red vertices form a vertex cover C Since |M|=|C|=4, both M and C are optimal!

LPs for Bipartite Matching (LP) (IP) Let G=(V, E) be a bipartite graph. Recall our IP and LP formulations for maximum-size matching. Theorem: Every BFS of (LP) is actually an (IP) solution. What is the dual of (LP)? (LP-Dual)

Dual of Bipartite Matching LP What is the dual LP? (LP-Dual) Note that any optimal solution must satisfy y v · 1 8 v 2 V Suppose we impose integrality constraints: (IP-Dual) Claim: If y is feasible for IP-dual then C = { v : y v =1 } is a vertex cover. Furthermore, the objective value is |C|. So IP-Dual is precisely the minimum vertex cover problem. Theorem: Every optimal BFS of (LP-Dual) is an (IP-Dual) solution (in the case of bipartite graphs).

Let G=(U [ V, E) be a bipartite graph. Define A by Lemma: A is TUM. Claim: If A is TUM then A T is TUM. Proof: Exercise? Corollary: Every BFS of P = { x : A T y ¸ 1, y ¸ 0 } is integral. But LP-Dual is So our Corollary implies every BFS of LP-dual is integral Every optimal solution must have y v · 1 8 v 2 V ) every optimal BFS has y v 2 {0,1} 8 v 2 V, and hence it is a feasible solution for IP-Dual. ¥ A v,e = 1 if vertex v is an endpoint of edge e 0 otherwise =

Proof of Konig’s Theorem Theorem (Konig’s Theorem): If G is bipartite then there exists a matching M and a vertex cover C s.t. |M|=|C|. Proof: Let x be an optimal BFS for (LP). Let y be an optimal BFS for (LP-Dual). Let M = { e : x e =1 }. M is a matching with |M| = objective value of x. (By earlier theorem) Let C = { v : y v = 1 }. C is a vertex cover with |C| = objective value of y. (By earlier theorem) By Strong LP Duality: |M| = LP optimal value = LP-Dual optimal value = |C|. ¥

Beyond Bipartite Graphs Given a bipartite graph, we can efficiently find a minimum-size vertex cover. Just compute a BFS of For non-bipartite graphs, this doesn’t work: – Setting y a = y b = y c = 0.5 gives a feasible solution to LP-Dual with objective value 1.5 – So optimal BFS has value · 1.5. But no vertex cover has size < 2. (LP-Dual) b a c Maximum size of a matching = 1 Minimum size of a vertex cover = 2

Beyond Bipartite Graphs For non-bipartite graphs, this doesn’t work: – Setting y a = y b = y c = 0.5 gives a feasible solution to LP-Dual with objective value 1.5. – So optimal BFS has value · 1.5. But no vertex cover has size < 2. Key point: (IP) captures vertex cover problem, but (LP) does not. We have no efficient way to solve (IP). b a c Maximum size of a matching = 1 Minimum size of a vertex cover = 2 (LP) (IP)

Beyond Bipartite Graphs For non-bipartite graphs, this doesn’t work: Key point: (IP) captures vertex cover problem, but (LP) does not. We have no efficient way to solve (IP). What’s the problem? The constraint matrix A is not totally unimodular: b a c Maximum size of a matching = 1 Minimum size of a vertex cover = 2 (LP) (IP)

Beyond Bipartite Graphs For non-bipartite graphs, this doesn’t work: – Setting y a = y b = y c = 0.5 gives a feasible solution to LP-Dual with objective value 1.5. – So optimal BFS has value · 1.5. But no vertex cover has size < 2. Theorem: There is no efficient algorithm to find a min size vertex cover in general graphs. (Assuming P  NP) Theorem: There is an efficient algorithm to find a vertex cover whose size is at most twice the minimum. b a c Maximum size of a matching = 1 Minimum size of a vertex cover = 2

Our Game Plan Objective Value 0 Min Vtx Cover LP Optimum Solve the vtx cover LP: Rounding: Extract Our Vtx Cover from LP optimum solution Prove that Our Vtx Cover is close to LP Optimum, i.e. is as small as possible. ) Our Vtx Cover is close to Min Vtx Cover, i.e., So Our Vtx Cover is within a factor ® of the minimum Our Vtx Cover Size of Our Vtx Cover LP Opt Value ® = Size of Our Vtx Cover Size of Min Vtx Cover · ® ®

Our Algorithm Astonishingly, this seems to be optimal: Theorem: [Khot, Regev 2003] No efficient algorithm can approximate the min vtx cover with factor better than 2, assuming a certain conjecture in complexity theory. (Similar to P  NP) Theorem: [Folklore] There exists an algorithm to extract a vertex cover from the LP optimum such that Size of Vtx Cover Size of Min Vtx Cover ® = · 2· 2

Our Algorithm Solve the vertex cover LP Return C = { v 2 V : y v ¸ ½ } Claim 1: C is a vertex cover. Claim 2: |C| is at most twice the size of the minimum vertex cover.

Our Algorithm Solve the vertex cover LP Return C = { v 2 V : y v ¸ ½ } Claim 1: C is a vertex cover. Proof: Consider any edge {u,v}. Since y u + y v ¸ 1, either y u ¸ ½ or y v ¸ ½. So either u 2 C or v 2 C. ¥

Our Algorithm Solve the vertex cover LP Return C = { v 2 V : y v ¸ ½ } Claim 2: |C| · 2 ¢ |minimum vertex cover|. Proof: |C| = |{ v 2 V : y v ¸ ½ }| ¥ = 2 ¢ LP optimum value · 2 ¢ |minimum vertex cover|

Summary Bipartite graphs – Vertex cover problem is dual of matching problem – Vertex Cover (IP) and (LP) are equivalent (by Total Unimodularity) – Can efficiently find minimum vertex cover Non-bipartite Graphs – Vertex cover not related to matching problem – Vertex Cover (IP) and (LP) are not equivalent – Cannot efficiently find minimum vertex cover – Can find a vertex cover of size at most twice minimum