MCS 312: NP Completeness and Approximation Algorithms Instructor Neelima Gupta

Slides:



Advertisements
Similar presentations
Instructor Neelima Gupta Table of Contents Approximation Algorithms.
Advertisements

Approximation Algorithms
Introduction to Kernel Lower Bounds Daniel Lokshtanov.
MCA 202: Discrete Mathematics under construction Instructor Neelima Gupta
Theory of Computing Lecture 18 MAS 714 Hartmut Klauck.
MCS 312: NP Completeness and Approximation algorithms Instructor Neelima Gupta
Combinatorial Algorithms
MCA 520: Graph Theory Instructor Neelima Gupta
Complexity ©D Moshkovitz 1 Approximation Algorithms Is Close Enough Good Enough?
Polynomial Time Approximation Schemes Presented By: Leonid Barenboim Roee Weisbert.
Approximation Algorithms Chapter 5: k-center. Overview n Main issue: Parametric pruning –Technique for approximation algorithms n 2-approx. algorithm.
Combinatorial Algorithms
Complexity 16-1 Complexity Andrei Bulatov Non-Approximability.
CSC5160 Topics in Algorithms Tutorial 2 Introduction to NP-Complete Problems Feb Jerry Le
Computability and Complexity 23-1 Computability and Complexity Andrei Bulatov Search and Optimization.
Complexity 15-1 Complexity Andrei Bulatov Hierarchy Theorem.
Introduction to Approximation Algorithms Lecture 12: Mar 1.
Computational problems, algorithms, runtime, hardness
Instructor Neelima Gupta Table of Contents Lp –rounding Dual Fitting LP-Duality.
Approximation Algorithms: Combinatorial Approaches Lecture 13: March 2.
Approximation Algorithm: Iterative Rounding Lecture 15: March 9.
NP-Complete Problems Reading Material: Chapter 10 Sections 1, 2, 3, and 4 only.
Approximation Algorithms
1 CSE 417: Algorithms and Computational Complexity Winter 2001 Lecture 23 Instructor: Paul Beame.
Last class Decision/Optimization 3-SAT  Independent-Set Independent-Set  3-SAT P, NP Cook’s Theorem NP-hard, NP-complete 3-SAT  Clique, Subset-Sum,
CSE 421 Algorithms Richard Anderson Lecture 27 NP Completeness.
1 CSE 417: Algorithms and Computational Complexity Winter 2001 Lecture 22 Instructor: Paul Beame.
MCA 520: Graph Theory Instructor Neelima Gupta
NP-complete and NP-hard problems. Decision problems vs. optimization problems The problems we are trying to solve are basically of two kinds. In decision.
1 Introduction to Approximation Algorithms Lecture 15: Mar 5.
Approximation Algorithms Motivation and Definitions TSP Vertex Cover Scheduling.
1 Spanning Tree Polytope x1 x2 x3 Lecture 11: Feb 21.
MCS312: NP-completeness and Approximation Algorithms
1 The TSP : NP-Completeness Approximation and Hardness of Approximation All exact science is dominated by the idea of approximation. -- Bertrand Russell.
Approximation Algorithms for NP-hard Combinatorial Problems Magnús M. Halldórsson Reykjavik University
C&O 355 Mathematical Programming Fall 2010 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
APPROXIMATION ALGORITHMS VERTEX COVER – MAX CUT PROBLEMS
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
MCS 312: NP Completeness and Approximation algorithms Instructor Neelima Gupta
Lecture 22 More NPC problems
MCS 312: NP Completeness and Approximation algorthms Instructor Neelima Gupta
Approximation Algorithms
1 Combinatorial Algorithms Parametric Pruning. 2 Metric k-center Given a complete undirected graph G = (V, E) with nonnegative edge costs satisfying the.
Unit 9: Coping with NP-Completeness
The Dominating Set and its Parametric Dual  the Dominated Set  Lan Lin prepared for theory group meeting on June 11, 2003.
Instructor Neelima Gupta Table of Contents Class NP Class NPC Approximation Algorithms.
Instructor Neelima Gupta Table of Contents Factor 2 algorithm for Bin Packing Factor 2 algorithm for Minimum Makespan Scheduling Reference:
NP-Algorithms Tractable vs Intractable Some problems are intractable: as they grow large, we are unable to solve them in reasonable time.
MCS 312: NP Completeness and Approximation algorthms Instructor Neelima Gupta
Lecture.6. Table of Contents Lp –rounding Dual Fitting LP-Duality.
CPS Computational problems, algorithms, runtime, hardness (a ridiculously brief introduction to theoretical computer science) Vincent Conitzer.
NP Completeness Piyush Kumar. Today Reductions Proving Lower Bounds revisited Decision and Optimization Problems SAT and 3-SAT P Vs NP Dealing with NP-Complete.
CSC 413/513: Intro to Algorithms
12. Lecture WS 2012/13Bioinformatics III1 V12 Menger’s theorem Borrowing terminology from operations research consider certain primal-dual pairs of optimization.
Introduction to NP Instructor: Neelima Gupta 1.
NP Hard Problems Instructor Neelima Gupta Presentation Edited by Sapna Grover.
Approximation Algorithms by bounding the OPT Instructor Neelima Gupta
Instructor Neelima Gupta Table of Contents Introduction to Approximation Algorithms Factor 2 approximation algorithm for TSP Factor.
Matching in bipartite graphs Given: non-weighted bipartite graph not covered node extending alternating path initial matching Algorithm: so-called “extending.
COSC 3101A - Design and Analysis of Algorithms 14 NP-Completeness.
The NP class. NP-completeness Lecture2. The NP-class The NP class is a class that contains all the problems that can be decided by a Non-Deterministic.
The NP class. NP-completeness
P & NP.
CS4234 Optimiz(s)ation Algorithms
Computability and Complexity
Problem Solving 4.
NP-Completeness Yin Tat Lee
CSE 6408 Advanced Algorithms.
Dominating Set By Eric Wengert.
Presentation transcript:

MCS 312: NP Completeness and Approximation Algorithms Instructor Neelima Gupta

Table of Contents Approximation Algorithm for Vertex Cover Reference: Vazirani

Factor-2 algorithm Find a maximal matching in the graph and output the matched vertices. Let S be this set of vertices. Claim 1: S forms a vertex cover. Proof: Suppose not. Then there exists an edge e = (u,v) such that neither u nor v is in S. This implies that the matching could have been extended by this edge e and hence was not maximal --- a contradiction. Claim 2: |S| <= 2 OPT

Lower bounding the OPT Claim: OPT >= size of any (maximal) matching Proof: Let M be a (maximal) matching. For every e = (u,v ) in M, any vertex cover must pick at least one of u and v. Hence size of any vertex cover >= |M|. Hence, in particular, OPT > = |M| Hence Claim2 follows: |S| = 2* |maximal matching| <=2 * OPT.

Can the approximation guarantee be improved? Following Qs need to be addresses – Can the approximation guarantee be improved by a better analysis? – Can an approximation algorithm with a better guarantee be designed using the lower bounding scheme of maximal matching? – Is there some other lower bounding technique that can give an improved guarantee for vertex cover?

Tight Example What is the meaning of Q1? Can we get a solution S using the above algorithm such that |S| < 2* OPT (for every instance of the problem)? Say |S| = 3/2 * OPT? Answer to the Q is No. Here is an example of an instance on which the above algorithm will always give a solution whose cost = 2*OPT. Complete Bipartite Graph: K n,n : OPT = n, |S| = 2n. (Figure needed)

Q2 i.e. Can we design an algorithm that gives a vertex cover solution S such that |S| < 2* |maximal matching| (for every instance of the problem)? Say |S| < 3/2* |maximal matching|? Ans: No. Here is an example of an instance where the size of any vertex cover is at least 2 * |maximal matching|. Example: K n : Complete graph of size n, n odd. |Size of maximal matching| is (n-1)/2 and OPT = n-1. Thus the size of any vertex cover >= OPT = n – 1 = 2 * |maximal matching|.

Q3 Still an Open Problem!!!

Min-Max Relations Consider the following two pair of problems: one of minimization and one of maximization. Minimum Vertex Cover: Is the size of MinVC in G at most k? Maximum Matching: Is the size of MaxM in G at least l? We have already seen that for a general graph MaxM < = MinVC König-Egerváry Theorem : For a bipartite graph: MaxM = MinVC

Well Characterized Problems MinVC and MaxM are both in NP as they have a “yes” certificate. Do these problems also have a “No” certificate? For bipartite graphs: answer to the above Q is yes: If the answer to MinVC problem is “No”, i.e. if minimum vertex cover is >k then the maximum matching is also >k. i.e. there exists a MaxM of size k+1. This serves as the certificate which can be used to verify “No” to MinVC in polynomial time (because the converse is also true). (Notice that a VC of size k+1 does not serve the purpose, minVC could still be <=k). Thus MinVC is in Co-NP for bipartite graphs

Well Characterized Problems Similarly, a VC of size l-1 will serve as a “NO” certificate for the MaxM problem. MaxM is in Co-NP for bipartite graphs. Catch: “No” certificate for MaxMM does not come from the VC but from a different structure. Such problems that have a “yes” as well as a “No” certificate are said to be well characterized. Importance of well characterized problems comes from the fact that the search for polynomial time algorithm for matching started with the realization that it is well characterized.

Min-Max Relations Such Min-Max relations are some of the most powerful and beautiful tools in combinatorics and some of the most fundamental polynomial time algorithms have been designed around such relations. Remember: Min-Cut, Max-Flow relation?

NP-hard problems do not possess a “No” certificate unless NP = Co-NP Let Q be an NP-hard problem Let P be in NP we can reduce an instance I P of P to an instance I Q of Q such that a “yes (I Q )” iff “yes (I P )”. Thus a “No” certificate to Q will serve as a “No” certificate to P also (by reduction) and hence NP is contained in Co-NP.

Let P be in Co-NP. Then P’ = P complement is in NP. we can reduce an instance I P’ of P’ to an instance I Q of Q such that a “yes (I Q )” iff “yes (I P’ )” or “No (I P )”. Thus a “No” certificate to Q will serve as a “Yes” certificate to P and hence P is in Co-NP. Thus Co- NP is contained in NP.

What if the graph is not bipartite? For general graphs, – MaxMM is strictly < MinVC (we have seen this in K n, odd n) – MinVC is NP-hard – MaxMM is polynomial time solvable.

For general graphs We have seen that for our algorithm |S| = 2* |maximal matching| <=2 * OPT (MinVC) Which implies, |maximal matching|> = IS|/2 >= MinVC/2 Thus we have, MinVC/2 <= MaxMM <= MinVC and, MaxMM <= MinVC <= 2*MaxMM Such a relation is called approximate min-max relation.