Approximation Algorithms by bounding the OPT Instructor Neelima Gupta

Slides:



Advertisements
Similar presentations
Great Theoretical Ideas in Computer Science
Advertisements

Instructor Neelima Gupta Table of Contents Approximation Algorithms.
Design and Analysis of Algorithms Approximation algorithms for NP-complete problems Haidong Xue Summer 2012, at GSU.
Great Theoretical Ideas in Computer Science for Some.
Approximation Algorithms for TSP
Combinatorial Algorithms
Great Theoretical Ideas in Computer Science.
1 Discrete Structures & Algorithms Graphs and Trees: II EECE 320.
Introduction to Approximation Algorithms Lecture 12: Mar 1.
Approximation Algorithms
Approximation Algorithms: Combinatorial Approaches Lecture 13: March 2.
Approximation Algorithms: Concepts Approximation algorithm: An algorithm that returns near-optimal solutions (i.e. is "provably good“) is called an approximation.
Approximation Algorithms1. 2 Outline and Reading Approximation Algorithms for NP-Complete Problems (§13.4) Approximation ratios Polynomial-Time Approximation.
1 Approximation Algorithms CSC401 – Analysis of Algorithms Lecture Notes 18 Approximation Algorithms Objectives: Typical NP-complete problems Approximation.
Great Theoretical Ideas in Computer Science.
A general approximation technique for constrained forest problems Michael X. Goemans & David P. Williamson Presented by: Yonatan Elhanani & Yuval Cohen.
Approximation Algorithms
1 NP-Complete Problems Polynomial time vs exponential time –Polynomial O(n k ), where n is the input size (e.g., number of nodes in a graph, the length.
NP-Complete Problems (Fun part)
1 Combinatorial Dominance Analysis Keywords: Combinatorial Optimization (CO) Approximation Algorithms (AA) Approximation Ratio (a.r) Combinatorial Dominance.
Vertex cover problem S  V such that for every {u,v}  E u  S or v  S (or both)
Approximation Algorithms Motivation and Definitions TSP Vertex Cover Scheduling.
1 NP-Complete Problems (Fun part) Polynomial time vs exponential time –Polynomial O(n k ), where n is the input size (e.g., number of nodes in a graph,
Theory of Computing Lecture 10 MAS 714 Hartmut Klauck.
Algorithms for Network Optimization Problems This handout: Minimum Spanning Tree Problem Approximation Algorithms Traveling Salesman Problem.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
MCS312: NP-completeness and Approximation Algorithms
The Traveling Salesman Problem Approximation
University of Texas at Arlington Srikanth Vadada Kishan Kumar B P Fall CSE 5311 Solving Travelling Salesman Problem for Metric Graphs using MST.
NP-Completeness: 3D Matching
1 The TSP : NP-Completeness Approximation and Hardness of Approximation All exact science is dominated by the idea of approximation. -- Bertrand Russell.
1 Approximation Algorithm Instructor: yedeshi
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
MCS 312: NP Completeness and Approximation algorithms Instructor Neelima Gupta
Advanced Algorithm Design and Analysis (Lecture 13) SW5 fall 2004 Simonas Šaltenis E1-215b
Approximation Algorithms
1 Combinatorial Algorithms Parametric Pruning. 2 Metric k-center Given a complete undirected graph G = (V, E) with nonnegative edge costs satisfying the.
Princeton University COS 423 Theory of Algorithms Spring 2001 Kevin Wayne Approximation Algorithms These lecture slides are adapted from CLRS.
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
Projects Network Theory VLSI PSM 1. Network 1. Steiner trees
WK15. Vertex Cover and Approximation Algorithm By Lin, Jr-Shiun Choi, Jae Sung.
Instructor Neelima Gupta Table of Contents Class NP Class NPC Approximation Algorithms.
Approximation Algorithms for TSP Tsvi Kopelowitz 1.
MCS 312: NP Completeness and Approximation algorthms Instructor Neelima Gupta
NP Completeness Piyush Kumar. Today Reductions Proving Lower Bounds revisited Decision and Optimization Problems SAT and 3-SAT P Vs NP Dealing with NP-Complete.
CSC 413/513: Intro to Algorithms
Approximation Algorithms Guo QI, Chen Zhenghai, Wang Guanhua, Shen Shiqi, Himeshi De Silva.
CSE 421 Algorithms Richard Anderson Lecture 27 NP-Completeness Proofs.
Introduction to NP Instructor: Neelima Gupta 1.
MCS 312: NP Completeness and Approximation Algorithms Instructor Neelima Gupta
Instructor Neelima Gupta Table of Contents Introduction to Approximation Algorithms Factor 2 approximation algorithm for TSP Factor.
COSC 3101A - Design and Analysis of Algorithms 14 NP-Completeness.
TU/e Algorithms (2IL15) – Lecture 11 1 Approximation Algorithms.
Approximation Algorithms
Steiner trees: Approximation Algorithms
School of Computing Clemson University Fall, 2012
Approximation Algorithms
Hamiltonian Cycle and TSP
Hamiltonian Cycle and TSP
Great Theoretical Ideas in Computer Science
CS4234 Optimiz(s)ation Algorithms
Approximation Algorithms
Computability and Complexity
Approximation Algorithms for TSP
Discrete Mathematics for Computer Science
Approximation Algorithms
Lecture 24 Vertex Cover and Hamiltonian Cycle
Presentation transcript:

Approximation Algorithms by bounding the OPT Instructor Neelima Gupta

Approximate algorithms give approximate solution to NP-Complete problems which is close to optimum solution. Maximization problems E.g. Clique Optimum clique > Approx. clique >= ½ *( Optimum clique) Minimization problems E.g. Vertex Cover Minimum vc < Approx. vc < = 2*(Minimum vc) Approximation Algorithms

Factor-2 algorithm Find a maximal matching in the graph and output the matched vertices. Let S be this set of vertices. Claim 1: S forms a vertex cover. Proof: Suppose not. Then there exists an edge e = (u,v) such that neither u nor v is in S. This implies that the matching could have been extended by this edge e and hence was not maximal --- a contradiction. Claim 2: |S| <= 2 OPT Proof: We’ll prove this by giving some lower bound say LB for OPT and showing that |S| <= 2 LB – Standard Technique

Lower bounding the OPT Claim: OPT >= size of any (maximal) matching Proof: Let M be a (maximal) matching. For every e = (u,v ) in M, any vertex cover must pick at least one of u and v. Hence size of any vertex cover >= |M|. Hence, in particular, OPT > = |M| Clearly |S| = 2* |maximal matching| Hence Claim2 follows.

Can the approximation guarantee be improved? Following Qs need to be addresses Can the approximation guarantee be improved by a better analysis? Can an approximation algorithm with a better guarantee be designed using the lower bounding scheme of maximal matching? Is there some other lower bounding technique that can give an improved guarantee for vertex cover?

Tight Example What is the meaning of Q1? Can we get a solution S using the above algorithm such that |S| < 2* OPT (for every instance of the problem)? Say |S| = 3/2 * OPT? Answer to the Q is No. Here is an example of an instance on which the above algorithm will always give a solution whose cost = 2*OPT. Complete Bipartite Graph: K n,n : OPT = n, |S| = 2n.

Q2 i.e. Can we design an algorithm that gives a vertex cover solution S such that |S| < 2* |maximal matching| (for every instance of the problem)? Say |S| <= 3/2* |maximal matching|? Ans: No. Here is an example of an instance where the size of any vertex cover is at least 2 * |maximal matching|. Example: K n : Complete graph of size n, n odd. |Size of maximal matching| is (n-1)/2 and OPT = n-1. Thus the size of any vertex cover >= OPT = n – 1 = 2 * |maximal matching|.

Q3 Still an Open Problem!!!

Metric Travelling Salesman Problem Problem Statement Given A complete graph G with non-negative edge costs that satisfy triangle inequality To Find A minimum cost cycle visiting every vertex exactly once.

Metric TSP - factor 2 approx. algorithm 1. Find an Minimum Spanning Tree (MST) T of G. 2. Double every edge of the MST to obtain an Eulerian graph. 3. Find a Eulerian tour, T’, on G. 4. Output the tour that visits vertices of G in the order of their first appearance in T’. Call this tour C. (Short Cutting)

Edges shown dotted do not carry weight and are assumed to be shortest path between the pair of vertices( due to triangular inequality). Example Given a Complete Graph V5 V1 V4 V2 V3 V6 V9 V7 V8 V

V1V2V8 V4V3 V7 V5 V6V9 V10 Step1: Compute Minimum Spanning Tree

Step 2: Double each edge of MST V5 V10 V7 V8V2 V1 V6 V3V4 V

Step 3: Computing Eulerian Cycle A cycle is one in which each edge visited exactly once v1  v2  v3  v4  v5  v6  v5  v4  v3  v7  v9  v10  v9  v7  v8  v7  v3  v2  v V5 V6 V4 V3 V1 V2V8 V7 V10 V

Step 4: Computing solution for TSP V4 V9 V10 V6 V8 V5 V7 V3 V2V v1  v2  v3  v4  v5  v6  v5  v4  v3  v7  v9  v10  v9  v7  v8  v7  v3  v2  v1

v1  v2  v3  v4  v5  v6  v7  v9  v10  v8  v1 Approximate solution for TSP V1 V9 V8 V3 V2 V4 V5 V6 V7 V10

Metric TSP - factor 2 approx. algorithm We now show that the proposed algorithm is indeed a factor 2 approximation algorithm for metric TSP Observe that:  Removing any edge from an optimal solution to TSP would give a spanning tree of the graph.  So the cost of an MST in the graph can be used as lower bound for obtaining factor 2 for this algorithm

Metric TSP - factor 2 approx. algorithm  Therefore, cost(T) <= OPT  T’ contains each edge of T twice, so cost(T’) = 2*cost(T)  Also, cost(C) <= cost(T’) because of triangle inequality  Hence cost(C) <= 2*OPT

FACTOR 3/2 APPROXIMATION ALGORITHM FOR TSP

Metric TSP – improving the factor to 3/2 Observations: Consider why did we have to double the MST – to obtain an Euler tour. Can we have an Euler tour with lower cost? YES ! A graph has an Euler tour if and only if all its vertices have even degrees. We therefore need to be bothered about the vertices of odd degree only.

Metric TSP - improving the factor to 3/2  Let V’ be the set of vertices of odd degree  Cardinality of V’ must be even. WHY? Because the sum of degrees of all vertices in MST has to be even.  Add to the MST, a minimum cost perfect matching on V’ so that every vertex has an even degree.  We also know that a polynomial time algorithm exists for finding the minimum cost perfect matching.

Metric TSP - factor 3/2 approx. algorithm  Step 1: Find an MST, T, of G.  Step 2: Compute a minimum cost perfect matching, M, on the odd degree vertices of T. Add M to T and obtain an Eulerian graph.  Step 3: Find an Euler tour, T’, of this graph.  Step 4: Output the tour that visits vertices of G in order of their first appearance in T’. Call this tour C.

V1V2V8 V4V3 V7 V5 V6V9 V10 Step1: Compute Minimum Spanning Tree

Step2: Compute Minimum Cost Perfect Matching V1V2V8 V4V3 V7 V5 V6V9 V10 V1, V3, V6, V7, V8, V10 are odd degree vertices

V1V2V8 V4V3 V7 V5 V6V9 V10 V1  V2  V3  V4  V5  V6  V3  V7  V9  V10  V7  V8  V1 Eulerian Cycle : Step 3: Computing Eulerian Cycle A cycle is one in which each edge visited exactly once

Step 4: Computing solution for TSP V1V2V8 V4V3 V7 V5 V6V9 V10 Solution for TSP : V1  V2  V3  V4  V5  V6  V7  V9  V10  V8  V1

Approximate solution for TSP V1V2V8 V4V3 V7 V5 V6V9 V10 Solution for TSP : V1  V2  V3  V4  V5  V6  V7  V9  V10  V8  V1

Metric TSP - factor 3/2 approx. algorithm In order to show that the proposed algorithm is a factor 3/2 approximation algorithm for metric TSP, we first need to understand the following: Given a subset V’ of V with even number of elements, and a minimum cost perfect matching M on V’, cost(M) <= OPT/2 Let us try to prove the above result !

Consider an optimal TSP tour of G, say t. Let t’ be the tour on V’ obtained by shortcutting t. Clearly, cost(t’)<=cost(t) because of triangle inequality. Now t’ is the union of two perfect matchings on V’ each consisting of alternate edges of t. Therefore, the cheaper of these matchings has cost <= cost(t’)/2<=OPT/2. Hence the optimal matching also has cost at most OPT/2. Metric TSP - factor 3/2 approx. algorithm

In view of this result, let us now see if the proposed algorithm ensures an approximation guarantee of 3/2 for metric TSP Problem Cost of the Euler tour, Using triangle inequality, cost(C)<=cost(T’). Hence Proved! Metric TSP - factor 3/2 approx. algorithm

Swati Singhal Varun Mendiratta Sumedha Upadhyaya Prachi Nagpal Acknowledgements

Any Questions….

Thank You!