Polynomial Time Approximation Schemes and Parameterized Complexity Jianer Chen Texas A&M University Joint work with Xiuzhen Huang, Ge Xia, and I. Kanj.

Slides:



Advertisements
Similar presentations
Analysis of Algorithms
Advertisements

Minimum Clique Partition Problem with Constrained Weight for Interval Graphs Jianping Li Department of Mathematics Yunnan University Jointed by M.X. Chen.
Minimum Vertex Cover in Rectangle Graphs
Approximation Algorithms
Generalization and Specialization of Kernelization Daniel Lokshtanov.
An Introduction to Computational Complexity Edith Elkind IAM, ECS.
What is Intractable? Some problems seem too hard to solve efficiently. Question 1: Does an efficient algorithm exist?  An O(a ) algorithm, where a > 1,
Bart Jansen, Utrecht University. 2  Max Leaf  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least.
The Theory of NP-Completeness
CS774. Markov Random Field : Theory and Application Lecture 17 Kyomin Jung KAIST Nov
PCPs and Inapproximability Introduction. My T. Thai 2 Why Approximation Algorithms  Problems that we cannot find an optimal solution.
Complexity 16-1 Complexity Andrei Bulatov Non-Approximability.
On the complexity of finding common approximate substrings Theoretical Computer Science 306 (2003) Patricia A. Evans, Andrew D. Smith, H. Todd.
Computability and Complexity 23-1 Computability and Complexity Andrei Bulatov Search and Optimization.
Complexity 15-1 Complexity Andrei Bulatov Hierarchy Theorem.
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
NP-Complete Problems Reading Material: Chapter 10 Sections 1, 2, 3, and 4 only.
The Theory of NP-Completeness
Randomized Process of Unknowns and Implicitly Enforced Bounds on Parameters Jianer Chen Department of Computer Science & Engineering Texas A&M University.
Computability and Complexity 24-1 Computability and Complexity Andrei Bulatov Approximation.
Algoritmi on-line e risoluzione di problemi complessi Carlo Fantozzi
1 Refined Search Tree Technique for Dominating Set on Planar Graphs Jochen Alber, Hongbing Fan, Michael R. Fellows, Henning Fernau, Rolf Niedermeier, Fran.
Data reduction lower bounds: Problems without polynomial kernels Hans L. Bodlaender Joint work with Downey, Fellows, Hermelin, Thomasse, Yeo.
Complexity Classes Kang Yu 1. NP NP : nondeterministic polynomial time NP-complete : 1.In NP (can be verified in polynomial time) 2.Every problem in NP.
Fixed Parameter Complexity Algorithms and Networks.
Computational Complexity Polynomial time O(n k ) input size n, k constant Tractable problems solvable in polynomial time(Opposite Intractable) Ex: sorting,
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
1 The Theory of NP-Completeness 2012/11/6 P: the class of problems which can be solved by a deterministic polynomial algorithm. NP : the class of decision.
Nattee Niparnan. Easy & Hard Problem What is “difficulty” of problem? Difficult for computer scientist to derive algorithm for the problem? Difficult.
Complexity Classes (Ch. 34) The class P: class of problems that can be solved in time that is polynomial in the size of the input, n. if input size is.
Approximation schemes Bin packing problem. Bin Packing problem Given n items with sizes a 1,…,a n  (0,1]. Find a packing in unit-sized bins that minimizes.
1 Approximation Through Scaling Algorithms and Networks 2014/2015 Hans L. Bodlaender Johan M. M. van Rooij.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
Closest String with Wildcards ( CSW ) Parameterized Complexity Analysis for the Closest String with Wildcards ( CSW ) Problem Danny Hermelin Liat Rozenberg.
The Complexity of Optimization Problems. Summary -Complexity of algorithms and problems -Complexity classes: P and NP -Reducibility -Karp reducibility.
Approximation Algorithms for Knapsack Problems 1 Tsvi Kopelowitz Modified by Ariel Rosenfeld.
Approximation Algorithms
Week 10Complexity of Algorithms1 Hard Computational Problems Some computational problems are hard Despite a numerous attempts we do not know any efficient.
Princeton University COS 423 Theory of Algorithms Spring 2001 Kevin Wayne Approximation Algorithms These lecture slides are adapted from CLRS.
CSCI 3160 Design and Analysis of Algorithms Tutorial 10 Chengyu Lin.
1 The Theory of NP-Completeness 2 Cook ’ s Theorem (1971) Prof. Cook Toronto U. Receiving Turing Award (1982) Discussing difficult problems: worst case.
FPT is Characterized by Useful Obstruction Sets Bart M. P. Jansen Joint work with Michael R. Fellows, Charles Darwin Univ. June 21st 2013, WG 2013, Lübeck.
Non-Approximability Results. Summary -Gap technique -Examples: MINIMUM GRAPH COLORING, MINIMUM TSP, MINIMUM BIN PACKING -The PCP theorem -Application:
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
CS 3343: Analysis of Algorithms Lecture 25: P and NP Some slides courtesy of Carola Wenk.
CSE 589 Part V One of the symptoms of an approaching nervous breakdown is the belief that one’s work is terribly important. Bertrand Russell.
Algorithms for hard problems Parameterized complexity – definitions, sample algorithms Juris Viksna, 2015.
NP-completeness NP-complete problems. Homework Vertex Cover Instance. A graph G and an integer k. Question. Is there a vertex cover of cardinality k?
1 Approximation algorithms Algorithms and Networks 2015/2016 Hans L. Bodlaender Johan M. M. van Rooij TexPoint fonts used in EMF. Read the TexPoint manual.
Algorithms for hard problems Introduction Juris Viksna, 2015.
NP Completeness Piyush Kumar. Today Reductions Proving Lower Bounds revisited Decision and Optimization Problems SAT and 3-SAT P Vs NP Dealing with NP-Complete.
Final Review Chris and Virginia. Overview One big multi-part question. (Likely to be on data structures) Many small questions. (Similar to those in midterm.
Young CS 331 D&A of Algo. NP-Completeness1 NP-Completeness Reference: Computers and Intractability: A Guide to the Theory of NP-Completeness by Garey and.
Lecture. Today Problem set 9 out (due next Thursday) Topics: –Complexity Theory –Optimization versus Decision Problems –P and NP –Efficient Verification.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
1 The instructor will be absent on March 29 th. The class resumes on March 31 st.
The NP class. NP-completeness Lecture2. The NP-class The NP class is a class that contains all the problems that can be decided by a Non-Deterministic.
Approximation algorithms
The NP class. NP-completeness
P & NP.
Chapter 10 NP-Complete Problems.
8.3.2 Constant Distance Approximations
8.2 – Strong NP Completeness
Optimization problems such as
Algorithms for hard problems
NP-Completeness Yin Tat Lee
Computability and Complexity
ICS 353: Design and Analysis of Algorithms
NP-Completeness Yin Tat Lee
NP-Completeness Reference: Computers and Intractability: A Guide to the Theory of NP-Completeness by Garey and Johnson, W.H. Freeman and Company, 1979.
Presentation transcript:

Polynomial Time Approximation Schemes and Parameterized Complexity Jianer Chen Texas A&M University Joint work with Xiuzhen Huang, Ge Xia, and I. Kanj

Approximation Algorithms and Parameterized Algorithms Assuming P  NPAssuming P  NP Both approximation algorithms and parameterized algorithms tend to solve intractable problems (in particular, NP- hard problems)Both approximation algorithms and parameterized algorithms tend to solve intractable problems (in particular, NP- hard problems) Approximation algorithms solve NP-hard problems with approximation solutionsApproximation algorithms solve NP-hard problems with approximation solutions Parameterized algorithms solve NP-hard problems with small parameters.Parameterized algorithms solve NP-hard problems with small parameters.

Some Definitions FPT: fixed-parameter tractable algorithms:FPT: fixed-parameter tractable algorithms: for a given instance x and a parameter k (k is small), solve the problem in time f (k)n c. for a given instance x and a parameter k (k is small), solve the problem in time f (k)n c. PTAS: poly-time approximation schemesPTAS: poly-time approximation schemes for a given instance x and   , construct a solution with approximation ratio  in polynomial time. for a given instance x and   , construct a solution with approximation ratio  in polynomial time. FPTAS: if the time is polynomial in both |x| and 1/ FPTAS: if the time is polynomial in both |x| and 1/  EPTAS: if the time is f (1/  )n cEPTAS: if the time is f (1/  )n c

Any Connections? Both FPT and PTAS (in particular FPTAS and EPTAS) problems are “easier” intractable problemsBoth FPT and PTAS (in particular FPTAS and EPTAS) problems are “easier” intractable problems FPTAS  FPT (Cai-Chen, 1997)FPTAS  FPT (Cai-Chen, 1997) EPTAS  FPT (Cesati-Trevisan, 1997)EPTAS  FPT (Cesati-Trevisan, 1997) Max-SNP  FPT (Cai-Chen, 1997)Max-SNP  FPT (Cai-Chen, 1997)

We Discuss More Precise Relationships in This Talk Under a very general condition, we present a precise characterization of FPTAS in terms of parameterized complexity Based on the W-hierarchy in parameterized complexity, we introduce a syntactic EPTAS class that seems to characterize most EPTAS problems

Parameterizing Optimization Problems Q = ( I Q, S Q, f Q, opt Q ): NP optimization problem If opt Q = max :If opt Q = max : Q  = { ( x, k ) | x  I Q and opt Q ( x )  k } Solving Q  : for a yes-instance ( x, k ), construct y  S Q ( x ) such that f Q ( x, y )  k Solving Q  : for a yes-instance ( x, k ), construct y  S Q ( x ) such that f Q ( x, y )  k If opt Q = min :If opt Q = min : Q  = { ( x, k ) | x  I Q and opt Q ( x )  k } Solving Q  : for a yes-instance ( x, k ), construct y  S Q ( x ) such that f Q ( x, y )  k Solving Q  : for a yes-instance ( x, k ), construct y  S Q ( x ) such that f Q ( x, y )  k

Scalability An optimization problem Q = ( I Q, S Q, f Q, opt Q ) is scalable If there are poly-time computable functions g 1 and g 2 and a polynomial q: 1.for any instance x of Q, and integer d > 1, x d = g 1 (x, d) is an instance of Q such that | opt Q (x d ) - opt Q (x)/d|  q(|x|) | opt Q (x d ) - opt Q (x)/d|  q(|x|) 2. for any solution y d to x d, y = g 2 (x d, y d ) is a solution to x such that | f Q (x d, y d ) - f Q (x, y)/d|  q(|x|) | f Q (x d, y d ) - f Q (x, y)/d|  q(|x|)

Most NP optimization problems are scalable If f Q (x, y) is bounded by a polynomial of |x|, simply let g 1 (x, d)=x, g 2 (x d, y d )= y dIf f Q (x, y) is bounded by a polynomial of |x|, simply let g 1 (x, d)=x, g 2 (x d, y d )= y d In general, a “number problem”, such as Knapsack and Makespan, has its solution values bounded by a polynomial of the values of the numbers in its instances. Then g 1 (x, d) can be simply “dividing each number in x by d then round it”, and g 2 (x d, y d ) is “the solution of x corresponding to y d ”In general, a “number problem”, such as Knapsack and Makespan, has its solution values bounded by a polynomial of the values of the numbers in its instances. Then g 1 (x, d) can be simply “dividing each number in x by d then round it”, and g 2 (x d, y d ) is “the solution of x corresponding to y d ”

FPTAS and Efficient-FPT Definition. A parameterized problem is efficient-FPT if its has an algorithm whose running time is bounded by a polynomial of |x| and k on input (x, k). Theorem. Let Q be a scalable NP optimization problem. Then Q has an FPTAS if and only if Q is efficient-FPT.

Proof. FPTAS  efficient-FPT: Cai-Chen 1997 Efficient-FPT  FPTAS: Let Q be a maximization problem, and Q  its parameterized version. For an instance x of Q and   0 1.let x 1 = g 1 (x,1); if (x 1, 3q(n)/  )  Q , then try all instances (x, 1), (x, 2), …, (x, 3q(n)/  + q(n)) to construct an optimal solution for x; STOP. 2.use binary search on d to find an integer d  1 such that (x d, 3q(n)/  )  Q , but (x d+1, 3 q(n)/  )  Q  ; 3.construct an optimal solution y d for x d ; 4.let y 0 = g 2 (x d, y d ) and output y 0 as a solution for x.

Remarks on the algorithm (x 1, 3q(n)/  )  Q , implies opt Q (x) < 3q(n)/  + q(n), thus, step 1 construct an optimal solution;(x 1, 3q(n)/  )  Q , implies opt Q (x) < 3q(n)/  + q(n), thus, step 1 construct an optimal solution; The existence of integer d  1 such that (x d, 3q(n)/  )  Q  and (x d+1, 3q(n)/  )  Q  is because (x 1, 3q(n)/  )  Q  and (x 2 r(n), 3q(n)/  )  Q  ;The existence of integer d  1 such that (x d, 3q(n)/  )  Q  and (x d+1, 3q(n)/  )  Q  is because (x 1, 3q(n)/  )  Q  and (x 2 r(n), 3q(n)/  )  Q  ; (x d+1, 3 q(n)/  )  Q  makes opt Q (x d ) bounded by a polynomial of n and 1/  so the optimal solution y d can be constructed;(x d+1, 3 q(n)/  )  Q  makes opt Q (x d ) bounded by a polynomial of n and 1/  so the optimal solution y d can be constructed; (x d, 3q(n)/  )  Q  provides good lower bound for y d.(x d, 3q(n)/  )  Q  provides good lower bound for y d.

Remarks on the theorem It has been a long time interest to characterize FPTAS;It has been a long time interest to characterize FPTAS; Early research (Ausiello et al 1980, and Paz-Moran 1981) uses p-time computable functions (no clue how to detect the existence of such functions);Early research (Ausiello et al 1980, and Paz-Moran 1981) uses p-time computable functions (no clue how to detect the existence of such functions); Recent research (Woeginger 2001) is based on a dynamic programming scheme;Recent research (Woeginger 2001) is based on a dynamic programming scheme; Ours tells explicitly how an efficient-FPT algorithm is converted to an FPTAS, and seems to be a superclass of Woeginger’s.Ours tells explicitly how an efficient-FPT algorithm is converted to an FPTAS, and seems to be a superclass of Woeginger’s.

Brief Review on PTAS PTAS has been extremely interesting in theoretical computer science;PTAS has been extremely interesting in theoretical computer science; Khanna-Motwani’s characterization (1996);Khanna-Motwani’s characterization (1996); Baker’s algorithms on planar graphs (1994);Baker’s algorithms on planar graphs (1994); Extensions to higher genus graphs (-2003);Extensions to higher genus graphs (-2003); Impracticality of general PTAS – introduction of EPTAS (Downey’s and Fellows’ surveys 2003);Impracticality of general PTAS – introduction of EPTAS (Downey’s and Fellows’ surveys 2003); Khanna-Motwani’s contains non-EPTAS (Cai-Fellows-Juedes-Rosamond 2003)Khanna-Motwani’s contains non-EPTAS (Cai-Fellows-Juedes-Rosamond 2003)

Our Characterization of EPTAS MotivationsMotivations Based on W-hierarchy in parameterized complexity;Based on W-hierarchy in parameterized complexity; Seems to include most EPTAS problems;Seems to include most EPTAS problems; Different from Khanna-Motwani – ours contains only EPTAS;Different from Khanna-Motwani – ours contains only EPTAS; Not a subclass of Khanna-Motwani – ours contains problems not in Khanna-Motwani;Not a subclass of Khanna-Motwani – ours contains problems not in Khanna-Motwani; Contain all FPTAS problems via reductions.Contain all FPTAS problems via reductions.

Definitions Planar Min-W[h]: given a planar monotone  -circuit of depth h, construct a satisfying assignment of min weight. (planar circuits: become planar after removing the output gate);Planar Min-W[h]: given a planar monotone  -circuit of depth h, construct a satisfying assignment of min weight. (planar circuits: become planar after removing the output gate); Similarly define Planar Max-W[h] and planar W[h]-SAT.Similarly define Planar Max-W[h] and planar W[h]-SAT.

Planar W-hierarchy Optimization problems that are FPTAS-reducible to one of Planar Min-W[h], Planar Max-W[h], and Planar W[h]-SAT.

Examples in Planar W-hierarchy on planar graphs belongs to Planar Min-W[2] ;Vertex Cover on planar graphs belongs to Planar Min-W[2] ; on planar graphs belongs to Planar Max-W[2] ;Independent Set on planar graphs belongs to Planar Max-W[2] ; of Khanna-Motwani belongs to planar W[2]-SATPlanar MaxSAT of Khanna-Motwani belongs to planar W[2]-SAT

Theorem. All problems in the Planar W-hierarchy have EPTAS Proof. Only need to prove this for Planar Min-W[h], Planar Max-W[h], and Planar W[h]-SAT. Extension of Baker’s constructions or by tree decomposition (Alber-Bodlaender-Fernau- Kloks-Niedermeier, 2002). Extension of Baker’s constructions or by tree decomposition (Alber-Bodlaender-Fernau- Kloks-Niedermeier, 2002).

Corollary. All problems in the Planar W-hierarchy are FPT. Proof. By Cesati-Trevison 1997.

FPT versus APX (further discussion) Fact: all MaxSNP problems are FPT;Fact: all MaxSNP problems are FPT; Relationship between FPT and APXRelationship between FPT and APX not clear: longest-path  FPT – APX binpacking  APX – FPT

FPT versus APX (further discussion) More problems in FPT – APX:More problems in FPT – APX: Controlled by graph genus: e.g. Independent Set on graphs of genus n c for any 1 < c < 2 (based on Chen-Kanj-Perkovic- Sedgwick-Xia 2003); FPT seems harder than APXFPT seems harder than APX except binpacking  APX – FPT; except binpacking  APX – FPT; Is every W[h]-complete problem non-APX, for h > 0?Is every W[h]-complete problem non-APX, for h > 0?

Concluding Remarks Nice relationships between FPT and approximability;Nice relationships between FPT and approximability; Characterization of efficient PTAS (FPTAS and EPTAS);Characterization of efficient PTAS (FPTAS and EPTAS); Further connections (in particular with APX).Further connections (in particular with APX).