Linear Programming and Parameterized Algorithms. Linear Programming n real-valued variables, x 1, x 2, …, x n. Linear objective function. Linear (in)equality.

Slides:



Advertisements
Similar presentations
Bart Jansen 1.  Problem definition  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least k leaves?
Advertisements

C&O 355 Lecture 23 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
1 Matching Polytope x1 x2 x3 Lecture 12: Feb 22 x1 x2 x3.
Generalization and Specialization of Kernelization Daniel Lokshtanov.
C&O 355 Mathematical Programming Fall 2010 Lecture 22 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
Totally Unimodular Matrices
Bart Jansen, Utrecht University. 2  Max Leaf  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least.
1 NP-completeness Lecture 2: Jan P The class of problems that can be solved in polynomial time. e.g. gcd, shortest path, prime, etc. There are many.
Fixed Parameter Complexity Algorithms and Networks.
Bart Jansen, Utrecht University. 2  Max Leaf  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least.
LP-Based Parameterized Algorithms for Separation Problems D. Lokshtanov, N.S. Narayanaswamy V. Raman, M.S. Ramanujan S. Saurabh.
Fast FAST By Noga Alon, Daniel Lokshtanov And Saket Saurabh Presentation by Gil Einziger.
Complexity 16-1 Complexity Andrei Bulatov Non-Approximability.
Computability and Complexity 23-1 Computability and Complexity Andrei Bulatov Search and Optimization.
Introduction to Approximation Algorithms Lecture 12: Mar 1.
Computational problems, algorithms, runtime, hardness
Linear Programming and Approximation
Totally Unimodular Matrices Lecture 11: Feb 23 Simplex Algorithm Elliposid Algorithm.
1 Introduction to Linear and Integer Programming Lecture 9: Feb 14.
Approximation Algorithm: Iterative Rounding Lecture 15: March 9.
Vertex Cover, Dominating set, Clique, Independent set
Approximation Algorithms
2-Layer Crossing Minimisation Johan van Rooij. Overview Problem definitions NP-Hardness proof Heuristics & Performance Practical Computation One layer:
Computability and Complexity 24-1 Computability and Complexity Andrei Bulatov Approximation.
Job Scheduling Lecture 19: March 19. Job Scheduling: Unrelated Multiple Machines There are n jobs, each job has: a processing time p(i,j) (the time to.
Linear Programming – Max Flow – Min Cut Orgad Keller.
1 Introduction to Approximation Algorithms Lecture 15: Mar 5.
1 Spanning Tree Polytope x1 x2 x3 Lecture 11: Feb 21.
C&O 355 Mathematical Programming Fall 2010 Lecture 17 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
C&O 355 Lecture 2 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
Fixed Parameter Complexity Algorithms and Networks.
C&O 355 Mathematical Programming Fall 2010 Lecture 2 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A.
Fixed Parameter Complexity Algorithms and Networks.
Nattee Niparnan. Easy & Hard Problem What is “difficulty” of problem? Difficult for computer scientist to derive algorithm for the problem? Difficult.
1 The TSP : NP-Completeness Approximation and Hardness of Approximation All exact science is dominated by the idea of approximation. -- Bertrand Russell.
C&O 355 Mathematical Programming Fall 2010 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
Design Techniques for Approximation Algorithms and Approximation Classes.
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
On realizing shapes in the theory of RNA neutral networks Speaker: Leszek Gąsieniec, U of Liverpool, UK Joint work with: Peter Clote, Boston College, USA.
Lecture 22 More NPC problems
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
1 Bart Jansen Vertex Cover Kernelization Revisited: Upper and Lower Bounds for a Refined Parameter STACS 2011, Dortmund March 10 th, 2011 Joint work with.
1 Bart Jansen Independent Set Kernelization for a Refined Parameter: Upper and Lower bounds TACO Day, Utrecht January 12 th, 2011 Joint work with Hans.
1 Steiner Tree Algorithms and Networks 2014/2015 Hans L. Bodlaender Johan M. M. van Rooij.
Week 10Complexity of Algorithms1 Hard Computational Problems Some computational problems are hard Despite a numerous attempts we do not know any efficient.
1 Bart Jansen Independent Set Kernelization for a Refined Parameter: Upper and Lower bounds ALGORITMe Staff Colloquium, Utrecht September 10 th, 2010 Joint.
EMIS 8373: Integer Programming NP-Complete Problems updated 21 April 2009.
TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A Image:
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
Minicourse on parameterized algorithms and complexity Part 4: Linear programming Dániel Marx (slides by Daniel Lokshtanov) Jagiellonian University in Kraków.
Flipping letters to minimize the support of a string Giuseppe Lancia, Franca Rinaldi, Romeo Rizzi University of Udine.
CPSC 536N Sparse Approximations Winter 2013 Lecture 1 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAAAAAAA.
CPS Computational problems, algorithms, runtime, hardness (a ridiculously brief introduction to theoretical computer science) Vincent Conitzer.
Data Reduction for Graph Coloring Problems Bart M. P. Jansen Joint work with Stefan Kratsch August 22 nd 2011, Oslo.
1 Approximation algorithms Algorithms and Networks 2015/2016 Hans L. Bodlaender Johan M. M. van Rooij TexPoint fonts used in EMF. Read the TexPoint manual.
C&O 355 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Kernel Bounds for Path and Cycle Problems Bart M. P. Jansen Joint work with Hans L. Bodlaender & Stefan Kratsch September 8 th 2011, Saarbrucken.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Lap Chi Lau we will only use slides 4 to 19
Joint work with Hans Bodlaender
Topics in Algorithms Lap Chi Lau.
Computability and Complexity
Constrained Bipartite Vertex Cover: The Easy Kernel is Essentially Tight Bart M. P. Jansen June 4th, WORKER 2015, Nordfjordeid, Norway.
Parameterised Complexity
Linear Programming and Approximation
Linear Programming Duality, Reductions, and Bipartite Matching
Problem Solving 4.
Presentation transcript:

Linear Programming and Parameterized Algorithms

Linear Programming n real-valued variables, x 1, x 2, …, x n. Linear objective function. Linear (in)equality constraints. Solvable in polynomial time.

Integer Linear Programming n integer-valued variables, x 1, x 2, …, x n. Linear objective function. Linear (in)equality constraints. NP-complete. Lingo: Linear Programs (LP’s), Integer Linear Programs (ILP’s)

Vertex Cover Have seen a kernel with O(k 2 ) vertices, will see a kernel with 2k vertices.

Vertex Cover (I)LP

Nemhauser Trotter Theorem

Matchings and Hall Sets A matching in a graph is a set of edges that do not share any endpoints. A matching saturates a vertex set S if every vertex in S is incident to a matching edge. A vertex set S is a Hall set if it is independent and |N(S)| < |S|. A Hall set may never be saturated!

Hall’s Theorem Theorem: A bipartite graph has a matching such that every left hand side vertex is saturated ⇔ there is no Hall set on the left hand side.

Hall’s Theorem Example Matching (so no Hall set) Hall set (so no matching)

Nemhauser Trotter Theorem

Nemhauser Trotter Proof This clearly proves (a), but why does it prove (b)? Left Right

Reduction Rule If exists optimal LP solution that sets x v to 1, then exists optimal vertex cover that selects v.  Remove v from G and decrease k by 1. Correctness follows from Nemhauser Trotter Polynomial time by LP solving.

Kernel No vertex is 1. No vertex is 0 (remove isolated vertices)

Above LP Vertex Cover

Vertex Cover Above LP

Reduction Rule Recall the reduction rules from the kernel for Vertex Cover: – If exists optimal LP solution that sets x v to 1, then exists optimal vertex cover that selects v. – Remove v from G and decrease k by 1. – Remove vertices of degree 0.

Reduction affects k-OPT LP ? Reduction rule: If exists optimal LP solution that sets x v to 1  Remove v and decrease k by 1. OPT LP decreases by exactly 1. Why? v Feasible LP Solution to G\u 1 k-OPT LP is unchanged!

Branching

Branching - Analysis

Vertex Cover recap Is this useful when compared to a 1.38 k algorithm?

Almost 2-SAT * Remove all clauses that contain the variable

Odd Cycle Transversal (OCT) Will give algorithms for Almost 2-SAT and OCT, using FPT-reductions to Vertex Cover above LP!

Odd Cycle Transversal  Almost 2-Sat xy z xy z

Almost 2-SAT  Vertex Cover/k-LP

Consequences

LP versus ILP We saw an application of LP’s in parameterized algorithms. ILP solving is NP-hard. Useless for algorithms? No! We can use parameterized algorithms for Integer Linear Programming.

Integer Linear Programming Theorem: k 4.5k poly(L) time algorithm, where k is the number of variables, and L is the number of bits encoding the instance.

Closest String Note: the parameter is the number of strings, not k

Closest String as Hit & Miss For every position, need to choose the letter of solution string s. For all strings s differs from at that position, increase distance by one. Can’t miss any string more than k times.

Closest String Alphabet Reduction Can assume that alphabet size is at most n

Column Types

Closest String ILP After alphabet reduction, there are at most n n column types. Count the number of columns of each column type.

ILP For each column type, make n variables, one for each letter. Constraints: For each column type t, the chosen letters add up to the number of type t.

Objective Function For a string s i and column type t, let s i [t] be the letter of s i in columns of type t. For each string s i, its distance from the solution string s is Objective is Minimize Max d i

Algorithm for Closest String

Conclusions (Integer) Linear Programming is a useful tool for parameterized algorithms. Has not yet been explored in great depth

Exercises Show that ILP is NP-hard. Show that the clause deletion version of Almost 2-SAT is FPT by reduction to Almost 2-SAT. Book: 3.20, 3.23

Surplus

Surplus and Reductions If «all ½» is the unique LP optimum then surplus(I) > 0 for all independent sets. Can we say anything meaningful for independent sets of surplus 1? 2? k?

Surplus Branching Lemma Let I be an independent set in G with minimum surplus. There exists an optimal vertex cover C that either contains I or avoids I.

Surplus Branching Lemma Proof IN(I) R

Branching Rule Find an independent set I of minimum surplus. Branch: Either put all of I into solution, or put all of N(I) into solution. Correct by branching lemma. Need to analyze measure drop in both branches.

Branching Rule

Branching Rule Analysis Cont’d v 1/2 I N(I) 0 1

Branching Summary

Reducing Surplus 1 sets. Lemma: If surplus(I) = 1, I has minimum surplus and N(I) is not independent then there exists an optimum vertex cover containing N(I). I N(I) R

Reducing Surplus 1 Sets

Reducing Surplus 1 sets. Reduction Rule: If surplus(I) = 1, I has minimum surplus and N(I) is independent then solve (G’,k-|I|) where G’ is G with N[I] contracted to a single vertex v. I N(I) R OPT LP decreases by at most |I| (why?)

Summary The correctness of these rules were also proved by NT!

Can we do better?

Better OCT?

LP Branching in other cases I believe more problems should have FPT algorithms by LP-guided branching. One example: Multiway Cut. What about... (Directed) Feedback Vertex Set, parameterized by solution size k?