Integer Programming Difference from linear programming –Variables x i must take on integral values, not real values Lots of interesting problems can be.

Slides:



Advertisements
Similar presentations
A threshold of ln(n) for approximating set cover By Uriel Feige Lecturer: Ariel Procaccia.
Advertisements

Approximation Algorithms Chapter 14: Rounding Applied to Set Cover.
The Theory of NP-Completeness
1 of 56 Linear Programming-Based Approximation Algorithms Shoshana Neuburger Graduate Center, CUNY May 13, 2009.
Instructor Neelima Gupta Table of Contents Lp –rounding Dual Fitting LP-Duality.
Graphs 4/16/2017 8:41 PM NP-Completeness.
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
NP-Complete Problems Reading Material: Chapter 10 Sections 1, 2, 3, and 4 only.
Approximation Algorithms
NP-Complete Problems Problems in Computer Science are classified into
NP-Completeness (2) NP-Completeness Graphs 4/17/2017 6:25 AM x x x x x
Job Scheduling Lecture 19: March 19. Job Scheduling: Unrelated Multiple Machines There are n jobs, each job has: a processing time p(i,j) (the time to.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
CSE 421 Algorithms Richard Anderson Lecture 27 NP Completeness.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
1 Introduction to Approximation Algorithms Lecture 15: Mar 5.
Approximation Algorithms Motivation and Definitions TSP Vertex Cover Scheduling.
Approximation Algorithms: Bristol Summer School 2008 Seffi Naor Computer Science Dept. Technion Haifa, Israel TexPoint fonts used in EMF. Read the TexPoint.
1 Lecture 4 Maximal Flow Problems Set Covering Problems.
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
1 The Theory of NP-Completeness 2012/11/6 P: the class of problems which can be solved by a deterministic polynomial algorithm. NP : the class of decision.
NP-Completeness: 3D Matching
Design Techniques for Approximation Algorithms and Approximation Classes.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
1 1. Draw the machine schema for a TM which when started with input 001 halts with abbb on the tape in our standard input format. 2. Suppose you have an.
The Complexity of Optimization Problems. Summary -Complexity of algorithms and problems -Complexity classes: P and NP -Reducibility -Karp reducibility.
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
Final Exam Review Final exam will have the similar format and requirements as Mid-term exam: Closed book, no computer, no smartphone Calculator is Ok Final.
Week 10Complexity of Algorithms1 Hard Computational Problems Some computational problems are hard Despite a numerous attempts we do not know any efficient.
EMIS 8373: Integer Programming NP-Complete Problems updated 21 April 2009.
CSC401 – Analysis of Algorithms Chapter 13 NP-Completeness Objectives: Introduce the definitions of P and NP problems Introduce the definitions of NP-hard.
Computer Science Day 2013, May Distinguished Lecture: Andy Yao, Tsinghua University Welcome and the 'Lecturer of the Year' award.
1 The Theory of NP-Completeness 2 Cook ’ s Theorem (1971) Prof. Cook Toronto U. Receiving Turing Award (1982) Discussing difficult problems: worst case.
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
Unit 9: Coping with NP-Completeness
NP-Complete Problems. Running Time v.s. Input Size Concern with problems whose complexity may be described by exponential functions. Tractable problems.
Linear Program Set Cover. Given a universe U of n elements, a collection of subsets of U, S = {S 1,…, S k }, and a cost function c: S → Q +. Find a minimum.
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
1.1 Chapter 3: Proving NP-completeness Results Six Basic NP-Complete Problems Some Techniques for Proving NP-Completeness Some Suggested Exercises.
CSE 589 Part V One of the symptoms of an approaching nervous breakdown is the belief that one’s work is terribly important. Bertrand Russell.
Lecture.6. Table of Contents Lp –rounding Dual Fitting LP-Duality.
NP Completeness Piyush Kumar. Today Reductions Proving Lower Bounds revisited Decision and Optimization Problems SAT and 3-SAT P Vs NP Dealing with NP-Complete.
CSC 413/513: Intro to Algorithms
Approximation Algorithms for Combinatorial Auctions with Complement-Free Bidders Speaker: Shahar Dobzinski Joint work with Noam Nisan & Michael Schapira.
CSE 421 Algorithms Richard Anderson Lecture 27 NP-Completeness Proofs.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Instructor: Shengyu Zhang 1. Optimization Very often we need to solve an optimization problem.  Maximize the utility/payoff/gain/…  Minimize the cost/penalty/loss/…
Approximation Algorithms based on linear programming.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Approximation algorithms
ICS 353: Design and Analysis of Algorithms NP-Complete Problems King Fahd University of Petroleum & Minerals Information & Computer Science Department.
NP-Completeness (2) NP-Completeness Graphs 4/13/2018 5:22 AM x x x x x
Chapter 10 NP-Complete Problems.
Integer Programming An integer linear program (ILP) is defined exactly as a linear program except that values of variables in a feasible solution have.
Richard Anderson Lecture 26 NP-Completeness
NP-Completeness (2) NP-Completeness Graphs 7/23/ :02 PM x x x x
NP-Completeness (2) NP-Completeness Graphs 7/23/ :02 PM x x x x
NP-Completeness Proofs
Richard Anderson Lecture 26 NP-Completeness
NP-Completeness (2) NP-Completeness Graphs 11/23/2018 2:12 PM x x x x
Richard Anderson Lecture 25 NP-Completeness
NP-Completeness NP-Completeness Graphs 12/6/2018 1:58 PM x x x x x x x
Richard Anderson Lecture 28 NP-Completeness
Richard Anderson Lecture 28 Coping with NP-Completeness
CSE 6408 Advanced Algorithms.
Topics in Algorithms 2005 Max Cuts
NP-Completeness (2) NP-Completeness Graphs 7/9/2019 6:12 AM x x x x x
Presentation transcript:

Integer Programming Difference from linear programming –Variables x i must take on integral values, not real values Lots of interesting problems can be formulated as integer programs Unfortunately, integer programming is NP-hard –Even when we restrict to choices 0 and 1 for vars Despite this difficulty, formulating a problem as an integer program can still be very useful in developing a good approximation algorithm for a problem

Algorithmic Techniques Formulate problem as an integer program (IP) Relax it to create a linear program (LP) –Solvable in polynomial time –The LP solution is a lower (upper) bound on the IP solution –The “gap” between these is often referred to as the integrality gap Get an integral solution –Round solution to create an integer solution with some form of performance guarantee –Argue problem has structure that optimal solution is guaranteed to be integral –Use LP solution as a guide for your algorithm –Primal-dual methods to gain good approximation bounds

Formulating Integer Programs Indicator variables –A variable x i often takes values 0 or 1 to encode a choice in the final solution structure –Value 0 means that some element is NOT part of the final solution –Value 1 means that some element IS part of the final solution –See associated worksheet for exercise on formulating problems as integer programs

Set Cover Universe of elements U = {u 1, …, u n } Subsets S 1, …, S m of U Weights (costs) w j ≥ 0 for each subset S j Goal: Find a collection I from {1, …, m} that minimizes ∑ j in I w j such that the union of S j = T

Approximation Algorithm Formulate an integer program IP Relax IP to create an LP Solve LP to create optimal solution x * Round solution to create integral solution as follows –If x i * > 1/f then choose the corresponding set Define f = maximum number of sets that contain any item Prove –Rounding algorithm creates set cover –Rounding algorithm guarantees approx ratio of ?

Prove IP is NP-hard Reduction from SAT Input instance for SAT –Set of variables x j –Set of clauses C j = disjunction of literals –Goal: Find a truth assignment T to the variables that satisfies at least one literal from each clause

Details Any SAT instance has boolean variables and clauses. Our Integer programming problem will have twice as many variables, one for each variable and its complement, as well as the following inequalities: 0  v i  1 and 0   v i  1 1  v i +  v i  1 for each clause C = {v 1,  v 2,... v i } : v 1 +  v 2 +…+ v i  1