The Complexity of the Network Design Problem Networks, 1978 Classic Paper Reading 99.12.

Slides:



Advertisements
Similar presentations
What is Intractable? Some problems seem too hard to solve efficiently. Question 1: Does an efficient algorithm exist?  An O(a ) algorithm, where a > 1,
Advertisements

1 NP-completeness Lecture 2: Jan P The class of problems that can be solved in polynomial time. e.g. gcd, shortest path, prime, etc. There are many.
NP-complete and NP-hard problems Transitivity of polynomial-time many-one reductions Concept of Completeness and hardness for a complexity class Definition.
The Theory of NP-Completeness
1 NP-Complete Problems. 2 We discuss some hard problems:  how hard? (computational complexity)  what makes them hard?  any solutions? Definitions 
CSC5160 Topics in Algorithms Tutorial 2 Introduction to NP-Complete Problems Feb Jerry Le
Computability and Complexity 23-1 Computability and Complexity Andrei Bulatov Search and Optimization.
Complexity 15-1 Complexity Andrei Bulatov Hierarchy Theorem.
Computational problems, algorithms, runtime, hardness
CSE332: Data Abstractions Lecture 27: A Few Words on NP Dan Grossman Spring 2010.
Complexity Theory CSE 331 Section 2 James Daly. Reminders Project 4 is out Due Friday Dynamic programming project Homework 6 is out Due next week (on.
NP-complete and NP-hard problems Transitivity of polynomial-time many-one reductions Definition of complexity class NP –Nondeterministic computation –Problems.
NP-Complete Problems Reading Material: Chapter 10 Sections 1, 2, 3, and 4 only.
The Theory of NP-Completeness
NP-Complete Problems Problems in Computer Science are classified into
CSE 326: Data Structures NP Completeness Ben Lerner Summer 2007.
NP-complete and NP-hard problems
Analysis of Algorithms CS 477/677
CSE 421 Algorithms Richard Anderson Lecture 27 NP Completeness.
Chapter 11: Limitations of Algorithmic Power
Chapter 11 Limitations of Algorithm Power Copyright © 2007 Pearson Addison-Wesley. All rights reserved.
Toward NP-Completeness: Introduction Almost all the algorithms we studies so far were bounded by some polynomial in the size of the input, so we call them.
Chapter 11 Limitations of Algorithm Power Copyright © 2007 Pearson Addison-Wesley. All rights reserved.
P, NP, and NP-Complete Suzan Köknar-Tezel.
1 The Theory of NP-Completeness 2 NP P NPC NP: Non-deterministic Polynomial P: Polynomial NPC: Non-deterministic Polynomial Complete P=NP? X = P.
The Theory of NP-Completeness 1. Nondeterministic algorithms A nondeterminstic algorithm consists of phase 1: guessing phase 2: checking If the checking.
The Theory of NP-Completeness 1. What is NP-completeness? Consider the circuit satisfiability problem Difficult to answer the decision problem in polynomial.
MCS312: NP-completeness and Approximation Algorithms
Computational Complexity Polynomial time O(n k ) input size n, k constant Tractable problems solvable in polynomial time(Opposite Intractable) Ex: sorting,
1 The Theory of NP-Completeness 2012/11/6 P: the class of problems which can be solved by a deterministic polynomial algorithm. NP : the class of decision.
Nattee Niparnan. Easy & Hard Problem What is “difficulty” of problem? Difficult for computer scientist to derive algorithm for the problem? Difficult.
Complexity Classes (Ch. 34) The class P: class of problems that can be solved in time that is polynomial in the size of the input, n. if input size is.
MIT and James Orlin1 NP-completeness in 2005.
Prabhas Chongstitvatana1 NP-complete proofs The circuit satisfiability proof of NP- completeness relies on a direct proof that L  p CIRCUIT-SAT for every.
Approximation Algorithms
Week 10Complexity of Algorithms1 Hard Computational Problems Some computational problems are hard Despite a numerous attempts we do not know any efficient.
CSE 024: Design & Analysis of Algorithms Chapter 9: NP Completeness Sedgewick Chp:40 David Luebke’s Course Notes / University of Virginia, Computer Science.
1 Lower Bounds Lower bound: an estimate on a minimum amount of work needed to solve a given problem Examples: b number of comparisons needed to find the.
EMIS 8373: Integer Programming NP-Complete Problems updated 21 April 2009.
1 The Theory of NP-Completeness 2 Cook ’ s Theorem (1971) Prof. Cook Toronto U. Receiving Turing Award (1982) Discussing difficult problems: worst case.
Unit 9: Coping with NP-Completeness
NP-Complete Problems. Running Time v.s. Input Size Concern with problems whose complexity may be described by exponential functions. Tractable problems.
NP-COMPLETE PROBLEMS. Admin  Two more assignments…  No office hours on tomorrow.
CSE 421 Algorithms Richard Anderson Lecture 27 NP-Completeness and course wrap up.
Lecture 6 NP Class. P = ? NP = ? PSPACE They are central problems in computational complexity.
Lecture 12 P and NP Introduction to intractability Class P and NP Class NPC (NP-complete)
Design and Analysis of Algorithms - Chapter 101 Our old list of problems b Sorting b Searching b Shortest paths in a graph b Minimum spanning tree b Primality.
NP-Completeness (Nondeterministic Polynomial Completeness) Sushanth Sivaram Vallath & Z. Joseph.
CS 3343: Analysis of Algorithms Lecture 25: P and NP Some slides courtesy of Carola Wenk.
NP-completeness Class of hard problems. Jaruloj ChongstitvatanaNP-complete Problems2 Outline  Introduction  Problems and Languages Turing machines and.
CSE 589 Part V One of the symptoms of an approaching nervous breakdown is the belief that one’s work is terribly important. Bertrand Russell.
LIMITATIONS OF ALGORITHM POWER
CPS Computational problems, algorithms, runtime, hardness (a ridiculously brief introduction to theoretical computer science) Vincent Conitzer.
CS6045: Advanced Algorithms NP Completeness. NP-Completeness Some problems are intractable: as they grow large, we are unable to solve them in reasonable.
Lecture 25 NP Class. P = ? NP = ? PSPACE They are central problems in computational complexity.
NP-completeness NP-complete problems. Homework Vertex Cover Instance. A graph G and an integer k. Question. Is there a vertex cover of cardinality k?
Algorithms for hard problems Introduction Juris Viksna, 2015.
NPC.
CSC 413/513: Intro to Algorithms
1 Ch 10 - NP-completeness Tractable and intractable problems Decision/Optimization problems Deterministic/NonDeterministic algorithms Classes P and NP.
The Theory of NP-Completeness 1. Nondeterministic algorithms A nondeterminstic algorithm consists of phase 1: guessing phase 2: checking If the checking.
Introduction to NP Instructor: Neelima Gupta 1.
COSC 3101A - Design and Analysis of Algorithms 14 NP-Completeness.
1 The Theory of NP-Completeness 2 Review: Finding lower bound by problem transformation Problem X reduces to problem Y (X  Y ) iff X can be solved by.
34.NP Completeness. Computer Theory Lab. Chapter 34P.2.
ICS 353: Design and Analysis of Algorithms NP-Complete Problems King Fahd University of Petroleum & Minerals Information & Computer Science Department.
Richard Anderson Lecture 26 NP-Completeness
ICS 353: Design and Analysis of Algorithms
Richard Anderson Lecture 25 NP-Completeness
Approximation Algorithms
Presentation transcript:

The Complexity of the Network Design Problem Networks, 1978 Classic Paper Reading 99.12

Outline Introduction NDP is NP-complete SNDP is NP-complete Conclusion 2

Introduction B 傅莉雯

Combinatorial optimization is a topic in -theoretical computer science -applied mathematics 4

Combinatorial optimization finding the least-cost solution to a mathematical problem in which each solution is associated with a numerical cost. Ex. -finding shortest path -the traveling salesman problem -the minimum spanning tree problem -… 5

P The class P consists of all the problems that can be solved in polynomial time. – Sorting – Exact string matching – Primes 6

P v.s. NP P consists of the problems that can be solved in (deterministically) polynomial time. NP consists of the problems that can be solved in non-deterministically polynomial time. DeterministicNon-deterministic Accept/RejectReject Accept Reject f (n) = O ( n^k ) 7

P v.s. NP P ⊆ NP Any problem in NP can be solved in (deterministically) exponential time. Could it be the case that any problem in NP can also be solved in (deterministically) polynomial time? P = NP? 8

NP-hard A problem is NP-hard if it is at least as hard as all the problems in NP. a problem X is NP-hard if the following condition holds: If X can be solved in (deterministic) polynomial time, then all the problems in NP can be solved in (deterministic) polynomial time. 9

NP-complete A problem is NP-complete if the following holds. – it is NP-hard – it is in NP An NP-complete problem is a “hardest” problem in NP. 10

NP-complete If one proves that a NP-complete broblem can be solved by a polynomial-time algorithm, then NP = P. If somebody proves that a NP-complete problem cannot be solved by any polynomial- time algorithm, then NP ≠ P. 11

Reduction Problem A can be reduced (in polynomial time) to Problem B if the following condition holds: -we can map input to A in polynomial time to an input to B, and get A’s answer when we get B’s. – if problem B has a polynomial-time algorithm, then so does problem A. 12

Network Design Problem Input: a weighted undirected graph Output: a subgraph which connects all the original vertices and minimizes the sum of the shortest path weights between all vertex pairs, subject to a budget constraint on the sum of its edge weights 13

NDP is NP-complete R 張允耀 R 楊凱文

NDP

Optimal v.s. Decision Calculate ↓ Optimal value Calculate ↓ Illegal or not? OptimalDecision X 90 O 95 O 97X 96

Knapsack Problem iPad 0.73KG iPhone 0.137KG iMac 13.8KG GALAXY 0.38KG Lenovo NB 1.27KG ViewSonic 3.1KG 2KG

NDP is NP-complete knapsackNDP Polynomial-bounded knapsackNP-completeNDP reducible NDP Knapsack

example

11’ 3’3 2 2’ 4 4’

KNAPSACK problem: t = 4, a 1 = 2, a 2 = 3, a 3 = 5, a 4 = 6, b =7. Solution: a 1 + a 3 = b KNAPSACK has solutions NDP has solutions??

Sum of weights = 2A = 32 Sum of the shortest path weights between all vertex pairs = 4tA = x 2t ( a 1 + a 2 + a 3 + a 4 ) = 4tA B = 2A+b = 39 C = 4tA-b = 249

B = 2A+b = 39 C = 4tA-b = 249

KNAPSACK problem: t = 4, a 1 = 2, a 2 = 3, a 3 = 5, a 4 = 6, b =4. We can’t find any solution for this KNAPSACK problem! Another example:

B = 2A+b = 36 C = 4tA-b = 252 This is not a solution.

There are not solutions. B = 2A+b = 36 C = 4tA-b = 252 5

SNDP is NP-complete D 陳琨 D 吳彥緯

Problem Formulation of SNDP unit edge weight spanning tree SNDP  NP 29 NDP with L({i, j}) = 1 for all {i, j}  E and B = |V|  1 Simple Network Design Problem (SNDP):

A Known NPC problem: Exact 3-cover Given a collection S = {  1,  2, …,  s } of 3- element subsets of a set T= {  1,  2, …,  3t }, does there exist a subcollection S’  S of pairwise disjoint sets such that Example: – T = {1,2,3,4,5,6}, S={{1,2,3}, {1,2,4}, {1,2,5}, {1,2,6}} – T = {1,2,3,4,5,6}, S={{1,2,3}, {3,4,5}, {1,2,5}, {1,2,6}} 30 S’={{3,4,5},{1,2,6}} No! Yes!

Reduction Given any instance of EXACT 3-COVER, we define an instance of SNDP as follows: 31 = r

Illustration of reduction 32 S T

Illustration of reduction 33 R

Illustration of reduction 34 S T R polynomial-time reduction

Claim  has a feasible solution  if and only if  G has a feasible solution  35 EXACT 3-COVER  SNDP G Sol.  Sol. G

Beginning of the proof Let G’ = (V,E’) be a spanning tree of G. Let F PQ (G’) denote the sum of the weights of all shortest paths in G’ between vertex sets P and Q (P, Q  V). Example: G G’ P Q R P Q F PQ (G’)= =6 36 SNDP G Sol. G SNDP G

Sol. G Observations Under the mentioned reduction, any feasible G’ has 3 properties. G’ contains all edges on 3 rd floor ‚G’ contains all edges on 2 nd floor ƒG’ contains some edges on 1 st floor in a specific way 37 SNDP G

2 nd Property If {  0,  }  E’ for some  S, then F(G’) = F RR (G’) + F RS (G’) + F RT (G’)+F SS (G’)+F ST (G’)+F TT (G’) > F RR (G’) + F RS (G’) + F RT (G’)  C RR + C RS + 2(r+1) + C RT > C RR + C RS + r + C RT = C RR + C RS + C RT + r = C RR + C RS + C RT + C SS + C ST + C TT = C {  0,  }  E’ for all  S – Implication: In G’, each vertex in T is adjacent to exactly one vertex in S – F RR (G’)=C RR, F RS (G’)=C RS, F SS (G’)=C SS, F RT (G’)=C RT, F ST (G’)=C ST  F(G’)<=C  iff  F TT (G’)=C TT  38 C RR = r 2 C RS = 2rs + s C RT = 9rt + 6t C SS = s 2 – s C ST = 9st – 6t C TT = 18t 2 – 12t

3 rd Property Denote the number of vertices in S being adjacent in G’ to exactly h vertices in T by S h (h=0,1,2,3) Example: S 0 =2, S 1 =1, S 2 =1, S 3 =0 Clearly,  F TT (G’)  C TT =18t 2 -12t  iff  S 3 =t, S 0 =s-t, S 1 =S 2 =0  39

Proved  has a feasible solution  if and only if  G has a feasible solution  40 EXACT 3-COVERSNDP

Conclusion

It is generally believed that P  NP This justifies the development of – Enumerative optimization methods with heuristics – Approximation algorithms 42

Applications Common Issues of network construction – communication convenience – construction cost Fire fighting network MRT network Sensor network 43

NDP is NP-complete. Generation of NDP Optimal Communication spanning Tree min ∑ u,vЄV λ(u,v)d T (u,v) 44

Given a weighted graph with a specific vertex p and an integer k, we wish to find a spanning tree of minimum total weight subject to the constraint that each subtree incident with p contains at most k other vertices. 45

k = 2 ↔ matching problem; k = 3 → NP-complete by a reduction of 3- DIMENSIONAL MATCHING 46