Proving that a Valid Inequality is Facet-defining  Ref: W, p144-147.  X  Z + n. For simplicity, assume conv(X) bounded and full-dimensional. Consider.

Slides:



Advertisements
Similar presentations
C&O 355 Lecture 15 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A.
Advertisements

Duality for linear programming. Illustration of the notion Consider an enterprise producing r items: f k = demand for the item k =1,…, r using s components:
C&O 355 Lecture 16 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A.
C&O 355 Lecture 8 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
C&O 355 Mathematical Programming Fall 2010 Lecture 6 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A.
Lecture #3; Based on slides by Yinyu Ye
Totally Unimodular Matrices
How should we define corner points? Under any reasonable definition, point x should be considered a corner point x What is a corner point?
The Structure of Polyhedra Gabriel Indik March 2006 CAS 746 – Advanced Topics in Combinatorial Optimization.
CSCI 3160 Design and Analysis of Algorithms Tutorial 6 Fei Chen.
Totally Unimodular Matrices Lecture 11: Feb 23 Simplex Algorithm Elliposid Algorithm.
7(2) THE DUAL THEOREMS Primal ProblemDual Problem b is not assumed to be non-negative.
Optimality Conditions for Nonlinear Optimization Ashish Goel Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A.
Polyhedral Optimization Lecture 3 – Part 2
C&O 355 Lecture 2 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
C&O 355 Mathematical Programming Fall 2010 Lecture 4 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
Section 4.1 Vectors in ℝ n. ℝ n Vectors Vector addition Scalar multiplication.
Simplex method (algebraic interpretation)
Linear Programming System of Linear Inequalities  The solution set of LP is described by Ax  b. Gauss showed how to solve a system of linear.
TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A Image:
Linear Programming (Convex) Cones  Def: closed under nonnegative linear combinations, i.e. K is a cone provided a 1, …, a p  K  R n, 1, …, p.
The Simplex Algorithm 虞台文 大同大學資工所 智慧型多媒體研究室. Content Basic Feasible Solutions The Geometry of Linear Programs Moving From Bfs to Bfs Organization of a.
OR Backgrounds-Convexity  Def: line segment joining two points is the collection of points.
Chap. 4 Vector Spaces 4.1 Vectors in Rn 4.2 Vector Spaces
I.4 Polyhedral Theory 1. Integer Programming  Objective of Study: want to know how to describe the convex hull of the solution set to the IP problem.
Optimization - Lecture 4, Part 1 M. Pawan Kumar Slides available online
X y x-y · 4 -y-2x · 5 -3x+y · 6 x+y · 3 Given x, for what values of y is (x,y) feasible? Need: y · 3x+6, y · -x+3, y ¸ -2x-5, and y ¸ x-4 Consider the.
C&O 355 Mathematical Programming Fall 2010 Lecture 5 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A.
CPSC 536N Sparse Approximations Winter 2013 Lecture 1 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAAAAAAA.
The Simplex Algorithm 虞台文 大同大學資工所 智慧型多媒體研究室. Content Basic Feasible Solutions The Geometry of Linear Programs Moving From Bfs to Bfs Organization of a.
1.2 Guidelines for strong formulations  Running time for LP usually depends on m and n ( number of iterations O(m), O(log n)). Not critically depend on.
Hon Wai Leong, NUS (CS6234, Spring 2009) Page 1 Copyright © 2009 by Leong Hon Wai CS6234: Lecture 4  Linear Programming  LP and Simplex Algorithm [PS82]-Ch2.
4.8 Rank Rank enables one to relate matrices to vectors, and vice versa. Definition Let A be an m  n matrix. The rows of A may be viewed as row vectors.
Linear Programming Back to Cone  Motivation: From the proof of Affine Minkowski, we can see that if we know generators of a polyhedral cone, they.
Linear Programming Chapter 9. Interior Point Methods  Three major variants  Affine scaling algorithm - easy concept, good performance  Potential.
Linear Programming Chap 2. The Geometry of LP  In the text, polyhedron is defined as P = { x  R n : Ax  b }. So some of our earlier results should.
Submodularity Reading Group Matroid Polytopes, Polymatroid M. Pawan Kumar
1 Chapter 4 Geometry of Linear Programming  There are strong relationships between the geometrical and algebraic features of LP problems  Convenient.
Lap Chi Lau we will only use slides 4 to 19
Topics in Algorithms Lap Chi Lau.
Proving that a Valid Inequality is Facet-defining
Chap 9. General LP problems: Duality and Infeasibility
Polyhedron Here, we derive a representation of polyhedron and see the properties of the generators. We also see how to identify the generators. The results.
Chapter 6. Large Scale Optimization
Chapter 5. Sensitivity Analysis
Chap 3. The simplex method
1.4 The Extreme Point Theorem : Geometry of a linear programming problem The set of feasible solutions to a general linear programming problem is a convex.
Polyhedron Here, we derive a representation of polyhedron and see the properties of the generators. We also see how to identify the generators. The results.
3.5 Minimum Cuts in Undirected Graphs
Chapter 4. Duality Theory
Chapter 6. Large Scale Optimization
2. Generating All Valid Inequalities
Chapter 5. The Duality Theorem
System of Linear Inequalities
Affine Spaces Def: Suppose
I.4 Polyhedral Theory (NW)
Quantum Foundations Lecture 3
Flow Feasibility Problems
Back to Cone Motivation: From the proof of Affine Minkowski, we can see that if we know generators of a polyhedral cone, they can be used to describe.
I.4 Polyhedral Theory.
Proving that a Valid Inequality is Facet-defining
Part II General Integer Programming
(Convex) Cones Def: closed under nonnegative linear combinations, i.e.
Chapter 2. Simplex method
BASIC FEASIBLE SOLUTIONS
1.2 Guidelines for strong formulations
Chapter 6. Large Scale Optimization
Chapter 2. Simplex method
1.2 Guidelines for strong formulations
Linear Constrained Optimization
Presentation transcript:

Proving that a Valid Inequality is Facet-defining  Ref: W, p  X  Z + n. For simplicity, assume conv(X) bounded and full-dimensional. Consider example, X = {(x, y)  R + m  B 1 :  i=1 m x i  my}. conv(X) is full-dimensional: Consider the m+2 affinely independent points (0, 0), (0, 1), (e i, 1), i = 1, …, m.  Problem 1: Given X  Z + n and a valid inequality  x   0 for X, show that the inequality defines a facet of conv(X). Ex: Show that x i  y is facet-defining.  Approach 1: (Use definition) Find n points x 1, …, x n  X satisfying  x =  0, and then prove that these n points are affinely independent. Ex: Consider m+1 points: (0, 0), (e i, 1), and (e i +e j, 1) for j  i. Integer Programming

 Approach 2: (indirect but useful way, see Thm 3.5, 3.6) 1.Select t  n points x 1, …, x t  X satisfying  x =  0. Suppose that all these points lie on a generic hyperplane  x =  0. 2.Solve the linear equation system  j=1 n  j x j k =  0 for k = 1, …, t in the n+1 unknowns ( ,  0 ). 3.If the only solution is ( ,  0 ) = ( ,  0 ) for  0, then the inequality  x   0 is facet-defining. Ex: Show x i  y is facet-defining. Select points (0, 0), (e i, 1), (e i +e j, 1) for j  i that are feasible and satisfy x i = y. As (0, 0) lies on  i=1 m  i x i +  m+1 y =  0,  0 = 0. As (e i, 1) lies on the hyperplane  i=1 m  i x i +  m+1 y = 0,  i = -  m+1. As (e i +e j, 1) lies on the hyperplane  i=1 m  i x i -  i y = 0,  j = 0 for j  i. So the hyperplane is  i x i -  i y = 0, and x i  y is facet-defining. Integer Programming

 If conv(X) is not full-dimensional, we use Thm 3.6 in the previous slides. Refer Proposition 3.5 on p.274 for a possible application of Thm 3.6. Integer Programming

4. Describing Polyhedra by Extreme Points and Extreme Rays  Prop 4.1: If P = {x  R n : Ax  b}   and rank(A) = n-k, P has a face of dimension k and no proper face of lower dimension. Pf) For any face F  P, rank(A F =, b F = )  n-k  dim(F)  k. (Prop. 2.4) Show  F with dim(F) = k. Let F be a face of minimum dimension ( > 0). (If k=0, nothing to prove) Let x * be an inner point of F, dim(F) > 0   y  x *  F. Consider z( ) = x * + (y – x * ),  R 1. Suppose z( ) intersect a i x = b i for some i  M F . Choose * = min {| i |: i  M F , z( i ) lines in a i x = b i }, and * = | i* |. Then *  0 (x * is an inner point)  F i* = {x  P: A F = x = b F =, a i* x = b i* }   is a face of P of smaller dimension than F, which is a contradiction. Hence z( ) not intersect a i x = b i for any i  M F .  Ax * + A (y-x * )  b   R 1  A(y-x * ) = 0  y  F  F = {y: Ay = Ax * }  dim(F) = k since rank(A) = n-k.  Integer Programming

 Frequently we assume P  R + n  rank(A) = n  P has zero-dimensional faces if P  . Assume rank(A) = n hereafter.  Def 4.1: x  P is an extreme point of P if there do not exist x 1, x 2  P, x 1  x 2 such that x = (1/2)x 1 + (1/2)x 2.  Prop 4.2: x is an extreme point of P  x is a zero-dimensional face of P. Pf) (  ) Suppose x is zero-dimensional face  rank(A x = ) = n. (Prop 2.4) Let (A, b) be submatrix of (A x =, b x = ) with A: n  n and rank n  x = A -1 b. If x = (1/2)x 1 + (1/2)x 2, x 1, x 2  P, then since Ax i  b, i = 1, 2, we have Ax 1 = Ax 2 = b ( Ax = (1/2)Ax 1 + (1/2)Ax 2 = b, Ax 1  b, Ax 2  b )  x 1 = x 2 = x, so x is an extreme point. (  ) If x  P is not a zero-dimensional face of P, then rank(A x = ) < n. (Prop 2.4)   y  0 such that A x = y = 0. For small  > 0, let x 1 = x +  y, x 2 = x -  y, x 1, x 2  P. Then x = (1/2)x 1 + (1/2)x 2, hence x is not an extreme point. Integer Programming

 Def 4.2: Let P 0 = {r  R n : Ar  0}. (recession cone, characteristic cone of P) If P = {x  R n : Ax  b}  , then r  P 0 \ {0} is called a ray of P.  r  R n, r  0 is a ray of P   x  P, {y  R n : y = x + r,  R + 1 }  P.  Note: Cone K is called pointed if K  (-K) = {0}. K  (-K) is called lineality space of cone K. For P = {x  R n : Ax  b}, if rank(A) = n, P 0  (-P 0 ) = {r  R n : Ar  0, -Ar  0} = {0}. Hence P 0 is guaranteed to be pointed.  Def 4.3: A ray r of P is an extreme ray if there do not exist r 1, r 2  P 0, r 1  r 2,  R + 1 such that r = (1/2)r 1 + (1/2)r 2.  Integer Programming

 Prop 4.3: If P  , r extreme ray of P if and only if { r:  R + 1 } is one- dimensional face of P 0. Pf) Let A r = = {a i : i  M, a i r = 0}. If { r:  R + 1 } is a one-dimensional face of P 0, rank(A r = ) = n-1  solutions of A r = y = 0 are y = r,  R 1. If r = (1/2)r 1 + (1/2)r 2, get contradiction as in Prop 4.2. If r  P 0 and rank(A r = ) < n-1, then nullity of A r =  2.  r *  r,  R 1 such that A r = r * = 0. Then r = (1/2)r 1 + (1/2)r 2, where r 1 = r +  r *, r 2 = r -  r *. Hence r is not an extreme ray, contradiction.   Cor 4.4: A polyhedron has a finite number of extreme points and extreme rays.  Question: Given P = {x  R n : Ax  b, x  0}  , how can we identify the extreme rays of P 0 ?  Thm 4.5: If P  , rank(A) = n, and max{cx: x  P} is finite, then there is an optimal solution that is an extreme point. Pf) Set of optimal solution is face F = {x  P: cx = c 0 }. By Prop. 4.1, F contains (n – rank(A))-dimensional face. By Prop. 4.2, F contains an extreme point. Integer Programming

 Thm 4.6:  extreme points x k,  c  Z n such that x k is the unique optimal solution of max{cx: x  P}. Pf) Let M xk = be equality set of x k. Let c * =  i  M= a i, c = c * for some >0 to get integer vector c. Then  x  P\{x k }, cx =  i  M= a i x <  b i =  a i x k = cx k (Compare with earlier Proposition regarding face.)  Thm 4.7: P  , rank(A) = n, max{cx: x  P} unbounded, then P has an extreme ray r * with cr * > 0. Pf) {u  R + m : uA = c} =  from duality of LP  By Farkas,  r  R n such that Ar  0, cr > 0. Consider max{cr: Ar  0, cr  1} = 1. By Thm 4.5,  optimal extreme point solution r *. Equality set of r * is A r* = r = 0 and cr = 1  rank(A r* = ) = n – 1.  r * extreme ray of P (Prop 4.3) Integer Programming

 Thm 4.8: (Affine) Minkowski’s Thm: finitely constrained  finitely generated. P = {x  R n : Ax  b}  , rank(A) = n (existence of extreme point guaranteed)  P = {x  R n : x =  k  K k x k +  j  J  j r j,  k =1, k  0, k  K,  j  0, j  J}, Where x k : extreme points of P, r j : extreme rays of P. Pf) Let Q = {x  R n : x =  k  K k x k +  j  J  j r j,  k =1, k  0, k  K,  j  0, j  J}. Q  P is clear Suppose  y  P \ Q (i.e. y  P, but y  Q). Show contradiction. Then not exist,  satisfying  k  K k x k +  j  J  j r j = y -  k  K k = -1 k  0 for k  K,  j  0 for j  J By Farkas’ lemma,  ( ,  0 )  R n+1 such that  x k -  0  0 for k  K,  r j  0 for j  J and  y -  0 > 0. Consider LP max{  x: x  P} If LP has a finite optimal solution, then  an extreme point optimal solution. Have  x k -  0  0, but  y -  0 > 0 (  y >  x k  k), contradiction. If unbounded,  extreme ray r j with  r j > 0 (Thm 4.7), contradiction. Hence there does not exist such y, i.e. Q = P Integer Programming

 Consider Primal-Dual pair of LP z = max{cx: x  P}, P = {x  R + n : Ax  b} w = min{ub: u  Q}, Q = {u  R + m : uA  c} {x k, k  K} extreme points of P, {r j, j  J} extreme rays of P 0 {u i, i  I} extreme points of Q, {v t, t  T} extreme rays of Q 0  Thm of the alternatives: I.  x such that x  0, Ax  b II.  u such that u  0, uA  0, ub < 0 Pf) Consider primal-dual pair (P) max 0x, Ax  b, x  0 (D) min ub, uA  0, u  0 Integer Programming

 Thm 4.9: I.The following are equivalent: a.The primal problem is feasible, that is, P   ; b.v t b  0 for all t  T. II.The following are equivalent when the primal problem is feasible: a.z is unbounded from above; b.  r j of P with cr j > 0; c.the dual problem is infeasible, that is, Q = . III.If the primal problem is feasible and z is unbounded, then z = max k  K cx k = w = min i  I u i b. Pf) I) P   if and only if vb  0  v  R + m with vA  0 (from previous) By Minkowski, Q 0 = {v  R + m : vA  0} = {v  R + m : v =  t  T  t v t,  t  0, t  T}  vb  0  v  Q 0 if and only if v t b  0  t  T. II) P = {x  R n : x =  k  K k x k +  j  J  j r j,  k =1, k  0, k  K,  j  0, j  J}  . z bounded if and only if cr j  0  j  J. b  c: apply (I) to dual (in negation form) III) From strong duality and Minkowski’s theorem to P and Q. Integer Programming

 Note: More general form of Minkowski’s thm Decomposition Thm: Suppose P = {x  R n : Ax  b}   Then P = S + K + Q, where S + K is the cone {x  R n : Ax  0} S = {x  R n : Ax = 0} is the lineality space of S + K K is a pointed cone. K + Q is a pointed polyhedron. Q is a polytope given by the convex hull of extreme points of K + Q. Integer Programming

 Projection of a polyhedron: Projection of (x, y)  R n  R p on H = {(x, y): y = 0} is (x, 0). Consider projection of P  R n  R p onto y = 0 as a projection from the (x, y)- space to the x-space, denoted by proj x (P). (x such that (x, y)  P for some y  R p )  Thm 4.10: Let P = {(x, y)  R n  R p : Ax + Gy  b}, then proj x (P) = {x  R n : v t (b-Ax)  0  t  T}, where {v t } t  T are extreme rays of Q = {v  R + m : vG = 0} Pf) H = {(x, y)  R n  R p : y = 0}  Proj H (P) = {(x, 0)  R n  R p : (x, y)  P for some y  R p }  {y  R p : Gy  (b-Ax)}    v  0, vG = 0, v(b-Ax) < 0 infeasible   v  0, vG = 0, we have v(b-Ax)  0  v(b-Ax)  0 p’Ax  p’b for all v  Q  v t (b-Ax)  0 for all v t  T (v t Ax  v t b )  Integer Programming

 For Thm 4.10, use the thm of the alternatives: I.  x such that Ax  b II.  u such that u  0, uA = 0, ub < 0 Pf) Consider primal-dual pair (P) max 0x, Ax  b (D) min ub, uA = 0, u  0  Cor 4.11: Projection of polyhedron is polyhedron. Integer Programming

 Cor 4.12: If P = {(x, y)  R n  R p : Ax + Gy  b} and {x  R n : Dx  d}, where D is q  n, then Q = proj x (P) if and only if: I.For i = 1, …, q, d i x  d 0 i is a valid inequality for P. II.For each x *  Q,  y * such that (x *, y * )  P. Pf) I. is equivalent to Q  proj x (P). II is equivalent to Q  proj x (P).  Thm 4.13: (Affine Weyl’s theorem) (finitely generated  finitely constrained) If A: m 1  n, B: m 2  n, rational matrices and Q = {x  R n : x = yA + zB,  k=1 m1 y k = 1, y  R + m1, z  R + m2 }, Then Q is a rational polyhedron. Pf) Q = proj x (P), where P = {(x, y, z)  R n  R + m1  R + m2 : x – yA – zB = 0,  k=1 m1 y k = 1} (Recall that we used Fourier-Motzkin elimination in IE531.) Integer Programming