Presentation is loading. Please wait.

Presentation is loading. Please wait.

Optimizing over the Split Closure Anureet Saxena ACO PhD Student, Tepper School of Business, Carnegie Mellon University. (Joint Work with Egon Balas)

Published byJoanna George Modified over 9 years ago

Similar presentations

Presentation on theme: "Optimizing over the Split Closure Anureet Saxena ACO PhD Student, Tepper School of Business, Carnegie Mellon University. (Joint Work with Egon Balas)"— Presentation transcript:

1 Optimizing over the Split Closure Anureet Saxena ACO PhD Student, Tepper School of Business, Carnegie Mellon University. (Joint Work with Egon Balas)

2 Anureet Saxena, TSoB1 Talk Outiline Cutting Planes Commercial Split Closure Separation Problem PMILP & Deparametrization Computational Results Support Size & Sparsity Support Coefficients Cuts Statistics arki001 solved

3 Anureet Saxena, TSoB2 MIP Model min cx Ax ¸ b x j 2 Z 8 j2N 1 N 1 : set of integer variables Contains x j ¸ 0 j2N x j · u j j2N 1 Incumbent Fractional Solution

4 Anureet Saxena, TSoB3 Taxonomy of Cutting Planes Fractional Basic Feas Fractional Basic Mixed Integer Basic Feas Intersection Basic Feas Intersection Basic L&P Simple Disjunctive Chvatal Fractional Gomory Mixed Integer Basic Intersection Basic + Strengthening L&P + Strengthening MIG Split Cuts Intersection Basic Feas + Strengthening MIR

5 Anureet Saxena, TSoB4 Taxonomy of Cutting Planes Fractional Basic Feas Fractional Basic Mixed Integer Basic Feas Intersection Basic Feas Intersection Basic L&P Simple Disjunctive Chvatal Fractional Gomory Mixed Integer Basic Intersection Basic + Strengthening L&P + Strengthening MIG Split Cuts Intersection Basic Feas + Strengthening MIR

6 Anureet Saxena, TSoB5 Taxonomy of Cutting Planes Fractional Basic Feas Fractional Basic Mixed Integer Basic Feas Intersection Basic Feas Intersection Basic L&P Simple Disjunctive Chvatal Fractional Gomory Mixed Integer Basic Intersection Basic + Strengthening L&P + Strengthening MIG Split Cuts Intersection Basic Feas + Strengthening MIR

7 Anureet Saxena, TSoB6 Taxonomy of Cutting Planes Fractional Basic Feas Fractional Basic Mixed Integer Basic Feas Intersection Basic Feas Intersection Basic L&P Simple Disjunctive Chvatal Fractional Gomory Mixed Integer Basic Intersection Basic + Strengthening L&P + Strengthening MIG Split Cuts Intersection Basic Feas + Strengthening MIR

8 Anureet Saxena, TSoB7 Taxonomy of Cutting Planes Elementary Closure Elementary closure of P w.r.t a family  of cutting planes is defined by intersecting P with all rank-1 cuts in  Eg: CG Closure, Split Closure

9 Anureet Saxena, TSoB8 Elementary Closures Intersection Basic L&P Simple Disjunctive Chvatal Fractional Gomory MIG Split Cuts MIR Split Closure CG Closure L&P Closure

10 Anureet Saxena, TSoB9 Elementary Closures Operations Research Constraint Programming Complexity Theory max v x2P I ) P cx¸v P2  Inference Dual Proof Family Rank-1 cuts have short polynomial length proofs

11 Anureet Saxena, TSoB10 Elementary Closures How much duality gap can be closed by optimizing over elementary closures? L&P Closure Bonami and Minoux CG Closure Fischetti and Lodi Split Closure ?

12 Anureet Saxena, TSoB11 Elementary Closures How much duality gap can be closed by optimizing over elementary closures? L&P Closure Bonami and Minoux CG Closure Fischetti and Lodi Split Closure Balas and Saxena

13 Anureet Saxena, TSoB12 Split Disjunctions  2 Z N,  0 2 Z  j = 0, j2 N 2  0 <  <  0 + 1 Split Disjunction  x ·  0  x ¸  0 + 1

14 Anureet Saxena, TSoB13 Split Cuts Ax ¸ b  x ·  0 Ax ¸ b  x ¸  0 +1 u u0u0 v0v0 v  L x ¸  L  R x ¸  R  x ¸  Split Cut

15 Anureet Saxena, TSoB14 Split Closure Elementary Split Closure of P = { x | Ax ¸ b } is the polyhedral set defined by intersecting P with the valid rank-1 split cuts. C = { x2 P |  x ¸  8 rank-1 split cuts  x¸  } Without Recursion

16 Anureet Saxena, TSoB15 Algorithmic Framework Solve Master LP Integral Sol? Unbounded? Infeasible? Rank-1 Split Cut Separation MIP Solved Optimum over Split Closure attained Split Cuts Generated No Split Cuts Generated min cx Ax ¸ b  t x¸  t t2  Yes No Add Cuts

17 Anureet Saxena, TSoB16 Algorithmic Framework Solve Master LP Integral Sol? Unbounded? Infeasible? Rank-1 Split Cut Separation Rank-1 Split Cut Separation MIP Solved Optimum over Split Closure attained Split Cuts Generated No Split Cuts Generated min cx Ax ¸ b  t x¸  t t2  Yes No Add Cuts

18 Anureet Saxena, TSoB17 Split Closure Separation Problem Theorem: lies in the split closure of P if and only if the optimal value of the following program is non-negative. Disjunctive Cut Cut Violation Split Disjunction Normalization Set  = 1 u.e + v.e + u 0 + v 0 = 1 u 0 + v 0 = 1  y = 1 |  | 2 =1

19 Anureet Saxena, TSoB18 Split Closure Separation Problem Theorem: lies in the split closure of P if and only if the optimal value of the following program is non-negative. Mixed Integer Non-Convex Quadratic Program u 0 + v 0 = 1

20 Anureet Saxena, TSoB19 SC Separation Theorem Theorem: lies in the split closure of P if and only if the optimal value of the following parametric mixed integer linear program is non-negative. Parameter Parametric Mixed Integer Linear Program

21 Anureet Saxena, TSoB20 Deparametrization Parameteric Mixed Integer Linear Program

22 Anureet Saxena, TSoB21 Deparametrization Parameteric Mixed Integer Linear Program If  is fixed, then PMILP reduces to a MILP

23 Anureet Saxena, TSoB22 Deparametrization MILP( ) Deparametrized Mixed Integer Linear Program Maintain a dynamically updated grid of parameters

24 Anureet Saxena, TSoB23 Separation Algorithm Initialize Parameter Grid (  ) For  2 , Solve MILP(  ) using CPLEX 9.0 Enumerate  branch and bound nodes Store all the separating split disjunctions which are discovered At least one split disjunction discovered? Grid Enrichment Diversification Strengthening STOP Bifurcation yes no

25 Anureet Saxena, TSoB24 Implementation Details Processor Details Pentium IV 2Ghz, 2GB RAM COIN-ORCPLEX 9.0 Core Implementation Solving Master LP Setting up MILP Disjunctions/Cuts Management L&P cut generation+strengthening Solving MILP(  )

26 Anureet Saxena, TSoB25 Computational Results MIPLIB 3.0 instances OR-Lib (Beasley) Capacitated Warehouse Location Problems

27 Anureet Saxena, TSoB26 MIPLIB 3.0 MIP Instances 98-100% Gap Closed

28 Anureet Saxena, TSoB27 MIPLIB 3.0 MIP Instances 98-100% Gap Closed

29 Anureet Saxena, TSoB28 MIPLIB 3.0 MIP Instances 75-98% Gap Closed Unsolved MIP Instance In MIPLIB 3.0

30 Anureet Saxena, TSoB29 MIPLIB 3.0 MIP Instances 25-75% Gap Closed

31 Anureet Saxena, TSoB30 MIPLIB 3.0 MIP Instances 0-25% Gap Closed

32 Anureet Saxena, TSoB31 MIPLIB 3.0 MIP Instances Summary of MIP Instances (MIPLIB 3.0) Total Number of Instances: 34 Number of Instances included: 33 No duality gap: noswot, dsbmip Instance not included: rentacar Results 98-100% Gap closed in 14 instances 75-98% Gap closed in 11 instances 25-75% Gap closed in 3 instances 0-25% Gap closed in 3 instances Average Gap Closed: 82.53%

33 Anureet Saxena, TSoB32 MIPLIB 3.0 Pure IP Instances 98-100% Gap Closed

34 Anureet Saxena, TSoB33 MIPLIB 3.0 Pure IP Instances 75-98% Gap Closed

35 Anureet Saxena, TSoB34 MIPLIB 3.0 Pure IP Instances 25-75% Gap Closed Ceria, Pataki et al closed around 50% of the gap using 10 rounds of L&P cuts

36 Anureet Saxena, TSoB35 MIPLIB 3.0 Pure IP Instances 0-25% Gap Closed

37 Anureet Saxena, TSoB36 MIPLIB 3.0 Pure IP Instances Summary of Pure IP Instances (MIPLIB 3.0) Total Number of Instances: 25 Number of Instances included: 24 No duality gap: enigma Instance not included: harp2 Results 98-100% Gap closed in 9 instances 75-98% Gap closed in 4 instances 25-75% Gap closed in 6 instances 0-25% Gap closed in 4 instances Average Gap Closed: 71.63%

38 Anureet Saxena, TSoB37 MIPLIB 3.0 Pure IP Instances % Gap Closed by First Chvatal Closure (Fischetti-Lodi Bound)

39 Anureet Saxena, TSoB38 MIPLIB 3.0 Pure IP Instances

40 Anureet Saxena, TSoB39 MIPLIB 3.0 Pure IP Instances

41 Anureet Saxena, TSoB40 MIPLIB 3.0 Pure IP Instances Comparison of Split Closure vs CG Closure Total Number of Instances: 24 CG closure closes >98% Gap: 9 Results (Remaining 15 Instances) Split Closure closes significantly more gap in 9 instances Both Closures close almost same gap in 6 instances

42 Anureet Saxena, TSoB41 OrLib CWLP Set 1 –37 Real-World Instances –50 Customers, 16-25-50 Warehouses Set 2 –12 Real-World Instances –1000 Customers, 100 Warehouses

43 Anureet Saxena, TSoB42 OrLib CWLP Set 1 Summary of OrLib CWLP Instances (Set 1) Number of Instances: 37 Number of Instances included: 37 Results 100% Gap closed in 37 instances

44 Anureet Saxena, TSoB43 OrLib CWLP Set 2 Summary of OrLib CWFL Instances (Set 2) Number of Instances: 12 Number of Instances included: 12 Results >90% Gap closed in 10 instances 85-90% Gap closed in 2 instances Average Gap Closed: 92.82%

45 Anureet Saxena, TSoB44 Algorithmic Framework Solve Master LP Integral Sol? Unbounded? Infeasible? Rank-1 Split Cut Separation MIP Solved Optimum over Split Closure attained Split Cuts Generated No Split Cuts Generated min cx Ax ¸ b  t x¸  t t2  Yes No Add Cuts

46 Anureet Saxena, TSoB45 Algorithmic Framework What can one say about the split disjunctions which were used to generate cuts? What are the characteristics of the cuts which are binding at the final optimal solution?

47 Anureet Saxena, TSoB46 Support Size & Sparsity The support of a split disjunction D( ,  0 ) is the set of non-zero components of   x ·  0  x ¸  0 + 1 (2x 1 + 3x 3 – x 5 · 1) Ç (2x 1 + 3x 3 – x 5 ¸ 2) Support Size = 3

48 Anureet Saxena, TSoB47 Support Size & Sparsity The support of a split disjunction D( ,  0 ) is the set of non-zero components of  Sparse Split Disjunctions Sparse Split Cuts Computationally Faster Avoid fill-in Disjunctive argument Non-negative row combinations Basis Factorization Sparse Matrix Op

49 Anureet Saxena, TSoB48 Support Size & Sparsity

50 Anureet Saxena, TSoB49 Support Size & Sparsity

51 Anureet Saxena, TSoB50 Support Size & Sparsity Empirical Observation Substantial Duality gap can be closed by using split cuts generated from sparse split disjunctions

52 Anureet Saxena, TSoB51 Support Coefficients Practice Elementary 0/1 disjunctions Mixed Integer Gomory Cuts Lift-and-project cuts Theory Determinants of sub-matrices Andersen, Cornuejols & Li (’05) Cook, Kannan & Scrhijver (’90) 1 det (B) Huge Gap

53 Anureet Saxena, TSoB52 Support Coefficients

54 Anureet Saxena, TSoB53 Support Coefficients

55 Anureet Saxena, TSoB54 Support Coefficients Empirical Observation Substantial Duality gap can be closed by using split cuts generated from split disjunctions containing small support coefficients.

56 Anureet Saxena, TSoB55 Cuts Statistics

57 Anureet Saxena, TSoB56 Number of Cuts Average: 113.80

58 Anureet Saxena, TSoB57 #Cuts/m vs log(n) Average: 45.76%

59 Anureet Saxena, TSoB58 Average Cut Density vs log(n) Average: 20.82%

60 Anureet Saxena, TSoB59 Cuts Statistics Internet Checkable Proofs Strengthened formulations for MIPLIB 3.0 instances available at www.andrew.cmu.edu/user/anureets/osc/osc.htm Google Query: anureet saxena (I’m feeling lucky)

61 Anureet Saxena, TSoB60 arki001 MIPLIB 3.0 & 2003 instance Metallurgical Industry Unsolved for the past 10 years [1996-2000-2005] Problem Stats 1048 Rows 1388 Columns 123 Gen Integer Vars 415 Binary Vars 850 Continuous Vars

62 Anureet Saxena, TSoB61 Solution Strategy Original Problem Strengthened Formulation Preprocessed Problem CPLEX 9.0 Presolver Rank-1 Split Cut Generation Emphasis on optimality Strong Branching

63 Anureet Saxena, TSoB62 Strengthening + CPLEX 9.0 Crossover Point (227 rank-1 cuts) Solved to optimality

64 Anureet Saxena, TSoB63 Strengthening + CPLEX 9.0 arki001 Solution Statistics % Gap closed by rank-1 split cuts: 83.05% Time spent in generating rank-1 split cuts: 53.76 hrs Time taken by CPLEX 9.0 after strengthening: 10.94 hrs No. of branch-and-bound nodes enumerated by CPLEX: 643425 Total time taken to solve the instance to optimality: 64.70 hrs

65 Anureet Saxena, TSoB64 CPLEX 9.0 After 100 hours: 43 million B&B nodes 22 million active nodes 12GB B&B Tree

66 Anureet Saxena, TSoB65 Comparison Crossover Point

67 Anureet Saxena, TSoB66 Thank You

Download ppt "Optimizing over the Split Closure Anureet Saxena ACO PhD Student, Tepper School of Business, Carnegie Mellon University. (Joint Work with Egon Balas)"

Similar presentations

IEOR 4004 Final Review part II.

IEOR 4004 Final Review part II.
1 LP Duality Lecture 13: Feb 28. 2 Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.

1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
Gomory’s cutting plane algorithm for integer programming Prepared by Shin-ichi Tanigawa.

Gomory’s cutting plane algorithm for integer programming Prepared by Shin-ichi Tanigawa.
EE 553 Integer Programming

EE 553 Integer Programming
Konrad-Zuse-Zentrum für Informationstechnik Berlin (ZIB) Tobias Achterberg Conflict Analysis SCIP Workshop at ZIB October 2007.

Konrad-Zuse-Zentrum für Informationstechnik Berlin (ZIB) Tobias Achterberg Conflict Analysis SCIP Workshop at ZIB October 2007.
Progress in Linear Programming Based Branch-and-Bound Algorithms

Progress in Linear Programming Based Branch-and-Bound Algorithms
EMIS 8373: Integer Programming Valid Inequalities updated 4April 2011.

EMIS 8373: Integer Programming Valid Inequalities updated 4April 2011.
Dash Optimization IMA 2005 “Constraint Branching and Disjunctive Cuts for Mixed Integer Programs” 1 Constraint Branching and Disjunctive Cuts for Mixed.

Dash Optimization IMA 2005 “Constraint Branching and Disjunctive Cuts for Mixed Integer Programs” 1 Constraint Branching and Disjunctive Cuts for Mixed.
1 One Size Fits All? : Computational Tradeoffs in Mixed Integer Programming Software Bob Bixby, Mary Fenelon, Zonghao Gu, Ed Rothberg, and Roland Wunderling.

1 One Size Fits All? : Computational Tradeoffs in Mixed Integer Programming Software Bob Bixby, Mary Fenelon, Zonghao Gu, Ed Rothberg, and Roland Wunderling.
Looking inside Gomory Aussois, January 7-11 2008 1 Looking inside Gomory Matteo Fischetti, DEI University of Padova (joint work with Egon Balas and Arrigo.

Looking inside Gomory Aussois, January Looking inside Gomory Matteo Fischetti, DEI University of Padova (joint work with Egon Balas and Arrigo.
1 Logic-Based Methods for Global Optimization J. N. Hooker Carnegie Mellon University, USA November 2003.

1 Logic-Based Methods for Global Optimization J. N. Hooker Carnegie Mellon University, USA November 2003.
Solving Integer Programs. Natural solution ideas that don’t work well Solution idea #1: Explicit enumeration: Try all possible solutions and pick the.

Solving Integer Programs. Natural solution ideas that don’t work well Solution idea #1: Explicit enumeration: Try all possible solutions and pick the.
Duality in Optimization and Constraint Satisfaction J. N. Hooker Carnegie Mellon Univ. Pittsburgh, USA September 2006.

Duality in Optimization and Constraint Satisfaction J. N. Hooker Carnegie Mellon Univ. Pittsburgh, USA September 2006.
Aussois, 4-8/1/20101 = ? Matteo Fischetti and Domenico Salvagnin University of Padova +

Aussois, 4-8/1/20101 = ? Matteo Fischetti and Domenico Salvagnin University of Padova +
Computational Methods for Management and Economics Carla Gomes

Computational Methods for Management and Economics Carla Gomes
Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.

Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy under contract.
1 Contents college 3 en 4 Book: Appendix A.1, A.3, A.4, §3.4, §3.5, §4.1, §4.2, §4.4, §4.6 (not: §3.6 - §3.8, §4.2 - §4.3) Extra literature on resource.

1 Contents college 3 en 4 Book: Appendix A.1, A.3, A.4, §3.4, §3.5, §4.1, §4.2, §4.4, §4.6 (not: §3.6 - §3.8, §4.2 - §4.3) Extra literature on resource.
1 Robustness by cutting planes and the Uncertain Set Covering Problem AIRO 2008, Ischia, 10 September 2008 (work supported my MiUR and EU) Matteo Fischetti.

1 Robustness by cutting planes and the Uncertain Set Covering Problem AIRO 2008, Ischia, 10 September 2008 (work supported my MiUR and EU) Matteo Fischetti.
1 Combinatorial Problems in Cooperative Control: Complexity and Scalability Carla Gomes and Bart Selman Cornell University Muri Meeting March 2002.

1 Combinatorial Problems in Cooperative Control: Complexity and Scalability Carla Gomes and Bart Selman Cornell University Muri Meeting March 2002.
Lift-and-Project cuts: an efficient solution method for mixed-integer programs Sebastian Ceria Graduate School of Business and Computational Optimization.

Lift-and-Project cuts: an efficient solution method for mixed-integer programs Sebastian Ceria Graduate School of Business and Computational Optimization.

Similar presentations

Ads by Google