Duality Theory  Every LP problem (called the ‘Primal’) has associated with another problem called the ‘Dual’.  The ‘Dual’ problem is an LP defined directly.

Slides:



Advertisements
Similar presentations
February 14, 2002 Putting Linear Programs into standard form
Advertisements

The simplex algorithm The simplex algorithm is the classical method for solving linear programs. Its running time is not polynomial in the worst case.
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
Geometry and Theory of LP Standard (Inequality) Primal Problem: Dual Problem:
IEOR 4004 Midterm review (Part II) March 12, 2014.
EMGT 501 HW #1 Solutions Chapter 2 - SELF TEST 18
LECTURE 14 Minimization Two Phase method by Dr. Arshad zaheer
Introduction to Algorithms
The Simplex Method The geometric method of solving linear programming problems presented before. The graphical method is useful only for problems involving.
Dr. Sana’a Wafa Al-Sayegh
1 Introduction to Linear Programming. 2 Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. X1X2X3X4X1X2X3X4.
Copyright (c) 2003 Brooks/Cole, a division of Thomson Learning, Inc
Degeneracy and the Convergence of the Simplex Algorithm LI Xiao-lei.
To accompany Quantitative Analysis for Management, 8e by Render/Stair/Hanna 9-1 © 2003 by Prentice Hall, Inc. Upper Saddle River, NJ Chapter 9 Linear.
Dragan Jovicic Harvinder Singh
Linear Inequalities and Linear Programming Chapter 5
Linear programming Thomas S. Ferguson University of California at Los Angeles Compressive Sensing Tutorial PART 3 Svetlana Avramov-Zamurovic January 29,
The Simplex Method: Standard Maximization Problems
1 Linear Programming Jose Rolim University of Geneva.
Finite Mathematics & Its Applications, 10/e by Goldstein/Schneider/SiegelCopyright © 2010 Pearson Education, Inc. 1 of 99 Chapter 4 The Simplex Method.
Linear Programming (LP)
The Simplex Method.
5.6 Maximization and Minimization with Mixed Problem Constraints
Chapter 4 The Simplex Method
MIT and James Orlin © Chapter 3. The simplex algorithm Putting Linear Programs into standard form Introduction to Simplex Algorithm.
LINEAR PROGRAMMING SIMPLEX METHOD.
Chapter 3 Linear Programming Methods 高等作業研究 高等作業研究 ( 一 ) Chapter 3 Linear Programming Methods (II)
The Dual Problem: Minimization with problem constraints of the form ≥
Chapter 6 Linear Programming: The Simplex Method
Duality Theory 對偶理論.
The Two-Phase Simplex Method LI Xiao-lei. Preview When a basic feasible solution is not readily available, the two-phase simplex method may be used as.
Duality Theory LI Xiaolei.
Kerimcan OzcanMNGT 379 Operations Research1 Linear Programming: The Simplex Method Chapter 5.
1 1 © 2003 Thomson  /South-Western Slide Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
1 1 © 2003 Thomson  /South-Western Slide Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
Public Policy Modeling Simplex Method Tuesday, October 13, 2015 Hun Myoung Park, Ph.D. Public Management & Policy Analysis Program Graduate School of International.
The big M method LI Xiao-lei.
Simplex Method Adapting to Other Forms.  Until now, we have dealt with the standard form of the Simplex method  What if the model has a non-standard.
Department Of Industrial Engineering Duality And Sensitivity Analysis presented by: Taha Ben Omar Supervisor: Prof. Dr. Sahand Daneshvar.
Duality Theory.
Linear Programming Revised Simplex Method, Duality of LP problems and Sensitivity analysis D Nagesh Kumar, IISc Optimization Methods: M3L5.
Chapter 4 Linear Programming: The Simplex Method
EE/Econ 458 Duality J. McCalley.
1 THE REVISED SIMPLEX METHOD CONTENTS Linear Program in the Matrix Notation Basic Feasible Solution in Matrix Notation Revised Simplex Method in Matrix.
Linear Inequalities and Linear Programming Chapter 5 Dr.Hayk Melikyan/ Department of Mathematics and CS/ 5.5 Dual problem: minimization.
OR Chapter 7. The Revised Simplex Method  Recall Theorem 3.1, same basis  same dictionary Entire dictionary can be constructed as long as we.
1 Introduction to Linear Programming. 2 Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. X1X2X3X4X1X2X3X4.
Simplex Method Simplex: a linear-programming algorithm that can solve problems having more than two decision variables. The simplex technique involves.
Business Mathematics MTH-367 Lecture 16. Chapter 11 The Simplex and Computer Solutions Methods continued.
Copyright © 2006 Brooks/Cole, a division of Thomson Learning, Inc. Linear Programming: An Algebraic Approach 4 The Simplex Method with Standard Maximization.
1 Simplex algorithm. 2 The Aim of Linear Programming A Linear Programming model seeks to maximize or minimize a linear function, subject to a set of linear.
Decision Support Systems INF421 & IS Simplex: a linear-programming algorithm that can solve problems having more than two decision variables.
The Simplex Method. and Maximize Subject to From a geometric viewpoint : CPF solutions (Corner-Point Feasible) : Corner-point infeasible solutions 0.
Solving Linear Program by Simplex Method The Concept
Stat 261 Two phase method.
Linear Programming Revised Simplex Method, Duality of LP problems and Sensitivity analysis D Nagesh Kumar, IISc Optimization Methods: M3L5.
Chap 10. Sensitivity Analysis
The Simplex Method The geometric method of solving linear programming problems presented before. The graphical method is useful only for problems involving.
The Two-Phase Simplex Method
Chapter 4 Linear Programming: The Simplex Method
Chap 9. General LP problems: Duality and Infeasibility
The Simplex Method: Standard Minimization Problems
Chapter 5. Sensitivity Analysis
Chapter 3 The Simplex Method and Sensitivity Analysis
Duality Theory and Sensitivity Analysis
Dual simplex method for solving the primal
The Simplex Method The geometric method of solving linear programming problems presented before. The graphical method is useful only for problems involving.
Chapter 5. The Duality Theorem
DUALITY THEORY Reference: Chapter 6 in Bazaraa, Jarvis and Sherali.
Presentation transcript:

Duality Theory  Every LP problem (called the ‘Primal’) has associated with another problem called the ‘Dual’.  The ‘Dual’ problem is an LP defined directly and systematically from the original (or Primal) LP model.  The optimal solution of one problem yields the optimal solution to the other.  Duality ease the calculations for the problems, whose number of variables is large.

Rules for converting Primal to Dual  If the Primal is to maximize, the dual is to minimize.  If the Primal is to minimize, the dual is to maximize.  For every constraint in the primal, there is a dual variable.  For every variable in the primal, there is a constraint in the dual.

Dual Problem Primal LP : Max z = c 1 x 1 + c 2 x c n x n Max z = c 1 x 1 + c 2 x c n x n subject to: a 11 x 1 + a 12 x a 1n x n ≤ b 1 a 21 x 1 + a 22 x a 2n x n ≤ b 2 : a m1 x 1 + a m2 x a mn x n ≤ b m a m1 x 1 + a m2 x a mn x n ≤ b m x 1 ≥ 0, x 2 ≥ 0,…….x j ≥ 0,……., x n ≥ 0. x 1 ≥ 0, x 2 ≥ 0,…….x j ≥ 0,……., x n ≥ 0. Associated Dual LP : Min. z = b 1 y 1 + b 2 y b m y m subject to: a 11 y 1 + a 21 y a m1 y m ≥ c 1 a 12 y 1 + a 22 y a m2 y m ≥ c 2 : a 1n y 1 + a 2n y a mn y m ≥ c n y 1 ≥ 0, y 2 ≥ 0,…….y j ≥ 0,……., y m ≥ 0.

Example Primal Max. Z = 3x 1 +5x 2 Subject to constraints: < 4 y 1 x 1 < 4 y 1 2x 2 < 12 y 2 2x 2 < 12 y 2 3x 1 +2x 2 < 18 y 3 3x 1 +2x 2 < 18 y 3 x 1, x 2 x 1, x 2 > 0 The Primal has: 2 variables and 3 constraints. So the Dual has: 3 variables and 2 constraints Dual Min. Z’ = 4y 1 +12y 2 +18y 3 Subject to constraints: 3 y 1 + 3y 3 > 3 2y 2 +2y 3 5 2y 2 +2y 3 > 5 y 1, y 2, y 3 y 1, y 2, y 3 > 0 We define one dual variable for each primal constraint.

Example Primal Min.. Z = 10x 1 +15x 2 Subject to constraints: 80 5x 1 + 7x 2 > 80 6x x x x 2 > 100 x 1, x 2 x 1, x 2 > 0

Solution Dual Max.. Z’ = 80y y 2 Subject to constraints: < 10 5y 1 + 6y 2 < 10 7y y 2 < 15 7y y 2 < 15 y 1, y 2 y 1, y 2 > 0

Example Primal Max. Z = 12x 1 + 4x 2 Subject to constraints: < 56 4x 1 + 7x 2 < 56 2x 1 + 5x x 1 + 5x 2 > 20 5x 1 + 4x 2 = 40 5x 1 + 4x 2 = 40 x 1, x 2 x 1, x 2 > 0

Solution 5x 1 + 4x 2 = 40  The equality constraint 5x 1 + 4x 2 = 40 can be replaced by the following two inequality constraints: 5x 1 + 4x 2 < 40 5x 1 + 4x 2 < 40 5x 1 + 4x x 1 - 4x x 1 - 4x 2 < -40 2x 1 + 5x 2 20  The second inequality 2x 1 + 5x 2 > 20 can be changed to the less-than-or-equal-to type by multiplying both sides of the inequality by -1 and reversing the direction of the inequality; that is, -2x 1 - 5x 2 < x 1 - 5x 2 < -20

Cont… The primal problem can now take the following standard form: Max. Z = 12x 1 + 4x 2 Subject to constraints: < 56 4x 1 + 7x 2 < 56 -2x 1 - 5x 2 < x 1 - 5x 2 < -20 5x 1 + 4x 2 < 40 5x 1 + 4x 2 < 40 -5x 1 - 4x 2 < x 1 - 4x 2 < -40 x 1, x 2 x 1, x 2 > 0

Cont… Min. Z’ = 56y 1 -20y y 3 – 40y 4 Subject to constraints: 12 4y 1 – 2y 2 + 5y 3 – 5y 4 > 12 7y 1 - 5y 2 + 4y 3 – 4y 4 4 7y 1 - 5y 2 + 4y 3 – 4y 4 > 4 y 1, y 2, y 3, y 4 y 1, y 2, y 3, y 4 > 0 The dual of this problem can now be obtained as follows:

Example Primal Min.. Z = 2x 2 + 5x 3 Subject to constraints: 2 x 1 + x 2 > 2 2x 1 + x 2 +6x 3 < 6 2x 1 + x 2 +6x 3 < 6 x 1 - x 2 +3x 3 = 4 x 1 - x 2 +3x 3 = 4 x 1, x 2, x 3 x 1, x 2, x 3 > 0

Solution Primal in standard form : Max.. Z = -2x 2 - 5x 3 Subject to constraints: < -2 -x 1 - x 2 < -2 2x 1 + x 2 +6x 3 < 6 2x 1 + x 2 +6x 3 < 6 x 1 - x 2 +3x 3 < 4 x 1 - x 2 +3x 3 < 4 - x 1 + x 2 - 3x 3 < -4 - x 1 + x 2 - 3x 3 < -4 x 1, x 2, x 3 x 1, x 2, x 3 > 0

Cont… Dual Min. Z’ = -2y 1 + 6y 2 + 4y 3 – 4y 4 Subject to constraints: 0 -y 1 + 2y 2 + y 3 – y 4 > 0 -y 1 + y 2 - y 3 + y y 1 + y 2 - y 3 + y 4 > -2 6y 2 + 3y 3 - 3y y 2 + 3y 3 - 3y 4 > -5 y 1, y 2, y 3, y 4 y 1, y 2, y 3, y 4 > 0

Introduction Suppose a “basic solution” satisfies the optimality condition but not feasible, then we apply dual simplex method. In regular Simplex method, we start with a Basic Feasible solution (which is not optimal) and move towards optimality always retaining feasibility. In the dual simplex method, the exact opposite occurs. We start with a “optimal” solution (which is not feasible) and move towards feasibility always retaining optimality condition.The algorithm ends once we obtain feasibility.

Dual Simplex Method To start the dual Simplex method, the following two conditions are to be met: 1.The objective function must satisfy the optimality conditions of the regular Simplex method. 2.All the constraints must be of the type .

Example Min. Z = 3x 1 + 2x 2 Subject to constraints: 3 3x 1 + x 2 > 3 4x 1 + 3x 2 6 4x 1 + 3x 2 > 6 x 1 + x 2 < 3 x 1, x 2 x 1, x 2 > 0

Cont… < constraints and convert the objective function into maximization function. Step I: The first two inequalities are multiplied by –1 to convert them to < constraints and convert the objective function into maximization function. Max. Z’ = -3x 1 - 2x 2 where Z’= -Z Subject to constraints: < -3 -3x 1 - x 2 < -3 -4x 1 - 3x 2 < -6 x 1 + x 2 < 3 x 1 + x 2 < 3 x 1, x 2 x 1, x 2 > 0

Cont… Let S 1, S 2, S 3 be three slack variables Model can rewritten as: Z’ + 3x 1 + 2x 2 = x 1 - x 2 +S 1 = -3 -4x 1 - 3x 2 +S 2 = -6 -4x 1 - 3x 2 +S 2 = -6 x 1 + x 2 +S 3 = 3 x 1 + x 2 +S 3 = 3 Initial BS is : x 1 = 0, x 2 = 0, S 1 = -3, S 2 = -6, S 3 = 3 and Z=0.

Cont… Basic Variable Coefficients of:Sol. Zx1x1 x2x2 S1S1 S2S2 S3S3 Z S1S S2S S3S Ratio-3/42/3--- Initial Basic Solution is Optimal (as the optimality condition is satisfied) but infeasible. Choose the most negative basic variable. Therefore, S 2 is the departing variable. Calculate Ratio = |Z row / S 2 row| (S 2 < 0) Choose minimum ratio. Therefore, x 2 is the entering variable.

Cont… Basic Variable Coefficients of:Sol. Zx1x1 x2x2 S1S1 S2S2 S3S3 Z11/3002/304 S1S1 0-5/301-1/30 x2x2 04/310-1/302 S3S /311 Ratio-1/5--2- Therefore, S 1 is the departing variable and x 1 is the entering variable.

Cont… Basic Variable Coefficients of:Sol. Zx1x1 x2x2 S1S1 S2S2 S3S3 Z1001/53/5021/5 x1x /51/503/5 x2x2 0014/5-3/506/5 S3S /52/516/5 Optimal Solution is : x 1 = 3/5, x 2 = 6/5, Z= 21/5

Example Max. Z = -x 1 - x 2 Subject to constraints: < 8 x 1 + x 2 < 8 x 2 3 x 2 > 3 -x 1 + x 2 < 2 x 1, x 2 x 1, x 2 > 0

Cont… Let S 1, S 2, S 3 be three slack variables Model can rewritten as: Z + x 1 + x 2 = 0 8 x 1 + x 2 + S 1 = 8 -x 2 + S 2 = -3 -x 2 + S 2 = -3 -x 1 + x 2 + S 3 = 2 x 1, x 2 x 1, x 2 > 0 Initial BS is : x 1 = 0, x 2 = 0, S 1 = 8, S 2 = -3, S 3 = 2 and Z=0.

Cont… Basic Variable Coefficients of:Sol. Zx1x1 x2x2 S1S1 S2S2 S3S3 Z S1S S2S S3S Ratio Therefore, S 2 is the departing variable and x 2 is the entering variable.

Cont… Basic Variable Coefficients of:Sol. Zx1x1 x2x2 S1S1 S2S2 S3S3 Z S1S x2x S3S Ratio Therefore, S 3 is the departing variable and x 1 is the entering variable.

Cont… Basic Variable Coefficients of:Sol. Zx1x1 x2x2 S1S1 S2S2 S3S3 Z S1S x2x x1x Optimal Solution is : x 1 = 1, x 2 = 3, Z= -4