D Nagesh Kumar, IIScOptimization Methods: M3L6 1 Linear Programming Other Algorithms.

Slides:



Advertisements
Similar presentations
© 2003 Anita Lee-Post Linear Programming Part 2 By Anita Lee-Post.
Advertisements

Solving IPs – Cutting Plane Algorithm General Idea: Begin by solving the LP relaxation of the IP problem. If the LP relaxation results in an integer solution,
Operation Research Chapter 3 Simplex Method.
D Nagesh Kumar, IIScOptimization Methods: M4L1 1 Linear Programming Applications Software for Linear Programming.
Chapter 5 The Simplex Method The most popular method for solving Linear Programming Problems We shall present it as an Algorithm.
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
D Nagesh Kumar, IIScOptimization Methods: M1L1 1 Introduction and Basic Concepts (i) Historical Development and Model Building.
Chapter 10: Iterative Improvement
Simplex Method LP problem in standard form. Canonical (slack) form : basic variables : nonbasic variables.
Advanced Topics in Optimization
D Nagesh Kumar, IIScOptimization Methods: M1L4 1 Introduction and Basic Concepts Classical and Advanced Techniques for Optimization.
Polyhedral Optimization Lecture 3 – Part 3 M. Pawan Kumar Slides available online
Linear Programming Applications
D Nagesh Kumar, IIScOptimization Methods: M2L5 1 Optimization using Calculus Kuhn-Tucker Conditions.
D Nagesh Kumar, IIScOptimization Methods: M7L1 1 Integer Programming All Integer Linear Programming.
D Nagesh Kumar, IIScOptimization Methods: M3L1 1 Linear Programming Preliminaries.
Introduction and Basic Concepts
D Nagesh Kumar, IIScOptimization Methods: M3L4 1 Linear Programming Simplex method - II.
Linear Programming Applications
D Nagesh Kumar, IIScOptimization Methods: M5L4 1 Dynamic Programming Other Topics.
Optimization of Linear Problems: Linear Programming (LP) © 2011 Daniel Kirschen and University of Washington 1.
Chapter 3 Linear Programming Methods 高等作業研究 高等作業研究 ( 一 ) Chapter 3 Linear Programming Methods (II)
Computational Geometry Piyush Kumar (Lecture 5: Linear Programming) Welcome to CIS5930.
Linear Programming Piyush Kumar. Graphing 2-Dimensional LPs Example 1: x y Feasible Region x  0y  0 x + 2 y  2 y  4 x  3 Subject.
Paper review of ENGG*6140 Optimization Techniques Paper Review -- Interior-Point Methods for LP for LP Yanrong Hu Ce Yu Mar. 11, 2003.
D Nagesh Kumar, IIScOptimization Methods: M1L3 1 Introduction and Basic Concepts (iii) Classification of Optimization Problems.
Linear Programming – Simplex Method
D Nagesh Kumar, IIScOptimization Methods: M5L2 1 Dynamic Programming Recursive Equations.
1 Max 8X 1 + 5X 2 (Weekly profit) subject to 2X 1 + 1X 2  1000 (Plastic) 3X 1 + 4X 2  2400 (Production Time) X 1 + X 2  700 (Total production) X 1.
D Nagesh Kumar, IIScOptimization Methods: M3L2 1 Linear Programming Graphical method.
WOOD 492 MODELLING FOR DECISION SUPPORT Lecture 3 Basics of the Simplex Algorithm.
LP Narrowing: A New Strategy for Finding All Solutions of Nonlinear Equations Kiyotaka Yamamura Naoya Tamura Koki Suda Chuo University, Tokyo, Japan.
Linear Programming Revised Simplex Method, Duality of LP problems and Sensitivity analysis D Nagesh Kumar, IISc Optimization Methods: M3L5.
Mechanical Engineering Department 1 سورة النحل (78)
OR Chapter 1. Introduction  Ex : Diet Problem Daily requirements : energy(2000kcal), protein(55g), calcium(800mg) Food Serving size Energy (kcal)
D Nagesh Kumar, IIScOptimization Methods: M2L4 1 Optimization using Calculus Optimization of Functions of Multiple Variables subject to Equality Constraints.
D Nagesh Kumar, IIScOptimization Methods: M4L4 1 Linear Programming Applications Structural & Water Resources Problems.
Gomory Cuts Updated 25 March Example ILP Example taken from “Operations Research: An Introduction” by Hamdy A. Taha (8 th Edition)“Operations Research:
Optimization - Lecture 4, Part 1 M. Pawan Kumar Slides available online
D Nagesh Kumar, IIScOptimization Methods: M7L2 1 Integer Programming Mixed Integer Linear Programming.
Linear Programming Maximize Subject to Worst case polynomial time algorithms for linear programming 1.The ellipsoid algorithm (Khachian, 1979) 2.Interior.
D Nagesh Kumar, IIScOptimization Methods: M6L5 1 Dynamic Programming Applications Capacity Expansion.
(iii) Lagrange Multipliers and Kuhn-tucker Conditions D Nagesh Kumar, IISc Introduction to Optimization Water Resources Systems Planning and Management:
Multi-objective Optimization
Linear Programming and Applications
Stochastic Optimization
D Nagesh Kumar, IIScOptimization Methods: M5L1 1 Dynamic Programming Introduction.
D Nagesh Kumar, IIScOptimization Methods: M8L5 1 Advanced Topics in Optimization Evolutionary Algorithms for Optimization and Search.
(i) Preliminaries D Nagesh Kumar, IISc Water Resources Planning and Management: M3L1 Linear Programming and Applications.
NONSTANDARD SIMPLEX ALGORITHM FOR LINEAR PROGRAMMING Southeast University Ping-Qi Pan.
Submodularity Reading Group Submodular Function Minimization via Linear Programming M. Pawan Kumar
D Nagesh Kumar, IIScOptimization Methods: M8L1 1 Advanced Topics in Optimization Piecewise Linear Approximation of a Nonlinear Function.
D Nagesh Kumar, IIScOptimization Methods: M6L1 1 Dynamic Programming Applications Design of Continuous Beam.
Introduction and Preliminaries D Nagesh Kumar, IISc Water Resources Planning and Management: M4L1 Dynamic Programming and Applications.
OR Chapter 4. How fast is the simplex method  Efficiency of an algorithm : measured by running time (number of unit operations) with respect to.
OR Chapter 4. How fast is the simplex method.
Linear Programming Piyush Kumar Welcome to CIS5930.
(iii) Simplex method - I D Nagesh Kumar, IISc Water Resources Planning and Management: M3L3 Linear Programming and Applications.
-- Interior-Point Methods for LP
Stat 261 Two phase method.
Linear Programming Revised Simplex Method, Duality of LP problems and Sensitivity analysis D Nagesh Kumar, IISc Optimization Methods: M3L5.
ADVANCED COMPUTATIONAL MODELS AND ALGORITHMS
Dynamic Programming Applications
Chapter 5 The Simplex Method
Gomory Cuts Updated 25 March 2009.
Chapter 6. Large Scale Optimization
Uri Zwick – Tel Aviv Univ.
3-3 Optimization with Linear Programming
Chapter 10: Iterative Improvement
ADVANCED COMPUTATIONAL MODELS AND ALGORITHMS
Presentation transcript:

D Nagesh Kumar, IIScOptimization Methods: M3L6 1 Linear Programming Other Algorithms

D Nagesh Kumar, IIScOptimization Methods: M3L6 2 Introduction & Objectives Few other methods, for solving LP problems, use an entirely different algorithmic philosophy. – Khatchian’s ellipsoid method – Karmarkar’s projective scaling method Objectives To present a comparative discussion between new methods and Simplex method To discuss in detail about Karmarkar’s projective scaling method

D Nagesh Kumar, IIScOptimization Methods: M3L6 3 Comparative discussion between new methods and Simplex method Simplex Algorithm Karmarkar’s Algorithm Optimal solution point Feasible Region Khatchian’s ellipsoid method and Karmarkar’s projective scaling method seek the optimum solution to an LP problem by moving through the interior of the feasible region.

D Nagesh Kumar, IIScOptimization Methods: M3L6 4 Comparative discussion between new methods and Simplex method 1. Both Khatchian’s ellipsoid method and Karmarkar’s projective scaling method have been shown to be polynomial time algorithms. Time required for an LP problem of size n is at most an b, where a and b are two positive numbers. 2. Simplex algorithm is an exponential time algorithm in solving LP problems. Time required for an LP problem of size n is at most c2 n, where c is a positive number

D Nagesh Kumar, IIScOptimization Methods: M3L6 5 Comparative discussion between new methods and Simplex method 3. For a large enough n (with positive a, b and c), c2 n > an b. The polynomial time algorithms are computationally superior to exponential algorithms for large LP problems. 4. However, the rigorous computational effort of Karmarkar’s projective scaling method, is not economical for ‘not-so-large’ problems.

D Nagesh Kumar, IIScOptimization Methods: M3L6 6 Karmarkar’s projective scaling method Also known as Karmarkar’s interior point LP algorithm Starts with a trial solution and shoots it towards the optimum solution LP problems should be expressed in a particular form

D Nagesh Kumar, IIScOptimization Methods: M3L6 7 Karmarkar’s projective scaling method LP problems should be expressed in the following form: where and

D Nagesh Kumar, IIScOptimization Methods: M3L6 8 Karmarkar’s projective scaling method It is also assumed that is a feasible solution and Two other variables are defined as: and. Karmarkar’s projective scaling method follows iterative steps to find the optimal solution

D Nagesh Kumar, IIScOptimization Methods: M3L6 9 Karmarkar’s projective scaling method In general, k th iteration involves following computations a)Compute where If,,any feasible solution becomes an optimal solution. Further iteration is not required. Otherwise, go to next step.

D Nagesh Kumar, IIScOptimization Methods: M3L6 10 Karmarkar’s projective scaling method b) c) However, it can be shown that for k =0, Thus, d) Repeat the steps (a) through (d) by changing k as k+1 e)

D Nagesh Kumar, IIScOptimization Methods: M3L6 11 Karmarkar’s projective scaling method: Example Consider the LP problem: Thus, and also,

D Nagesh Kumar, IIScOptimization Methods: M3L6 12 Karmarkar’s projective scaling method: Example Iteration 0 (k=0):

D Nagesh Kumar, IIScOptimization Methods: M3L6 13 Karmarkar’s projective scaling method: Example Iteration 0 (k=0)…contd.:

D Nagesh Kumar, IIScOptimization Methods: M3L6 14 Karmarkar’s projective scaling method: Example Iteration 0 (k=0)…contd.:

D Nagesh Kumar, IIScOptimization Methods: M3L6 15 Karmarkar’s projective scaling method: Example Iteration 0 (k=0)…contd.:

D Nagesh Kumar, IIScOptimization Methods: M3L6 16 Karmarkar’s projective scaling method: Example Iteration 1 (k=1):

D Nagesh Kumar, IIScOptimization Methods: M3L6 17 Karmarkar’s projective scaling method: Example Iteration 1 (k=1)…contd.:

D Nagesh Kumar, IIScOptimization Methods: M3L6 18 Karmarkar’s projective scaling method: Example Iteration 1 (k=1)…contd.:

D Nagesh Kumar, IIScOptimization Methods: M3L6 19 Karmarkar’s projective scaling method: Example Iteration 1 (k=1)…contd.:

D Nagesh Kumar, IIScOptimization Methods: M3L6 20 Karmarkar’s projective scaling method: Example Iteration 1 (k=1)…contd.: Two successive iterations are shown. Similar iterations can be followed to get the final solution upto some predefined tolerance level

D Nagesh Kumar, IIScOptimization Methods: M3L6 21 Thank You