Optimization of Linear Problems: Linear Programming (LP) © 2011 Daniel Kirschen and University of Washington 1.

Slides:



Advertisements
Similar presentations
Introduction to Algorithms 6.046J/18.401J/SMA5503
Advertisements

© 2003 Anita Lee-Post Linear Programming Part 2 By Anita Lee-Post.
Linear Programming Problem
Solving IPs – Cutting Plane Algorithm General Idea: Begin by solving the LP relaxation of the IP problem. If the LP relaxation results in an integer solution,
Engineering Optimization
Introduction to Algorithms
Dragan Jovicic Harvinder Singh
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
Linear Programming?!?! Sec Linear Programming In management science, it is often required to maximize or minimize a linear function called an objective.
Linear Programming Fundamentals Convexity Definition: Line segment joining any 2 pts lies inside shape convex NOT convex.
Basic Feasible Solutions: Recap MS&E 211. WILL FOLLOW A CELEBRATED INTELLECTUAL TEACHING TRADITION.
CSCI 3160 Design and Analysis of Algorithms Tutorial 6 Fei Chen.
Chapter 10: Iterative Improvement
Spreadsheet Modeling and Decision Analysis, 3e, by Cliff Ragsdale. © 2001 South-Western/Thomson Learning. 8-1 Introduction to Nonlinear Programming (NLP)
Linear and Integer Programming Models
To Accompany Russell and Taylor, Operations Management, 4th Edition,  2003 Prentice-Hall, Inc. All rights reserved by Prentice-Hall, Inc1  Model.
Lecture outline Support vector machines. Support Vector Machines Find a linear hyperplane (decision boundary) that will separate the data.
Polyhedral Containment Check for a Linear Hybrid Automata Reachability Procedure Industry mentor: Steve Vestal Honeywell, Inc. Team 5: Sonja Petrović (presenter),
Objectives: Set up a Linear Programming Problem Solve a Linear Programming Problem.
LP formulation of Economic Dispatch
Graphical Solutions Plot all constraints including nonnegativity ones
WOOD 492 MODELLING FOR DECISION SUPPORT Lecture 2 Introduction to Linear Programming.
Stevenson and Ozgur First Edition Introduction to Management Science with Spreadsheets McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies,
Chapter 15 Constrained Optimization. The Linear Programming Model Let : x 1, x 2, x 3, ………, x n = decision variables Z = Objective function or linear.
Linear Programming - Standard Form
Computational Geometry Piyush Kumar (Lecture 5: Linear Programming) Welcome to CIS5930.
Linear Programming Piyush Kumar. Graphing 2-Dimensional LPs Example 1: x y Feasible Region x  0y  0 x + 2 y  2 y  4 x  3 Subject.
Some Key Facts About Optimal Solutions (Section 14.1) 14.2–14.16
Nonlinear Programming (NLP) Operation Research December 29, 2014 RS and GISc, IST, Karachi.
Nonlinear Programming.  A nonlinear program (NLP) is similar to a linear program in that it is composed of an objective function, general constraints,
ECE 556 Linear Programming Ting-Yuan Wang Electrical and Computer Engineering University of Wisconsin-Madison March
BUSINESS MATHEMATICS & STATISTICS. LECTURE 45 Planning Production Levels: Linear Programming.
Linear Programming – Simplex Method
QMB 4701 MANAGERIAL OPERATIONS ANALYSIS
1 Max 8X 1 + 5X 2 (Weekly profit) subject to 2X 1 + 1X 2  1000 (Plastic) 3X 1 + 4X 2  2400 (Production Time) X 1 + X 2  700 (Total production) X 1.
OR Chapter 2. Simplex method (2,0) (2,2/3) (1,2)(0,2)
Soham Uday Mehta. Linear Programming in 3 variables.
Two Discrete Optimization Problems Problem: The Transportation Problem.
McGraw-Hill/Irwin © The McGraw-Hill Companies, Inc., Table of Contents CD Chapter 14 (Solution Concepts for Linear Programming) Some Key Facts.
Linear Programming Maximize Subject to Worst case polynomial time algorithms for linear programming 1.The ellipsoid algorithm (Khachian, 1979) 2.Interior.
Non-Linear Programming © 2011 Daniel Kirschen and University of Washington 1.
3 Components for a Spreadsheet Optimization Problem  There is one cell which can be identified as the Target or Set Cell, the single objective of the.
Foundation of the Simplex Method.  Constraints Boundary Equations  Graphical approach is very limited based on number of variables. The simplex method.
Nonlinear Programming In this handout Gradient Search for Multivariable Unconstrained Optimization KKT Conditions for Optimality of Constrained Optimization.
Linear Programming: Formulations, Geometry and Simplex Method Yi Zhang January 21 th, 2010.
Instructional Design Document Simplex Method - Optimization STAM Interactive Solutions.
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Linear Programming Piyush Kumar Welcome to CIS5930.
Operations Research.  Operations Research (OR) aims to having the optimization solution for some administrative problems, such as transportation, decision-making,
TU/e Algorithms (2IL15) – Lecture 12 1 Linear Programming.
Part 4 Nonlinear Programming 4.3 Successive Linear Programming.
Chapter 2 Linear Programming Models: Graphical and Computer Methods
MGTSC 352 Lecture 15: Aggregate Planning Altametal Case
Linear Programming for Solving the DSS Problems
An Introduction to Linear Programming Pertemuan 4
Stat 261 Two phase method.
Linear Programming Reading: CLRS, Ch. 29 or reference
Constrained Optimization
Linear Programming CISC4080, Computer Algorithms CIS, Fordham Univ.
3-3 Optimization with Linear Programming
CISC5835, Algorithms for Big Data
INFM 718A / LBSC 705 Information For Decision Making
Warm Up Solve for x:
Linear Programming Example: Maximize x + y x and y are called
Linear Programming Problem
Module B Linear Programming.
Dr. Arslan Ornek DETERMINISTIC OPTIMIZATION MODELS
Chapter 10: Iterative Improvement
Discrete Optimization
Presentation transcript:

Optimization of Linear Problems: Linear Programming (LP) © 2011 Daniel Kirschen and University of Washington 1

Motivation Many optimization problems are linear – Linear objective function – All constraints are linear Non-linear problems can be linearized: – Piecewise linear cost curves – DC power flow Efficient and robust method to solve such problems © 2011 Daniel Kirschen and University of Washington 2

Piecewise linearization of a cost curve © 2011 Daniel Kirschen and University of Washington 3 PAPA

Mathematical formulation 4 n minimize Σ c j x j j =1 n subject to: Σ a ij x j ≤ b i, i = 1, 2,..., m j =1 n Σ c ij x j = d i, i = 1, 2,..., p j =1 c j, a ij, b i, c ij, d i are constants © 2011 Daniel Kirschen and University of Washington Decision variables: x j j=1, 2,.. n

x y Feasible Region x + 2 y  2 y ≤ 4 x  3 x  0;y  0 Subject to: Maximize x + y Example 1 © 2011 Daniel Kirschen and University of Washington 5

x y x + 2 y  2 y ≤ 4 x  3 x  0;y  0 Subject to: Maximize x + y Example 1 x + y = 0 © 2011 Daniel Kirschen and University of Washington 6

x y x + 2 y  2 y ≤ 4 x  3 x  0;y  0 Subject to: Maximize x + y Example 1 x + y = 1 Feasible Solution © 2011 Daniel Kirschen and University of Washington 7

x y x + 2 y  2 y ≤ 4 x  3 x  0;y  0 Subject to: Maximize x + y Example 1 x + y = 2 Feasible Solution © 2011 Daniel Kirschen and University of Washington 8

x y x + 2 y  2 y ≤ 4 x  3 x  0;y  0 Subject to: Maximize x + y Example 1 x + y = 3 © 2011 Daniel Kirschen and University of Washington 9

x y x + 2 y  2 y ≤ 4 x  3 x  0;y  0 Subject to: Maximize x + y Example 1 x + y = 7 Optimal Solution © 2011 Daniel Kirschen and University of Washington 10

Solving a LP problem (1) Constraints define a polyhedron in n dimensions If a solution exists, it will be at an extreme point (vertex) of this polyhedron Starting from any feasible solution, we can find the optimal solution by following the edges of the polyhedron Simplex algorithm determines which edge should be followed next © 2011 Daniel Kirschen and University of Washington 11

x y x + 2 y  2 y ≤ 4 x  3 x  0;y  0 Subject to: Maximize x + y Which direction? x + y = 7 Optimal Solution © 2011 Daniel Kirschen and University of Washington 12

Solving a LP problem (2) If a solution exists, the Simplex algorithm will find it But it could take a long time for a problem with many variables! – Interior point algorithms – Equivalent to optimization with barrier functions © 2011 Daniel Kirschen and University of Washington 13

Interior point methods 14 Constraints (edges) Extreme points (vertices) Simplex: search from vertex to vertex along the edges Interior-point methods: go through the inside of the feasible space © 2011 Daniel Kirschen and University of Washington

Sequential Linear Programming (SLP) Used if more accuracy is required Algorithm: – Linearize – Find a solution using LP – Linearize again around the solution – Repeat until convergence © 2011 Daniel Kirschen and University of Washington 15

Summary Main advantages of LP over NLP: – Robustness If there is a solution, it will be found Unlike NLP, there is only one solution – Speed Very efficient implementation of LP solution algorithms are available in commercial solvers Many non-linear optimization problems are linearized so they can be solved using LP © 2011 Daniel Kirschen and University of Washington 16