Review of Reservoir Problem OR753 October 29, 2014 Remote Sensing and GISc, IST.

Slides:



Advertisements
Similar presentations
Integer Optimization Basic Concepts Integer Linear Program(ILP): A linear program except that some or all of the decision variables must have integer.
Advertisements

1 Material to Cover  relationship between different types of models  incorrect to round real to integer variables  logical relationship: site selection.
Branch-and-Bound Technique for Solving Integer Programs
Geometry and Theory of LP Standard (Inequality) Primal Problem: Dual Problem:
Solving LP Models Improving Search Special Form of Improving Search
1 Chapter 11 Here we see cases where the basic LP model can not be used.
Pure, Mixed-Integer, Zero-One Models
Linear Programming Models & Case Studies
Operations Management Linear Programming Module B - Part 2
EE 553 Integer Programming
Water Resources Development and Management Optimization (Integer Programming) CVEN 5393 Mar 11, 2013.
Basic Feasible Solutions: Recap MS&E 211. WILL FOLLOW A CELEBRATED INTELLECTUAL TEACHING TRADITION.
Solving Integer Programs. Natural solution ideas that don’t work well Solution idea #1: Explicit enumeration: Try all possible solutions and pick the.
Computational Methods for Management and Economics Carla Gomes
ENGR 351 Numerical Methods Instructor: Dr. L.R. Chevalier
Linear Programming Integer Linear Models. When Variables Have To Be Integers Example – one time production decisions –Fractional values make no sense.
Linear Programming (LP)
D Nagesh Kumar, IIScOptimization Methods: M7L1 1 Integer Programming All Integer Linear Programming.
Spreadsheet Modeling & Decision Analysis:
LP formulation of Economic Dispatch
Daniel Kroening and Ofer Strichman Decision Procedures An Algorithmic Point of View Deciding ILPs with Branch & Bound ILP References: ‘Integer Programming’
(Not in text).  An LP with additional constraints requiring that all the variables be integers is called an all-integer linear program (IP).  The LP.
1 1 Slide LINEAR PROGRAMMING: THE GRAPHICAL METHOD n Linear Programming Problem n Properties of LPs n LP Solutions n Graphical Solution n Introduction.
Chapter 19 Linear Programming McGraw-Hill/Irwin
Decision Procedures An Algorithmic Point of View
Linear Programming Chapter 13 Supplement.
1 1 Slide Integer Linear Programming Professor Ahmadi.
1 1 Slide Integer Linear Programming Professor Ahmadi.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. 6S Linear Programming.
Linear Programming Topics General optimization model LP model and assumptions Manufacturing example Characteristics of solutions Sensitivity analysis Excel.
Nonlinear Programming (NLP) Operation Research December 29, 2014 RS and GISc, IST, Karachi.
Operations Research Assistant Professor Dr. Sana’a Wafa Al-Sayegh 2 nd Semester ITGD4207 University of Palestine.
Chapter 9 Integer Programming
Types of IP Models All-integer linear programs Mixed integer linear programs (MILP) Binary integer linear programs, mixed or all integer: some or all of.
ECE 556 Linear Programming Ting-Yuan Wang Electrical and Computer Engineering University of Wisconsin-Madison March
Integer Programming Key characteristic of an Integer Program (IP) or Mixed Integer Linear Program (MILP): One or more of the decision variable must be.
Linear Programming McGraw-Hill/Irwin Copyright © 2012 by The McGraw-Hill Companies, Inc. All rights reserved.
Integer Programming Each year CrossChek decides which lines of golf clubs and clothing it will market. Consider that each line of golf clubs is expected.
To accompany Quantitative Analysis for Management, 8e by Render/Stair/Hanna 11-1 © 2003 by Prentice Hall, Inc. Upper Saddle River, NJ Chapter 11.
Chapter 1. Formulations 1. Integer Programming  Mixed Integer Optimization Problem (or (Linear) Mixed Integer Program, MIP) min c’x + d’y Ax +
15.053Tuesday, April 9 Branch and Bound Handouts: Lecture Notes.
Integer Programming Li Xiaolei. Introduction to Integer Programming An IP in which all variables are required to be integers is called a pure integer.
Branch-and-Cut Valid inequality: an inequality satisfied by all feasible solutions Cut: a valid inequality that is not part of the current formulation.
Integer LP In-class Prob
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
OR Chapter 8. General LP Problems Converting other forms to general LP problem : min c’x  - max (-c)’x   = by adding a nonnegative slack variable.
Spreadsheet Modeling & Decision Analysis A Practical Introduction to Management Science 5 th edition Cliff T. Ragsdale.
McGraw-Hill/Irwin Copyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Supplement 6 Linear Programming.
Integer Programming, Branch & Bound Method
Lecture 6 – Integer Programming Models Topics General model Logic constraint Defining decision variables Continuous vs. integral solution Applications:
IE 312 Review 1. The Process 2 Problem Model Conclusions Problem Formulation Analysis.
Introduction to Integer Programming Integer programming models Thursday, April 4 Handouts: Lecture Notes.
Chapter 6 Optimization Models with Integer Variables.
Approximation Algorithms based on linear programming.
1 Chapter 6 Reformulation-Linearization Technique and Applications.
Chapter 9 Integer Programming to accompany Operations Research: Applications and Algorithms 4th edition by Wayne L. Winston Copyright (c) 2004 Brooks/Cole,
0 Integer Programming Introduction to Integer Programming (IP) Difficulties of LP relaxation IP Formulations Branch and Bound Algorithms Reference: Chapter.
Water Resources Development and Management Optimization (Integer and Mixed Integer Programming) CVEN 5393 Mar 28, 2011.
Linear Programming Topics General optimization model
Introduction to Operations Research
Linear Programming Topics General optimization model
Linear Programming Topics General optimization model
Integer Programming (정수계획법)
Integer Linear Programming
Integer Programming (정수계획법)
Operations Research Models
Linear Programming Integer Linear Models.
Graphical solution A Graphical Solution Procedure (LPs with 2 decision variables can be solved/viewed this way.) 1. Plot each constraint as an equation.
Chapter 1. Formulations.
Branch-and-Bound Algorithm for Integer Program
Presentation transcript:

Review of Reservoir Problem OR753 October 29, 2014 Remote Sensing and GISc, IST

Reservoir Model Multipurpose Reservoir Water Supply Flood Control Recreation Hydropower Objective Function may be related to any of the above uses. Conflicting objectives

Water Supply with Constant Release Notation CAP=reservoir capacity [m 3 ] S t =storage volume at the beginning of month t [m 3 ] I t =inflow volume during month t [m 3 ] (known) R t =release volume during month t [m 3 ] R min = Required minimum release each month [m 3 ] (known) S min = Required minimum storage [m 3 ] (known) Constraints Mass Balance Equation S t = S t-1 + I t - R t Capacity Constraint S t ≤ CAP S t ≥ S min R t ≥ R min All variables greater than or equal to zero Objective Function Minimize CAP For all t

Integer Programming

Integer Programming (IP) Pure Integer Programming Problem All variables are required to be Integers Mixed Integer Programming Problem Only some of the variables are required to be integers LP Relaxation of the IP LP obtained by omitting all integer constraints on variables Optimal value for LP relaxation > optimal value of IP IP is an LP in which some or all of the variables are required to be non-negative integers

Example: Pure IP MILP 0-1 IPs

LP Relaxation Any IP may be viewed as the LP relaxation plus additional constraints (the constraints that state which variables must be integers or be 0 or 1).

IP IPs are usually much harder to solve than LPs LP Relaxation is a less constrained version of IP This means that the feasible region for any IP must be contained in the feasible region for the corresponding LP relaxation For any IP that is a max problem, this implies that Optimal z-value for LP relaxation ≥ optimal z-value for IP

Example Feasible region for this problem consists of the following set of points: S {(0, 0), (0, 1), (0, 2), (0, 3), (1, 0), (1, 1)}. Unlike the feasible region for any LP, this is not a convex set By simply computing and comparing the z-values for each of the six points in the feasible region, we find the optimal solution is z =33, x 1 =0, x 2 =3

Properties If the feasible region for a pure IP’s LP relaxation is bounded, then the feasible region for the IP will consist of a finite number of points In theory, such an IP could be solved by enumerating the z-values for each feasible point and determining the feasible point having the largest z-value The problem with this approach is that most actual IPs have feasible regions consisting of billions of feasible points In such cases, a complete enumeration of all feasible points would require a large amount of computer time

What about rounding-off IP Relaxation solution? In our example optimal solution to the LP relaxation: x 1 =13/7 and x 2 = 0 Rounding this solution yields the a possible optimal solution x1= 2, x2 = 0 This is infeasible OR x 1 =1, x 2 =0 as possible optimal solution This is not optimal (x 1 =0, x 2 =3 is the optimal solution)

Solving IP Problem Enumeration Branch and Bound Method

Enumeration Each variable can take a finite number of discrete (integer) values The simple approach is to enumerate all these possibilities Chose the best feasible solution (optimal value) Becomes hard as number of variables increases Example: If there are X 1, X 2, X 3 and X 4 binary (1,0) decision variables How many possible solutions?

Enumeration: Possible Solutions X1X2X3X = 16 possible solution many of these may be infeasible Conceptually simple but computationally impossible for large problems

Enumerating all possible solutions is of course not feasible when there are too many variables If there are 100 variables 1 billion solutions per second will require about 400 billions year Age of Earth is = 4.54 Billions years!!!!!!!!!!!!!!!!

Branch and Bound (tree search) Method Systematically enumerating feasible solutions to find out the optimal solution Not all of the feasible solutions are enumerated but a small fraction of them Guarantees to find the optimal integer solution with small number of enumeration

Branch and Bound: Procedure Convert IP problem to a LP relaxation problem Solve the problem The optimal solution may have non-integer values of the decision variables Select a variable with non-integer value and generate two new problems (branching) by forcing that variable to be integer 1.Original LP relaxation plus the selected variable=1 2.Original LP relaxation plus the selected variable=0 Solve these two problems Drop any infeasible or inferior solution Repeat the procedure till the optimal solution is found Note: If you solve the LP relaxation of a pure IP and obtain a solution in which all variables are integers, then the optimal solution to the LP relaxation is also the optimal solution to the IP.

Branch and Bound: Example Max 30x x x x 4 Subject To 100x x 2 ≤ x x x x 4 ≤ 1,050 x 1, x 2, x 3, x 4 are binary (1,0) variables Optimal Solution: Z= ; x 1 = 1.5, x 2 = 0, x 3 = 0, x 4 =

Branch and Bound: Example x4=0 x4=1 x3=0 x3=1 x2=0 x2=1 Z =98 x1=1 x2=1 x3=0.45 x4=0 Z =97.08 x1=1 x2= x3=0 x4=1 Z =80 x1=1 x2=1 x3=0 x4=0 Z =78.75 x1=1 x2=0.175 x3=1 x4=0 Infeasible Multiple optimal solutions Z =89.11 x1=1 x2=0 x3=0.227 x4=1 Infeasible x3=0x3=1 Z = x1=1 x2=1 x3=0 x4=0.506 Z =80 x1=1 x2=0 x3=0 x4=1

Integer Programming: Some useful Formulation Binary Variables (x 1, x 2, x 3,..) x 1 and x 2 are mutually exclusive (either both are absent or only one is present) X 1 +X 2 ≤ 1 Either x 1 or x 2 is present (exactly one) X 1 +X 2 = 1 At least x 1 or x 2 is present X 1 +X 2 ≥ 1 x 1 can not be present unless x 2 is present X 1 -X 2 ≤ 0 either both x 1 and x 2 are present or both are absent X 1 -X 2 = 0

X 3 can’t be undertaken unless either X 1 or X 2 or both are undertaken X 3 ≤ X 1 + X 2 X 3 should be undertaken if either or both X 1 and X 2 are undertaken (X 3 may still be undertaken if both X 1 and X 2 are absent) X 3 ≥ X 1 X 3 ≥ X 2 X 3 will strictly and only be undertaken if either or both X 1 and X 2 are undertaken X 3 ≥ X 1 X 3 ≥ X 2 X 3 ≤ X 1 + X 2 Integer Programming: Some useful Formulation X X X 3 1, 01, 01, 00 X10110X21010X31110X10110X21010X31110 X X X , 0

To approximate the non-linear relationship X 1 =X 2 X 3 as linear relationships  X 1 <=(X 2 +X 3 )/2  X 1 >=X 2 +X 3 -1 X 2 X 3 X 1 =X 2 X 3 X 1 =X 2 +X X 1 =0X 1 =-1 01X 1 =0X 1 =0 10X 1 =0X 1 =0 11X 1 =1X 1 =1 Integer Programming: Some useful Formulation

If-Then Constraints If X 1 =1 then X 2 =X 3 =0  X 1 ≤ M(1-y)  X 2 + X 3 ≤ My Where; M = is a large positive number y =1, 0 X 1, X 2, X 3 are 0,1 Either-Or Constraint Let X 1 is any positive number (variable) Either X 1 =0 or greater than N (a given value)  X 1 ≤ My  N-X 1 ≤ M(1-y) Where y =1,0 Note: Choose value of M such that both X 1 and N-X 1 would never exceed M Integer Programming: (for detailed description go through example 6, page 488 Winston)

Formulating IP

Any IP, such as above, that has only one constraint is referred to as a knapsack problem.

Let M1, M2, and M3 be three large positive numbers, and add the following constraints to (IP 1):

Constraint 1: x1 ≤ 0 or x1 ≥ 1,000 Similarly, Constraint 2 & 3 may be formulated Constraint 4 is a straightforward resource constraint that reduces to

If–Then Constraints Example:

Example 9 (Winston) Where

Solution Find out optimal solution to the LP relaxation Optimal solution to the LP relaxation is z = 165/4, x1 = 15/4, x2 = 9/4 We know that optimal z-value for IP ≤ optimal z- value for LP relaxation This implies that the optimal z-value for the IP cannot exceed 165/4 Thus, the optimal z-value for the LP relaxation is an upper bound for Telfa’s profit Next step is to partition the feasible region for the LP relaxation to find out IP’s optimal solution

Solving IPs with LINDO Note: the shadow prices and reduced costs refer to sub-problems generated during the branch-and bound solution—not to the IP. Unlike linear programming, there is no well-developed theory of sensitivity analysis for integer programming

Q 20 (Sec 9.2 Winston, pg. 504) – Homework Assignment due November 26, 2014 WSP Publishing sells textbooks to college students. WSP has two sales reps available to assign to the A–G state area. The number of college students (in thousands) in each state is given in Figure 9. Each sales rep must be assigned to two adjacent states. For example, a sales rep could be assigned to A and B, but not A and D. WSP’s goal is to maximize the number of total students in the states assigned to the sales reps. Formulate an IP whose solution will tell you where to assign the sales reps. Then use LINDO to solve your IP.

END