1. Review of Reservoir Problem OR753 October 29, 2014 Remote Sensing and GISc, IST

2. Reservoir Model Multipurpose Reservoir Water Supply Flood Control Recreation Hydropower Objective Function may be related to any of the above uses. Conflicting objectives

3. Water Supply with Constant Release Notation CAP=reservoir capacity [m 3 ] S t =storage volume at the beginning of month t [m 3 ] I t =inflow volume during month t [m 3 ] (known) R t =release volume during month t [m 3 ] R min = Required minimum release each month [m 3 ] (known) S min = Required minimum storage [m 3 ] (known) Constraints Mass Balance Equation S t = S t-1 + I t - R t Capacity Constraint S t ≤ CAP S t ≥ S min R t ≥ R min All variables greater than or equal to zero Objective Function Minimize CAP For all t

4. Integer Programming

5. Integer Programming (IP) Pure Integer Programming Problem All variables are required to be Integers Mixed Integer Programming Problem Only some of the variables are required to be integers LP Relaxation of the IP LP obtained by omitting all integer constraints on variables Optimal value for LP relaxation > optimal value of IP IP is an LP in which some or all of the variables are required to be non-negative integers

6. Example: Pure IP MILP 0-1 IPs

7. LP Relaxation Any IP may be viewed as the LP relaxation plus additional constraints (the constraints that state which variables must be integers or be 0 or 1).

8. IP IPs are usually much harder to solve than LPs LP Relaxation is a less constrained version of IP This means that the feasible region for any IP must be contained in the feasible region for the corresponding LP relaxation For any IP that is a max problem, this implies that Optimal z-value for LP relaxation ≥ optimal z-value for IP

9. Example Feasible region for this problem consists of the following set of points: S {(0, 0), (0, 1), (0, 2), (0, 3), (1, 0), (1, 1)}. Unlike the feasible region for any LP, this is not a convex set By simply computing and comparing the z-values for each of the six points in the feasible region, we find the optimal solution is z =33, x 1 =0, x 2 =3

10. Properties If the feasible region for a pure IP’s LP relaxation is bounded, then the feasible region for the IP will consist of a finite number of points In theory, such an IP could be solved by enumerating the z-values for each feasible point and determining the feasible point having the largest z-value The problem with this approach is that most actual IPs have feasible regions consisting of billions of feasible points In such cases, a complete enumeration of all feasible points would require a large amount of computer time

11. What about rounding-off IP Relaxation solution? In our example optimal solution to the LP relaxation: x 1 =13/7 and x 2 = 0 Rounding this solution yields the a possible optimal solution x1= 2, x2 = 0 This is infeasible OR x 1 =1, x 2 =0 as possible optimal solution This is not optimal (x 1 =0, x 2 =3 is the optimal solution)

12. Solving IP Problem Enumeration Branch and Bound Method

13. Enumeration Each variable can take a finite number of discrete (integer) values The simple approach is to enumerate all these possibilities Chose the best feasible solution (optimal value) Becomes hard as number of variables increases Example: If there are X 1, X 2, X 3 and X 4 binary (1,0) decision variables How many possible solutions?

14. Enumeration: Possible Solutions X1X2X3X4 00000000 00010001 00100010 01000100 10001000 00110011 01010101 10011001 01100110 10101010 11001100 11101110 11001100 10111011 01110111 11111111 2 4 = 16 possible solution many of these may be infeasible Conceptually simple but computationally impossible for large problems

17. Enumerating all possible solutions is of course not feasible when there are too many variables If there are 100 variables 1 billion solutions per second will require about 400 billions year Age of Earth is = 4.54 Billions years!!!!!!!!!!!!!!!!

18. Branch and Bound (tree search) Method Systematically enumerating feasible solutions to find out the optimal solution Not all of the feasible solutions are enumerated but a small fraction of them Guarantees to find the optimal integer solution with small number of enumeration

19. Branch and Bound: Procedure Convert IP problem to a LP relaxation problem Solve the problem The optimal solution may have non-integer values of the decision variables Select a variable with non-integer value and generate two new problems (branching) by forcing that variable to be integer 1.Original LP relaxation plus the selected variable=1 2.Original LP relaxation plus the selected variable=0 Solve these two problems Drop any infeasible or inferior solution Repeat the procedure till the optimal solution is found Note: If you solve the LP relaxation of a pure IP and obtain a solution in which all variables are integers, then the optimal solution to the LP relaxation is also the optimal solution to the IP.

20. Branch and Bound: Example Max 30x 1 + 50x 2 + 40x 3 + 50x 4 Subject To 100x 1 + 50x 2 ≤ 150 45x 1 + 600x 2 + 900x 3 + 800x 4 ≤ 1,050 x 1, x 2, x 3, x 4 are binary (1,0) variables Optimal Solution: Z= 106.406; x 1 = 1.5, x 2 = 0, x 3 = 0, x 4 = 1.22813

21. Branch and Bound: Example x4=0 x4=1 x3=0 x3=1 x2=0 x2=1 Z =98 x1=1 x2=1 x3=0.45 x4=0 Z =97.08 x1=1 x2=0.3416 x3=0 x4=1 Z =80 x1=1 x2=1 x3=0 x4=0 Z =78.75 x1=1 x2=0.175 x3=1 x4=0 Infeasible Multiple optimal solutions Z =89.11 x1=1 x2=0 x3=0.227 x4=1 Infeasible x3=0x3=1 Z =105.31 x1=1 x2=1 x3=0 x4=0.506 Z =80 x1=1 x2=0 x3=0 x4=1

22. Integer Programming: Some useful Formulation Binary Variables (x 1, x 2, x 3,..) x 1 and x 2 are mutually exclusive (either both are absent or only one is present) X 1 +X 2 ≤ 1 Either x 1 or x 2 is present (exactly one) X 1 +X 2 = 1 At least x 1 or x 2 is present X 1 +X 2 ≥ 1 x 1 can not be present unless x 2 is present X 1 -X 2 ≤ 0 either both x 1 and x 2 are present or both are absent X 1 -X 2 = 0

23. X 3 can’t be undertaken unless either X 1 or X 2 or both are undertaken X 3 ≤ X 1 + X 2 X 3 should be undertaken if either or both X 1 and X 2 are undertaken (X 3 may still be undertaken if both X 1 and X 2 are absent) X 3 ≥ X 1 X 3 ≥ X 2 X 3 will strictly and only be undertaken if either or both X 1 and X 2 are undertaken X 3 ≥ X 1 X 3 ≥ X 2 X 3 ≤ X 1 + X 2 Integer Programming: Some useful Formulation X 1 0110 X 2 1010 X 3 1, 01, 01, 00 X10110X21010X31110X10110X21010X31110 X 1 0110 X 2 1010 X 3 1111, 0

24. To approximate the non-linear relationship X 1 =X 2 X 3 as linear relationships  X 1 <=(X 2 +X 3 )/2  X 1 >=X 2 +X 3 -1 X 2 X 3 X 1 =X 2 X 3 X 1 =X 2 +X 3 -1 00X 1 =0X 1 =-1 01X 1 =0X 1 =0 10X 1 =0X 1 =0 11X 1 =1X 1 =1 Integer Programming: Some useful Formulation

25. If-Then Constraints If X 1 =1 then X 2 =X 3 =0  X 1 ≤ M(1-y)  X 2 + X 3 ≤ My Where; M = is a large positive number y =1, 0 X 1, X 2, X 3 are 0,1 Either-Or Constraint Let X 1 is any positive number (variable) Either X 1 =0 or greater than N (a given value)  X 1 ≤ My  N-X 1 ≤ M(1-y) Where y =1,0 Note: Choose value of M such that both X 1 and N-X 1 would never exceed M Integer Programming: (for detailed description go through example 6, page 488 Winston)

26. Formulating IP

27. Any IP, such as above, that has only one constraint is referred to as a knapsack problem.

32. Let M1, M2, and M3 be three large positive numbers, and add the following constraints to (IP 1):

34. Constraint 1: x1 ≤ 0 or x1 ≥ 1,000 Similarly, Constraint 2 & 3 may be formulated Constraint 4 is a straightforward resource constraint that reduces to

36. If–Then Constraints Example:

37. Example 9 (Winston) Where

38. Solution Find out optimal solution to the LP relaxation Optimal solution to the LP relaxation is z = 165/4, x1 = 15/4, x2 = 9/4 We know that optimal z-value for IP ≤ optimal z- value for LP relaxation This implies that the optimal z-value for the IP cannot exceed 165/4 Thus, the optimal z-value for the LP relaxation is an upper bound for Telfa’s profit Next step is to partition the feasible region for the LP relaxation to find out IP’s optimal solution

41. Solving IPs with LINDO Note: the shadow prices and reduced costs refer to sub-problems generated during the branch-and bound solution—not to the IP. Unlike linear programming, there is no well-developed theory of sensitivity analysis for integer programming

42. Q 20 (Sec 9.2 Winston, pg. 504) – Homework Assignment due November 26, 2014 WSP Publishing sells textbooks to college students. WSP has two sales reps available to assign to the A–G state area. The number of college students (in thousands) in each state is given in Figure 9. Each sales rep must be assigned to two adjacent states. For example, a sales rep could be assigned to A and B, but not A and D. WSP’s goal is to maximize the number of total students in the states assigned to the sales reps. Formulate an IP whose solution will tell you where to assign the sales reps. Then use LINDO to solve your IP.

43. END