1 1 Slides by John Loucks St. Edward’s University Modifications by A. Asef-Vaziri

2 2 Chapter 2 Introduction to Linear Programming n Linear Programming Problem n Problem Formulation n A Simple Maximization Problem n Computer Solutions n A Simple Minimization Problem n Special Cases

3 3 Linear Programming (LP) Problem n Linear programming involves choosing a course of action when the mathematical model of the problem contains only linear functions. n The maximization or minimization of some quantity is the objective in all linear programming problems. n All LP problems have constraints that limit the degree to which the objective can be pursued. n A feasible solution satisfies all the problem's constraints. n An optimal solution is a feasible solution that results in the largest possible objective function value when maximizing (or smallest when minimizing).

4 4 Linear Programming (LP) Problem n If both the objective function and the constraints are linear, the problem is referred to as a linear programming problem. n Linear functions are functions in which each variable appears in a separate term raised to the first power and is multiplied by a constant (which could be 0). n Linear constraints are linear functions that are restricted to be "less than or equal to", "equal to", or "greater than or equal to" a constant.

5 5 Problem Formulation n Problem formulation or modeling is the process of translating a verbal statement of a problem into a mathematical statement. n Formulating models is an art that can only be mastered with practice and experience. n Every LP problems has some unique features, but most problems also have common features. n General guidelines Understand the problem thoroughly. Understand the problem thoroughly. Identify the decision variables. Identify the decision variables. Describe the objective function. Describe the objective function. Describe each constraint. Describe each constraint.

6 6 Example 1: A Simple Maximization Problem n LP Formulation Max 5 x x 2 s.t. x 1 < 6 2 x x 2 < 19 2 x x 2 < 19 x 1 + x 2 < 8 x 1 + x 2 < 8 x 1 > 0 and x 2 > 0 x 1 > 0 and x 2 > 0 ObjectiveFunction “Regular”Constraints Non-negativity Constraints Constraints

7 7 Computer Solutions n LP problems involving 1000s of variables and 1000s of constraints are now routinely solved with computer packages. n Linear programming solvers are now part of many spreadsheet packages, such as Microsoft Excel. n Leading commercial packages include CPLEX, LINGO, MOSEK, Xpress-MP, and Premium Solver for Excel. n In this chapter we will discuss the following output: objective function value objective function value values of the decision variables values of the decision variables reduced costs reduced costs slack and surplus slack and surplus

8 8 Example 1: Spreadsheet Solution n Partial Spreadsheet Showing Problem Data

9 9 Example 1: Spreadsheet Solution n Partial Spreadsheet Showing Solution

10 Example 1: Spreadsheet Solution n Interpretation of Computer Output We see from the previous slide that: Objective Function Value = 46 Objective Function Value = 46 Decision Variable #1 ( x 1 ) = 5 Decision Variable #1 ( x 1 ) = 5 Decision Variable #2 ( x 2 ) = 3 Decision Variable #2 ( x 2 ) = 3 Slack in Constraint #1 = 6 – 5 = 1 Slack in Constraint #1 = 6 – 5 = 1 Slack in Constraint #2 = 19 – 19 = 0 Slack in Constraint #2 = 19 – 19 = 0 Slack in Constraint #3 = 8 – 8 = 0 Slack in Constraint #3 = 8 – 8 = 0

11 Reduced Cost n The reduced cost for a decision variable whose value is 0 in the optimal solution is: the amount the variable's objective function coefficient would have to improve (increase for maximization problems, decrease for minimization problems) before this variable could assume a positive value. n The reduced cost for a decision variable whose value is > 0 in the optimal solution is 0.

12 Example 1: Spreadsheet Solution n Reduced Costs

13 Example 2: A Simple Minimization Problem n LP Formulation Min 5 x x 2 s.t. 2 x x 2 > 10 4 x 1  x 2 > 12 4 x 1  x 2 > 12 x 1 + x 2 > 4 x 1 + x 2 > 4 x 1, x 2 > 0 x 1, x 2 > 0

14 Feasible Region n The feasible region for an LP problem can be nonexistent, a single point, a line, a polygon, or an unbounded area. n Any linear program falls in one of four categories: is infeasible is infeasible has a unique optimal solution has a unique optimal solution has alternative optimal solutions has alternative optimal solutions has an objective function that can be increased without bound has an objective function that can be increased without bound n A feasible region may be unbounded and yet there may be optimal solutions. This is common in minimization problems and is possible in maximization problems.

15 Special Cases: Alternative Optimal Solutions n Consider the following LP problem. Max 4 x x 2 s.t. x 1 < 6 2 x x 2 < 18 2 x x 2 < 18 x 1 + x 2 < 7 x 1 + x 2 < 7 x 1 > 0 and x 2 > 0 x 1 > 0 and x 2 > 0

16 Special Cases: Infeasibility No solution to the LP problem satisfies all the constraints, including the non-negativity conditions. No solution to the LP problem satisfies all the constraints, including the non-negativity conditions. Graphically, this means a feasible region does not exist. Graphically, this means a feasible region does not exist. Causes include: Causes include: A formulation error has been made.A formulation error has been made. Management’s expectations are too high.Management’s expectations are too high. Too many restrictions have been placed on the problem (i.e. the problem is over-constrained).Too many restrictions have been placed on the problem (i.e. the problem is over-constrained).

17 Example: Infeasible Problem n Consider the following LP problem. Max 2 x x 2 s.t. 4 x x 2 < 12 2 x 1 + x 2 > 8 2 x 1 + x 2 > 8 x 1, x 2 > 0 x 1, x 2 > 0

18 Special Cases: Unbounded Feasible Region The solution to a maximization LP problem is unbounded if the value of the solution may be made indefinitely large without violating any of the constraints. The solution to a maximization LP problem is unbounded if the value of the solution may be made indefinitely large without violating any of the constraints. For real problems, this is the result of improper formulation. (Quite likely, a constraint has been inadvertently omitted.) For real problems, this is the result of improper formulation. (Quite likely, a constraint has been inadvertently omitted.)

19 Example: Unbounded Solution n Consider the following LP problem. Max 4 x x 2 s.t. x 1 + x 2 > 5 3 x 1 + x 2 > 8 3 x 1 + x 2 > 8 x 1, x 2 > 0 x 1, x 2 > 0

20 End of Chapter 2