1. Part 4 Nonlinear Programming 4.3 Successive Linear Programming

2. Basic Concept

3. Approach 1: Direct Use of Linear Programs The simplest and most direct use of the linearization construction is to replace the general nonlinear problem with a complete linearization of all problem functions at some selected estimate solution. The linearized problem takes the form of a linear program and can be solved as such.

4. Case 1.1 The linearly constrained case

5. Case 1.1 The approximate problem

7. Bounded Line Search

8. Frank-Wolfe Algorithm

10. Remark

11. Case 1.2 The general LP case

12. Direct Linear Approximation

13. Remark In order attain convergence to the true optimum, it is sufficient that at each iteration an improvement be made in both the objective function and constraint infeasibility. This type of monotonic behavior will occur if the problem functions are mildly nonlinear.

14. Approach 2 Separable Programming The motivation for this technique stems from the observation that a good way of improving the linear approximation over a large interval is to partition the interval into subintervals and construct individual linear approximation over each subinterval, i.e., piecewise linear approximation.

15. Case 2.1 Single-Variable Functions

16. Line Segment in Interval k

18. General Formula

19. Case 2.2 Multivariable Separable Functions

20. General Formula

22. Restricted Basis Entry Prior to entering one lambda into the basis (which will make it nonzero), a check should be made to ensure that no more than one other lambda associated with the same x_i is in the basis. If there is one such lambda in the basis, it has to be adjacent.

23. Example

25. k 1000 211-2 3216-8 4381-18

27. Homework