Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy.

Slides:



Advertisements
Similar presentations
PowerPoint Slides by Robert F. BrookerCopyright (c) 2001 by Harcourt, Inc. All rights reserved. Linear Programming Mathematical Technique for Solving Constrained.
Advertisements

The simplex algorithm The simplex algorithm is the classical method for solving linear programs. Its running time is not polynomial in the worst case.
Topic Outline ? Black-Box Optimization Optimization Algorithm: only allowed to evaluate f (direct search) decision vector x objective vector f(x) objective.
Optimization with Constraints
Understanding optimum solution
Integer linear programming Optimization problems where design variables have to be integers are more difficult than ones with continuous variables. The.
Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy.
Chapter 2: Modeling with Linear Programming & sensitivity analysis
D Nagesh Kumar, IIScOptimization Methods: M4L1 1 Linear Programming Applications Software for Linear Programming.
Multi-objective optimization multi-criteria decision-making.
Introduction to Linear and Integer Programming
Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy.
Multi-objective Approach to Portfolio Optimization 童培俊 张帆.
Multiobjective Optimization Chapter 7 Luke, Essentials of Metaheuristics, 2011 Byung-Hyun Ha R1.
Spring, 2013C.-S. Shieh, EC, KUAS, Taiwan1 Heuristic Optimization Methods Pareto Multiobjective Optimization Patrick N. Ngatchou, Anahita Zarei, Warren.
Multi-Objective Evolutionary Algorithms Matt D. Johnson April 19, 2007.
Introduction to Management Science
MAE 552 Heuristic Optimization Instructor: John Eddy Lecture #36 4/29/02 Multi-Objective Optimization.
MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition
On the Task Assignment Problem : Two New Efficient Heuristic Algorithms.
Introduction to Management Science
Introduction and Basic Concepts
A New Algorithm for Solving Many-objective Optimization Problem Md. Shihabul Islam ( ) and Bashiul Alam Sabab ( ) Department of Computer Science.
Chapter 4 Simplex Method for Linear Programming Shi-Shang Jang Chemical Engineering Department National Tsing-Hua University.
Linear Programming Old name for linear optimization –Linear objective functions and constraints Optimum always at boundary of feasible domain First solution.
Linear programming. Linear programming… …is a quantitative management tool to obtain optimal solutions to problems that involve restrictions and limitations.
Arithmetic Sequences and Series
Stevenson and Ozgur First Edition Introduction to Management Science with Spreadsheets McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies,
3.5 Solving systems of equations in 3 variables
Evolutionary Multi-objective Optimization – A Big Picture Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
Portfolio-Optimization with Multi-Objective Evolutionary Algorithms in the case of Complex Constraints Benedikt Scheckenbach.
Optimization formulation Optimization methods help us find solutions to problems where we seek to find the best of something. This lecture is about how.
1 Linear Programming: Model Formulation and Graphical Solution.
A two-stage approach for multi- objective decision making with applications to system reliability optimization Zhaojun Li, Haitao Liao, David W. Coit Reliability.
Graphing Linear Inequalities in Two Variables Chapter 4 – Section 1.
Linear Programming Data Structures and Algorithms A.G. Malamos References: Algorithms, 2006, S. Dasgupta, C. H. Papadimitriou, and U. V. Vazirani Introduction.
Evaluation and Validation Peter Marwedel TU Dortmund, Informatik 12 Germany 2013 年 12 月 02 日 These slides use Microsoft clip arts. Microsoft copyright.
Robin McDougall Scott Nokleby Mechatronic and Robotic Systems Laboratory 1.
Survey of gradient based constrained optimization algorithms Select algorithms based on their popularity. Additional details and additional algorithms.
PowerPoint Slides by Robert F. BrookerHarcourt, Inc. items and derived items copyright © 2001 by Harcourt, Inc. Managerial Economics in a Global Economy.
Kanpur Genetic Algorithms Laboratory IIT Kanpur 25, July 2006 (11:00 AM) Multi-Objective Dynamic Optimization using Evolutionary Algorithms by Udaya Bhaskara.
1 Multi-Objective Portfolio Optimization Jeremy Eckhause AMSC 698S Professor S. Gabriel 6 December 2004.
2/29/20121 Optimizing LCLS2 taper profile with genetic algorithms: preliminary results X. Huang, J. Wu, T. Raubenhaimer, Y. Jiao, S. Spampinati, A. Mandlekar,
Arben Asllani University of Tennessee at Chattanooga Chapter 5 Business Analytics with Goal Programming Business Analytics with Management Science Models.
Log Truck Scheduling Problem
Optimization Optimization is the methodology for obtaining the best alternative from all possible ones. Unconstrained optimization has only an objective.
Multi-objective Optimization
Linear Programming and Applications
Multiobjective Optimization for Locating Multiple Optimal Solutions of Nonlinear Equation Systems and Multimodal Optimization Problems Yong Wang School.
1 Optimization Techniques Constrained Optimization by Linear Programming updated NTU SY-521-N SMU EMIS 5300/7300 Systems Analysis Methods Dr.
Tamaki Okuda ● Tomoyuki Hiroyasu   Mitsunori Miki   Shinya Watanabe  
Multi-Objective Optimization for Topology Control in Hybrid FSO/RF Networks Jaime Llorca December 8, 2004.
Evolutionary Computing Chapter 12. / 26 Chapter 12: Multiobjective Evolutionary Algorithms Multiobjective optimisation problems (MOP) -Pareto optimality.
THREE DIMENSIONAL-PALLET LOADING PROBLEM BY ABDULRHMAN AL-OTAIBI.
Structural & Multidisciplinary Optimization Group Deciding How Conservative A Designer Should Be: Simulating Future Tests and Redesign Nathaniel Price.
1 LP-3 Symplex Method. 2  When decision variables are more than 2, it is always advisable to use Simplex Method to avoid lengthy graphical procedure.
Elimination Method - Systems. Elimination Method  With the elimination method, you create like terms that add to zero.
ZEIT4700 – S1, 2016 Mathematical Modeling and Optimization School of Engineering and Information Technology.
An Introduction to Linear Programming
Linear Programming for Solving the DSS Problems
Micro Economics in a Global Economy
Managerial Economics in a Global Economy
Assignment I TSP with Simulated Annealing
Dave Powell, Elon University,
Heuristic Optimization Methods Pareto Multiobjective Optimization
Linear Programming Introduction.
EEE 244-8: Optimization.
Linear Programming Introduction.
Joint Optimization of Multiple Behavioral and Implementation Properties of Digital IIR Filter Designs Magesh Valliappan, Brian L. Evans, and Mohamed Gzara.
Multiobjective Optimization
Presentation transcript:

Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy There are points that are clearly poorer than others because all objectives are worse In optimization jargon we call these points dominated Points that are not dominated are called non-dominated or Pareto optimal

Definition of Pareto optimality For a problem with m objective functions, a design variable vector x* is Pareto optimal if and only if there is no vector x in the feasible space with the characteristics

Problem domination We have two objectives that are to be minimized. The following are the pairs of objectives at 10 design points. Identify the dominated ones. (67,71) (48,72) (29,88) (-106, 294) (32,13), (-120,163), (103,-30) (-78,114) (-80,143) (75,-171) Solution in notes page

Work choice example Item (task)Pay ($)Time (min)Fun index Minimize time and maximize fun so that you make $100. Will need between 33.3 to 100 items. Time can vary from 66.7 minutes to 300. Fun can vary between 33.3 and 300.

Comparing tasks Item (task)Pay ($)/hour Total time (hours) Total fun task 2 is dominated by task 3. Tasks 1,3,4 are Pareto optimal

Multi-objective Formulation ItemPayTimeFun

Solution by enumeration In the range of three variables calculate time and fun for all combinations that produce exactly $100. Pareto front is upper boundary and it is almost a straight line. Matlab code given in notes page.

Pay-fun Problem Formulate the problem of maximizing fun and pay for five hours (300 minutes) including only non-dominated variables. Solution Obtain the Pareto front analytically or by enumeration and writes its equation (fun as a function of pay). Solution.Solution.

More efficient solution methods Methods that try to avoid generating the Pareto front –Generate “utopia point” –Define optimum based on some measure of distance from utopia point Generating entire Pareto front –Weighted sum of objectives with variable coefficients –Optimize one objective for a range of constraints on the others –Niching methods with population based algorithms

The utopia point is (66.7,300). One approach is to use it to form a compromise objective as shown above. It gives time=168 minutes, fun=160 (x 3 =76,x 4 =8)

Series of constraints The next slides provides a Matlab segment for solving this optimization problem using the function fmincon, but without the requirement of integer variables. How will you change the formulation so that a single Matlab run will give us results for any required earning level R? Solution in the notes page.

Matlab segment x0 = [ ]; for fun_idx = 30:5:300 A = [ ; ]; b = [-100;-fun_idx]; lb = zeros(3,1); options = optimset('Display','off'); [x,fval,exitflag,output,lambda] = fmincon('myfun',x0,A,b,[],[],lb,[],[],options); pareto_sol(fun_idx,:) = x; pareto_fun(fun_idx,1) = fval; pareto_fun(fun_idx,2) = 3*x(1) + 2*x(2) + x(3); End function f = myfun(x) f = 3*x(1) + 2*x(2) + 2*x(3);

Pareto-front Problem Generate the Pareto front for the pay and fun maximization using a series of constraints, and also find a compromise point on it using the utopia point. SolutionSolution What is responsible for the slope discontinuity in the Pareto front on Slide 10? Solution in notes page