A New Algorithm for Solving Many-objective Optimization Problem Md. Shihabul Islam (0905115) and Bashiul Alam Sabab (0905117) Department of Computer Science.

Slides:



Advertisements
Similar presentations
ZEIT4700 – S1, 2014 Mathematical Modeling and Optimization School of Engineering and Information Technology.
Advertisements

Topic Outline ? Black-Box Optimization Optimization Algorithm: only allowed to evaluate f (direct search) decision vector x objective vector f(x) objective.
Non-dominated Sorting Genetic Algorithm (NSGA-II)
MOEAs University of Missouri - Rolla Dr. T’s Course in Evolutionary Computation Matt D. Johnson November 6, 2006.
Angers, 10 June 2010 Multi-Objective Optimisation (II) Matthieu Basseur.
Biased Random Key Genetic Algorithm with Hybrid Decoding for Multi-objective Optimization Panwadee Tangpattanakul, Nicolas Jozefowiez, Pierre Lopez LAAS-CNRS.
Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy.
Constructing Complex NPC Behavior via Multi- Objective Neuroevolution Jacob Schrum – Risto Miikkulainen –
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
Multi-objective optimization multi-criteria decision-making.
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
Convexity of Point Set Sandip Das Indian Statistical Institute.
Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy.
Multiobjective Optimization Chapter 7 Luke, Essentials of Metaheuristics, 2011 Byung-Hyun Ha R1.
2003 International Congress of Refrigeration, Washington, D.C., August 17-22, 2003 Application of Multi-objective Optimization in Food Refrigeration Processes.
A Study on Recent Fast Ways of Hypervolume Calculation for MOEAs Mainul Kabir ( ) and Nasik Muhammad Nafi ( ) Department of Computer Science.
Spring, 2013C.-S. Shieh, EC, KUAS, Taiwan1 Heuristic Optimization Methods Pareto Multiobjective Optimization Patrick N. Ngatchou, Anahita Zarei, Warren.
MAE 552 Heuristic Optimization Instructor: John Eddy Lecture #35 4/26/02 Multi-Objective Optimization.
A New Evolutionary Algorithm for Multi-objective Optimization Problems Multi-objective Optimization Problems (MOP) –Definition –NP hard By Zhi Wei.
Multi-Objective Evolutionary Algorithms Matt D. Johnson April 19, 2007.
Diversity Maintenance Behavior on Evolutionary Multi-Objective Optimization Presenter : Tsung Yu Ho at TEILAB.
Design of Curves and Surfaces by Multi Objective Optimization Rony Goldenthal Michel Bercovier School of Computer Science and Engineering The Hebrew University.
MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition
D Nagesh Kumar, IIScOptimization Methods: M2L5 1 Optimization using Calculus Kuhn-Tucker Conditions.
Resource Allocation Problem Reporter: Wang Ching Yu Date: 2005/04/07.
Multiobjective Optimization Athens 2005 Department of Architecture and Technology Universidad Politécnica de Madrid Santiago González Tortosa Department.
Linear Programming Operations Research – Engineering and Math Management Sciences – Business Goals for this section  Modeling situations in a linear environment.
Optimal Arrangement of Ceiling Cameras for Home Service Robots Using Genetic Algorithms Stefanos Nikolaidis*, ** and Tamio Arai** *R&D Division, Square.

Osyczka Andrzej Krenich Stanislaw Habel Jacek Department of Mechanical Engineering, Cracow University of Technology, Krakow, Al. Jana Pawla II 37,
Quality Indicators (Binary ε-Indicator) Santosh Tiwari.
Evolutionary Multi-objective Optimization – A Big Picture Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
Portfolio-Optimization with Multi-Objective Evolutionary Algorithms in the case of Complex Constraints Benedikt Scheckenbach.
Evolving Multi-modal Behavior in NPCs Jacob Schrum – Risto Miikkulainen –
On comparison of different approaches to the stability radius calculation Olga Karelkina Department of Mathematics University of Turku MCDM 2011.
Example II: Linear truss structure
Constrained Evolutionary Optimization Yong Wang Associate Professor, PhD School of Information Science and Engineering, Central South University
A two-stage approach for multi- objective decision making with applications to system reliability optimization Zhaojun Li, Haitao Liao, David W. Coit Reliability.
Copyright 2013, 2010, 2007, Pearson, Education, Inc. Section 7.6 Linear Programming.
Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy.
Guaranteed Convergence and Distribution in Evolutionary Multi- Objective Algorithms (EMOA’s) via Achivement Scalarizing Functions By Karthik.
Simulation in Wind Turbine Vibrations: A Data Driven Analysis Graduate Students: Zijun Zhang PI: Andrew Kusiak Intelligent Systems Laboratory The University.
Kanpur Genetic Algorithms Laboratory IIT Kanpur 25, July 2006 (11:00 AM) Multi-Objective Dynamic Optimization using Evolutionary Algorithms by Udaya Bhaskara.
DIVERSITY PRESERVING EVOLUTIONARY MULTI-OBJECTIVE SEARCH Brian Piper1, Hana Chmielewski2, Ranji Ranjithan1,2 1Operations Research 2Civil Engineering.
Evolutionary Design (2) Boris Burdiliak. Topics Representation Representation Multiple objectives Multiple objectives.
Multi-objective Optimization
ZEIT4700 – S1, 2015 Mathematical Modeling and Optimization School of Engineering and Information Technology.
Multiobjective Optimization for Locating Multiple Optimal Solutions of Nonlinear Equation Systems and Multimodal Optimization Problems Yong Wang School.
Genetic Algorithms D Nagesh Kumar, IISc Water Resources Planning and Management: M9L2 Advanced Topics.
Multi-objective Evolutionary Algorithms (for NACST/Seq) summarized by Shin, Soo-Yong.
Tamaki Okuda ● Tomoyuki Hiroyasu   Mitsunori Miki   Shinya Watanabe  
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Multiobjective Optimization  Particularities of multiobjective optimization  Multiobjective.
Genetic algorithms: A Stochastic Approach for Improving the Current Cadastre Accuracies Anna Shnaidman Uri Shoshani Yerach Doytsher Mapping and Geo-Information.
Evolutionary multi-objective algorithm design issues Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
Evolutionary Computing Chapter 12. / 26 Chapter 12: Multiobjective Evolutionary Algorithms Multiobjective optimisation problems (MOP) -Pareto optimality.
A Multiobjective Evolutionary Algorithm Using Gaussian Process based Inverse Modeling Ran Cheng 1, Yaochu Jin 1, Kaname Narukawa 2 and Bernhard Sendhof.
Improving Random Immigrants Injections for Dynamic Multi-objective Optimization Problems. Md Nurullah Patwary Fahim ( ) Department of Computer Science.
Constrained Optimization by the  Constrained Differential Evolution with an Archive and Gradient-Based Mutation Tetsuyuki TAKAHAMA ( Hiroshima City University.
 Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems n Introduction.
1 A genetic algorithm with embedded constraints – An example on the design of robust D-stable IIR filters 潘欣泰 國立高雄大學 資工系.
ZEIT4700 – S1, 2016 Mathematical Modeling and Optimization School of Engineering and Information Technology.
L-Dominance: An Approximate-Domination Mechanism
Alan P. Reynolds*, David W. Corne and Michael J. Chantler
Assignment I TSP with Simulated Annealing
Heuristic Optimization Methods Pareto Multiobjective Optimization
A New multi-objective algorithm: Pareto archived dds
Chen-Yu Lee, Jia-Fong Yeh, and Tsung-Che Chiang
RM-MEDA: A Regularity Model-Based Multiobjective Estimation of Distribution Algorithm BISCuit EDA Seminar
MOEA Testing and Analysis
BICRITERIA OPTIMIZATION OF ENERGY EFFICIENT PLACEMENT AND ROUTING IN HETEROGENOUS WIRELESS SENSOR NETWORKS Mustafa Gökçe Baydoğan School of Computing,
Presentation transcript:

A New Algorithm for Solving Many-objective Optimization Problem Md. Shihabul Islam ( ) and Bashiul Alam Sabab ( ) Department of Computer Science and Engineering (CSE), BUET Problem Definition Most current state-of-the-art Evolutionary Multi-objective Optimization (EMO) algorithms, such as NSGA II, SPEA2 and MOEA/D perform well on problems with two or three objectives. But they encounter difficulties in their scalability to Many-objective Optimization Problems (problems with more than three objectives). Objective Propose a new algorithm for solving Many-objective Optimization Problems that will ensure fast convergence and high degree of diversity of non-dominated solutions. Our Method Step 1: In each generation, calculate the maximum point of intersection by taking the maximum value of each of the objectives (Fig. 2). Step 2: Connect the maximum point of intersection and the center point provided by the decision maker to get a straight line (Fig. 2). Step 3: Find out the solution which lies on the straight line. If there are multiple solutions, then take the one nearest to the center point (Fig. 2). Step 4: Now, rotate the straight line with respect to the maximum point of intersection by a predefined angle, θ provided by the decision maker. The rotation process has to be executed on both clock-wise and anti-clock-wise direction. The maximum rotation limit will be the boundary specified by the maximum points of the objectives (Fig. 3). Step 5: If no solutions lie on the straight line of i th iteration, at first draw the rotation of (i+1) th iteration. As a result, a triangle will be formed using the lines of (i-1) th and (i+1) th iteration. Now, calculate the straight line distance between the solutions lying in the triangle region to the straight line of i th iteration. The solution with the minimum straight line distance will be the desired solution of this step. In case the (i+1) th iteration crosses the boundary line, the boundary line has to be counted instead (Fig 4). Objective f 2 Objective f 1 Maximum Point of Intersection Center Point f 1 (max) f 2 (max) Fig. 2: Initial iteration; taking the solution which lies on the straight line between the maximum point of intersection and the center point Objective f 2 Objective f 1 Maximum Point of Intersection Center Point Rotated Center Point Rotated by a specific angle, θ Fig. 3: New position of the center point after rotation of the straight line by an angle, θ Objective f 2 Objective f 1 Maximum Point of Intersection Center Point Rotated Center Point Rotated by a specific angle, θ Rotation of Next Iteration Fig. 4: Iteration for the situation where no solution lies on the straight line Flow-chart of the Algorithm Generate Initial Population (P t ) of Size N Selection Recombination Mutation Generate Offspring (Q t ) of Size N Total Population: R t = P t + Q t, of Size 2N Sort R t According to Non-domination Fronts (F 1,F 2 and so on… ) Add Front to Next Generation of Population, P t+1 If |N- P t+1 | > 0 and |N- P t+1 | > F Next Apply Our Mechanism to Select |N- P t+1 | Solutions from the Front and Add it to P t+1 (size N) Reached Targeted Iteration Number? Generate Report No Yes Evolutionary Multi-objective Optimization Evolutionary Multi-objective Optimization (EMO): Involves a number of objective functions which are to be either minimized or maximized. General form: Maximize/Minimize: f m (x), m = 1, 2, …, M; Subject to: g j (x) ≥ 0, j = 1, 2, …, J; h k (x) = 0, k = 1, 2, …, K; x (L) i ≤ x i ≤ x (U) i, i = 1, 2, …, n; Where, ‘x’ is a vector of decision variables: x = (x 1, x 2, …, x n ) T and each decision variable, x i ∈ R is bounded by the lower bound x (L) i and upper bound x (U) i which constitute the decision variable space, ‘m’ is the number of objectives. Solutions satisfying inequality J and equality K constraints are feasible and belong to the feasible part of the decision space Many-objective Optimization: When, the number of objectives, m ≥ 3, the problem is called a Many-objective Optimization Problem (MaOP). Domination: A solution x (1) is said to dominate another solution x (2), if both the following conditions are true: i) x (1) is no worse than x (2) in all objectives. ii) x (1) is strictly better than x (2) in at least one objective. Pareto-optimality: Pareto-optimal set is the non-dominated set of the entire feasible search space. The image of the set of Pareto efficient solutions is called Pareto-front. Failure of EMO Algorithms for Solving MaOP  Almost all solutions in current population become non-dominated in early generations.  Hence, Pareto dominance-based fitness evaluation cannot generate a strong selection pressure which is necessary to drive the population to the Pareto front.  Convergence improvement often causes a decrease in the diversity of the non-dominated solutions.  As a result, the search ability of Pareto dominance-based EMO algorithms is severely deteriorated. Fig. 1: The connected line of red points represents the Pareto-front Conclusion Our proposed algorithm can work well ensuring fast convergence and high degree of diversity of non-dominated solutions. Our future challenge will be to test the algorithm in cases of high dimensionalities & compare its performance with the existing state-of-the-art MaOP algorithms. References [1] K. Deb, “Multi-Objective Optimization Using Evolutionary Algorithms: An Introduction”, Multi- objective Evolutionary Optimisation for Product Design and Manufacturing, pp. 3-34, [2] K. Deb, H. Jain, “An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point- Based Non-dominated Sorting Approach, Part I: Solving Problems With Box Constraints”, IEEE Transactions on Evolutionary Computation, vol: 18, issue: 4, pp , 2013.