The Smart Normal Constraint Method for

Slides:



Advertisements
Similar presentations
GA Approaches to Multi-Objective Optimization
Advertisements

Topic Outline ? Black-Box Optimization Optimization Algorithm: only allowed to evaluate f (direct search) decision vector x objective vector f(x) objective.
Angers, 10 June 2010 Multi-Objective Optimisation (II) Matthieu Basseur.
1 An Adaptive GA for Multi Objective Flexible Manufacturing Systems A. Younes, H. Ghenniwa, S. Areibi uoguelph.ca.
Smart Shopper A Consumer Decision Support System Using Type-2 Fuzzy Logic Systems Ling Gu 2003 Fall CSc8810.
Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy.
Multi-Objective Optimization NP-Hard Conflicting objectives – Flow shop with both minimum makespan and tardiness objective – TSP problem with minimum distance,
*time Optimization Heiko, Diego, Thomas, Kevin, Andreas, Jens.
Multi-objective optimization multi-criteria decision-making.
Optimization methods Review
Optimal Design Laboratory | University of Michigan, Ann Arbor 2011 Design Preference Elicitation Using Efficient Global Optimization Yi Ren Panos Y. Papalambros.
Spring, 2013C.-S. Shieh, EC, KUAS, Taiwan1 Heuristic Optimization Methods Pareto Multiobjective Optimization Patrick N. Ngatchou, Anahita Zarei, Warren.
A New Evolutionary Algorithm for Multi-objective Optimization Problems Multi-objective Optimization Problems (MOP) –Definition –NP hard By Zhi Wei.
Motion Detail Preserving Optical Flow Estimation Li Xu 1, Jiaya Jia 1, Yasuyuki Matsushita 2 1 The Chinese University of Hong Kong 2 Microsoft Research.
1 Reliability and Robustness in Engineering Design Zissimos P. Mourelatos, Associate Prof. Jinghong Liang, Graduate Student Mechanical Engineering Department.
Advisor: Yeong-Sung Lin Presented by Chi-Hsiang Chan 2011/5/23 1.
MAE 552 Heuristic Optimization Instructor: John Eddy Lecture #36 4/29/02 Multi-Objective Optimization.
Interactive Layout Design Optimization Author: Jeremy J. Michalek Presented by: Hoda Homayouni.
1 Genetic algorithm approach on multi-criteria minimum spanning tree problem Kuo-Hsien Chuang 2009/01/06.
1 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Classical Exploration Methods for Design Space Exploration (multi-criteria.
A New Algorithm for Solving Many-objective Optimization Problem Md. Shihabul Islam ( ) and Bashiul Alam Sabab ( ) Department of Computer Science.
Optimization of Linear Problems: Linear Programming (LP) © 2011 Daniel Kirschen and University of Washington 1.
Tier I: Mathematical Methods of Optimization
Particle Swarm Optimization Algorithms
Evolutionary Multi-objective Optimization – A Big Picture Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
Example II: Linear truss structure
Optimum Design of Steel Space Frames by Hybrid Teaching-Learning Based Optimization and Harmony Search Algorithms & Dr.Alper AKIN Dr. IbrahIm AYDOGDU Dear.
Constrained Evolutionary Optimization Yong Wang Associate Professor, PhD School of Information Science and Engineering, Central South University
Design Exploration Christopher A. Mattson Department of Mechanical Engineering Brigham Young University.
2002/4/10IDSL seminar Estimating Business Targets Advisor: Dr. Hsu Graduate: Yung-Chu Lin Data Source: Datta et al., KDD01, pp
A two-stage approach for multi- objective decision making with applications to system reliability optimization Zhaojun Li, Haitao Liao, David W. Coit Reliability.
Ken YoussefiMechanical Engineering Dept. 1 Design Optimization Optimization is a component of design process The design of systems can be formulated as.
Classification and Ranking Approaches to Discriminative Language Modeling for ASR Erinç Dikici, Murat Semerci, Murat Saraçlar, Ethem Alpaydın 報告者:郝柏翰 2013/01/28.
Chapter 7 Handling Constraints
Chih-Ming Chen, Student Member, IEEE, Ying-ping Chen, Member, IEEE, Tzu-Ching Shen, and John K. Zao, Senior Member, IEEE Evolutionary Computation (CEC),
Introduction to multi-objective optimization We often have more than one objective This means that design points are no longer arranged in strict hierarchy.
Doshisha Univ., Japan Parallel Evolutionary Multi-Criterion Optimization for Block Layout Problems ○ Shinya Watanabe Tomoyuki Hiroyasu Mitsunori Miki Intelligent.
Supporting Conceptual Design Innovation through Interactive Evolutionary Systems I.C. Parmee Advanced Computation in Design and Decision-making CEMS, University.
Robin McDougall Scott Nokleby Mechatronic and Robotic Systems Laboratory 1.
Distributed Genetic Algorithms with a New Sharing Approach in Multiobjective Optimization Problems Tomoyuki HIROYASU Mitsunori MIKI Sinya WATANABE Doshisha.
Guaranteed Convergence and Distribution in Evolutionary Multi- Objective Algorithms (EMOA’s) via Achivement Scalarizing Functions By Karthik.
Design, Optimization, and Control for Multiscale Systems
Kanpur Genetic Algorithms Laboratory IIT Kanpur 25, July 2006 (11:00 AM) Multi-Objective Dynamic Optimization using Evolutionary Algorithms by Udaya Bhaskara.
Advanced Computer Architecture & Processing Systems Research Lab Framework for Automatic Design Space Exploration.
Intelligent Database Systems Lab Presenter : BEI-YI JIANG Authors : HAI V. PHAM, ERIC W. COOPER, THANG CAO, KATSUARI KAMEI INFORMATION SCIENCES Hybrid.
Multi-objective Optimization
Gradient Methods In Optimization
Multiobjective Optimization for Locating Multiple Optimal Solutions of Nonlinear Equation Systems and Multimodal Optimization Problems Yong Wang School.
Multi-objective Evolutionary Algorithms (for NACST/Seq) summarized by Shin, Soo-Yong.
Optimization in Engineering Design 1 Introduction to Non-Linear Optimization.
Tamaki Okuda ● Tomoyuki Hiroyasu   Mitsunori Miki   Shinya Watanabe  
Evolutionary Computing Chapter 12. / 26 Chapter 12: Multiobjective Evolutionary Algorithms Multiobjective optimisation problems (MOP) -Pareto optimality.
A Multiobjective Evolutionary Algorithm Using Gaussian Process based Inverse Modeling Ran Cheng 1, Yaochu Jin 1, Kaname Narukawa 2 and Bernhard Sendhof.
- Divided Range Multi-Objective Genetic Algorithms -
Metaheuristics for the New Millennium Bruce L. Golden RH Smith School of Business University of Maryland by Presented at the University of Iowa, March.
1 A genetic algorithm with embedded constraints – An example on the design of robust D-stable IIR filters 潘欣泰 國立高雄大學 資工系.
L-Dominance: An Approximate-Domination Mechanism
Braden Hancock Brigham Young University B.S. Mechanical Engineering
In Search of the Optimal Set of Indicators when Classifying Histopathological Images Catalin Stoean University of Craiova, Romania
Presented by Prashant Duhoon
APLACE: A General and Extensible Large-Scale Placer
Heuristic Optimization Methods Pareto Multiobjective Optimization
A New multi-objective algorithm: Pareto archived dds
Multi-Objective Optimization
Chen-Yu Lee, Jia-Fong Yeh, and Tsung-Che Chiang
Steady-State Aerodynamics Codes for HAWTs
Boltzmann Machine (BM) (§6.4)
MOEA Testing and Analysis
Multidisciplinary Optimization
Multiobjective Optimization
Presentation transcript:

The Smart Normal Constraint Method for Directly Generating a Smart Pareto Set Braden J. Hancock Christopher A. Mattson Brigham Young University Dept. of Mechanical Engineering AIAA-2013-1759 April 8-11, 2013

Outline Motivation Normal Constraint (NC) Method - Benchmark Smart Normal Constraint (SNC) Method Numerical Examples Conclusions

Motivation

Backwards Compatibility Motivation Payload Size Radar Footprint Manufacturability Fuel Efficiency Maximum Speed Backwards Compatibility Cost Carbon Emissions

Motivation Weight Cost Feasible Design Space Pareto Frontier Ideal Location (infeasible) Cost

Evolution of Algorithms Phase 1 Phase 2 Phase 3 (any Pareto set) (“smart” Pareto set) (evenly-distributed Pareto set)

Current Method

Proposed Method

Normal Constraint (NC) Method SOOs NC Method Steps: Reference Points Utopia Line Vector(s) 3) Utopia Line Points 4) Single-Objective Optimization (µ2) (µ2) (µ2) (µ2) (µ2) (µ2) (µ2) (µ2) MOO (µ1 , µ2) The Normal Constraint (NC) Method was first developed by (Messac et al, 2003)

NC Method: Step 1 NC Method Steps: Reference Points Utopia Line Vector(s) 3) Utopia Line Points 4) Single-Objective Optimization Anchor Point μ1* Anchor Point μ2*

NC Method: Step 2 NC Method Steps: Reference Points Utopia Line Vector(s) 3) Utopia Line Points 4) Single-Objective Optimization Utopia line vector

NC Method: Step 3 NC Method Steps: Reference Points Utopia Line Vector(s) 3) Utopia Line Points 4) Single-Objective Optimization

NC Method: Step 4 NC Method Steps: (µ2) (µ2) (µ2) (µ2) (µ2) (µ2) Reference Points Utopia Line Vector(s) 3) Utopia Line Points 4) Single-Objective Optimization (repeat bracketed step)

Practically Insignificant Tradeoff (PIT) region Smart Pareto Filter Practically Insignificant Tradeoff (PIT) region The smart Pareto filter was first developed by (Mattson et al, 2004)

Practically Insignificant Tradeoff (PIT) region Smart Distance Practically Insignificant Tradeoff (PIT) region p (1) (2) “ ” p (3)

Smart Distance

Smart Distance s = 1 s = 1 s = 0.5 s = 2 Inside PIT  s < 1 On PIT  s = 1 Outside PIT  s > 1 s = 1 s = 0.5 s = 2

NC-SNC Methods Comparison Search is based on initial information Search is based on iteratively updated information Majority of algorithm steps

SNC Method: Step 1 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC Method: Step 2 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC Method: Step 3 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC Method: Step 4 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC Method: Step 5 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization 1.2 2.4 3.6 4.8 6.0 7.2 9.6 10.8 12.0 13.2 14.4 15.6 8.4 (repeat bracketed steps)

SNC Method: Step 5 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization 15.6 14.4 13.2 12.0 10.8 9.6 8.4 7.2 6.0 4.8 3.6 2.4 1.2 (repeat bracketed steps)

SNC Method: Step 5 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization 1.2 2.4 3.6 4.8 6.0 7.2 8.4 7.2 6.0 4.8 3.6 2.4 1.2 (repeat bracketed steps)

SNC Method: Step 6 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC Method: Step 2 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC Method: Step 3 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC Method: Step 4 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC Method: Step 5 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization .9 1.8 2.7 3.6 2.7 1.8 .9 .8 1.6 2.4 3.6 2.4 1.6 .8 (repeat bracketed steps)

SNC Method: Step 6 SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC Method: Repeat SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC Method: Repeat SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC Method: Repeat SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC Method: Repeat SNC Method Steps: Reference Points Connectivity of Approximation Approximation Lines Approximation Points 5) Calculate Smart Distances 6) Single-Objective Optimization (repeat bracketed steps)

SNC/NC Comparison SNC: 9 SOOs NC: 20 SOOs

Additional Comments Additional Comments: nD Connectivity Delaunay Triangulation Special Characteristics Dominated Redundant Separated

Additional Comments Additional Considerations: New Dominated Point nD Connectivity Delaunay Triangulation Special Characteristics Dominated Redundant Separated

Additional Comments Additional Considerations: Approximation Point outside PIT Additional Considerations: nD Connectivity Delaunay Triangulation Special Characteristics Dominated Redundant Separated New Pareto Point inside PIT

Normal Constraint Used for SOO Additional Comments New Restricted Region Additional Considerations: nD Connectivity Delaunay Triangulation Special Characteristics Dominated Redundant Separated Normal Constraint Used for SOO

Example Problems Problem TNK (Tanaka et al, 1995) 2 # Objectives # Variables # Constraints TNK (Tanaka et al, 1995) 2 Gear Box (Huang et al, 2006) 3 7 11 WATER (Ray et al, 2001) 5

Example Problem TNK (Tanaka et al, 1995) Example Methodology Example Problem TNK (Tanaka et al, 1995)

Example Problem TNK (Tanaka et al, 1995) Example Methodology Example Problem TNK (Tanaka et al, 1995) PIT Region

% Decrease of Function Calls with SNC Example Results Problem Method Total # Function Calls % Decrease of Function Calls with SNC TNK (Tanaka et al, 1995) NC 3,066 57% SNC 1,320 Gear Box (Huang et al, 2006) 17,600 65% 6,205 WATER (Ray et al, 2001) 410,000 99% 3,380

Engineering Application Parameterized Model 3D Unsteady RANS Analysis (CFD) Optimized Geometry NC Method + Smart Filter 400,000 function calls 6 hours per function call 80 CPUs SNC Method 3,300 function calls 6 hours per function call 80 CPUs 3.5 Years 10 Days

Future Work 1) Implementation in parallel 2) Gradient-based search for constraint location

Conclusions 1) The SNC method is the first method capable of directly generating smart Pareto sets in n dimensions. 2) The SNC method is made possible through: a) an iteratively updated approximation of the Pareto frontier b) a novel scalar measurement for “smart distance” p 3) The SNC method requires significantly fewer function calls than the predominant existing method for smart Pareto set generation in nearly all cases.

Bibliography Huang HZ, Gu YK, Du X (2006) An interactive fuzzy multi-objective optimization method for engineering design. Engineering Applications of Artificial Intelligence 19:451-460 Mattson CA, Mullur AA, Messac A (2004) Smart Pareto filter: obtaining a minimal representation of multiobjective design space. Engineering Optimization 36:721-740 Messac A, Ismail-Yahaya A, Mattson CA (2003) The normalized normal constraint method for generating the Pareto frontier. Structural and Multidisciplinary Optimization 25:86-98 Ray T, Tai K, Seow C (2001) An evolutionary algorithm for multiobjective optimization. Engineering Optimization 33:399-424 Tanaka M, Watanabe H, Furukawa Y, Tanino T (1995) GA-based decision support system for multicriteria optimization. In: Proc. IEEE Int. Conf. Systems