A New multi-objective algorithm: Pareto archived dds

Slides:



Advertisements
Similar presentations
Bayesian Belief Propagation
Advertisements

MOEAs University of Missouri - Rolla Dr. T’s Course in Evolutionary Computation Matt D. Johnson November 6, 2006.
Angers, 10 June 2010 Multi-Objective Optimisation (II) Matthieu Basseur.
Biased Random Key Genetic Algorithm with Hybrid Decoding for Multi-objective Optimization Panwadee Tangpattanakul, Nicolas Jozefowiez, Pierre Lopez LAAS-CNRS.
Cost-effective Outbreak Detection in Networks Jure Leskovec, Andreas Krause, Carlos Guestrin, Christos Faloutsos, Jeanne VanBriesen, Natalie Glance.
Multi-objective optimization multi-criteria decision-making.
Multi-criteria Design of X-bar control chart Zhaojun (Steven) Li IND E 516 Homework 1.
Spring, 2013C.-S. Shieh, EC, KUAS, Taiwan1 Heuristic Optimization Methods Pareto Multiobjective Optimization Patrick N. Ngatchou, Anahita Zarei, Warren.
© University of Minnesota Data Mining for the Discovery of Ocean Climate Indices 1 CSci 8980: Data Mining (Fall 2002) Vipin Kumar Army High Performance.
Adaptive Multi-objective Differential Evolution with Stochastic Coding Strategy Wei-Ming Chen
Multi-Objective Evolutionary Algorithms Matt D. Johnson April 19, 2007.
CS Pattern Recognition Review of Prerequisites in Math and Statistics Prepared by Li Yang Based on Appendix chapters of Pattern Recognition, 4.
MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition
The Pareto fitness genetic algorithm: Test function study Wei-Ming Chen
A New Algorithm for Solving Many-objective Optimization Problem Md. Shihabul Islam ( ) and Bashiul Alam Sabab ( ) Department of Computer Science.
Collaborative Filtering Matrix Factorization Approach
Masoud Asadzadeh 1, Masoud Asadzadeh 1, Saman Razavi 1, Bryan Tolson 1 David Fay 2, William Werick 3, Yin Fan 2 2- Great Lakes - St. Lawrence Regulation.
Evolutionary Multi-objective Optimization – A Big Picture Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
Stochastic Approximation and Simulated Annealing Lecture 8 Leonidas Sakalauskas Institute of Mathematics and Informatics Vilnius, Lithuania EURO Working.
Efficient Model Selection for Support Vector Machines
Multimodal Interaction Dr. Mike Spann
Masoud Asadzadeh, Bryan A. Tolson, A. J. MacLean. Dept. of Civil & Environmental Engineering, University of Waterloo Hydrologic model calibration aims.
Generative Topographic Mapping by Deterministic Annealing Jong Youl Choi, Judy Qiu, Marlon Pierce, and Geoffrey Fox School of Informatics and Computing.
THE BATTLE OF THE WATER NETWORKS (BWN-II): PADDS BASED SOLUTION APPROACH Bryan A. Tolson, Ayman Khedr, Masoud Asadzadeh.
Omni-Optimizer A Procedure for Single and Multi-objective Optimization Prof. Kalyanmoy Deb and Santosh Tiwari.
Robin McDougall Scott Nokleby Mechatronic and Robotic Systems Laboratory 1.
1 A New Algorithm for Water Distribution System Optimization: Discrete Dynamically Dimensioned Search (DDDS) EWRI 2008 May 12, 2008 Dr. Bryan Tolson 1.
A MANAGEMENT SYSTEM FOR OPTIMIZING OPERATING RULES OF MULTIPURPOSE RESERVOIRS ALLOWING FOR BOTH EXTREME FLOODS AND ECOLOGICAL PERFORMANCE 4 th International.
Method of Hooke and Jeeves
9 th LBA-ECO Science Team Meeting Assessing the Influence of Observational Data Error on SiB 2 Model Parameter Uncertainty Luis A. Bastidas 1, E. Rosero.
Assessing the Impact of Alternative Pipe Groupings on Multi-Objective Water Distribution Network Masoud Asadzadeh Bryan Tolson.
Kanpur Genetic Algorithms Laboratory IIT Kanpur 25, July 2006 (11:00 AM) Multi-Objective Dynamic Optimization using Evolutionary Algorithms by Udaya Bhaskara.
DIVERSITY PRESERVING EVOLUTIONARY MULTI-OBJECTIVE SEARCH Brian Piper1, Hana Chmielewski2, Ranji Ranjithan1,2 1Operations Research 2Civil Engineering.
Vaida Bartkutė, Leonidas Sakalauskas
Target Releas e Component 1 Component 3 Baseline Flow Component 2 Design a regulation plan for Lake Superior that:  is easily interpretable (piecewise.
Tamaki Okuda ● Tomoyuki Hiroyasu   Mitsunori Miki   Shinya Watanabe  
DEPARTMENT/SEMESTER ME VII Sem COURSE NAME Operation Research Manav Rachna College of Engg.
Evolutionary Computing Chapter 12. / 26 Chapter 12: Multiobjective Evolutionary Algorithms Multiobjective optimisation problems (MOP) -Pareto optimality.
O. Giustolisi, L. Berardi, D. Laucelli Technical University of Bari, Bari (Italy)
Machine Learning Artificial Neural Networks MPλ ∀ Stergiou Theodoros 1.
Constrained Optimization by the  Constrained Differential Evolution with an Archive and Gradient-Based Mutation Tetsuyuki TAKAHAMA ( Hiroshima City University.
Introduction to genetic algorithm
Power Magnetic Devices: A Multi-Objective Design Approach
Bounded Nonlinear Optimization to Fit a Model of Acoustic Foams
L-Dominance: An Approximate-Domination Mechanism
Root Finding Methods Fish 559; Lecture 15 a.
Department of Computer Science
Automatic Synthesizer Preset Generation with PresetGen
Discrete ABC Based on Similarity for GCP
Heuristic Optimization Methods
Non-linear Minimization
The Smart Normal Constraint Method for
Glenn Fung, Murat Dundar, Bharat Rao and Jinbo Bi
Analytics and OR DP- summary.
Masoud Asadzadeh Bryan Tolson Robert McKillop
Risk-informed Decision Making under Incomplete Information
Towards Next Generation Panel at SAINT 2002
Masoud Asadzadeh Bryan A. Tolson University of Waterloo
Collaborative Filtering Matrix Factorization Approach
Local search algorithms
Heuristic Optimization Methods Pareto Multiobjective Optimization
Evolutionary Computation,
Chen-Yu Lee, Jia-Fong Yeh, and Tsung-Che Chiang
Cost-effective Outbreak Detection in Networks
5.2.3 Optimization, Search and
○ Hisashi Shimosaka (Doshisha University)
Nearest Neighbors CSC 576: Data Mining.
RM-MEDA: A Regularity Model-Based Multiobjective Estimation of Distribution Algorithm BISCuit EDA Seminar
MOEA Testing and Analysis
Stochastic Methods.
Presentation transcript:

A New multi-objective algorithm: Pareto archived dds Masoud asadzadeh Dr. Bryan Tolson Department of civil and environmental engineering Masoud Asadzadeh

Research goal Develop an efficient multi-objective optimization algorithm that has few parameters. Modify Dynamically Dimensioned Search (DDS), a simple efficient, parsimonious algorithm to solve unconstrained computationally expensive, multi-objective water resources problems. Set up the new tool so that it can easily scale to higher dimensional problems (not only problems with two objectives).

Dynamically Dimensioned Search (DDS) Background Dynamically Dimensioned Search (DDS) Tolson & Shoemaker [2007] Designed for: Single Objective Continuous Optimization Computationally Expensive Automatic Hydrologic Model Calibration Modified to solve problems with discrete decision variables, Tolson et al. [2008] Single-Solution Based algorithm (not population based) Simple & Fast Approximate Stochastic Global Optimization Algorithm Generate Good Results in Modeller's Time Frame Algorithm parameter tuning is unnecessary

Initialize starting solution Perturb the current best solution dds description Initialize starting solution Perturb the current best solution Y Globally search at the start of the search by perturbing all decision variables (DV) from their current best values Continue? STOP N Locally search at the end of the search by perturbing typically only one DV from its current best value Perturb each DV from a normal probability distribution centered on the current value of DV

F(x)=[f1(x),f2(x),…,fN(x)] Problem definition Minimize: F(x)=[f1(x),f2(x),…,fN(x)] Subject to: x=[x1,x2,…,xI]  RI f1 f2

PA-dds description Perturb the current ND solution Update the set of ND solutions if necessary Search for individual minima first Initialize starting solutions Create the non-dominated (ND) solutions set Pick a ND solution based on crowding distance Pick the New solution N New solution is ND? Y Y STOP N Continue?

PA-DDS on Bi-Objective Test Problems Results PA-DDS on Bi-Objective Test Problems Zitzler [1999] Actual Tradeoff Best Convergence Median Convergence Average Convergence Metric Y (Deb 2001) PA-DDS NSGA II* AMALGAM* ZDT4 0.049 0.052 0.002 ZDT6 0.050 0.001 * Vrugt and Robinson [2007]

Higher Dimensional Problem (25000 iterations) NEW RESULTS (TEST PROBLEMS DTLZ1) Higher Dimensional Problem (25000 iterations) DTLZ1, with 3 objectives Deb et. al [2002] 2D view f3 f1 Actual Tradeoff PA-DDS result f1 f3 f2

New York Tunnels Problem MORE NEW RESULTS New York Tunnels Problem Water Distribution Network (WDN) Rehabilitation of an existing WDN 21 pipes (decision variables) 15 standard pipe sizes for each pipe 1 more option - no change in the pipe 1621 size of the discrete decision space Minimum cost in the single objective version of the problem is $38.638 million Objectives: Cost and Hydraulic deficit

New York Tunnels Problem More New Results New York Tunnels Problem Perelman et al. [2008] 3,360,000

Conclusion PA-DDS inherits simplicity and parsimonious characteristics of DDS Generating good approximation of tradeoff in the modeller's time frame Reducing the need to fine tune the algorithm parameters Solving both continuous and discrete problems PA-DDS can scale to higher dimensional problems Research for the efficiency assessment is ongoing

Thanks to our funding source NSERC Discovery grant Thank You

only modification is to discretize the DV perturbation distribution Discrete probability distribution of candidate solution option numbers for a single decision variable with 16 possible values and a current best solution of xbest=8. Default DDDS-v1 r-parameter of 0.2*