Doshisha Univ., Japan Parallel Evolutionary Multi-Criterion Optimization for Block Layout Problems ○ Shinya Watanabe Tomoyuki Hiroyasu Mitsunori Miki Intelligent.

Slides:



Advertisements
Similar presentations
GA Approaches to Multi-Objective Optimization
Advertisements

Representing Hypothesis Operators Fitness Function Genetic Programming
Topic Outline ? Black-Box Optimization Optimization Algorithm: only allowed to evaluate f (direct search) decision vector x objective vector f(x) objective.
Delivering High Performance to Parallel Applications Using Advanced Scheduling Nikolaos Drosinos, Georgios Goumas Maria Athanasaki and Nectarios Koziris.
Divided Range Genetic Algorithms in Multiobjective Optimization Problems Tomoyuki HIROYASU Mitsunori MIKI Sinya WATANBE Doshisha University.
Comparison of Genetic Algorithm and WASAM Model for Real Time Water Allocation: A Case Study of Song Phi Nong Irrigation Project Bhaktikul, K, Mahidol.
Institute of Intelligent Power Electronics – IPE Page1 Introduction to Basics of Genetic Algorithms Docent Xiao-Zhi Gao Department of Electrical Engineering.
Protein Structure Prediction With Evolutionary Algorithms Natalio Krasnogor, U of the West of England William Hart, Sandia National Laboratories Jim Smith,
Evolutionary Synthesis of MEMS Design Ningning Zhou, Alice Agogino, Bo Zhu, Kris Pister*, Raffi Kamalian Department of Mechanical Engineering, *Department.
Spring, 2013C.-S. Shieh, EC, KUAS, Taiwan1 Heuristic Optimization Methods Pareto Multiobjective Optimization Patrick N. Ngatchou, Anahita Zarei, Warren.
A New Evolutionary Algorithm for Multi-objective Optimization Problems Multi-objective Optimization Problems (MOP) –Definition –NP hard By Zhi Wei.
A new crossover technique in Genetic Programming Janet Clegg Intelligent Systems Group Electronics Department.
Genetic Algorithms in Materials Processing N. Chakraborti Department of Metallurgical & Materials Engineering Indian Institute of Technology Kharagpur.
Artificial Intelligence Genetic Algorithms and Applications of Genetic Algorithms in Compilers Prasad A. Kulkarni.
A New Algorithm for Solving Many-objective Optimization Problem Md. Shihabul Islam ( ) and Bashiul Alam Sabab ( ) Department of Computer Science.
S. Mohsen Sadatiyan A., Samuel Dustin Stanley, Donald V. Chase, Carol J. Miller, Shawn P. McElmurry Optimizing Pumping System for Sustainable Water Distribution.
Coordinative Behavior in Evolutionary Multi-agent System by Genetic Algorithm Chuan-Kang Ting – Page: 1 International Graduate School of Dynamic Intelligent.
Genetic Algorithms Overview Genetic Algorithms: a gentle introduction –What are GAs –How do they work/ Why? –Critical issues Use in Data Mining –GAs.
Optimal Arrangement of Ceiling Cameras for Home Service Robots Using Genetic Algorithms Stefanos Nikolaidis*, ** and Tamio Arai** *R&D Division, Square.
1 Reasons for parallelization Can we make GA faster? One of the most promising choices is to use parallel implementations. The reasons for parallelization.
Parallel Genetic Algorithms with Distributed-Environment Multiple Population Scheme M.Miki T.Hiroyasu K.Hatanaka Doshisha University,Kyoto,Japan.
Prepared by Barış GÖKÇE 1.  Search Methods  Evolutionary Algorithms (EA)  Characteristics of EAs  Genetic Programming (GP)  Evolutionary Programming.
Evolutionary algorithms
A New Model of Distributed Genetic Algorithm for Cluster Systems: Dual Individual DGA Tomoyuki HIROYASU Mitsunori MIKI Masahiro HAMASAKI Yusuke TANIMURA.
SOFT COMPUTING (Optimization Techniques using GA) Dr. N.Uma Maheswari Professor/CSE PSNA CET.
MOGADES: Multi-Objective Genetic Algorithm with Distributed Environment Scheme Intelligent Systems Design Laboratory , Doshisha University , Kyoto Japan.
Constrained Evolutionary Optimization Yong Wang Associate Professor, PhD School of Information Science and Engineering, Central South University
Doshisha Univ. JapanGECCO2002 Energy Minimization of Protein Tertiary Structure by Parallel Simulated Annealing using Genetic Crossover Takeshi YoshidaTomoyuki.
Optimization Problems - Optimization: In the real world, there are many problems (e.g. Traveling Salesman Problem, Playing Chess ) that have numerous possible.
Genetic Algorithms Genetic algorithms imitate a natural optimization process: natural selection in evolution. Developed by John Holland at the University.
Optimal resource assignment to maximize multistate network reliability for a computer network Yi-Kuei Lin, Cheng-Ta Yeh Advisor : Professor Frank Y. S.
(Particle Swarm Optimisation)
More on Heuristics Genetic Algorithms (GA) Terminology Chromosome –candidate solution - {x 1, x 2,...., x n } Gene –variable - x j Allele –numerical.
Distributed Genetic Algorithms with a New Sharing Approach in Multiobjective Optimization Problems Tomoyuki HIROYASU Mitsunori MIKI Sinya WATANABE Doshisha.
Genetic Algorithms Siddhartha K. Shakya School of Computing. The Robert Gordon University Aberdeen, UK
Doshisha Univ., Kyoto, Japan CEC2003 Adaptive Temperature Schedule Determined by Genetic Algorithm for Parallel Simulated Annealing Doshisha University,
A Parallel Genetic Algorithm with Distributed Environment Scheme
DIVERSITY PRESERVING EVOLUTIONARY MULTI-OBJECTIVE SEARCH Brian Piper1, Hana Chmielewski2, Ranji Ranjithan1,2 1Operations Research 2Civil Engineering.
Genetic Algorithms What is a GA Terms and definitions Basic algorithm.
Evolutionary Algorithms K. Ganesh Research Scholar, Ph.D., Industrial Management Division, Humanities and Social Sciences Department, Indian Institute.
Speeding Up Warehouse Physical Design Using A Randomized Algorithm Minsoo Lee Joachim Hammer Dept. of Computer & Information Science & Engineering University.
Parallel Genetic Algorithms By Larry Hale and Trevor McCasland.
ZEIT4700 – S1, 2015 Mathematical Modeling and Optimization School of Engineering and Information Technology.
Multi-objective Evolutionary Algorithms (for NACST/Seq) summarized by Shin, Soo-Yong.
Tamaki Okuda ● Tomoyuki Hiroyasu   Mitsunori Miki   Shinya Watanabe  
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Multiobjective Optimization  Particularities of multiobjective optimization  Multiobjective.
Evolutionary multi-objective algorithm design issues Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
Doshisha Univ., Kyoto Japan NCGA : Neighborhood Cultivation Genetic Algorithm for Multi-Objective Optimization Problems Intelligent Systems Design Laboratory,
- Divided Range Multi-Objective Genetic Algorithms -
Agenda  INTRODUCTION  GENETIC ALGORITHMS  GENETIC ALGORITHMS FOR EXPLORING QUERY SPACE  SYSTEM ARCHITECTURE  THE EFFECT OF DIFFERENT MUTATION RATES.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
1 Comparative Study of two Genetic Algorithms Based Task Allocation Models in Distributed Computing System Oğuzhan TAŞ 2005.
Advanced AI – Session 6 Genetic Algorithm By: H.Nematzadeh.
Global topology optimization of truss structures Dmitrij Šešok Rimantas Belevičius Department of Engineering Mechanics. Vilnius Gediminas Technical University.
Parallel Simulated Annealing using Genetic Crossover Tomoyuki Hiroyasu Mitsunori Miki Maki Ogura November 09, 2000 Doshisha University, Kyoto, Japan.
Genetic (Evolutionary) Algorithms CEE 6410 David Rosenberg “Natural Selection or the Survival of the Fittest.” -- Charles Darwin.
Department of Computer Science
Bulgarian Academy of Sciences
Comparing Genetic Algorithm and Guided Local Search Methods
Heuristic Optimization Methods Pareto Multiobjective Optimization
Multi-Objective Optimization
Doshisha Univ., Kyoto Japan
Temperature Parallel Simulated Annealing with Adaptive Neighborhood for Continuous Optimization problem Mitsunori MIKI Tomoyuki HIROYASU Masayuki KASAI.
○ Hisashi Shimosaka (Doshisha University)
New Crossover Scheme for Parallel Distributed Genetic Algorithms
Tomoyuki HIROYASU Mitsunori MIKI Masahiro HAMASAKI Yusuke TANIMURA
Md. Tanveer Anwar University of Arkansas
Energy Minimization of Protein Tertiary Structure by Parallel Simulated Annealing using Genetic Crossover Doshisha University, Kyoto, Japan Takeshi Yoshida.
Mitsunori MIKI Tomoyuki HIROYASU Takanori MIZUTA
Presentation transcript:

Doshisha Univ., Japan Parallel Evolutionary Multi-Criterion Optimization for Block Layout Problems ○ Shinya Watanabe Tomoyuki Hiroyasu Mitsunori Miki Intelligent Systems Design Laboratory, Doshisha University,Japan

Doshisha Univ., Japan Some of EMO can derive the good pareto optimum solutions. EMO need high calculation cost.  Evolutionary algorithms have potential parallelism.  PC Cluster Systems become very popular. Background (1) ● EMO・・・・ Evolutionary Multi-criterion Optimizations ( Ex. VEGA,MOGA,NPGA…etc ) Parallel Computing SW-HUB

Doshisha Univ., Japan Some parallel models for EMO are proposed –There are few studies for the validity on parallel model. Divided Range Multi-Objective Genetic Algorithms (DRMOGA) –it is applied to some test functions and it is found that this model is effective model for continuous multi-objective problems. Background (2) ● Parallel EMO Algorithms DRMOGA hasn’t been applied to discrete problems. Purpose The purpose of this study is to find the effectiveness of DRMOGA.

Doshisha Univ., Japan Multi-Criterion Optimization Problems(1) ● Multi-Criterion Optimization Problems (MOPs) Design variables Objective function Constraints G i (x)<0 ( i = 1, 2, …, k) F={f 1 (x), f 2 (x), …, f m (x)} X={x 1, x 2, …., x n } In the optimization problems, when there are several objective functions, the problems are called multi-objective or multi-criterion problems. f 2 (x) Feasible region f 1 (x) Weak pareto optimal solutions Pareto optimal solutions

Doshisha Univ., Japan ・ Multi-objective GA Like single objective GA, genetic operations such as evaluation, selection, crossover, and mutation, are repeated.f1 (x) 1 st generation 5 th generation 10 th generation f 2 (x) Pareto optimal solutions 50 th generation Multi-objective GA (1) 30 th generation

Doshisha Univ., Japan DGA model Distributed GAs  A population is divided into subpopulations (islands)  SGA is performed on each subpopulation Migration is performed for some generations Exchange of individuals 1 island / 1PE Migration

Doshisha Univ., Japan f (x) f 1 2 Division 1 Division 2 Max Pareto Optimum solution Min f 1 (x) f 2 Division 1 f 1 (x) f 2 Division 2 Divided Range Multi-Objective GA(1) 1 st The individuals are sorted by the values of focused objective function. 2 nd The N/m individuals are chosen in sequence. 3 rd SGA is performed on each sub population. 4 th After some generations, the step is returned to first Step

Doshisha Univ., Japan ・ Block Layout Problems with Floor Constraints (Sirai 1999) Block Packing method 1 4 5 3 2 6 7 : Dead Space Formulation of Block Layout Problems i=1 n f 1 = ΣΣc i j d ij j=1 n f 2 = Total Area S Objects where n:number of blocks c ij : flow from block i to block j d ij : distance from block i to block j

Doshisha Univ., Japan Application models –SGA, DGA, DRMOGA Layout problems –13, 27blocks Parameter Numerical Example Block No. verticalhorizontal ex)13 blocks GA parametervalue mutation rate 0.05 migration interval (resorted interval) 20 migration rate 0.2 crossover rate 1.0 Number of individuals 100 (total 1600) terminal condition300generation 20

Doshisha Univ., Japan Cluster system for calculation Spec. of Cluster (16 nodes) Processor Pentium Ⅱ (Deschutes) Clock 400MHz # Processors 1 × 16 Main memory 128Mbytes × 16 Network Fast Ethernet (100Mbps) Communication TCP/IP, MPICH OS Linux Compiler gcc (egcs )

Doshisha Univ., Japan DGA DRMOGA Results of 13 Blocks case Real weak pareto solutions 13

Doshisha Univ., Japan Results of 13 Blocks case (SGA) Local optimum solutions Real weak pareto solutions 13

Doshisha Univ., Japan Results of 27 Blocks case DRMOGA A B 27 DGA

Doshisha Univ., Japan AB (f_1, f_2) = ( 38446, ) (f_1, f_2) = ( 42739, ) 27

Doshisha Univ., Japan Results Most of the solutions were weak-pareto solutions. SGA, DGA and DRMOGA are applied to the layout problems –There are small difference between the results of three methods. –When results of DRMOGA compared with those of DGA, there isn’t big advantage. –SGA sometimes could not find the real weak pareto solutions. These problems have little trade-off relationships between the objective functions.

Doshisha Univ., Japan Results f (x) f 1 2 Division 1 Division 2 f (x) f 1 2 The individuals can’t be divided into two division by the value of the focused objective function(f 2 (x)). Can’t exchange individuals enough.

Doshisha Univ., Japan The DRMOGA was applied to discrete problems ; The block layout problems. –The test problems didn’t have definitely pareto solutions. –The searching ability of DGA and DRMOGA were almost same in numerical examples. –The mechanism of DRMOGA didn’t work effectively in these problems. –SGA may be caught by local minimum. Conclusion The results of DRMOGA were compared with those of SGA and DGA

Doshisha Univ., Japan ~ アルゴリズムの流れ ~ ⑦へ⑦へ

Doshisha Univ., Japan f 2 (x) f 1 (x) f 2 (x) f 1 (x) ・ DGA( Island model) ・ DRMOGA f 2 (x) f 1 (x) f 2 (x) f 1 (x) + = f 2 (x) f 1 (x) f 2 (x) f 1 (x) + = Divided Range Multi-Objective GA(2)

Doshisha Univ., Japan Results of 10 Blocks case (DRMOGA) Real weak pareto set Local optimum set A B

Doshisha Univ., Japan AB

DGA SGA Results of 10 Blocks case

Doshisha Univ., Japan Why are the results in this presentation different from the results in the paper? –In first, we selected GA parameters with no consideration. But we investigated more suitable GA parameters, and in this presentation, we used new GA parameters. That’s why this results Is different from results in paper. What do you aim in this presentation? –Main purpose in this study is to investigate the effectiveness of DRMOGA for Block layout problems. To my regret, this problem isn’t suitable for multi-criterion problems and we can’t get good results. How do you think about meaning of this presentation? –In other discrete problem, the effectiveness of DRMOGA hasn’t been researched yet. And I think that in the problem that has obviously trade- off relationships, DRMOGA will get good results. Because in that problems, the characteristics of DRMOGA can work effectively.

Doshisha Univ., Japan VEGA Schaffer (1985) VEGA+Pareto optimum individuals Tamaki (1995) Ranking Goldberg (1989) MOGA Fonseca (1993) Non Pareto optimum Elimination Kobayashi (1996) Ranking + sharing Srinvas (1994) Others Multi-objective GA (2) Squire EMO

Doshisha Univ., Japan (f_1, f_2) = ( , 14238)(f_1, f_2) = (879179, ) 13

Doshisha Univ., Japan Expression of solutions Configuration of GA Genetic operations Selection Pareto reservation strategy Crossover PMX method Mutation 2 bit substitution method

Doshisha Univ., Japan Calculation Time Case method Calculation time(sec) 13blocks SGA DGA 1.73E+01 DRMOGA 2.02E+01 27blocks SGA DGA 5.28E+01 DRMOGA 5.61E E E+03

Doshisha Univ., Japan Results of 27 Blocks case SGA 27