Trivial Parallelization of an Existing EA Asher Freese CS401.

Slides:



Advertisements
Similar presentations
MOEAs University of Missouri - Rolla Dr. T’s Course in Evolutionary Computation Matt D. Johnson November 6, 2006.
Advertisements

CS6800 Advanced Theory of Computation
1 An Adaptive GA for Multi Objective Flexible Manufacturing Systems A. Younes, H. Ghenniwa, S. Areibi uoguelph.ca.
Genetic Algorithms By: Anna Scheuler and Aaron Smittle.
March 23, 2003 AAAI symposium, Stanford. Jianjun Hu, Erik D. Goodman, Kisung Seo Zhun Fan, Ronald C. Rosenberg Genetic Algorithm Research & Applications.
Tuesday, May 14 Genetic Algorithms Handouts: Lecture Notes Question: when should there be an additional review session?
Evolutionary Computing A Practical Introduction Presented by Ben Paechter Napier University with thanks to the EvoNet Training Committee and its “Flying.
(Intro To) Evolutionary Computation Revision Lecture Ata Kaban The University of Birmingham.
A New Evolutionary Algorithm for Multi-objective Optimization Problems Multi-objective Optimization Problems (MOP) –Definition –NP hard By Zhi Wei.
Age-Based Population Dynamics in Evolutionary Algorithms Lisa Guntly.
Introduction to Genetic Algorithms Yonatan Shichel.
Iterative Improvement Algorithms
Evolutionary Computing and the Traveling Salesman
EA* A Hybrid Approach Robbie Hanson. What is it?  The A* algorithm, using an EA for the heuristic.  An efficient way of partitioning the search space.
EC Awards Lecture ~ Spring 2008 Advances in Parameterless Evolutionary Algorithms Lisa Guntly André Nwamba Research Advisor: Dr. Daniel Tauritz Natural.
Applying Evolutionary Algorithm to Chaco Tool on the Partitioning of Power Transmission System (CS448 Class Project) Yan Sun.
Comparison of Evolutionary Techniques. Motivation EAs are general problem solvers EAs are themselves problems EAs should be simpler to apply to new problems.
D Nagesh Kumar, IIScOptimization Methods: M1L4 1 Introduction and Basic Concepts Classical and Advanced Techniques for Optimization.
Optimizing a Chess Heuristic Using Evolutionary Algorithms Benjamin Rhew
Genetic Algorithm What is a genetic algorithm? “Genetic Algorithms are defined as global optimization procedures that use an analogy of genetic evolution.
Chapter 6: Transform and Conquer Genetic Algorithms The Design and Analysis of Algorithms.
Soft Computing Paradigm
A l a p a g o s : a generic distributed parallel genetic algorithm development platform Nicolas Kruchten 4 th year Engineering Science (Infrastructure.
Island Based GA for Optimization University of Guelph School of Engineering Hooman Homayounfar March 2003.
Parallel Genetic Algorithms with Distributed-Environment Multiple Population Scheme M.Miki T.Hiroyasu K.Hatanaka Doshisha University,Kyoto,Japan.
Patterns of Evolution. Sequential Evolution Changes in the gene pool from one generation to the next. Populations evolve gradually as they become adapted.
A New Model of Distributed Genetic Algorithm for Cluster Systems: Dual Individual DGA Tomoyuki HIROYASU Mitsunori MIKI Masahiro HAMASAKI Yusuke TANIMURA.
1 Paper Review for ENGG6140 Memetic Algorithms By: Jin Zeng Shaun Wang School of Engineering University of Guelph Mar. 18, 2002.
Artificial Intelligence Lecture No. 31 Dr. Asad Ali Safi ​ Assistant Professor, Department of Computer Science, COMSATS Institute of Information Technology.
Optimization Problems - Optimization: In the real world, there are many problems (e.g. Traveling Salesman Problem, Playing Chess ) that have numerous possible.
Linear Programming Chapter 6. Large Scale Optimization.
Applying Genetic Algorithm to the Knapsack Problem Qi Su ECE 539 Spring 2001 Course Project.
Evolving Virtual Creatures & Evolving 3D Morphology and Behavior by Competition Papers by Karl Sims Presented by Sarah Waziruddin.
8.6. Knapsack Ciphers. The Concept At the core of the Knapsack cipher is the Knapsack problem: At the core of the Knapsack cipher is the Knapsack problem:
An Interactive Tutorial for NP-Completeness. Outline  Background and Motivation  Visualizations  The NP-Complete Problems  Practice Exercises on NP-Complete.
QuickCheck: A Lightweight Tool for Random Testing of Haskell Programs By Koen Claessen, Juhn Hughes ME: Mike Izbicki.
István Lőrentz 1 Mihaela Malita 2 Răzvan Andonie 3 Mihaela MalitaRăzvan Andonie 3 (presenter) 1 Electronics and Computers Department, Transylvania University.
Extended Finite-State Machine Inference with Parallel Ant Colony Based Algorithms PPSN’14 September 13, 2014 Daniil Chivilikhin PhD student ITMO.
Immune Genetic Algorithms By Jeremy Moreau. References Licheng Jiao, Senior Member, IEEE, and Lei Wang, “A Novel Genetic Algorithm Based on Immunity,”
The Generalized Traveling Salesman Problem: A New Genetic Algorithm Approach by John Silberholz, University of Maryland Bruce Golden, University of Maryland.
Parent Selection Strategies for Evolutionary Algorithms A Comparison of Parent Selection Strategies Modeled After Human Social Interaction By Michael Ames.
Genetic Algorithms What is a GA Terms and definitions Basic algorithm.
Biologically inspired algorithms BY: Andy Garrett YE Ziyu.
Motivation: Sorting is among the fundamental problems of computer science. Sorting of different datasets is present in most applications, ranging from.
Genetic Algorithms. The Basic Genetic Algorithm 1.[Start] Generate random population of n chromosomes (suitable solutions for the problem) 2.[Fitness]
Operational Research & ManagementOperations Scheduling Economic Lot Scheduling 1.Summary Machine Scheduling 2.ELSP (one item, multiple items) 3.Arbitrary.
Parallel Genetic Algorithms By Larry Hale and Trevor McCasland.
Waqas Haider Bangyal 1. Evolutionary computing algorithms are very common and used by many researchers in their research to solve the optimization problems.
Global Clock Synchronization in Sensor Networks Qun Li, Member, IEEE, and Daniela Rus, Member, IEEE IEEE Transactions on Computers 2006 Chien-Ku Lai.
Local Search Algorithms and Optimization Problems
Hierarchical Load Balancing for Large Scale Supercomputers Gengbin Zheng Charm++ Workshop 2010 Parallel Programming Lab, UIUC 1Charm++ Workshop 2010.
Gerstner Lab, CTU Prague 1Motivation Typically,  an evolutionary optimisation framework considers the EA to be used to evolve a population of candidate.
Chapter 15: Co-Evolutionary Systems
Evolutionary Computing Chapter 13. / 24 Chapter 13: Constraint Handling Motivation and the trouble What is a constrained problem? Evolutionary constraint.
Asteroseismology of Sun-like Stars
CAP6938 Neuroevolution and Artificial Embryogeny Evolutionary Comptation Dr. Kenneth Stanley January 23, 2006.
1 Comparative Study of two Genetic Algorithms Based Task Allocation Models in Distributed Computing System Oğuzhan TAŞ 2005.
EVOLUTIONARY SYSTEMS AND GENETIC ALGORITHMS NAME: AKSHITKUMAR PATEL STUDENT ID: GRAD POSITION PAPER.
Genetic Algorithms An Evolutionary Approach to Problem Solving.
Genetic Algorithms And other approaches for similar applications Optimization Techniques.
Hirophysics.com The Genetic Algorithm vs. Simulated Annealing Charles Barnes PHY 327.
CEng 713, Evolutionary Computation, Lecture Notes parallel Evolutionary Computation.
Genetic Algorithm (Knapsack Problem)
Paper Review for ENGG6140 Memetic Algorithms
USING MICROBIAL GENETIC ALGORITHM TO SOLVE CARD SPLITTING PROBLEM.
STUDY AND IMPLEMENTATION
Amdahl's law.
Applications of Genetic Algorithms TJHSST Computer Systems Lab
Variational Inequalities
Presentation transcript:

Trivial Parallelization of an Existing EA Asher Freese CS401

Motivation Many difficult problems Many difficult problems –NP-Complete 0/1 Knapsack 0/1 Knapsack Traveling Salesman Traveling Salesman Initial Solution: Evolutionary Algorithm Initial Solution: Evolutionary Algorithm Problem: Problem: –EAs rarely get optimal solution –Some problems are even bigger than an EA can handle in reasonable time

Solution Parallel Computing (Island Model) Parallel Computing (Island Model) –Parallelization increases speed of programs –EAs are inherently parallelizable Easy to split populations Easy to split populations Most suitable uses Most suitable uses –Requires many generations to converge –Expensive fitness function

Previous Research Very Little Very Little –Proof of concept –Speed up computation of unrelated problem –Method of achieving population diversity

Approach Parallel, Island Model framework Parallel, Island Model framework –Parallel framework takes EA class Instantiation by main will not change Instantiation by main will not change –Loop Run for some generations Run for some generations Trade individuals among processes Trade individuals among processes –EA class inherits parent for parallel framework

Parallel EA Structure

Two types of Parallelization Purely Parellel Purely Parellel –Each EA is completely independent Island Model trading Island Model trading –EA’s mostly independent –Trade individuals occasionally

Testing N-queens problem N-queens problem 0/1 Knapsack (later) 0/1 Knapsack (later) Ackley Function (later) Ackley Function (later)

Results

Parallel Comparisons

Results, cont

Preliminary Conclusion Low epoch length, bad Low epoch length, bad Low number traded individuals, good Low number traded individuals, good High number of processors, good High number of processors, good

Future Work More tests More tests –0/1 Knapsack –Ackley Function Different trading algorithms Different trading algorithms Processor niching Processor niching

Questions?