Genetic Algorithms Genetic algorithms imitate a natural optimization process: natural selection in evolution. Developed by John Holland at the University.

Slides:



Advertisements
Similar presentations
Genetic Algorithms Chapter 3. A.E. Eiben and J.E. Smith, Introduction to Evolutionary Computing Genetic Algorithms GA Quick Overview Developed: USA in.
Advertisements

Genetic Algorithms Genetic algorithms imitate natural optimization process, natural selection in evolution. Developed by John Holland at the University.
CSM6120 Introduction to Intelligent Systems Evolutionary and Genetic Algorithms.
Tuesday, May 14 Genetic Algorithms Handouts: Lecture Notes Question: when should there be an additional review session?
Genetic Algorithms Representation of Candidate Solutions GAs on primarily two types of representations: –Binary-Coded –Real-Coded Binary-Coded GAs must.
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
Evolutionary Computational Intelligence
A new crossover technique in Genetic Programming Janet Clegg Intelligent Systems Group Electronics Department.
1 Genetic Algorithms. CS The Traditional Approach Ask an expert Adapt existing designs Trial and error.
Genetic Algorithm for Variable Selection
Intro to AI Genetic Algorithm Ruth Bergman Fall 2002.
Tutorial 1 Temi avanzati di Intelligenza Artificiale - Lecture 3 Prof. Vincenzo Cutello Department of Mathematics and Computer Science University of Catania.
Evolutionary Computational Intelligence
Chapter 6: Transform and Conquer Genetic Algorithms The Design and Analysis of Algorithms.
Tutorial 4 (Lecture 12) Remainder from lecture 10: The implicit fitness sharing method Exercises – any solutions? Questions?
Genetic Algorithms Overview Genetic Algorithms: a gentle introduction –What are GAs –How do they work/ Why? –Critical issues Use in Data Mining –GAs.
Christoph F. Eick: Applying EC to TSP(n) Example: Applying EC to the TSP Problem  Given: n cities including the cost of getting from on city to the other.
Genetic Algorithm.
Genetic Algorithms Genetic algorithms imitate natural optimization process, natural selection in evolution. Developed by John Holland at the University.
SOFT COMPUTING (Optimization Techniques using GA) Dr. N.Uma Maheswari Professor/CSE PSNA CET.
Intro. ANN & Fuzzy Systems Lecture 36 GENETIC ALGORITHM (1)
Genetic algorithms Prof Kang Li
Optimization in Engineering Design Georgia Institute of Technology Systems Realization Laboratory Mixed Integer Problems Most optimization algorithms deal.
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
Genetic Algorithms Michael J. Watts
Genetic algorithms Charles Darwin "A man who dares to waste an hour of life has not discovered the value of life"
More on Heuristics Genetic Algorithms (GA) Terminology Chromosome –candidate solution - {x 1, x 2,...., x n } Gene –variable - x j Allele –numerical.
Introduction to Evolutionary Algorithms Session 4 Jim Smith University of the West of England, UK May/June 2012.
An Introduction to Genetic Algorithms Lecture 2 November, 2010 Ivan Garibay
1 Machine Learning: Lecture 12 Genetic Algorithms (Based on Chapter 9 of Mitchell, T., Machine Learning, 1997)
Soft Computing A Gentle introduction Richard P. Simpson.
Genetic Algorithms Siddhartha K. Shakya School of Computing. The Robert Gordon University Aberdeen, UK
Derivative Free Optimization G.Anuradha. Contents Genetic Algorithm Simulated Annealing Random search method Downhill simplex method.
Evolutionary Art with Multiple Expression Programming By Quentin Freeman.
Genetic Algorithms. Evolutionary Methods Methods inspired by the process of biological evolution. Main ideas: Population of solutions Assign a score or.
1 Genetic Algorithms and Ant Colony Optimisation.
Edge Assembly Crossover
Genetic Algorithms What is a GA Terms and definitions Basic algorithm.
Genetic Algorithms Abhishek Sharma Piyush Gupta Department of Instrumentation & Control.
Chapter 12 FUSION OF FUZZY SYSTEM AND GENETIC ALGORITHMS Chi-Yuan Yeh.
EE749 I ntroduction to Artificial I ntelligence Genetic Algorithms The Simple GA.
5. Implementing a GA 4 학습목표 GA 를 사용해 실제 문제를 해결할 때 고려해야 하는 사항에 대해 이해한다 Huge number of choices with little theoretical guidance Implementation issues + sophisticated.
D Nagesh Kumar, IIScOptimization Methods: M8L5 1 Advanced Topics in Optimization Evolutionary Algorithms for Optimization and Search.
1 Contents 1. Basic Concepts 2. Algorithm 3. Practical considerations Genetic Algorithm (GA)
An Introduction to Genetic Algorithms Lecture 2 November, 2010 Ivan Garibay
Genetic Algorithms. Underlying Concept  Charles Darwin outlined the principle of natural selection.  Natural Selection is the process by which evolution.
Genetic Algorithm Dr. Md. Al-amin Bhuiyan Professor, Dept. of CSE Jahangirnagar University.
►Search and optimization method that mimics the natural selection ►Terms to define ٭ Chromosome – a set of numbers representing one possible solution ٭
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
1 Comparative Study of two Genetic Algorithms Based Task Allocation Models in Distributed Computing System Oğuzhan TAŞ 2005.
Genetic Algorithms. Solution Search in Problem Space.
Genetic Algorithms An Evolutionary Approach to Problem Solving.
Genetic Algorithm(GA)
Genetic Algorithms and Evolutionary Programming A Brief Overview.
 Presented By: Abdul Aziz Ghazi  Roll No:  Presented to: Sir Harris.
Presented By: Farid, Alidoust Vahid, Akbari 18 th May IAUT University – Faculty.
Hirophysics.com The Genetic Algorithm vs. Simulated Annealing Charles Barnes PHY 327.
Introduction to Genetic Algorithms
Genetic Algorithms Author: A.E. Eiben and J.E. Smith
Genetic Algorithms.
Artificial Intelligence Methods (AIM)
Introduction to Genetic Algorithm (GA)
Example: Applying EC to the TSP Problem
Example: Applying EC to the TSP Problem
Genetic Algorithms Chapter 3.
EE368 Soft Computing Genetic Algorithms.
A Gentle introduction Richard P. Simpson
Machine Learning: UNIT-4 CHAPTER-2
Population Based Metaheuristics
Population Methods.
Presentation transcript:

Genetic Algorithms Genetic algorithms imitate a natural optimization process: natural selection in evolution. Developed by John Holland at the University of Michigan for machine learning in Similar algorithms developed in Europe in the 1970s under the name evolutionary strategies Main difference has been in the nature of the variables: Discrete vs. continuous Class is called evolutionary algorithms Key components are population, parent and child designs, and randomness (e.g. mutation)

Basic Scheme Coding: replace design variables with a continuous string of digits or “genes” –Binary –Integer –Real Population: Create population of design points Selection: Select parents based on fitness Crossover: Create child designs Mutation: Mutate child designs

Genetic operators Crossover: portions of strings of the two parents are exchanged Mutation: the value of one bit (gene) is changed at random Permutation: the order of a portion of the chromosome is reversed Addition/deletion: one gene is added to/removed from the chromosome

Select parents Algorithm of standard GA Create initial population Calculate fitness Create children

Stacking sequence optimization For many practical problems angles limited to 0-deg,  45-deg, 90-deg. Ply thickness given by manufacturer Stacking sequence optimization a combinatorial problem Genetic algorithms effective and easy to implement, but do not deal well with constraints

Coding - stacking sequence Binary coding common. Natural coding works better. (0 0 =>1, 45 0 =>2, =>3, 90 0 =>4) (45/-45/90/0)s => (2/3/4/1) To satisfy balance condition, convenient to work with two-ply stacks (0 2 =>1,  45=>2, 90 2 =>3) or (45/-45/90 2 /0 2 ) s => (2/3/1) To allow variable thickness add empty stacks (2/3/1/E/E)=> (45/-45/90 2 /0 2 ) s

Coding - dimensions Binary coding most common. Real number coding possible but requires special treatement. Trinary coding used in one example. Genetic algorithm not effective for getting high precision. It is better to go for coarse grid of real values. With n binary digits get 2 n values. Segregate stacking sequence and geometry chromosomes.

Initial population Random number generator used Typical function call is rand(seed) In Matlab rand(n) generates nxn matrix of uniformly distributed (0,1) random numbers Seed updated after call to avoid repeating the same number. See Matlab help on how to change seed (state). If we want repeatable runs must control seed. Need to transform random numbers to values of alleles (possible gene values).

Fitness Augmented objective f*=f + pv-bm+sign(v) . –v = max violation –m = min margin As we get nearer the optimum, difference in f* between individuals gets smaller. To keep evolutionary pressure, fitness is –normalized objective –or n s +1-rank

Selection Roulette wheel and tournament based selection Elitist strategies Selection pressures versus exploration No twin rule

Roulette wheel Example fitnesses

Single Point Crossover Parent designs [0 4 /±45 2 /90 2 ] s and [±45 4 /0 2 ] s Parent 1 [1/1/2/2/  3] Parent 2 [2/2/2/2/  1] One child [1/1/2/2/1] That is: [0 4 /±45 2 /0 2 ] s

Other kinds of crossover Multiple point crossover Uniform crossover Bell-curve crossover for real numbers Multi-parent crossover

Mutation and stack swap [1/1/2/2/3]=> [1/1/2/3/3] [0 4 /±45 2 /90 2 ] s => [0 4 /±45/90 4 ] s [1/1/2/2/3]=> [1/2/1/2/3] [0 4 /±45 2 /90 2 ] s => [(0 2 /±45) 2 /90 2 ] s

Questions GA Global optimization balances exploration and exploitation. How is that reflected in genetic algorithms? SolutionSolution What are all possible balanced and symmetric child designs of [0 2 /±45/90] s and [±45 2 /0] s with uniform cross-over? SolutionSolution When we breed plants and animals we do not introduce randomness on purpose into the selection procedure. Why do we do that with GAs? Solution on notes page.

Reliability Genetic algorithm is random search with random outcome. Reliability can be estimated from multiple runs for similar problems with known solution Variance of reliability, r, from n runs

Reliability curves