Genetic Algorithm with Real-coded Binary Rep. 1 GAs and Premature Convergence Premature convergence - GAs converge too early to suboptimal solution  as.

Slides:



Advertisements
Similar presentations
Genetic Algorithms Chapter 3. A.E. Eiben and J.E. Smith, Introduction to Evolutionary Computing Genetic Algorithms GA Quick Overview Developed: USA in.
Advertisements

Population-based metaheuristics Nature-inspired Initialize a population A new population of solutions is generated Integrate the new population into the.
A First Course in Genetic Algorithms
Biologically Inspired Computing: Operators for Evolutionary Algorithms
Exact and heuristics algorithms
1 Evolutionary Computational Inteliigence Lecture 6b: Towards Parameter Control Ferrante Neri University of Jyväskylä.
Linkage Learning in Evolutionary Algorithms. Recombination Missouri University of Science and Technology Recombination explores the search space Classic.
Genetic Algorithms Representation of Candidate Solutions GAs on primarily two types of representations: –Binary-Coded –Real-Coded Binary-Coded GAs must.
Evolutionary Computing A Practical Introduction Presented by Ben Paechter Napier University with thanks to the EvoNet Training Committee and its “Flying.
Estimation of Distribution Algorithms Let’s review what have done in EC so far: We have studied EP and found that each individual searched via Gaussian.
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
Evolutionary Computational Intelligence
A new crossover technique in Genetic Programming Janet Clegg Intelligent Systems Group Electronics Department.
Introduction to Genetic Algorithms Yonatan Shichel.
Population New Population Selection Crossover and Mutation Insert When the new population is full repeat Generational Algorithm.
Intro to AI Genetic Algorithm Ruth Bergman Fall 2002.
Intro to AI Genetic Algorithm Ruth Bergman Fall 2004.
Chapter 6: Transform and Conquer Genetic Algorithms The Design and Analysis of Algorithms.
Tutorial 4 (Lecture 12) Remainder from lecture 10: The implicit fitness sharing method Exercises – any solutions? Questions?
Genetic Algorithms Overview Genetic Algorithms: a gentle introduction –What are GAs –How do they work/ Why? –Critical issues Use in Data Mining –GAs.
Genetic Algorithm.
Problems Premature Convergence Lack of genetic diversity Selection noise or variance Destructive effects of genetic operators Cloning Introns and Bloat.
Slides are based on Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems.
SOFT COMPUTING (Optimization Techniques using GA) Dr. N.Uma Maheswari Professor/CSE PSNA CET.
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
Genetic Algorithms Michael J. Watts
Genetic algorithms Charles Darwin "A man who dares to waste an hour of life has not discovered the value of life"
L ECTURE 3 Notes are modified from EvoNet Flying Circus slides. Found at: www2.cs.uh.edu/~ceick/ai/EC1.ppt.
Introduction to GAs: Genetic Algorithms How to apply GAs to SNA? Thank you for all pictures and information referred.
Outline Introduction Evolution Strategies Genetic Algorithm
The Generational Control Model This is the control model that is traditionally used by GP systems. There are a distinct number of generations performed.
An Introduction to Genetic Algorithms Lecture 2 November, 2010 Ivan Garibay
Genetic Algorithms Introduction Advanced. Simple Genetic Algorithms: Introduction What is it? In a Nutshell References The Pseudo Code Illustrations Applications.
Chapter 4.1 Beyond “Classic” Search. What were the pieces necessary for “classic” search.
FINAL EXAM SCHEDULER (FES) Department of Computer Engineering Faculty of Engineering & Architecture Yeditepe University By Ersan ERSOY (Engineering Project)
GENETIC ALGORITHM A biologically inspired model of intelligence and the principles of biological evolution are applied to find solutions to difficult problems.
Iterative Prototype Optimisation with Evolved Improvement Steps Jiří Kubalík and Jan Faigl Czech Technical University Department of Cybernetics Technicka.
Evolution Programs (insert catchy subtitle here).
Introduction to Genetic Algorithms. Genetic Algorithms We’ve covered enough material that we can write programs that use genetic algorithms! –More advanced.
Edge Assembly Crossover
Genetic Algorithms What is a GA Terms and definitions Basic algorithm.
Genetic Algorithms. The Basic Genetic Algorithm 1.[Start] Generate random population of n chromosomes (suitable solutions for the problem) 2.[Fitness]
Diversity Preservation in Evolutionary Algorithms Jiří Kubalík Intelligent Data Analysis Group Department of Cybernetics CTU Prague.
Waqas Haider Bangyal 1. Evolutionary computing algorithms are very common and used by many researchers in their research to solve the optimization problems.
5. Implementing a GA 4 학습목표 GA 를 사용해 실제 문제를 해결할 때 고려해야 하는 사항에 대해 이해한다 Huge number of choices with little theoretical guidance Implementation issues + sophisticated.
GENETIC ALGORITHM Basic Algorithm begin set time t = 0;
Innovative and Unconventional Approach Toward Analytical Cadastre – based on Genetic Algorithms Anna Shnaidman Mapping and Geo-Information Engineering.
D Nagesh Kumar, IIScOptimization Methods: M8L5 1 Advanced Topics in Optimization Evolutionary Algorithms for Optimization and Search.
In the name of ALLAH Presented By : Mohsen Shahriari, the student of communication in Sajad institute for higher education.
Introduction to GAs: Genetic Algorithms Quantitative Analysis: How to make a decision? Thank you for all pictures and information referred.
Genetic algorithms: A Stochastic Approach for Improving the Current Cadastre Accuracies Anna Shnaidman Uri Shoshani Yerach Doytsher Mapping and Geo-Information.
Genetic Algorithms Chapter Description of Presentations
An Introduction to Genetic Algorithms Lecture 2 November, 2010 Ivan Garibay
Gerstner Lab, CTU Prague 1Motivation Typically,  an evolutionary optimisation framework considers the EA to be used to evolve a population of candidate.
Genetic Algorithms. Underlying Concept  Charles Darwin outlined the principle of natural selection.  Natural Selection is the process by which evolution.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
EVOLUTIONARY SYSTEMS AND GENETIC ALGORITHMS NAME: AKSHITKUMAR PATEL STUDENT ID: GRAD POSITION PAPER.
Genetic Algorithms And other approaches for similar applications Optimization Techniques.
George Yauneridge.  Machine learning basics  Types of learning algorithms  Genetic algorithm basics  Applications and the future of genetic algorithms.
Hirophysics.com The Genetic Algorithm vs. Simulated Annealing Charles Barnes PHY 327.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 Intelligent Exploration for Genetic Algorithms Using Self-Organizing.
Genetic Algorithm (Knapsack Problem)
Using GA’s to Solve Problems
Genetic Algorithms.
CSC 380: Design and Analysis of Algorithms
Basics of Genetic Algorithms (MidTerm – only in RED material)
Genetic Algorithms Chapter 3.
Basics of Genetic Algorithms
Introduction to Genetic Algorithm and Some Experience Sharing
CSC 380: Design and Analysis of Algorithms
Presentation transcript:

Genetic Algorithm with Real-coded Binary Rep. 1 GAs and Premature Convergence Premature convergence - GAs converge too early to suboptimal solution  as the population gets homogeneous, only a little new can be evolved Reasons for premature convergence:  improper selection pressure  insufficient population size  deception  improper representation and genetic operators

Genetic Algorithm with Real-coded Binary Rep. 2 Real-coded Binary Representation Pseudo-binary representation – binary gene values coded by real numbers from the interval  0.0, 1.0  interpretation(r)=1, if r > 0.5 =0, if r < 0.5 Example: ch 1 = [ ] ch 2 = [ ] interpretation(ch 1 )=interpretation(ch 2 )=[1001] Gene strength – gene’s stability measure  The closer the real value is to 0.5 the weaker the gene is  „one-valued genes“: 0.92 > 0.86 > 0.65 > 0.62  „zero-valued genes“: 0.07 > 0.19 > 0.23 > 0.41

Genetic Algorithm with Real-coded Binary Rep. 3 Gene-strength Adjustment Every offspring gene is adjusted depending on  its interpretation  the relative frequency of ones at given position in the population Vector P[] stores the population statistic Ex.: P[ ]  82% of ones at the first position, 17% of ones at the second position, 35% of ones at the third position, 68% of ones at the fourth position.

Genetic Algorithm with Real-coded Binary Rep. 4 Gene Strengthening/Weakening Zero-valued gene: gene’ = gene + c*(1.0-P[i]) weakening gene’ = gene – c*P[i] strengthening One-valued gene gene’ = gene + c*(1.0-P[i]) strengthening gene’ = gene – c*P[i] weakening C stands for a maximal gene-adaptation step: c  (0.0,0.2  Gene value interpreted with above-average frequency at given position in the chromosome is weakened, the other one is strengthened.

Genetic Algorithm with Real-coded Binary Rep. 5 Boosting-up the Exploitation Genotype of promising solutions should be stabilized for subsequent generations  newly generated solutions that are better than their parents  disable rapid changes in their genotype interpretation All genes of such individuals are strengthened  zero-valued genes are set to be close to 0.0  one-valued genes are rescaled to be close to 1.0 Ex.: ch = (0.71, 0.45, 0.18, 0.57)  ch’= (0.97, 0.03, 0.02, 0.99) Genes survive through more generations not being changed due to the gene-strength adjustment mechanism

Genetic Algorithm with Real-coded Binary Rep. 6 GARB Algorithm 1begin 2initialize(OldPop) 3repeat 4calculate P[] from OldPop 5repeat 6select Parents from OldPop 7generate Children 8adjust Children genes 9evaluate Children 10if Child is better than Parents 11then rescale Child 12insert Children to NewPop 13until NewPop is completed 14switch OldPop and NewPop 15until termination condition 16end

Genetic Algorithm with Real-coded Binary Rep. 7 Deceptive function DF3 Test Problems F101 function Hierarchical IF and only IF Oscillating Knapsack Problem 14 objects, w i =2 i, i=0,...,13 f(x)=1/(1+target -  w i x i ) Target oscillates between two values and 2837, which differ in 9 bits

Genetic Algorithm with Real-coded Binary Rep. 8 Results on Static Problems DF3 H-IFF F101

Genetic Algorithm with Real-coded Binary Rep. 9 Single Gene Diversity Monitoring DF3

Genetic Algorithm with Real-coded Binary Rep. 10 Single Gene Diversity Monitoring (Cnd.) F101 H-IFF

Genetic Algorithm with Real-coded Binary Rep. 11 Results on Knapsack Problem Oscillating knapsack problem

Genetic Algorithm with Real-coded Binary Rep. 12 Results on Knapsack Problem Oscillation period Algorithm GARB C= GARB C= GARB C= GARB C= GARB C= GARB C= GARB C= GARB C= Haploid-Recover Extended-Additive Ng-Wong Osc. period10 gener. Osc. period20 gener.

Genetic Algorithm with Real-coded Binary Rep. 13 Recovering from Homogen. State DF3Knapsack problem

Genetic Algorithm with Real-coded Binary Rep. 14Conclusions A novel approach for preventing the premature convergence  based on pseudo-binary representation  preserves the diversity of the evolved population during the whole run  enables to escape even from the homogeneous state  enhances exploration capabilities of the genetic algorithm Steady-state evolutionary model  might be faster in responding to the convergence trend observed in the population Does not deal with the linkage problem  not another competent genetic algorithm  might be combined with some chromosome reordering techniques