Tutorial 4 (Lecture 12) Remainder from lecture 10: The implicit fitness sharing method Exercises – any solutions? Questions?

Slides:



Advertisements
Similar presentations
Population-based metaheuristics Nature-inspired Initialize a population A new population of solutions is generated Integrate the new population into the.
Advertisements

Parameter control Chapter 8. A.E. Eiben and J.E. Smith, Introduction to Evolutionary Computing Parameter Control in EAs 2 Motivation 1 An EA has many.
1 Evolutionary Computational Inteliigence Lecture 6b: Towards Parameter Control Ferrante Neri University of Jyväskylä.
Parameter Control A.E. Eiben and J.E. Smith, Introduction to Evolutionary Computing Chapter 8.
Genetic Algorithms Representation of Candidate Solutions GAs on primarily two types of representations: –Binary-Coded –Real-Coded Binary-Coded GAs must.
Evolutionary Computing A Practical Introduction Presented by Ben Paechter Napier University with thanks to the EvoNet Training Committee and its “Flying.
1 Lecture 8: Genetic Algorithms Contents : Miming nature The steps of the algorithm –Coosing parents –Reproduction –Mutation Deeper in GA –Stochastic Universal.
(Intro To) Evolutionary Computation Revision Lecture Ata Kaban The University of Birmingham.
A new crossover technique in Genetic Programming Janet Clegg Intelligent Systems Group Electronics Department.
Tutorial 2 (Lecture6) (Intro to) Evolutionary Computation School of Computer Science University of Birmingham.
Fast Evolutionary Optimisation Temi avanzati di Intelligenza Artificiale - Lecture 6 Prof. Vincenzo Cutello Department of Mathematics and Computer Science.
Genetic Algorithm for Variable Selection
Tutorial 2 Temi avanzati di Intelligenza Artificiale - Lecture 6 Prof. Vincenzo Cutello Department of Mathematics and Computer Science University of Catania.
Intro to AI Genetic Algorithm Ruth Bergman Fall 2002.
Tutorial 1 Temi avanzati di Intelligenza Artificiale - Lecture 3 Prof. Vincenzo Cutello Department of Mathematics and Computer Science University of Catania.
Evolutionary Computational Intelligence Lecture 8: Memetic Algorithms Ferrante Neri University of Jyväskylä.
Evolutionary Computational Intelligence
Genetic Algorithms Nehaya Tayseer 1.Introduction What is a Genetic algorithm? A search technique used in computer science to find approximate solutions.
CS 447 Advanced Topics in Artificial Intelligence Fall 2002.
Intro to AI Genetic Algorithm Ruth Bergman Fall 2004.
Chapter 6: Transform and Conquer Genetic Algorithms The Design and Analysis of Algorithms.
Prepared by Barış GÖKÇE 1.  Search Methods  Evolutionary Algorithms (EA)  Characteristics of EAs  Genetic Programming (GP)  Evolutionary Programming.
Evolutionary algorithms
Genetic Algorithm.
Charles L. Karr Rodney Bowersox Vishnu Singh
Intro. ANN & Fuzzy Systems Lecture 36 GENETIC ALGORITHM (1)
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
Genetic Algorithms Michael J. Watts
Genetic algorithms Charles Darwin "A man who dares to waste an hour of life has not discovered the value of life"
Genetic Algorithms Genetic algorithms imitate a natural optimization process: natural selection in evolution. Developed by John Holland at the University.
L ECTURE 3 Notes are modified from EvoNet Flying Circus slides. Found at: www2.cs.uh.edu/~ceick/ai/EC1.ppt.
S J van Vuuren The application of Genetic Algorithms (GAs) Planning Design and Management of Water Supply Systems.
Genetic Algorithms Genetic Algorithms – What are they? And how they are inspired from evolution. Operators and Definitions in Genetic Algorithms paradigm.
FINAL EXAM SCHEDULER (FES) Department of Computer Engineering Faculty of Engineering & Architecture Yeditepe University By Ersan ERSOY (Engineering Project)
Crossovers and Mutation Richard P. Simpson. Genotype vs. Phenotype The genotype of a chromosome is just the basic data structure (it bits in a binary.
15/06/2003NORPIE 2004, Trondheim1 Genetic Optimization of Electric Machines, a State of the Art Study S. E. Skaar, R. Nilssen.
2005MEE Software Engineering Lecture 11 – Optimisation Techniques.
Algorithms and their Applications CS2004 ( ) 13.1 Further Evolutionary Computation.
1 Genetic Algorithms and Ant Colony Optimisation.
Why do GAs work? Symbol alphabet : {0, 1, * } * is a wild card symbol that matches both 0 and 1 A schema is a string with fixed and variable symbols 01*1*
/ 26 Evolutionary Computing Chapter 8. / 26 Chapter 8: Parameter Control Motivation Parameter setting –Tuning –Control Examples Where to apply parameter.
 Genetic Algorithms  A class of evolutionary algorithms  Efficiently solves optimization tasks  Potential Applications in many fields  Challenges.
Genetic Algorithms What is a GA Terms and definitions Basic algorithm.
Introduction to Genetic Algorithm Principle: survival-of-the-fitness Characteristics of GA Robust Error-tolerant Flexible When you have no idea about solving.
MAE 552 Heuristic Optimization Instructor: John Eddy Lecture #12 2/20/02 Evolutionary Algorithms.
Chapter 12 FUSION OF FUZZY SYSTEM AND GENETIC ALGORITHMS Chi-Yuan Yeh.
EE459 I ntroduction to Artificial I ntelligence Genetic Algorithms Practical Issues: Selection.
D Nagesh Kumar, IIScOptimization Methods: M8L5 1 Advanced Topics in Optimization Evolutionary Algorithms for Optimization and Search.
Evolutionary Computing Chapter 11. / 7 Chapter 11: Non-stationary and Noisy Function Optimisation What is a non-stationary problem? Effect of uncertainty.
FACTS Placement Optimization For Multi-Line Contignecies Josh Wilkerson November 30, 2005.
An Introduction to Genetic Algorithms Lecture 2 November, 2010 Ivan Garibay
Selection and Recombination Temi avanzati di Intelligenza Artificiale - Lecture 4 Prof. Vincenzo Cutello Department of Mathematics and Computer Science.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
Overview Last two weeks we looked at evolutionary algorithms.
1 Comparative Study of two Genetic Algorithms Based Task Allocation Models in Distributed Computing System Oğuzhan TAŞ 2005.
Genetic Algorithms. Solution Search in Problem Space.
Genetic Algorithms And other approaches for similar applications Optimization Techniques.
Introduction to Genetic Algorithms
Genetic Algorithms Author: A.E. Eiben and J.E. Smith
MAE 552 Heuristic Optimization
CSC 380: Design and Analysis of Algorithms
Genetic Algorithms Chapter 3.
Parameter control Chapter 8.
EE368 Soft Computing Genetic Algorithms.
Searching for solutions: Genetic Algorithms
Biologically Inspired Computing: Operators for Evolutionary Algorithms
Parameter control Chapter 8.
CSC 380: Design and Analysis of Algorithms
Parameter control Chapter 8.
Population Methods.
Presentation transcript:

Tutorial 4 (Lecture 12) Remainder from lecture 10: The implicit fitness sharing method Exercises – any solutions? Questions?

Fitness Sharing -- questions, insights Sharing function -At which step of the evolutionary algorithm do we use this? -What if i==j? -Is this for minimisation or maximisation? -Ask your own question about it…

Sharing and Fitness Function f 1 (x,y) = e (- 0.7 * (x+2.0) *(x+2.0)) * e (-0.9 * y * y) * e (- (x -5.0) * (x-6.0)) * e (-(y-2.0) * (y-2.0)) f 2 (x,y) = 1 + e (- 0.7 * (x+2.0) *(x+2.0)) * e (-0.9 * y * y) * e (- (x -5.0) * (x-6.0)) * e (-(y-2.0) * (y- 2.0)) -What's the difference? -What implications will this have on the sharing?

Past programming exercise (remember?) Write an evolutionary algorithm to find the maximum of the function f(x,y)=exp(-0.7*(x+2)*(x+2))*exp(-0.9*y*y)+2*exp(-(x- 5)*(x-6))*exp(-(y-2)*(y-2)) for values –10<x,y<10. Create two versions: (1) binary representation on e.g. 2x16 bits; (2) real-valued representation. Run a few runs and describe the differences in search behaviour. (e.g. how long does it take to find the optimum, does it always find the global optimum, how close it gets to the optimum) Implement it without self-adaptation first. Hints & Code  see last tutorial notes

Answers Your representation influences very much how close you can get to the optimum. Using binary representation, the genotype length is the first factor. If you allow, say, 4 bits per variable, you can only get 16 different values, so your resolution is 10 - (-10) / 16 = 1.25, so in the worst case you can only get to within 0.7 of your optimum. If you allow too many bits, mutations to the lowest bits will move your search points very little, so search gets slower. Hamming cliffs (where you have to flip more than one bit to reach the nearest neighbour) further make binary search difficult, using a hamming code representation helps. With real valued representations, the mutation operation is not dependent on your bit length. Gaussian and Cauchy mutation give you nicely distributed mixes of small and large mutations, and you can control the spread with the strategy parameter. Averaging crossover also works well for this test case. The probability of finding the global optimum depends on a number of factors, like population size, mutation rate, strategy parameter used, and selection mechanism (remember tournament vs. roulette wheel).

Question. How is your programming exercise, which involved self-adaptation, coming along? Hint (For lazy Java users only) Here's some example code to use self-adaptive mutation in real representation. Compared to the previous example code, not much has changed: The individual now has an additional array to store the strategy parameter, together with methods to access it: solutions/self-adaptive/Individual.java.html The main EA has changed in a few places: the initialization of the individuals now also initializes the strategy parameter, and the mutation now uses Cauchy mutation with self- adaptation. Also, since the problem is now a minimization problem, the selection routines are modified to allow switching between minimization and maximization. solutions/self-adaptive/EA.java.html Note that the selection mechanism is different from that used in the FEP paper, we still use tournament selection and 'best-survives' survival here (the mechanism in the paper is much simpler). The fitness function implements f8: solutions/self-adaptive/FitnessFunction.java.html The random helper class again (unchanged): solutions/self-adaptive/RandomHelper.java.html You can disable the minimum strategy parameter by setting it to 0. Try and see what happens!

Question. Suppose you have a genotype of length n. Describe in words, what is the difference between n-1 point crossover and uniform crossover? Answer Uniform crossover flips a coin for each gene, and decides if it is swapped or not. Any combination of swaps is possible. N-1- point crossover swaps after every position, so exactly every second gene is swapped (completely deterministic, and not very useful) Question. Different selection operators produce different selection pressure. Explain this in words, in terms of exploration versus exploitation. Give some examples. Hint Think of the examples of Roulette Wheel versus tournament selection schemes.