By Ping-Chu Hung Advisor: Ying-Ping Chen.  Introduction: background and objectives  Review of ECGA  ECGA for integer variables ◦ Experiments and performances.

Slides:



Advertisements
Similar presentations
CS6800 Advanced Theory of Computation
Advertisements

Genetic Algorithms for Real Parameter Optimization Written by Alden H. Wright Department of Computer Science University of Montana Presented by Tony Morelli.
CHAPTER 9 E VOLUTIONARY C OMPUTATION I : G ENETIC A LGORITHMS Organization of chapter in ISSO –Introduction and history –Coding of  –Standard GA operations.
Linkage Problem, Distribution Estimation, and Bayesian Networks Evolutionary Computation 8(3) Martin Pelikan, David E. Goldberg, and Erick Cantu-Paz.
Genetic Algorithms Representation of Candidate Solutions GAs on primarily two types of representations: –Binary-Coded –Real-Coded Binary-Coded GAs must.
1 Structure of search space, complexity of stochastic combinatorial optimization algorithms and application to biological motifs discovery Robin Gras INRIA.
Date:2011/06/08 吳昕澧 BOA: The Bayesian Optimization Algorithm.
1 Lecture 8: Genetic Algorithms Contents : Miming nature The steps of the algorithm –Coosing parents –Reproduction –Mutation Deeper in GA –Stochastic Universal.
Estimation of Distribution Algorithms Ata Kaban School of Computer Science The University of Birmingham.
Evolutionary Computational Intelligence
A new crossover technique in Genetic Programming Janet Clegg Intelligent Systems Group Electronics Department.
A simple EA and Common Search Operators Temi avanzati di Intelligenza Artificiale - Lecture 2 Prof. Vincenzo Cutello Department of Mathematics and Computer.
Hierarchical Allelic Pairwise Independent Function by DAVID ICLĂNZAN Present by Tsung-Yu Ho At Teilab,
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
Using a “Memetic” Evolutionary Algorithm to Solve a Form of The Maximum Clique Problem By Ian Baird November 20 th, 2003.
Tutorial 1 Temi avanzati di Intelligenza Artificiale - Lecture 3 Prof. Vincenzo Cutello Department of Mathematics and Computer Science University of Catania.
Genetic Algorithms Overview Genetic Algorithms: a gentle introduction –What are GAs –How do they work/ Why? –Critical issues Use in Data Mining –GAs.
©2003/04 Alessandro Bogliolo Background Information theory Probability theory Algorithms.
Genetic Programming.
Prepared by Barış GÖKÇE 1.  Search Methods  Evolutionary Algorithms (EA)  Characteristics of EAs  Genetic Programming (GP)  Evolutionary Programming.
Genetic Algorithm.
Charles L. Karr Rodney Bowersox Vishnu Singh
SOFT COMPUTING (Optimization Techniques using GA) Dr. N.Uma Maheswari Professor/CSE PSNA CET.
© Negnevitsky, Pearson Education, Lecture 10 Evolutionary Computation: Evolution strategies and genetic programming Evolution strategies Evolution.
CS Machine Learning Genetic Algorithms (II).
Investigation of the Effect of Neutrality on the Evolution of Digital Circuits. Eoin O’Grady Final year Electronic and Computer Engineering Project.
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
Optimal resource assignment to maximize multistate network reliability for a computer network Yi-Kuei Lin, Cheng-Ta Yeh Advisor : Professor Frank Y. S.
Design of an Evolutionary Algorithm M&F, ch. 7 why I like this textbook and what I don’t like about it!
Introduction to GAs: Genetic Algorithms How to apply GAs to SNA? Thank you for all pictures and information referred.
Introduction to Evolutionary Algorithms Session 4 Jim Smith University of the West of England, UK May/June 2012.
An Introduction to Genetic Algorithms Lecture 2 November, 2010 Ivan Garibay
Learning Bayesian Networks with Local Structure by Nir Friedman and Moises Goldszmidt.
Computational Complexity Jang, HaYoung BioIntelligence Lab.
FINAL EXAM SCHEDULER (FES) Department of Computer Engineering Faculty of Engineering & Architecture Yeditepe University By Ersan ERSOY (Engineering Project)
GENETIC ALGORITHM A biologically inspired model of intelligence and the principles of biological evolution are applied to find solutions to difficult problems.
How to apply Genetic Algorithms Successfully Prabhas Chongstitvatana Chulalongkorn University 4 February 2013.
GAs: why do they sometimes not work? n The coding moves the GA to operate on a different search space --- bad coding might deceive the GA or might slow.
A New Evolutionary Approach for the Optimal Communication Spanning Tree Problem Sang-Moon Soak Speaker: 洪嘉涓、陳麗徽、李振宇、黃怡靜.
Introduction to Evolutionary Computation Prabhas Chongstitvatana Chulalongkorn University WUNCA, Mahidol, 25 January 2011.
Why do GAs work? Symbol alphabet : {0, 1, * } * is a wild card symbol that matches both 0 and 1 A schema is a string with fixed and variable symbols 01*1*
Chapter 9 Genetic Algorithms.  Based upon biological evolution  Generate successor hypothesis based upon repeated mutations  Acts as a randomized parallel.
Edge Assembly Crossover
Genetic Algorithms Genetic algorithms provide an approach to learning that is based loosely on simulated evolution. Hypotheses are often described by bit.
Introduction to Genetic Algorithm Principle: survival-of-the-fitness Characteristics of GA Robust Error-tolerant Flexible When you have no idea about solving.
D Nagesh Kumar, IIScOptimization Methods: M8L5 1 Advanced Topics in Optimization Evolutionary Algorithms for Optimization and Search.
Authors: Soamsiri Chantaraskul, Klaus Moessner Source: IET Commun., Vol.4, No.5, 2010, pp Presenter: Ya-Ping Hu Date: 2011/12/23 Implementation.
Discovering Interesting Patterns for Investment Decision Making with GLOWER-A Genetic Learner Overlaid With Entropy Reduction Advisor : Dr. Hsu Graduate.
An Introduction to Genetic Algorithms Lecture 2 November, 2010 Ivan Garibay
Why do GAs work? Symbol alphabet : {0, 1, * } * is a wild card symbol that matches both 0 and 1 A schema is a string with fixed and variable symbols 01*1*
Genetic Algorithm Dr. Md. Al-amin Bhuiyan Professor, Dept. of CSE Jahangirnagar University.
Ch 20. Parameter Control Ch 21. Self-adaptation Evolutionary Computation vol. 2: Advanced Algorithms and Operators Summarized and presented by Jung-Woo.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
Overview Last two weeks we looked at evolutionary algorithms.
EVOLUTIONARY SYSTEMS AND GENETIC ALGORITHMS NAME: AKSHITKUMAR PATEL STUDENT ID: GRAD POSITION PAPER.
Genetic Algorithms And other approaches for similar applications Optimization Techniques.
Genetic Algorithm. Outline Motivation Genetic algorithms An illustrative example Hypothesis space search.
Hirophysics.com The Genetic Algorithm vs. Simulated Annealing Charles Barnes PHY 327.
Evolutionary Computation: Advanced Algorithms and Operators
Introduction to Genetic Algorithms
Using GA’s to Solve Problems
Genetic Algorithms.
Evolutionary Algorithms Jim Whitehead
Prof. Marie desJardins September 20, 2010
Modified Crossover Operator Approach for Evolutionary Optimization
EE368 Soft Computing Genetic Algorithms.
Introduction to Genetic Algorithm and Some Experience Sharing
FDA – A Scalable Evolutionary Algorithm for the Optimization of Additively Decomposed Functions BISCuit EDA Seminar
Beyond Classical Search
GA.
Presentation transcript:

By Ping-Chu Hung Advisor: Ying-Ping Chen

 Introduction: background and objectives  Review of ECGA  ECGA for integer variables ◦ Experiments and performances  ECGA for real numbers  ECGA on characteristic determination  Future work and conclusions 2

 Flow Chart of GAs  Building blocks: the key to success Individuals Good Individuals (Parents) Good Individuals (Parents) evaluation and selection crossover and mutation 3

 If a function can be decomposed into several nonlinear sub-functions, we say that variables in the same sub-function have linkage between them.  A building block is a set of variables that have linkage between them.  The key for GAs to success is keeping good schema and abandon bad schema  In practical use, schemas are often broken by crossover 4

 Flow Chart of EDAs  ECGA(1999) is one of the most advanced EDAs Individuals Good Individuals (Parents) Good Individuals (Parents) evaluation and selection Probability Model Probability Model modeling sampling 5

 GAs and EDAs are commonly based on binary strings  To solve integer and real number problems, we intuitively encode variables as binary strings  Variables encoded as binary strings will induce extra linkages  GAs are incapable of solving linkage problems, but how about EDAs? 6

 Extend ECGA to different variable types ◦ Integer: modify the probability model ◦ Real value: based on iECGA, split-on-demand  Evaluate the performance of iECGA ◦ iECGA outperforms ECGA in integer deception problems  Apply real-coded ECGA on a real-world application ◦ Characteristic determination problem 7

 Introduction: background and objectives  Review of ECGA  ECGA for integer variables ◦ Experiments and performances  ECGA for real numbers  ECGA on characteristic determination  Future work and conclusions 8

 A probability model contains two factors ◦ How to represent probability models? ◦ How to judge the quality of probability models?  ECGA ◦ Represent models as marginal product models (MPMs) ◦ Judge models by minimum description length (MDL) principle 9

[0,3][1][2] AlleleCountAlleleCountAlleleCount Population [1,2][0][3] AlleleCountAlleleCountAlleleCount

11

 Flow Chart of ECGA Individuals Good Individuals (Parents) Good Individuals (Parents) evaluation, tournament selection MPMs modeling sampling 12 Greedy MPM search MDL as criterion Building-block- wise Crossover

 Introduction: background and objectives  Review of ECGA  ECGA for integer variables ◦ Experiments and performances  ECGA for real numbers  ECGA on characteristic determination  Future work and conclusions 13

 Given an integer ranged from 0 to 15, the integer will be encoded as a four-bit binary string  These four bits intuitively form a building block  If several integers have linkage between them, ECGA have to solve a two-level linkage problem 14

 Individuals as integer vectors  Modified MPM  Modified model complexity [0,1][2] AlleleCountAlleleCount Population

 To test the effect of encoding, we have two kinds of objective function ◦ No linkage at integer level, but linkage at bit level ◦ Linkage at both level  Comparison between iECGA, ECGA, and integer coded GA 16

 No linkage at integer level, but linkage at bit level  f ₁(x) is deceptive function in bit level. Fitness of f ₁(x) is the number of 1’s in binary form of x 17

 Linkage at both level (u is the upperbound) 18

19

size of BBsorder of BBs BB at bit levelBB at integer level f₁f₁ 4 bits1 1 f₂f₂ 28 bits2 f₃f₃ 3 bits39 bits3 f₄f₄ 2 bits48 bits4 20

 Population size:  Crossover ◦ Uniform crossover in GA ◦ BB-wise crossover in ECGA and iECGA  Mutation ◦ No mutation in ECGA and iECGA ◦ Mutation rate 0.1 in GA  Selection ◦ Tournament selection  Modeling ◦ Maximum building-block size in ECGA: 15 bits 21

Fitness Function bits 22

Fitness Function bits 23

Fitness Function bits 24

Fitness Function bits 25

Convergence speed for Fitness Function 4 26

 Why iECGA performs better than GA? ◦ Good schemas are preserved ◦ Higher convergence speed  Why ECGA fails in integer domain? ◦ Greedy MPM search is incapable to find out hierarchical building blocks ◦ The linkage between integers may not propagate to the bit level  Why function 3 is harder than others? functioncardinalityorder of BBs f₂f₂ f₃f₃ f₄f₄

 Introduction: background and objectives  Review of ECGA  ECGA for integer variables ◦ Experiments and performances  ECGA for real numbers  ECGA on characteristic determination  Future work and conclusions 28

Real-number Individuals Real-number Individuals Good Real-Number Individuals Good Real-Number Individuals tournament selection tournament selection Good Integer Individuals Good Integer Individuals Split-on- Demand (Chen et. al., 2006) Split-on- Demand (Chen et. al., 2006) random sampling random sampling MPM model greedy MPM search 29

30 3

31

(0,0) (3,5) (1,4) 32

higher density in better area 33

 Introduction: background and objectives  Review of ECGA  ECGA for integer variables ◦ Experiments and performances  ECGA for real numbers  ECGA on characteristic determination  Future work and conclusions 34

 When we design and fabricate a new solid state device, the extrinsic properties can be measured, but the intrinsic properties are unknown ◦ Measure extrinsic properties first ◦ Then evaluate intrinsic properties  Why we need intrinsic properties? ◦ For simulation software ◦ Control the quality of the poly-Si film 35

Put voltage on gate 36

 What we can measure? ◦ Given a V G, we can measure an E a  What we want to get? ◦ The values of N d, S d, E td, N t, E tt 37

101 (V G, E a ) pairs Real-coded ECGA 5 variables objective value calculate approximate value of Ea sum up the difference between approximate value and experimental value 38 Objective Function

39

40

 What we can measure? ◦ Given a V G, we can measure an E a  What we want to get? ◦ The values of N d, S d, E td, N t, E tt, N i, E it 41

ELA 42

SSL 43

FLA 44

SPC 45

 The equivalent circuit of gate/SiO ₂/poly-Si structure bulkinterface oxide 46

 What we can measure? ◦ Given a frequency ω and a gate bias V G, we can measure the value of C eq  Properties of interface (D it, τ it ) ◦ Independent of frequencies, but depend on gate biases  Properties of bulk (D s, τ s ) ◦ Independent of both frequencies and gate biases 47

22 variables: 2 common bulk properties and 20 interface properties 70 input values: 7 frequencies vs. 10 gate biases 48

49

 Introduction: background and objectives  Review of ECGA  ECGA for integer variables ◦ Experiments and performances  ECGA for real numbers  ECGA on characteristic determination  Future work and conclusions 50

 Hierarchical building blocks  Overlapped building blocks  Mutation operator ◦ Building-block-wise mutation operator on ECGA  Other representations ◦ Gray code 51

 Extend ECGA to different variable types ◦ Integer: modify the probability model ◦ Real value: based on iECGA, split-on-demand  Evaluate the performance of iECGA ◦ iECGA outperforms ECGA in integer deception problems  Apply real-coded ECGA on a real-world application ◦ Characteristic determination problem 52