Genetic Algorithms based Parameter Identification of Yeast Fed-Batch Cultivation Angelova M., Tzonkov St., Pencheva T.

Slides:



Advertisements
Similar presentations
CS6800 Advanced Theory of Computation
Advertisements

Using Parallel Genetic Algorithm in a Predictive Job Scheduling
On the Genetic Evolution of a Perfect Tic-Tac-Toe Strategy
Non-Linear Problems General approach. Non-linear Optimization Many objective functions, tend to be non-linear. Design problems for which the objective.
Genetic Algorithms1 COMP305. Part II. Genetic Algorithms.
1 Lecture 8: Genetic Algorithms Contents : Miming nature The steps of the algorithm –Coosing parents –Reproduction –Mutation Deeper in GA –Stochastic Universal.
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
Department of Engineering, Control & Instrumentation Research Group 22 – Mar – 2006 Optimisation Based Clearance of Nonlinear Flight Control Laws Prathyush.
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
Intro to AI Genetic Algorithm Ruth Bergman Fall 2002.
Evolutionary Computational Intelligence Lecture 8: Memetic Algorithms Ferrante Neri University of Jyväskylä.
Intro to AI Genetic Algorithm Ruth Bergman Fall 2004.
Chapter 6: Transform and Conquer Genetic Algorithms The Design and Analysis of Algorithms.
Genetic Programming. Agenda What is Genetic Programming? Background/History. Why Genetic Programming? How Genetic Principles are Applied. Examples of.
Genetic Programming.
Slides are based on Negnevitsky, Pearson Education, Lecture 10 Evolutionary Computation: Evolution strategies and genetic programming n Evolution.
1 Reasons for parallelization Can we make GA faster? One of the most promising choices is to use parallel implementations. The reasons for parallelization.
Genetic Algorithm.
1 Paper Review for ENGG6140 Memetic Algorithms By: Jin Zeng Shaun Wang School of Engineering University of Guelph Mar. 18, 2002.
Cristian Urs and Ben Riveira. Introduction The article we chose focuses on improving the performance of Genetic Algorithms by: Use of predictive models.
Soft Computing Lecture 18 Foundations of genetic algorithms (GA). Using of GA.
SOFT COMPUTING (Optimization Techniques using GA) Dr. N.Uma Maheswari Professor/CSE PSNA CET.
Improved Gene Expression Programming to Solve the Inverse Problem for Ordinary Differential Equations Kangshun Li Professor, Ph.D Professor, Ph.D College.
© Negnevitsky, Pearson Education, Lecture 10 Evolutionary Computation: Evolution strategies and genetic programming Evolution strategies Evolution.
Genetic algorithms Prof Kang Li
Improvement of Multi-population Genetic Algorithms Convergence Time Maria Angelova, Tania Pencheva
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
Genetic Algorithms Michael J. Watts
What is Genetic Programming? Genetic programming is a model of programming which uses the ideas (and some of the terminology) of biological evolution to.
Optimization Problems - Optimization: In the real world, there are many problems (e.g. Traveling Salesman Problem, Playing Chess ) that have numerous possible.
Optimal resource assignment to maximize multistate network reliability for a computer network Yi-Kuei Lin, Cheng-Ta Yeh Advisor : Professor Frank Y. S.
The Generational Control Model This is the control model that is traditionally used by GP systems. There are a distinct number of generations performed.
Applying Genetic Algorithm to the Knapsack Problem Qi Su ECE 539 Spring 2001 Course Project.
ACO for Parameter Settings of E.coli Fed-batch Cultivation Model Stefka Fidanova, Olympia Roeva Bulgarian Academy of Sciences.
Genetic Algorithms Genetic Algorithms – What are they? And how they are inspired from evolution. Operators and Definitions in Genetic Algorithms paradigm.
Evolving Virtual Creatures & Evolving 3D Morphology and Behavior by Competition Papers by Karl Sims Presented by Sarah Waziruddin.
Derivative Free Optimization G.Anuradha. Contents Genetic Algorithm Simulated Annealing Random search method Downhill simplex method.
1 A New Method for Composite System Annualized Reliability Indices Based on Genetic Algorithms Nader Samaan, Student,IEEE Dr. C. Singh, Fellow, IEEE Department.
Genetic Algorithms Przemyslaw Pawluk CSE 6111 Advanced Algorithm Design and Analysis
Edge Assembly Crossover
Genetic Algorithms What is a GA Terms and definitions Basic algorithm.
Institute of Biophysics and Biomedical Engineering - Bulgarian Academy of Sciences OLYMPIA ROEVA 105 Acad. George Bonchev Str Sofia, Bulgaria
Chapter 12 FUSION OF FUZZY SYSTEM AND GENETIC ALGORITHMS Chi-Yuan Yeh.
EE749 I ntroduction to Artificial I ntelligence Genetic Algorithms The Simple GA.
Parallel Genetic Algorithms By Larry Hale and Trevor McCasland.
CS 8625 High Performance Computing Dr. Hoganson Copyright © 2003, Dr. Ken Hoganson CS8625 Class Will Start Momentarily… CS8625 High Performance.
Alice E. Smith and Mehmet Gulsen Department of Industrial Engineering
Introduction Metaheuristics: increasingly popular in research and industry mimic natural metaphors to solve complex optimization problems efficient and.
Innovative and Unconventional Approach Toward Analytical Cadastre – based on Genetic Algorithms Anna Shnaidman Mapping and Geo-Information Engineering.
Neural Networks And Its Applications By Dr. Surya Chitra.
Genetic Algorithm Dr. Md. Al-amin Bhuiyan Professor, Dept. of CSE Jahangirnagar University.
Agenda  INTRODUCTION  GENETIC ALGORITHMS  GENETIC ALGORITHMS FOR EXPLORING QUERY SPACE  SYSTEM ARCHITECTURE  THE EFFECT OF DIFFERENT MUTATION RATES.
Sensitivity Analysis for the Purposes of Parameter Identification of a S. cerevisiae Fed-batch Cultivation Sensitivity Analysis for the Purposes of Parameter.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
EVOLUTIONARY SYSTEMS AND GENETIC ALGORITHMS NAME: AKSHITKUMAR PATEL STUDENT ID: GRAD POSITION PAPER.
Genetic Algorithm(GA)
Genetic Algorithm. Outline Motivation Genetic algorithms An illustrative example Hypothesis space search.
 Presented By: Abdul Aziz Ghazi  Roll No:  Presented to: Sir Harris.
 Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems n Introduction.
Genetic (Evolutionary) Algorithms CEE 6410 David Rosenberg “Natural Selection or the Survival of the Fittest.” -- Charles Darwin.
Purposeful Model Parameters Genesis in Simple Genetic Algorithms
Genetic Algorithms.
Bulgarian Academy of Sciences
Evolution strategies and genetic programming
A Comparison of Simulated Annealing and Genetic Algorithm Approaches for Cultivation Model Identification Olympia Roeva.
Presented by: Dr Beatriz de la Iglesia
GENETIC ALGORITHMS FOR FEED RATE PROFILES DESIGN
Comparing Genetic Algorithm and Guided Local Search Methods
EE368 Soft Computing Genetic Algorithms.
Presentation transcript:

Genetic Algorithms based Parameter Identification of Yeast Fed-Batch Cultivation Angelova M., Tzonkov St., Pencheva T.

Fermentation processes Fermentation processes (FP) are widely used in different branches of industry, i.e. in the production of pharmaceuticals, chemicals and enzymes, yeast, foods and beverages. Live microorganisms play an important role in these processes so their peculiarities predetermine some specific characteristics of FP as modeling and control objects. Fermentation processes are: - complex, - nonlinear, - dynamic systems with interdependent and time-varying process variables. These special peculiarities lead to obtaining of non-linear models with a very complex structure. The conventional optimization methods in general can not overcome the fermentation processes limitations and as an alternative, genetic algorithms like stochastic global optimization method can be applied to reach to a satisfied solution for model’s parameter identification.

Genetic algorithms Genetic algorithms (GA) : - are a direct random search technique for finding global optimal solution in complex multidimensional search space; - are based on mechanics of natural selection and natural genetics; - have advantages such as hard problems solving, noise tolerance, easy to interface and hybridize; - are proved to be very suitable for the optimization of highly non-linear problems, that is why they are applied in the area of biotechnology, especially for parameter identification of fermentation process models.

SGA and MpGA Simple (SGA) and multi-population (MpGA) genetic algorithm, as presented initially in Goldberg search a global optimal solution using three main genetic operators in a sequence selection, crossover and mutation. - SGA-SCM and MpGA-SCM Many improved variations of the SGA and MpGA have been developed. Among them are the modified genetic algorithm with a sequence crossover, mutation and selection and consequent modification of MpGA based on such exchange. - SGA-CMS and MpGA-CMS. In these algorithms selection operator has been processed after performing of crossover and mutation. The main idea for such operators’ sequence is to prevent the loss of reached good solution by either crossover or mutation or both operators. SGA-CMS applied to a parameter identification of E. coli fed-batch cultivation and further tested also for a parameter identification of S. cerevisiae fed-batch cultivation improves the optimization capability of the algorithm, decreasing decision time.

SGA and MpGA Obtained promising results applying SGA-CMS and MpGA-CMS encourage more investigations to be performed in order further improvements of the algorithms to be found. In SGA and MpGA as presented initially in Goldberg, the operator mutation is usually applied after the operator crossover. Since the basic idea of GA is to imitate the mechanics of natural selection and genetics, one can make an analogy with the processes occurring in the nature, saying that the probability mutation to come first and then crossover is comparable to the idea both processes to occur in a reverse order.

The purpose of investigation The purpose of this study is to investigate the influence of the genetic operators’ sequence selection, crossover and mutation in SGA and MpGA. SGA-SCM and MpGA-SCM, as well as developed SGA-CMS and MpGA-CMS have been compared with four new proposed kinds with exchanged sequence of mutation and crossover operators. Obtained altogether eight kinds of the SGA and the MpGA have been compared in terms of accuracy and performance for a parameter identification of S. cerevisiae fed-batch cultivation.

Implementation of exchanged operators’ sequence of crossover and mutation in SGA and MpGA Simple genetic algorithm (denoted here as SGA-SCM) guides the mechanism of evaluation implementing the three main operators in a sequence selection, crossover and mutation. Presently four modifications of SGA and MpGA are elaborated and demonstrated, implementing the exchange of operators’ sequence crossover and mutation. Newly presented modifications are as follows: SGA-SMC – a modification of the developed in SGA-SCM; SGA-MCS – a modification of the developed in SGA-CMS; MpGA-SMC – a modification of the developed in MpGA-SCM; MpGA-MCS – a modification of the developed in MpGA-CMS.

The elaboration of MpGA-MCS Multi-population genetic algorithm is a single population genetic algorithm, in which many populations, called subpopulations, evolve independently from each other for a certain number of generations. After a certain number of generations (isolation time), a number of individuals are distributed between the subpopulations. In the beginning, the MpGA generates a random population of n chromosomes, i.e. suitable solutions for the problem. In order to prevent the loss of reached good solution by either crossover or mutation or both operators, selection operator has been processed after performing of crossover and mutation. The new modification presented here is that, the individuals are reproduced processing firstly mutation, followed by crossover. The elements of chromosome are a bit changed when a newly created offspring mutates, after that the genes from parents combine to form a whole new chromosome during the crossover. Then the algorithm evaluates the objective values (cost values) of the individuals in the current population. After the reproduction, the MpGA-MCS calculates the objective function for the offspring and the best fitted individuals from the offspring are selected to replace the parents, according to their objective values. When a certain number of generations is fulfilled, a mean deviation in the population is satisfied, or when a particular point in the search space is encountered, the MpGA is terminated. Proposed exchange in a operators’ sequence mutation and crossover has been also applied towards SGA-SCM, SGA-CMS and MpGA-SCM. This results in new algorithm modifications considered in this investigation and denoted as SGA-SMC, SGA-MCS and MpGA-SMC respectively.

Mathematical model of S. cerevisiae fed- batch cultivation Experimental data of S. cerevisiae fed-batch cultivation is obtained in the Institute of Technical Chemistry – University of Hannover, Germany. where X is the concentration of biomass, [g.l -1 ]; S – concentration of substrate (glucose), [g.l -1 ]; E – concentration of ethanol, [g.l -1 ]; O 2 – concentration of oxygen, [%]; O 2 * – dissolved oxygen saturation concentration, [%]; F – feeding rate, [l.h -1 ]; V – volume of bioreactor, [l]; k L O2 a– volumetric oxygen transfer coefficient,[h -1 ]; S in – glucose concentration in the feeding solution, [g.l -1 ]; , q S, q E and are respectively specific rates of growth, substrate utilization, ethanol production and dissolved oxygen consumption, [h -1 ].

Specific rates where – maximum growth rates of substrate and ethanol, [h -1 ]; k S, k E – saturation constants of substrate and ethanol, [g.l -1 ]; Yij – yield coefficients, [g.g -1 ]. Mean square deviation between the model output and the experimental data obtained during cultivation has been used as an optimization criterion: where Y is the experimental data, Y* – model predicted data, Y = [X, S, E, O2].

Results from model parameter identification using different kinds of SGA ParameterSGA-SCMSGA-SMCSGA-CMSSGA-MCS JYJY CPU time, s μ 2S, h μ 2E, h k S, g.l k E, g.l Y SX, g.g Y EX, g.g k la o2, h Y OS, g.g Y OE, g.g

Results from model parameter identification using different kinds of MpGA ParameterMpGA-SCMMpGA-SMCMpGA-CMSMpGA-MCS JYJY CPU time, s μ 2S, h μ 2E, h k S, g.l k E, g.l Y SX, g.g Y EX, g.g k la o2, h Y OS, g.g Y OE, g.g

Experimental and model data for biomas concentration

Experimental and model data for substrate concentration

Experimental and model data for ethanol concentration

Experimental and model data for dissolved oxygen concentration

Analysis and conclusions In this investigation altogether four modifications – two of SGA and two of MpGA have been proposed, implementing the exchanged operators’ sequence of mutation and crossover. Newly suggested SGA-SMC, SGA-MCS, MpGA-SMC and MpGA-MCS have been developed and compared respectively to SGA-SCM, SGA-CMS, MpGA- SCM and MpGA-CMS for the purposes of a parameter identification of a fed- batch cultivation of S. cerevisiae. Implementation of the main genetic operators in order mutation, crossover and selection in SGA significantly improves calculation time of the algorithm without affecting to the model adequacy. SGA-MCS solves the optimization problem 9% faster than SGA-CMS and 24% than SGA-SCM. Four kinds of MpGA lead to significant improvement of about 50% of the optimization criterion value but for more computational time. Among the considered MpGA, the fastest and the most precise one implements an operators’ sequence of crossover, mutation and selection. Finally, comparing SGA and MpGA it is up to the user to make a decision which type of GA to use as a compromise between the time consumption and model precision.

NM&A’10 Genetic Algorithms based Parameter Identification of Yeast Fed-Batch Cultivation ACKNOWLEDGEMENTS This work is partially supported by the European Social Fund and Bulgarian Ministry of Education, Youth and Science under Operative Program “Human Resources Development”, grant BG051PO /40 and National Science Fund of Bulgaria, grant number DID “Modeling Processes with Fixed Development Rules”. Thank you for your attention!