COMPARISON BETWEEN A SIMPLE GA AND AN ANT SYSTEM FOR THE CALIBRATION OF A RAINFALL-RUNOFF MODEL NELSON OBREGÓN RAFAEL E. OLARTE 6th International Conference.

Slides:



Advertisements
Similar presentations
CS6800 Advanced Theory of Computation
Advertisements

Intelligent Control Methods Lecture 12: Genetic Algorithms Slovak University of Technology Faculty of Material Science and Technology in Trnava.
Using Parallel Genetic Algorithm in a Predictive Job Scheduling
Genetic Algorithms Representation of Candidate Solutions GAs on primarily two types of representations: –Binary-Coded –Real-Coded Binary-Coded GAs must.
1 Wendy Williams Metaheuristic Algorithms Genetic Algorithms: A Tutorial “Genetic Algorithms are good at taking large, potentially huge search spaces and.
Non-Linear Problems General approach. Non-linear Optimization Many objective functions, tend to be non-linear. Design problems for which the objective.
Department of Engineering, Control & Instrumentation Research Group 22 – Mar – 2006 Optimisation Based Clearance of Nonlinear Flight Control Laws Prathyush.
1 Genetic Algorithms. CS The Traditional Approach Ask an expert Adapt existing designs Trial and error.
Genetic Algorithm for Variable Selection
D Nagesh Kumar, IIScOptimization Methods: M1L4 1 Introduction and Basic Concepts Classical and Advanced Techniques for Optimization.
Genetic Algorithms: A Tutorial
Travelling Salesman Problem: Convergence Properties of Optimization Algorithms Group 2 Zachary Estrada Chandini Jain Jonathan Lai.
Genetic Algorithm.
Genetic Algorithms and Ant Colony Optimisation
Genetic algorithms Prof Kang Li
Optimization in Engineering Design Georgia Institute of Technology Systems Realization Laboratory Mixed Integer Problems Most optimization algorithms deal.
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
Optimization Problems - Optimization: In the real world, there are many problems (e.g. Traveling Salesman Problem, Playing Chess ) that have numerous possible.
Genetic Algorithms Genetic algorithms imitate a natural optimization process: natural selection in evolution. Developed by John Holland at the University.
Optimal resource assignment to maximize multistate network reliability for a computer network Yi-Kuei Lin, Cheng-Ta Yeh Advisor : Professor Frank Y. S.
(Particle Swarm Optimisation)
More on Heuristics Genetic Algorithms (GA) Terminology Chromosome –candidate solution - {x 1, x 2,...., x n } Gene –variable - x j Allele –numerical.
Ant Colony Optimization. Summer 2010: Dr. M. Ameer Ali Ant Colony Optimization.
Optimization of multi-pass turning operations using ant colony system Authors: K. Vijayakumar, G. Prabhaharan, P. Asokan, R. Saravanan 2003 Presented by:
1 “Genetic Algorithms are good at taking large, potentially huge search spaces and navigating them, looking for optimal combinations of things, solutions.
Genetic Algorithms Siddhartha K. Shakya School of Computing. The Robert Gordon University Aberdeen, UK
2005MEE Software Engineering Lecture 11 – Optimisation Techniques.
Algorithms and their Applications CS2004 ( ) 13.1 Further Evolutionary Computation.
1 Genetic Algorithms and Ant Colony Optimisation.
Ant colony optimization. HISTORY introduced by Marco Dorigo (MILAN,ITALY) in his doctoral thesis in 1992 Using to solve traveling salesman problem(TSP).traveling.
Genetic Algorithms CSCI-2300 Introduction to Algorithms
 Genetic Algorithms  A class of evolutionary algorithms  Efficiently solves optimization tasks  Potential Applications in many fields  Challenges.
Genetic Algorithms What is a GA Terms and definitions Basic algorithm.
ECE 103 Engineering Programming Chapter 52 Generic Algorithm Herbert G. Mayer, PSU CS Status 6/4/2014 Initial content copied verbatim from ECE 103 material.
Genetic Algorithms. 2 Overview Introduction To Genetic Algorithms (GAs) GA Operators and Parameters Genetic Algorithms To Solve The Traveling Salesman.
Evolutionary Algorithms K. Ganesh Research Scholar, Ph.D., Industrial Management Division, Humanities and Social Sciences Department, Indian Institute.
Robot Intelligence Technology Lab. Generalized game of life YongDuk Kim.
Heterogeneous redundancy optimization for multi-state series-parallel systems subject to common cause failures Chun-yang Li, Xun Chen, Xiao-shan Yi, Jun-youg.
Solving Function Optimization Problems with Genetic Algorithms September 26, 2001 Cho, Dong-Yeon , Tel:
EE459 I ntroduction to Artificial I ntelligence Genetic Algorithms Practical Issues: Selection.
GENETIC ALGORITHM Basic Algorithm begin set time t = 0;
Artificial Intelligence Search Methodologies Dr Rong Qu School of Computer Science University of Nottingham Nottingham, NG8 1BB, UK
What is Ant Colony Optimization?
1 Contents 1. Basic Concepts 2. Algorithm 3. Practical considerations Genetic Algorithm (GA)
Gerstner Lab, CTU Prague 1Motivation Typically,  an evolutionary optimisation framework considers the EA to be used to evolve a population of candidate.
Genetic Algorithms and TSP Thomas Jefferson Computer Research Project by Karl Leswing.
Agenda  INTRODUCTION  GENETIC ALGORITHMS  GENETIC ALGORITHMS FOR EXPLORING QUERY SPACE  SYSTEM ARCHITECTURE  THE EFFECT OF DIFFERENT MUTATION RATES.
►Search and optimization method that mimics the natural selection ►Terms to define ٭ Chromosome – a set of numbers representing one possible solution ٭
The Implementation of Genetic Algorithms to Locate Highest Elevation By Harry Beddo.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
Overview Last two weeks we looked at evolutionary algorithms.
1 Comparative Study of two Genetic Algorithms Based Task Allocation Models in Distributed Computing System Oğuzhan TAŞ 2005.
Genetic Algorithms. Solution Search in Problem Space.
Genetic Algorithms An Evolutionary Approach to Problem Solving.
Genetic Algorithms And other approaches for similar applications Optimization Techniques.
Genetic Algorithm(GA)
Genetic (Evolutionary) Algorithms CEE 6410 David Rosenberg “Natural Selection or the Survival of the Fittest.” -- Charles Darwin.
Genetic Algorithms.
Artificial Intelligence Project 2 Genetic Algorithms
Genetic Algorithm and Their Applications to Scheduling
Comparing Genetic Algorithm and Guided Local Search Methods
Genetic Algorithms and TSP
metaheuristic methods and their applications
Metaheuristic methods and their applications. Optimization Problems Strategies for Solving NP-hard Optimization Problems What is a Metaheuristic Method?
Genetic Algorithms CSCI-2300 Introduction to Algorithms
EE368 Soft Computing Genetic Algorithms.
Introduction to Genetic Algorithm and Some Experience Sharing
Artificial Intelligence CIS 342
Genetic algorithms: case study
Traveling Salesman Problem by Genetic Algorithm
Presentation transcript:

COMPARISON BETWEEN A SIMPLE GA AND AN ANT SYSTEM FOR THE CALIBRATION OF A RAINFALL-RUNOFF MODEL NELSON OBREGÓN RAFAEL E. OLARTE 6th International Conference on Hydroinformatics Singapore, June 2004

OBJECTIVES 1.To propose an Ant System for solving continuous functions. 2.To compare this AS with a simple GA in terms of their Parsimony, Efficacy and Efficiency (only the calibration problem of the Thomas Model will be considered).

CONTENTS 1.Brief explanation of a simple AS 2.Adapting an AS for the Thomas Model calibration problem 3.Adapting a GA for the Thomas Model calibration problem 4.Comparison between the 2 algorithms 5.Conclusions

1.BRIEF EXPLANATION OF A SIMPLE AS

The Traveler Salesman Problem ??

A Simple Ant System 1) Distribute randomly m ants on m of the n cities.

A Simple Ant System 1) Distribute randomly m ants on m of the n cities. 2) Every ant makes a random tour and dies.

A Simple Ant System 1) Distribute randomly m ants on m of the n cities. 2) Every ant makes a random tour and dies. 3) Update pheromone trails  ij on the segments (ij). 3) Update pheromone trails  ij upon segments ( ij ).

A Simple Ant System 1) Distribute randomly m ants on m of the n cities. 2) Every ant makes a random tour and then dies. 3) Update pheromone trails  ij upo segments (ij). 4) Distribute randomly m ants on m of the n cities.

A Simple Ant System 1) Distribute randomly m ants on m of the n cities. 2) Every ant makes a random tour and then dies. 3) Update pheromone trails  ij upo segments (ij). 4) Distribute randomly m ants on m of the n cities. 5) Every ant makes a complete tour according to probability p ij and then dies. ? ? ? ? ? ? ? 5) Every ant makes a complete tour according to probability p ij and the dies.

A Simple Ant System 1) Distribute randomly m ants on m of the n cities. 2) Every ant makes a random tour and then dies. 3) Update pheromone trails  ij upon segments (ij). 4) DistribUte randomly m ants on m of the n cities. 6) Update pheromone trails  ij upon segments (ij). 5) Every ant makes a complete tour according to probability p ij and then dies. 6) Update pheromone trails  ij upon segments (ij).

A Simple Ant System 1) Distribute randomly m ants on m of the n cities. 2) Every ant makes a random tour and then dies. 3) Update pheromone trails  ij upon segments (ij). 4) Distribute randomly m ants on m of the n cities. 6) Update pheromone trails  ij upon segments (ij). 5) Every ant makes a complete tour according to probability p ij and then dies. 7) Has the # of iterations ( maxIter) been completed? 7) Has the # of iterations ( maxIter ) been reached?

2.ADAPTING AN AS FOR THE THOMAS MODEL CALIBRATION PROBLEM

The Thomas Model Calibration Problem P ET Q? CATCHMENT PRECIPITATION EVAPOTRANSPIRATION STREAMFLOW Sw 0, Sg 0 a, b, c, d Parameters Initial Conditions Sw 0, Sg 0 a, b, c, d Initial Conditions Parameters

The Thomas Model Calibration Problem Sw 0, Sg 0 a, b, c, d Initial Conditions Parameters  a b c d Sw 0 Sg 0

The Thomas Model Calibration Problem  a b c d Sw 0 Sg 0 a b c d Sw 0 Sg 0  b Adapting the simple AS

b a b c d Sw 0 Sg 0  1) Distribute randomly m ants on m of the n cities. 2) Every ant makes a random tour and then dies. 3) Update pheromone trails  ij upon segments (ij). 4) Distribute randomly m ants on m of the n cities. 6) Update pheromone trails  ij upon segments (ij). 5) Every ant makes a complete tour according to probability p ij and then dies. 7) Has the # of iterations ( maxIter) been completed? Adapting the simple AS

b a c Sw 0 Sg 0  d b 1) Distribute randomly m ants on m of the n cities. 2) Every ant makes a random tour and then dies. 3) Update pheromone trails  ij upon segments (ij). 4) Distribute randomly m ants on m of the n cities. 6) Update pheromone trails  ij upon segments (ij). 5) Every ant makes a complete tour according to probability p ij and then dies. 7) Has the # of iterations ( maxIter) been completed? Adapting the simple AS Adapting the MAX-MIN AS At each iteration, set limits for the values of  ij, that is,  min and  max. At each iteration, only update  ij of the iteration best found solution. Every globUpdate iterations, update the  ij of the global best found. 1) Distribute randomly m ants on m of the n cities. 2) Let each ant make a random tour and die. 6) Distribute randomly m ants on m of the n cities. 4) Update pheromone trails  ij upon segments (ij) within  max and  min. 7) Let each ant make a complete tour (according to probability p ij ) and die. Update the limit  max. 8) Has the # of iterations ( maxIter) been completed? 3) Calculate  max and set all segments with that pheromone. 5) If an interval of globUpdate iterations has been made, reinforce pheromone trail of the global best found solution. Parameters’ Sensibility + – adcbadcb

3.ADAPTING A GA FOR THE THOMAS MODEL CALIBRATION PROBLEM

A Simple GA (6) Number of generations maxGen reached? 1) Generate population of popSize chromosomes. 2) Evaluate the objective function in each chromosome. 3) Select the fittest chromosomes using normalization. 4) Generate next population using double point crossover (with p c probability) and mutation (with p m probability). 5) Get rid of the e worst chromosomes and replace them with the e best from the previous population..

Chromosomes  a b c d Sw 0 Sg 0

Elitism Generation t-1Generation t e best e worst

Other Algorithm’s Properties Double-Point Crossover Double-Point Crossover Roulette-Wheel selection with previous normalization according to the following equation. Roulette-Wheel selection with previous normalization according to the following equation.

4.COMPARISON BETWEEN THE 2 ALGORITHMS

Area of Study used for the Comparison CATCHMENTAREA [km 2 ]Q i -min [mm/month] Q i -max [mm/month] Curibital56, Susagua31, Bogotá (Partial)85, Localization: near Bogotá, Colombia.

Search Spaces kk adcbSw 0 Sg 0 Lower Bound Upper Bound Precision bkbk MAX-MIN Ant System # of genes Simple Genetic Algorithm 201 x 1000 x 900 x 341 x 501 x 501 = 3.6x ( ) = 3.6x10 6

Efficacy Parameters used MM AS m = 150 globUpdate = 10  = 0.95  min = 0.1 GA popSize = 75 elite = 1 p m = 0.1 p c = 0.6 Parameters used MM AS m = 150 globUpdate = 10  = 0.95  min = 0.1 GA popSize = 75 elite = 1 p m = 0.1 p c = 0.7 Parameters used MM AS m = 150 globUpdate = 10  = 0.95  min = 0.1 GA popSize = 75 elite = 1 p m = 0.01 p c = 0.6

Efficiency Parameters used MM AS m = 50 globUpdate = 10  = 0.95  min = 0.1 GA popSize = 50 elite = 1 p m = 0.1 p c = 0.6

Parsimony 1) Distribute randomly m ants on m of the n cities. 2) Let each ant make a random tour and die. 6) Distribute randomly m ants on m of the n cities. 4) Update pheromone trails  ij upon segments (ij) within  max and  min. 7) Let each ant make a complete tour (according to probability p ij ) and die. Update the limit  max. 8) Has the # of iterations ( maxIter) been completed? 3) Calculate  max and set all segments with that pheromone. 5) If an interval of globUpdate iterations has been made, reinforce pheromone trail of the global best found solution. (6) Number of generations maxGen reached? 1) Generate population of popSize chromosomes. 2) Evaluate the objective function in each chromosome. 3) Select the fittest chromosomes using normalization. 4) Generate next population using double point crossover (with p c probability) and mutation (with p m probability). 5) Get rid of the e worst chromosomes and replace them with the e best from the previous population.. Simple GA MAX-MIN AS maxGenmaxIter popSizem eliteglobUpdate pmpm pcpc   min

Parsimony Exploitation Exploration p m globUpdate   min elite

maxGen maxIter popSize m

elite globUpdate Other Parameters: maxGen=750 popSize=75 pm=0.2 pc =0.6 Other Parameters: maxIter= 300 m = 50 r = 0.97 tmin = 0.1

pcpc  pmpm  min maxIter= 300 m = 50 globUpdate = 10 tmin = 0.1 maxIter= 300 m = 50 globUpdate = 10 r = 0.95 :maxIter= 300 m = 50 globUpdate = 10 tmin = 0.1 maxGen = 750 popSize= 75 elite = 1 pc = 0.6

5.CONCLUSIONS

1.Some parameter values can now been taken from the present work for the application of both algorithms to the Thomas Model Calibration Problem 2.The GA showed a much better efficiency than the AS. 3.Research must continue in order to improve the implementation of AS for solving continuous functions.

THANK-YOU