Parallel Cooperative Optimization Research Group

Slides:



Advertisements
Similar presentations
Local optimization technique G.Anuradha. Introduction The evaluation function defines a quality measure score landscape/response surface/fitness landscape.
Advertisements

Local Search Algorithms
G5BAIM Artificial Intelligence Methods
Local Search Algorithms Chapter 4. Outline Hill-climbing search Simulated annealing search Local beam search Genetic algorithms Ant Colony Optimization.
Neural and Evolutionary Computing - Lecture 4 1 Random Search Algorithms. Simulated Annealing Motivation Simple Random Search Algorithms Simulated Annealing.
Multi-Objective Optimization NP-Hard Conflicting objectives – Flow shop with both minimum makespan and tardiness objective – TSP problem with minimum distance,
Tabu Search Strategy Hachemi Bennaceur 5/1/ iroboapp project, 2013.
Genetic Algorithms Contents 1. Basic Concepts 2. Algorithm
CPSC 322, Lecture 16Slide 1 Stochastic Local Search Variants Computer Science cpsc322, Lecture 16 (Textbook Chpt 4.8) February, 9, 2009.
Spie98-1 Evolutionary Algorithms, Simulated Annealing, and Tabu Search: A Comparative Study H. Youssef, S. M. Sait, H. Adiche
Local search algorithms
Local search algorithms
Two types of search problems
Local Search and Stochastic Algorithms Solution tutorial 4.
Introduction to Artificial Intelligence Local Search (updated 4/30/2006) Henry Kautz.
MAE 552 – Heuristic Optimization
A TABU SEARCH APPROACH TO POLYGONAL APPROXIMATION OF DIGITAL CURVES.
Simulated Annealing Van Laarhoven, Aarts Version 1, October 2000.
Introduction to Simulated Annealing 22c:145 Simulated Annealing  Motivated by the physical annealing process  Material is heated and slowly cooled.
Ant Colony Optimization: an introduction
Metaheuristics The idea: search the solution space directly. No math models, only a set of algorithmic steps, iterative method. Find a feasible solution.
Software framework for metaheuristics Parallel Cooperative Optimization Research Group Laboratoire d’Informatique Fondamentale de Lille
Elements of the Heuristic Approach
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
An Introduction to Artificial Life Lecture 4b: Informed Search and Exploration Ramin Halavati In which we see how information.
Algorithms and their Applications CS2004 ( )
Design & Analysis of Algorithms Combinatory optimization SCHOOL OF COMPUTING Pasi Fränti
1 Simulated Annealing Contents 1. Basic Concepts 2. Algorithm 3. Practical considerations.
Simulated Annealing.
Course: Logic Programming and Constraints
G5BAIM Artificial Intelligence Methods
Single-solution based metaheuristics. Outline Local Search Simulated annealing Tabu search …
Probabilistic Algorithms Evolutionary Algorithms Simulated Annealing.
Ant Algorithm and its Applications for Solving Large Scale Optimization Problems on Parallel Computers Stefka Fidanova Institute for Information and Communication.
Tutorial on ParadisEO: Parallel Models for the TSP
Local search algorithms In many optimization problems, the state space is the space of all possible complete solutions We have an objective function that.
Heuristic Methods for the Single- Machine Problem Chapter 4 Elements of Sequencing and Scheduling by Kenneth R. Baker Byung-Hyun Ha R2.
Local Search Algorithms and Optimization Problems
CPSC 322, Lecture 16Slide 1 Stochastic Local Search Variants Computer Science cpsc322, Lecture 16 (Textbook Chpt 4.8) Oct, 11, 2013.
Intro. ANN & Fuzzy Systems Lecture 37 Genetic and Random Search Algorithms (2)
Escaping Local Optima. Where are we? Optimization methods Complete solutions Partial solutions Exhaustive search Hill climbing Exhaustive search Hill.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
Local Search Algorithms CMPT 463. When: Tuesday, April 5 3:30PM Where: RLC 105 Team based: one, two or three people per team Languages: Python, C++ and.
Constraints Satisfaction Edmondo Trentin, DIISM. Constraint Satisfaction Problems: Local Search In many optimization problems, the path to the goal is.
Local search algorithms In many optimization problems, the path to the goal is irrelevant; the goal state itself is the solution State space = set of "complete"
1 Genetic Algorithms Contents 1. Basic Concepts 2. Algorithm 3. Practical considerations.
Scientific Research Group in Egypt (SRGE)
Optimization via Search
CSCI 4310 Lecture 10: Local Search Algorithms
Heuristic Optimization Methods
Van Laarhoven, Aarts Version 1, October 2000
آموزش شبکه عصبی با استفاده از روش بهینه سازی PSO
School of Computer Science & Engineering
Local Search Algorithms
Tabu Search Review: Branch and bound has a “rigid” memory structure (i.e. all branches are completed or fathomed). Simulated Annealing has no memory structure.
B. Jayalakshmi and Alok Singh 2015
Artificial Intelligence (CS 370D)
Subject Name: Operation Research Subject Code: 10CS661 Prepared By:Mrs
Design Space Exploration
CS621: Artificial Intelligence
metaheuristic methods and their applications
Metaheuristic methods and their applications. Optimization Problems Strategies for Solving NP-hard Optimization Problems What is a Metaheuristic Method?
Multi-Objective Optimization
School of Computer Science & Engineering
Design & Analysis of Algorithms Combinatorial optimization
More on Search: A* and Optimization
Stochastic Local Search Variants Computer Science cpsc322, Lecture 16
Local Search Algorithms
Local Search Algorithms
Simulated Annealing & Boltzmann Machines
Presentation transcript:

Parallel Cooperative Optimization Research Group ParadisEO-MO : software framework for single solution-based metaheuristics http://paradiseo.gforge.inria.fr Laboratoire d’Informatique Fondamentale de Lille

Outline Algorithms in ParadisEO-MO 1.1 : Hill climbing Simulated Annealing Tabu search Iterated local search Hybridization with ParadisEO-EO. What’s next in ParadisEO-MO 1.2 ?

Design concepts Single solution metaheurisitcs  neighbourhood exploration. Generating another solution ?  disturbing the current solution  make a movement. Base of ParadisEO-MO = moMove.

Delta = - d(2,1) – d (5,3) + d(2, 5) + d(1, 3) Move chosen : Two-Opt Two points within the string are selected and the segment between them is inverted. This operator put in two new edges in the tour. 4 4 2 1 5 3 4 1 1 2 5 1 3 4 2 5 2 5 3 3 Delta = - d(2,1) – d (5,3) + d(2, 5) + d(1, 3)

Available algorithms Tabu Search Simulated Annealing Iterated local search Hill Climbing

Hill Climbing

Designing a Hill Climbing Designing a move operator, its features. Designing/implementing the operator to build the first move (and implicitly the first neighbor). Designing/implementing the operator to update a given move to its successor. Designing/implementing the incremental evaluation function. Choosing the neighbor selection strategy. No continuation criterion (stopping as a local optimum is reached).

Move selection strategies Hill Climbing class To build the next move Full evaluation function To build the first move To compute the fitness delta Move selection strategies

Move selection strategies Hill Climbing class To build the next move To build the first move To compute the fitness delta Move selection strategies

Move selection strategies Hill Climbing class To build the next move To compute the fitness delta Move selection strategies

Move selection strategies Hill Climbing class To compute the fitness delta Move selection strategies

Move selection strategies Hill Climbing class Move selection strategies

Hill Climbing class

Hill Climbing class

Simulated Annealing

How can a Simulated Annealing be built ? Could be reused from Hill Climbing Designing a move operator, its features. Designing/implementing the operator to build a random candidate move. Designing/implementing the incremental evaluation function. Choosing the cooling schedule strategy. Independent of the tackled problem

Simulated Annealing class Full evaluation function To compute the fitness delta Stopping criterion between two temperature updates Random move generator Cooling schedule strategy

Simulated Annealing class Stopping criterion between two temperature updates Random move generator Cooling schedule strategy

Simulated Annealing class Stopping criterion betwenn two temperature updates Cooling schedule strategy

Simulated Annealing class Stopping criterion between two temperature updates

Simulated Annealing class

Simulated Annealing class

Tabu Search

How can Tabu Search be built ? Design a move operator, its features. Design/implement the operator to build the first move (and implicitly the first neighbor). Design/implement the operator to update a given move to its successor. Design/implement the incremental evaluation function. Choosing the Tabu List. Choosing the aspiration criterion. Choosing the continuation criterion. Could be reused from Hill Climbing Independent of the tackled problem

Tabu Search class To build the next move Full evaluation function To build the first move To compute the fitness delta Aspiration criterion Continuation criterion Tabu List

Continuation criterion Tabu Search class Aspiration criterion Continuation criterion Tabu List

Continuation criterion Tabu Search class Continuation criterion Tabu List

Continuation criterion Tabu Search class Continuation criterion

Tabu Search class

Tabu Search class

Iterated local search

Designing an iterative local search Design/implement the operator to make a perturbation on a solution. Design/implement a local search Choosing the solution comparator. Choosing the continuation criterion. Could be reused from Hill Climbing Independent of the tackled problem

Iterated local search class A solution perturbation A local search A solution comparator A stopping criterion

Iterated local search class A local search A solution comparator A stopping criterion

Iterated local search class A solution comparator A stopping criterion

Iterated local search class A stopping criterion

Iterated local search class

Iterated local search class

Hybridizing allows to combine: EO & MO  Hybridizing Hybridizing allows to combine: The exploration power of population-based metaheuristics. The intensification power of single solution-based metaheurisitcs.

Scheme of an EA in ParadisEO-EO

ParadisEO-EO/ParadisEO-MO link

Hybrid EA

ParadisEO-MO 1.2 ?

Thank you for your attention Any questions ? Thank you for your attention Multi-objective metaheuristics ???  ParadisEO-MOEO. Parallel and distributed metaheuristics ???  ParadisEO-PEO. ParadisEO web site: http://paradiseo.gforge.inria.fr OPAC team web site: http://www.lifl.fr/OPAC