Reporter : Mac Date : 2012.01.03 Multi-Start Method Rafael Marti.

Slides:



Advertisements
Similar presentations
Algorithm Design Techniques
Advertisements

Local optimization technique G.Anuradha. Introduction The evaluation function defines a quality measure score landscape/response surface/fitness landscape.
Population-based metaheuristics Nature-inspired Initialize a population A new population of solutions is generated Integrate the new population into the.
G5BAIM Artificial Intelligence Methods
1 An Adaptive GA for Multi Objective Flexible Manufacturing Systems A. Younes, H. Ghenniwa, S. Areibi uoguelph.ca.
Multi-Objective Optimization NP-Hard Conflicting objectives – Flow shop with both minimum makespan and tardiness objective – TSP problem with minimum distance,
Gizem ALAGÖZ. Simulation optimization has received considerable attention from both simulation researchers and practitioners. Both continuous and discrete.
Institute of Intelligent Power Electronics – IPE Page1 Introduction to Basics of Genetic Algorithms Docent Xiao-Zhi Gao Department of Electrical Engineering.
CPSC 322, Lecture 16Slide 1 Stochastic Local Search Variants Computer Science cpsc322, Lecture 16 (Textbook Chpt 4.8) February, 9, 2009.
Date:2011/06/08 吳昕澧 BOA: The Bayesian Optimization Algorithm.
Ryan Kinworthy 2/26/20031 Chapter 7- Local Search part 1 Ryan Kinworthy CSCE Advanced Constraint Processing.
GREEDY RANDOMIZED ADAPTIVE SEARCH PROCEDURES Reporter : Benson.
February 2002Parallel GRASP for the 2-path network design problem Slide 1/25 (ROADEF) 4 èmes Journées de la ROADEF Paris, February 20-22, 2002 A Parallel.
Learning From Data Chichang Jou Tamkang University.
Chapter 10: Algorithm Design Techniques
A TABU SEARCH APPROACH TO POLYGONAL APPROXIMATION OF DIGITAL CURVES.
Evolutionary Computational Intelligence Lecture 8: Memetic Algorithms Ferrante Neri University of Jyväskylä.
Genetic Algorithms Nehaya Tayseer 1.Introduction What is a Genetic algorithm? A search technique used in computer science to find approximate solutions.
D Nagesh Kumar, IIScOptimization Methods: M1L4 1 Introduction and Basic Concepts Classical and Advanced Techniques for Optimization.
Scatter search for project scheduling with resource availability cost Jia-Xian Zhu.
Ant Colony Optimization: an introduction
Tabu Search Manuel Laguna. Outline Background Short Term Memory Long Term Memory Related Tabu Search Methods.
Metaheuristics The idea: search the solution space directly. No math models, only a set of algorithmic steps, iterative method. Find a feasible solution.
Elements of the Heuristic Approach
T ABU S EARCH Ta-Chun Lien. R EFERENCE Fred G., Manuel L., Tabu Search, Kluwer Academic Publishers, USA(1997)
Genetic Algorithms Overview Genetic Algorithms: a gentle introduction –What are GAs –How do they work/ Why? –Critical issues Use in Data Mining –GAs.
Island Based GA for Optimization University of Guelph School of Engineering Hooman Homayounfar March 2003.
Escaping local optimas Accept nonimproving neighbors – Tabu search and simulated annealing Iterating with different initial solutions – Multistart local.
Ranga Rodrigo April 6, 2014 Most of the sides are from the Matlab tutorial. 1.
Genetic Algorithms and Ant Colony Optimisation
Efficient Model Selection for Support Vector Machines
Stochastic Algorithms Some of the fastest known algorithms for certain tasks rely on chance Stochastic/Randomized Algorithms Two common variations – Monte.
Heuristic Optimization Methods
Tabu Search UW Spring 2005 INDE 516 Project 2 Lei Li, HongRui Liu, Roberto Lu.
GRASP: A Sampling Meta-Heuristic
Design & Analysis of Algorithms Combinatory optimization SCHOOL OF COMPUTING Pasi Fränti
Optimization Problems - Optimization: In the real world, there are many problems (e.g. Traveling Salesman Problem, Playing Chess ) that have numerous possible.
(Particle Swarm Optimisation)
Heuristic Optimization Methods Tabu Search: Advanced Topics.
Heuristic Optimization Methods Scatter Search. 2 Agenda Scatter Search (SS) –For Local Search based Metaheuristics: SA based on ideas from nature TS based.
Derivative Free Optimization G.Anuradha. Contents Genetic Algorithm Simulated Annealing Random search method Downhill simplex method.
Heuristic Optimization Methods Greedy algorithms, Approximation algorithms, and GRASP.
Christoph F. Eick: Using EC to Solve Transportation Problems Transportation Problems.
Taguchi. Abstraction Optimisation of manufacturing processes is typically performed utilising mathematical process models or designed experiments. However,
CAS 721 Course Project Implementing Branch and Bound, and Tabu search for combinatorial computing problem By Ho Fai Ko ( )
FORS 8450 Advanced Forest Planning Lecture 5 Relatively Straightforward Stochastic Approach.
Single-solution based metaheuristics. Outline Local Search Simulated annealing Tabu search …
1 Genetic Algorithms and Ant Colony Optimisation.
Genetic Algorithms Przemyslaw Pawluk CSE 6111 Advanced Algorithm Design and Analysis
Introducing Mixtures of Generalized Mallows in Estimation of Distribution Algorithms Josian Santamaria Josu Ceberio Roberto Santana Alexander Mendiburu.
Reactive Tabu Search Contents A brief review of search techniques
LOG740 Heuristic Optimization Methods Local Search / Metaheuristics.
METAHEURISTIC Jacques A. Ferland Department of Informatique and Recherche Opérationnelle Université de Montréal
Hub Location–Allocation in Intermodal Logistic Networks Hüseyin Utku KIYMAZ.
Local Search. Systematic versus local search u Systematic search  Breadth-first, depth-first, IDDFS, A*, IDA*, etc  Keep one or more paths in memory.
Optimization in Engineering Design 1 Introduction to Non-Linear Optimization.
Warehouse Lending Optimization Paul Parker (2016).
Introduction to genetic algorithm
Meta-heuristics Introduction - Fabien Tricoire
C.-S. Shieh, EC, KUAS, Taiwan
Tabu Search Review: Branch and bound has a “rigid” memory structure (i.e. all branches are completed or fathomed). Simulated Annealing has no memory structure.
Subject Name: Operation Research Subject Code: 10CS661 Prepared By:Mrs
metaheuristic methods and their applications
Metaheuristic methods and their applications. Optimization Problems Strategies for Solving NP-hard Optimization Problems What is a Metaheuristic Method?
Multi-Objective Optimization
Design & Analysis of Algorithms Combinatorial optimization
The use of Neural Networks to schedule flow-shop with dynamic job arrival ‘A Multi-Neural Network Learning for lot Sizing and Sequencing on a Flow-Shop’
Market-based Dynamic Task Allocation in Mobile Surveillance Systems
EE368 Soft Computing Genetic Algorithms.
Heuristic Optimization Methods
Presentation transcript:

Reporter : Mac Date : Multi-Start Method Rafael Marti

1.Introduction Search method based in local optimization need some type of diversification. Multi-Start method. Re-Start mechanisms

2.Oeveview Two phases Generation Search Pseudo-code

2.Overview Tabu Search Adaptive memory design. Use different memory function to design restarting mechanisms. Adaptive memory strategies Combinatorial optimization problems. Based on memory structure.

2.Overview Devoted to the Monte Carlo random re-start in the context of nonlinear unconstrained optimization. Combine Monte Carlo method with LS. Reduce the number of complete local search increase the probability that they start from points close to the global optimum

2.Overview Genetic Algorithms Use TSP for testing Generation, Combination, Local Search Stop Criteria Number of initial solutions generated Number of objective function evaluations

2.Overview 6 benchmark problem TSP, JSP, knapsack, bin packing, neural network weight optimization, numerical function optimization. Multiple restart stochastic hill-climbing(MRSH) solutions are represented with strings local search based on random flip of bits

2.Overview GRASP Unconstrained global optimization Quasirandom samples Inexpensive local search terminates when no new local minimum is found after several iterations

2.Overview Clustering Adaptive Multi Start method (CAMS) Solve VLSI. a set of random starting points and local search adaptive starting points that are central to the best local minimum solutions found so far

2.Overview Enhance multi-start approaches strongly determined and consistent variables Strongly determined variables Value can’t be changed without significantly eroding consistent variables receives a particular value in a significant portion of good solutions. Based on Tabu Search framework

2.Overview For Capacitated Minimum Spanning Tree Problem Adaptive Reasoning Techniques, proposed in the tabu search framework able to learn about, and modify the behavior of a primary greedy heuristic. Path Relinking within GRASP

3.Classification Memory identify elements that are common to good previously generated solutions Memory-less It is not as unreasonable as might be imagined since the construction of “unconnected” solutions may be interpreted as a means of strategically sampling the solution space.

3.Classification Randomized solutions are generated in a random way Systematic solutions are generated in a deterministic way Combine Randomized and Systematic GRASP

3.Classification Degree of Rebuild Rebuild Build

3.1 Diversity Measures 1. Calculate the median position of each element i in the solutions in P. 2. Calculate the dissimilarity of each solution in the population with respect to the median solution 3. Calculate d as the sum of all the individual dissimilarities.

3.1 Diversity Measures Cal 1 Case 2

3.1 Diversity Measures The notion of influence introduced by Glover (1990) in the context of Tabu Search The influence considers the potential and the structure of a solution in the search process. conclusion

4.Computational Experiments linear ordering problem (LOP) Matrix of weight : Maximize the sum of the weight in the upper triangle

4.Computational Experiments

G5, G4, G2, G1, DG, RND, G6, G3, MIX and FQ. The weight of quality and diversity is equivalent

5.Conclusion The objective of this study has been to extend and advance the knowledge associated to implementing multi-start procedures. It has not yet become widely implemented and tested as a metaheuristic itself for solving complex optimization problems