G5BAIM Artificial Intelligence Methods

Slides:



Advertisements
Similar presentations
Heuristic Search techniques
Advertisements

Subset of Slides from Lei Li, HongRui Liu, Roberto Lu
G5BAIM Artificial Intelligence Methods
State Space Representation and Search
Tabu Search Strategy Hachemi Bennaceur 5/1/ iroboapp project, 2013.
Artificial Intelligence Lecture
Gizem ALAGÖZ. Simulation optimization has received considerable attention from both simulation researchers and practitioners. Both continuous and discrete.
Spie98-1 Evolutionary Algorithms, Simulated Annealing, and Tabu Search: A Comparative Study H. Youssef, S. M. Sait, H. Adiche
Tabu Search for Model Selection in Multiple Regression Zvi Drezner California State University Fullerton.
MAE 552 – Heuristic Optimization Lecture 24 March 20, 2002 Topic: Tabu Search.
1 Nuno Abreu, Zafeiris Kokkinogenis, Behdad Bozorg, Muhammad Ajmal.
MAE 552 – Heuristic Optimization Lecture 23 March 18, 2002 Topic: Tabu Search.
MAE 552 – Heuristic Optimization
Ant Colony Optimization Optimisation Methods. Overview.
A TABU SEARCH APPROACH TO POLYGONAL APPROXIMATION OF DIGITAL CURVES.
Informed Search Next time: Search Application Reading: Machine Translation paper under Links Username and password will be mailed to class.
Introduction to Simulated Annealing 22c:145 Simulated Annealing  Motivated by the physical annealing process  Material is heated and slowly cooled.
G5BAIM Artificial Intelligence Methods Tabu Search.
Tabu Search Manuel Laguna. Outline Background Short Term Memory Long Term Memory Related Tabu Search Methods.
Metaheuristics The idea: search the solution space directly. No math models, only a set of algorithmic steps, iterative method. Find a feasible solution.
Elements of the Heuristic Approach
T ABU S EARCH Ta-Chun Lien. R EFERENCE Fred G., Manuel L., Tabu Search, Kluwer Academic Publishers, USA(1997)
Escaping local optimas Accept nonimproving neighbors – Tabu search and simulated annealing Iterating with different initial solutions – Multistart local.
Heuristic Optimization Methods
Heuristic Optimization Methods
Tabu Search Glover and Laguna, Tabu search in Pardalos and Resende (eds.), Handbook of Applied Optimization, Oxford Academic Press, 2002 Glover and Laguna,
Tabu Search UW Spring 2005 INDE 516 Project 2 Lei Li, HongRui Liu, Roberto Lu.
Algorithms and their Applications CS2004 ( )
Introduction to search Chapter 3. Why study search? §Search is a basis for all AI l search proposed as the basis of intelligence l inference l all learning.
Heuristic Optimization Methods
Optimization Problems - Optimization: In the real world, there are many problems (e.g. Traveling Salesman Problem, Playing Chess ) that have numerous possible.
Introduction to search Chapter 3. Why study search? §Search is a basis for all AI l search proposed as the basis of intelligence l all learning algorithms,
Escaping Local Optima. Where are we? Optimization methods Complete solutions Partial solutions Exhaustive search Hill climbing Random restart General.
Heuristic Optimization Methods Tabu Search: Advanced Topics.
Heuristic Optimization Methods Greedy algorithms, Approximation algorithms, and GRASP.
FORS 8450 Advanced Forest Planning Lecture 11 Tabu Search.
CAS 721 Course Project Implementing Branch and Bound, and Tabu search for combinatorial computing problem By Ho Fai Ko ( )
FORS 8450 Advanced Forest Planning Lecture 5 Relatively Straightforward Stochastic Approach.
Single-solution based metaheuristics. Outline Local Search Simulated annealing Tabu search …
Reactive Tabu Search Contents A brief review of search techniques
Probabilistic Algorithms Evolutionary Algorithms Simulated Annealing.
Presenter: Leo, Shih-Chang, Lin Advisor: Frank, Yeong-Sung, Lin /12/16.
Optimization Problems
Heuristic Methods for the Single- Machine Problem Chapter 4 Elements of Sequencing and Scheduling by Kenneth R. Baker Byung-Hyun Ha R2.
Preliminary Background Tabu Search Genetic Algorithm.
Intro. ANN & Fuzzy Systems Lecture 37 Genetic and Random Search Algorithms (2)
Escaping Local Optima. Where are we? Optimization methods Complete solutions Partial solutions Exhaustive search Hill climbing Exhaustive search Hill.
Tabu Search Subset of Slides from Lei Li, HongRui Liu, Roberto Lu Edited by J. Wiebe.
General Purpose Procedures Applied to Scheduling
Optimization Problems
Tabu Search Glover and Laguna, Tabu search in Pardalos and Resende (eds.), Handbook of Applied Optimization, Oxford Academic Press, 2002 Glover and Laguna,
CSCI 4310 Lecture 10: Local Search Algorithms
Department of Computer Science
Scientific Research Group in Egypt (SRGE)
Heuristic Optimization Methods
Local Search Algorithms
Tabu Search Review: Branch and bound has a “rigid” memory structure (i.e. all branches are completed or fathomed). Simulated Annealing has no memory structure.
Artificial Intelligence (CS 370D)
Subject Name: Operation Research Subject Code: 10CS661 Prepared By:Mrs
metaheuristic methods and their applications
Study Guide for ES205 Yu-Chi Ho Jonathan T. Lee Nov. 7, 2000
Optimization Problems
Metaheuristic methods and their applications. Optimization Problems Strategies for Solving NP-hard Optimization Problems What is a Metaheuristic Method?
Multi-Objective Optimization
School of Computer Science & Engineering
Subset of Slides from Lei Li, HongRui Liu, Roberto Lu
MOEA Local Search and Coevolution
Artificial Intelligence Search Algorithms
Local Search Algorithms
Stochastic Methods.
Presentation transcript:

G5BAIM Artificial Intelligence Methods Dr. Rong Qu Tabu Search

Characteristics of SA (review) Random selection of a neighbouring solution Probabilistic acceptance of non-improving solutions; The best solution is recorded: Lack of memory of history of search; All the information found during the search is lost;

Tabu Search Proposed independently by Glover (1986) and Hansen (1986) “a meta-heuristic superimposed on another heuristic. The overall approach is to avoid entrapment in cycles by forbidding or penalizing moves which take the solution, in the next iteration, to points in the solution space previously visited (hence tabu).”

Tabu Search (continued) Accepts non-improving solutions deterministically in order to escape from local optima (where all the neighbouring solutions are non-improving) by guiding a steepest descent local search (or steepest ascent hill climbing) algorithm

Tabu Search (continued) After evaluating a number of neighbourhoods, we accept the best one, even if it is low quality on cost function. Accept worse move Uses of memory in two ways: prevent the search from revisiting previously visited solutions; explore the unvisited areas of the solution space; for example,

Tabu Search (continued) Use past experiences to improve current decision making. By using memory (a “tabu list”) to prohibit certain moves - makes tabu search a global optimizer rather than a local optimizer.

Tabu Search vs. Simulated Annealing Accept worse move Selection of neighbourhoods Use of memory

Is memory useful during the search?

Uses of memory during the search? Intelligence needs memory! Information on characteristics of good solutions (or bad solutions!)

Uses of memory during the search? Tabu move – what does it mean? Not allowed to re-visit exact the same state that we’ve been before Discouraging some patterns in solution: e.g. in TSP problem, tabu a state that has the towns listed in the same order that we’ve seen before. If the size of problem is large, lot of time just checking if we’ve been to certain state before.

Uses of memory during the search? Tabu move – what does it mean? Not allowed to return to the state that the search has just come from. just one solution remembered smaller data structure in tabu list

Uses of memory during the search? Tabu move – what does it mean? Tabu a small part of the state In TSP problem, tabu the two towns just been considered in the last move – search is forced to consider other towns.

Uses of memory during the search? In Tabu Search What neighbourhood is What constitute a tabu list

Dangers of memory Exhaustive usage of memory resources Design of efficient data structures to record and access the recorded data efficiently; Hash table Binary tree Memorising information which should not be remembered

Dangers of memory Collecting more data than could be handled: Clear understanding of which attributes of solutions are crucial; Limited selection of attributes of solutions to be memorised; Clear strategy on usage of information or their disposal when not needed;

select the best non-Tabu Tabu Search current solution defined neighborhood select the best non-Tabu neighborhood neighborhood solutions tabu list evaluation cost function

Tabu Search algorithm Function TABU_SEARCH(Problem) returns a solution state Inputs: Problem, a problem Local Variables: Current, a state Next, a state BestSolutionSeen, a state H, a history of visited states

Tabu Search algorithm (cont.) Current = MAKE-NODE(INITIAL-STATE[Problem]) While not terminate Next = a highest-valued successor of Current If(not Move_Tabu(H,Next) or Aspiration(Next)) then Current = Next Update BestSolutionSeen H = Recency(H + Current) Endif End-While Return BestSolutionSeen

Elements of Tabu Search Memory related - recency (How recent the solution has been reached) Tabu List (short term memory): to record a limited number of attributes of solutions (moves, selections, assignments, etc) to be discouraged in order to prevent revisiting a visited solution; Tabu tenure (length of tabu list): number of iterations a tabu move is considered to remain tabu;

Elements of Tabu Search Memory related – recency (How recent the solution has been reached) Tabu tenure List of moves does not grow forever – restrict the search too much Restrict the size of list FIFO Other ways: dynamic

Elements of Tabu Search Memory related – frequency Long term memory: to record attributes of elite solutions to be used in: Diversification: Discouraging attributes of elite solutions in selection functions in order to diversify the search to other areas of solution space; Intensification: giving priority to attributes of a set of elite solutions (usually in weighted probability manner)

Elements of Tabu Search If a move is good, but it’s tabu-ed, do we still reject it? Aspiration criteria: accepting an improving solution even if generated by a tabu move Similar to SA in always accepting improving solutions, but accepting non-improving ones when there is no improving solution in the neighbourhood;

Example: TSP using Tabu Search In our example of TSP: Find the list of towns to be visited so that the travelling salesman will have the shortest route Short term memory: Maintain a list of t towns and prevent them from being selected for consideration of moves for a number of iterations; After a number of iterations, release those towns by FIFO

Example: TSP using Tabu Search In our example of TSP: Long term memory: Maintain a list of t towns which have been considered in the last k best (worst) solutions encourage (or discourage) their selections in future solutions using their frequency of appearance in the set of elite solutions and the quality of solutions which they have appeared in our selection function

Example: TSP using Tabu Search In our example of TSP: Aspiration: If the next moves consider those moves in the tabu list but generate better solution than the current one Accept that solution anyway Put it into tabu list

Tabu Search Pros & Cons Pros Cons Generated generally good solutions for optimisation problems compared with other AI methods Cons Tabu list construction is problem specific No guarantee of global optimal solutions

Summary Use of memory in search Tabu Search algorithm Elements of Tabu Search Example of Tabu Search on TSP

References Glover, F. 1989. Tabu Search – Part I. ORSA Journal on Computing, Vol. 1, No. 3, pp 190-206. Glover, F. 1990. Tabu Search – Part II. ORSA Journal on Computing, Vol. 2, No. 1, pp 4-32. Glover, F., Laguna, M. 1998. Tabu Search. Kluwer Academic Publishers Rayward-Smith, V.J., Osman, I.H., Reeves, C.R., Smith, G.D. 1996. Modern Heuristic Search Methods, John Wiley & Sons. Russell, S., Norvig, P. 1995. Artificial Intelligence A Modern Approach. Prentice-Hall

G5BAIM Artificial Intelligence Methods Dr. Rong Qu End of Tabu Search

SA vs. TS SA TS No. of neighbourhoods considered at each move Accept worse moves? How? Accept better moves? Stopping conditions 1 n Yes P = exp^(-c/t) Yes The best neighbourhood if it is not tabu-ed. Always Always (aspiration) T = 0, or at a low temperature, or No Improvement after certain number of iterations Certain number of iterations, Or No improvement after certain number of iterations