Hill-climbing Search Goal: Optimizing an objective function.

Slides:



Advertisements
Similar presentations
Heuristic Search techniques
Advertisements

Local optimization technique G.Anuradha. Introduction The evaluation function defines a quality measure score landscape/response surface/fitness landscape.
Local Search Algorithms
Optimization with Constraints
CS6800 Advanced Theory of Computation
PROBLEM SOLVING AND SEARCH
Search in Python Chapter 3.
© J. Christopher Beck Lecture 17: Tabu Search.
Informed search algorithms
Heuristic Search Chapter 3.
Local search algorithms
Local search algorithms
Two types of search problems
MAE 552 – Heuristic Optimization Lecture 27 April 3, 2002
Local Search and Stochastic Algorithms Solution tutorial 4.
MAE 552 – Heuristic Optimization Lecture 4 January 30, 2002.
Machine Learning and Review Reading: C Bayesian Approach  Each observed training example can incrementally decrease or increase probability of.
Search  Exhaustive/Blind Search Methods Depth First Search Breadth First Search  Heuristic Methods Hill Climbing Beam Search Best First Search…
Informed Search Next time: Search Application Reading: Machine Translation paper under Links Username and password will be mailed to class.
Traveling Salesman Problem Continued. Heuristic 1 Ideas? –Go from depot to nearest delivery –Then to delivery closest to that –And so on until we are.
Ch. 11: Optimization and Search Stephen Marsland, Machine Learning: An Algorithmic Perspective. CRC 2009 some slides from Stephen Marsland, some images.
Informed Search Methods
Escaping local optimas Accept nonimproving neighbors – Tabu search and simulated annealing Iterating with different initial solutions – Multistart local.
Busby, Dodge, Fleming, and Negrusa. Backtracking Algorithm Is used to solve problems for which a sequence of objects is to be selected from a set such.
Vilalta&Eick: Informed Search Informed Search and Exploration Search Strategies Heuristic Functions Local Search Algorithms Vilalta&Eick: Informed Search.
Informed Search Chapter 4 (b)
Dr.Abeer Mahmoud ARTIFICIAL INTELLIGENCE (CS 461D) Dr. Abeer Mahmoud Computer science Department Princess Nora University Faculty of Computer & Information.
Probabilistic Roadmaps for Path Planning in High-Dimensional Configuration Spaces (1996) L. Kavraki, P. Švestka, J.-C. Latombe, M. Overmars.
Escaping Local Optima. Where are we? Optimization methods Complete solutions Partial solutions Exhaustive search Hill climbing Random restart General.
A RTIFICIAL I NTELLIGENCE UNIT : 2 Search Techniques.
Local Search Algorithms
Local Search Pat Riddle 2012 Semester 2 Patricia J Riddle Adapted from slides by Stuart Russell,
For Wednesday Read chapter 6, sections 1-3 Homework: –Chapter 4, exercise 1.
For Wednesday Read chapter 5, sections 1-4 Homework: –Chapter 3, exercise 23. Then do the exercise again, but use greedy heuristic search instead of A*
Local Search and Optimization Presented by Collin Kanaley.
Search (continued) CPSC 386 Artificial Intelligence Ellen Walker Hiram College.
Iterative Improvement Search Including Hill Climbing, Simulated Annealing, WALKsat and more....
Lecture 6 – Local Search Dr. Muhammad Adnan Hashmi 1 24 February 2016.
Heuristic Search  Best First Search –A* –IDA* –Beam Search  Generate and Test  Local Searches –Hill Climbing  Simple Hill Climbing  Steepest Ascend.
Intro. ANN & Fuzzy Systems Lecture 37 Genetic and Random Search Algorithms (2)
Escaping Local Optima. Where are we? Optimization methods Complete solutions Partial solutions Exhaustive search Hill climbing Exhaustive search Hill.
Department of Computer Science Lecture 5: Local Search
Informed Search. S B AD E C F G straight-line distances h(S-G)=10 h(A-G)=7 h(D-G)=1 h(F-G)=1 h(B-G)=10 h(E-G)=8 h(C-G)=20 The graph above.
Local Search Algorithms CMPT 463. When: Tuesday, April 5 3:30PM Where: RLC 105 Team based: one, two or three people per team Languages: Python, C++ and.
1 Intro to AI Local Search. 2 Intro to AI Local search and optimization Local search: –use single current state & move to neighboring states Idea: –start.
Eick: Informed Search Informed Search and Exploration Search Strategies Heuristic Functions Local Search Algorithms Vilalta&Eick: Informed Search.
Dept. Computer Science, Korea Univ. Intelligent Information System Lab A I (Artificial Intelligence) Professor I. J. Chung.
Informed Search Chapter 4 (b)
Informed Search Chapter 4 (b)
School of Computer Science & Engineering
CSCI 4310 Lecture 10: Local Search Algorithms
Informed Search Chapter 4 (b)
CS 326A: Motion Planning Probabilistic Roadmaps for Path Planning in High-Dimensional Configuration Spaces (1996) L. Kavraki, P. Švestka, J.-C. Latombe,
School of Computer Science & Engineering
For Monday Chapter 6 Homework: Chapter 3, exercise 7.
Computer Science cpsc322, Lecture 14
Artificial Intelligence (CS 370D)
Heuristic search INT 404.
CS Fall 2016 (Shavlik©), Lecture 9, Week 5
Informed Search Chapter 4 (b)
School of Computer Science & Engineering
Lecture 9: Tabu Search © J. Christopher Beck 2005.
Design & Analysis of Algorithms Combinatorial optimization
More on Search: A* and Optimization
Artificial Intelligence
More on HW 2 (due Jan 26) Again, it must be in Python 2.7.
More on HW 2 (due Jan 26) Again, it must be in Python 2.7.
First Exam 18/10/2010.
Heuristic Optimization Methods Calculus and Optimization
CSC 380: Design and Analysis of Algorithms
Presentation transcript:

Hill-climbing Search Goal: Optimizing an objective function. Can be applied to “goal” predicate type of problems. BSAT with objective function number of clauses satisfied. Intuition: Always move to a better state

Some Hill-Climbing Algo’s Start State = empty state or random state or special state Until (no improvement) Steepest Ascent: find best successor OR (greedy): select first improving successor Go to that successor Repeat the above process some number of times (Restarts). Can be done with partial solutions or full solutions.

Local (Iterative) Improving Initial state = full candidate solution Random or “nearest neighbor selection” Greedy hill-climbing: if up, do it if flat, probabilistically decide to accept move Not necessary for homework Otherwise need to limit number of flat moves if down, don’t do it We are gradually expanding the possible moves.

TSP Notes Only use “up” moves It is not necessary to compute the entire tour lengths after an operator applies. Instead compute change in length- most of the path length stays the same. You keep applying the operators until no improvement occurs.

Uncross Problem