Decomposition spaces Spring 2007, Juris Vīksna. Sample problem - Towers of Hanoi [Adapted from R.Shinghal]

Slides:



Advertisements
Similar presentations
BEST FIRST SEARCH - BeFS
Advertisements

Chapter 4: Informed Heuristic Search
Greedy best-first search Use the heuristic function to rank the nodes Search strategy –Expand node with lowest h-value Greedily trying to find the least-cost.
Traveling Salesperson Problem
GRAPH BALANCING. Scheduling on Unrelated Machines J1 J2 J3 J4 J5 M1 M2 M3.
Informed search algorithms
Informed Search Methods Copyright, 1996 © Dale Carnegie & Associates, Inc. Chapter 4 Spring 2004.
State Space 3 Chapter 4 Heuristic Search. Three Algorithms Backtrack Depth First Breadth First All work if we have well-defined: Goal state Start state.
Solving Problem by Searching
1 Heuristic Search Chapter 4. 2 Outline Heuristic function Greedy Best-first search Admissible heuristic and A* Properties of A* Algorithm IDA*
Search in AI.
Mahgul Gulzai Moomal Umer Rabail Hafeez
Problem Solving by Searching
All rights reservedL. Manevitz Lecture 31 Artificial Intelligence A/O* and Minimax L. Manevitz.
1 Pseudo-polynomial time algorithm (The concept and the terminology are important) Partition Problem: Input: Finite set A=(a 1, a 2, …, a n } and a size.
Cooperating Intelligent Systems Informed search Chapter 4, AIMA.
1 Heuristic Search 4 4.0Introduction 4.1An Algorithm for Heuristic Search 4.2Admissibility, Monotonicity, and Informedness 4.3Using Heuristics in Games.
Informed Search Idea: be smart about what paths to try.
Graphs II Robin Burke GAM 376. Admin Skip the Lua topic.
Heuristic Search In addition to depth-first search, breadth-first search, bound depth-first search, and iterative deepening, we can also use informed or.
Informed State Space Search Department of Computer Science & Engineering Indian Institute of Technology Kharagpur.
AND/OR Graphs Ivan Bratko Faculty of Information and Computer Sc. University of Ljubljana Useful for solving problems by problem decomposition Searching.
Télécom 2A – Algo Complexity (1) Time Complexity and the divide and conquer strategy Or : how to measure algorithm run-time And : design efficient algorithms.
Problem Solving by Searching Search Methods : informed (Heuristic) search.
Problem Reduction Search: AND/OR Graphs & Game Trees Department of Computer Science & Engineering Indian Institute of Technology Kharagpur.
George F Luger ARTIFICIAL INTELLIGENCE 5th edition Structures and Strategies for Complex Problem Solving HEURISTIC SEARCH Luger: Artificial Intelligence,
George F Luger ARTIFICIAL INTELLIGENCE 6th edition Structures and Strategies for Complex Problem Solving HEURISTIC SEARCH Luger: Artificial Intelligence,
Informed Search Methods. Informed Search  Uninformed searches  easy  but very inefficient in most cases of huge search tree  Informed searches  uses.
CS 415 – A.I. Slide Set 6. Chapter 4 – Heuristic Search Heuristic – the study of the methods and rules of discovery and invention State Space Heuristics.
Game Playing. Introduction One of the earliest areas in artificial intelligence is game playing. Two-person zero-sum game. Games for which the state space.
State space representations and search strategies Spring 2007, Juris Vīksna.
Review: Tree search Initialize the frontier using the starting state While the frontier is not empty – Choose a frontier node to expand according to search.
Artificial Intelligence University Politehnica of Bucharest Adina Magda Florea
CS621: Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 5: Power of Heuristic; non- conventional search.
Problem Reduction So far we have considered search strategies for OR graph. In OR graph, several arcs indicate a variety of ways in which the original.
A * Search A* (pronounced "A star") is a best first, graph search algorithm that finds the least-cost path from a given initial node to one goal node out.
State space representations and search strategies - 2 Spring 2007, Juris Vīksna.
Search Techniques CS480/580 Fall Introduction Trees: – Root, parent, child, sibling, leaf node, node, edge – Single path from root to any node Graphs:
A* optimality proof, cycle checking CPSC 322 – Search 5 Textbook § 3.6 and January 21, 2011 Taught by Mike Chiang.
Algorithms for hard problems Introduction Juris Viksna, 2015.
Review for E&CE Find the minimal cost spanning tree for the graph below (where Values on edges represent the costs). 3 Ans. 18.
CS344: Introduction to Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 17– Theorems in A* (admissibility, Better performance.
CS621: Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lectures 18, 19, 20– A* Monotonicity 2 nd, 6 th and 7 th September, 2010.
Explorations in Artificial Intelligence Prof. Carla P. Gomes Module 5 Adversarial Search (Thanks Meinolf Sellman!)
Chapter 3.5 Heuristic Search. Learning Objectives Heuristic search strategies –Best-first search –A* algorithm Heuristic functions.
Dept. Computer Science, Korea Univ. Intelligent Information System Lab A I (Artificial Intelligence) Professor I. J. Chung.
Review: Tree search Initialize the frontier using the starting state
AI Classnotes #5, John Shieh, 2012
Graph Theory and Algorithm 02
Abstraction Transformation & Heuristics
Artificial Intelligence Problem solving by searching CSC 361
Analysis and design of algorithm
Finding Heuristics Using Abstraction
The A* Algorithm Héctor Muñoz-Avila.
James B. Orlin Presented by Tal Kaminker
Lecture 19-Problem Solving 4 Incremental Method
Lecture 8 Heuristic search Motivational video Assignment 2
Problem Solving 4.
Introduction to Artificial Intelligence Lecture 9: Two-Player Games I
Artificial Intelligence Chapter 9 Heuristic Search
X y y = x2 - 3x Solutions of y = x2 - 3x y x –1 5 –2 –3 6 y = x2-3x.
Chap 4: Searching Techniques
Trees and minimum connector problems
HW 1: Warmup Missionaries and Cannibals
Informed Search Idea: be smart about what paths to try.
Heuristic Search Generate and Test Hill Climbing Best First Search
HW 1: Warmup Missionaries and Cannibals
A Guaranteed Bidirectional Search
Informed Search Idea: be smart about what paths to try.
Presentation transcript:

Decomposition spaces Spring 2007, Juris Vīksna

Sample problem - Towers of Hanoi [Adapted from R.Shinghal]

Sample problem - Towers of Hanoi [Adapted from J.Pearl]

Sample problem - Symbolic integration [Adapted from R.Shinghal]

Sample problem - Symbolic integration [Adapted from R.Shinghal]

Sample problem - Block world [Adapted from R.Shinghal]

Sample problem - Block world [Adapted from R.Shinghal]

Sample problem - Block world [Adapted from R.Shinghal]

Sample problem - Block world [Adapted from R.Shinghal]

Sample problem - Coin weighting [Adapted from J.Pearl]

Sample problem - Coin weighting [Adapted from J.Pearl]

Decomposition spaces [Adapted from R.Shinghal]

Decomposition spaces - decomposition space S - set of problems C= {{(x,y 1 ),...,(x,y k )}|x,y i  S}- set of connectors I  S - the initial problem E  S- set of elementary problems U  S- set of unsolvable problems W: C  R + - weight function

Decomposition spaces - decomposition space The problem find a solution tree find a solution tree with minimal weight

Solution tree Definition T(n) is a solution tree for node n, if T(n)={n} and n is an elementary problem T(n) = {T(n 1 ),....,T(n k )}, where T(n 1 ),...,T(n k ) are solution trees for nodes n 1,...,n k and there is a connector {(n,n 1 ),...,(n,n k )}  C

Solution tree Maximum weight We define w(T(n)) as follows: w(T(n)) = 0, if T(n)={n} w(T(n)) = max{w(T(n 1 )),....,w(T(n k ))} + W(c T ), if T(n) = {T(n 1 ),....,T(n k )}, where c T = {(n,n 1 ),...,(n,n k )}  C

Solution tree Summary weight We define w(T(n)) as follows: w(T(n)) = 0, if T(n)={n} w(T(n)) =  {w(T(n 1 )),....,w(T(n k ))} + W(c T ), if T(n) = {T(n 1 ),....,T(n k )}, where c T = {(n,n 1 ),...,(n,n k )}  C

AND/OR graphs [Adapted from J.Pearl]

Heuristics - decomposition space h*(x)- a minimum weight for solution tree T(x) h(x)- heuristic estimate of h*(x)

Potential solution tree - decomposition space A  S - set of already discovered problems T(n) is a potential solution tree for node n, if T(n)={n}, if n  A and the children of n does not belong to A T(n) = {T(n 1 ),....,T(n k )}, where T(n 1 ),...,T(n k ) are potential solution trees for nodes n 1,...,n k and there is a connector {(n,n 1 ),...,(n,n k )}  C

Potential solution tree (Maximum) weight of potential solution tree We define w(T(n)) as follows: w(T(n)) = 0, if T(n)={n} and n is shown to be in E w(T(n)) = h(n), if T(n)={n} and n is not shown to be in E w(T(n)) = max{w(T(n 1 )),....,w(T(n k ))} + W(c T ), if T(n) = {T(n 1 ),....,T(n k )}, where c T = {(n,n 1 ),...,(n,n k )}  C

Potential solution tree (Summary) weight of potential solution tree We define w(T(n)) as follows: w(T(n)) = 0, if T(n)={n} and n is shown to be in E w(T(n)) = h(n), if T(n)={n} and n is not shown to be in E w(T(n)) =  {w(T(n 1 )),....,w(T(n k ))} + W(c T ), if T(n) = {T(n 1 ),....,T(n k )}, where c T = {(n,n 1 ),...,(n,n k )}  C

Most promising solution tree A potential solution tree T(n) is most promising, if it has the minimal weight (of all potential solution trees) We denote the cost of the most promising solution tree by e(n)

AO* algorithm [Adapted from J.Pearl]

Complete search Definition An AO* algorithm is said to be complete if it terminates with a solution when one exists.

Admissible search Definition An AO* algorithm is admissible if it is guaranteed to return an optimal solution (solution tree with minimum possible weight) whenever a solution exists.

Locally finite state spaces Definition A decomposition space is locally finite, if for every x  S, there is only a finite number of y  S such that (x,y)  c for some c  C there exists  > 0 such that for all c  C we have W(c)  .

Completeness of AO* Theorem AO* algorithm is complete on locally finite state spaces.

Admissibility of AO* Definition A heuristic function h is said to be admissible if 0  h(n)  h*(n) for all n  S.

Admissibility of AO* Theorem AO* which uses admissible heuristic function is admissible on locally finite state spaces.

Admissibility of AO* Lemma If AO* uses admissible heuristic function h, then at any time before AO* terminates: e(n)  h*(n) for nodes from Open if n is marked as solved then e(n)=h*(n)

Admissibility of AO* Theorem AO* which uses admissible heuristic function is admissible on locally finite state spaces.

Monotone heuristic functions Definition A heuristic function h is said to be monotone, if h(n)  min max{h(n 1 ),....,h(n k )} + W(c), where the minimum is taken for all c={(n,n 1 ),...,(n,n k )}  C.

Monotone heuristic functions Definition A heuristic function h is said to be monotone, if h(n)  min  {h(n 1 ),....,h(n k )} + W(c), where the minimum is taken for all c={(n,n 1 ),...,(n,n k )}  C.

Monotonicity and admissibility Theorem Every monotone heuristic is also admissible.