Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:

Slides:



Advertisements
Similar presentations
Heuristic Search techniques
Advertisements

Greedy best-first search Use the heuristic function to rank the nodes Search strategy –Expand node with lowest h-value Greedily trying to find the least-cost.
Traveling Salesperson Problem
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
October 1, 2012Introduction to Artificial Intelligence Lecture 8: Search in State Spaces II 1 A General Backtracking Algorithm Let us say that we can formulate.
5-1 Chapter 5 Tree Searching Strategies. 5-2 Satisfiability problem Tree representation of 8 assignments. If there are n variables x 1, x 2, …,x n, then.
Branch & Bound Algorithms
CSC 423 ARTIFICIAL INTELLIGENCE
Search in AI.
Best-First Search: Agendas
Utilizing Problem Structure in Local Search: The Planning Benchmarks as a Case Study Jőrg Hoffmann Alberts-Ludwigs-University Freiburg.
Algorithm Strategies Nelson Padua-Perez Chau-Wen Tseng Department of Computer Science University of Maryland, College Park.
CPSC 322, Lecture 9Slide 1 Search: Advanced Topics Computer Science cpsc322, Lecture 9 (Textbook Chpt 3.6) January, 23, 2009.
3/25  Monday 3/31 st 11:30AM BYENG 210 Talk by Dana Nau Planning for Interactions among Autonomous Agents.
CPSC 322, Lecture 12Slide 1 CSPs: Search and Arc Consistency Computer Science cpsc322, Lecture 12 (Textbook Chpt ) January, 29, 2010.
MAE 552 – Heuristic Optimization Lecture 27 April 3, 2002
Dealing with NP-Complete Problems
Using Search in Problem Solving
Review Best-first search uses an evaluation function f(n) to select the next node for expansion. Greedy best-first search uses f(n) = h(n). Greedy best.
Ch 13 – Backtracking + Branch-and-Bound
Informed Search Idea: be smart about what paths to try.
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
Classical Planning Chapter 10.
Busby, Dodge, Fleming, and Negrusa. Backtracking Algorithm Is used to solve problems for which a sequence of objects is to be selected from a set such.
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
1 Plan-Space Planning Dr. Héctor Muñoz-Avila Sources: Ch. 5 Appendix A Slides from Dana Nau’s lecture.
(Classical) AI Planning. Some Examples Route search: Find a route between Lehigh University and the Naval Research Laboratory Project management: Construct.
Complexity of Classical Planning Megan Smith Lehigh University CSE 497, Spring 2007.
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
Heuristic Search In addition to depth-first search, breadth-first search, bound depth-first search, and iterative deepening, we can also use informed or.
Informed State Space Search Department of Computer Science & Engineering Indian Institute of Technology Kharagpur.
Design and Analysis of Algorithms - Chapter 111 How to tackle those difficult problems... There are two principal approaches to tackling NP-hard problems.
Chapter 12 Coping with the Limitations of Algorithm Power Copyright © 2007 Pearson Addison-Wesley. All rights reserved.
Informed (Heuristic) Search
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
Search with Costs and Heuristic Search 1 CPSC 322 – Search 3 January 17, 2011 Textbook §3.5.3, Taught by: Mike Chiang.
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
Lecture 3: Uninformed Search
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
Automated Planning Dr. Héctor Muñoz-Avila. What is Planning? Classical Definition Domain Independent: symbolic descriptions of the problems and the domain.
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
Artificial Intelligence University Politehnica of Bucharest Adina Magda Florea
Goal-based Problem Solving Goal formation Based upon the current situation and performance measures. Result is moving into a desirable state (goal state).
Introduction to Artificial Intelligence Class 1 Planning & Search Henry Kautz Winter 2007.
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
Slides by: Eric Ringger, adapted from slides by Stuart Russell of UC Berkeley. CS 312: Algorithm Design & Analysis Lecture #36: Best-first State- space.
A* optimality proof, cycle checking CPSC 322 – Search 5 Textbook § 3.6 and January 21, 2011 Taught by Mike Chiang.
Ch. 3 – Search Supplemental slides for CSE 327 Prof. Jeff Heflin.
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
CSCE350 Algorithms and Data Structure Lecture 21 Jianjun Hu Department of Computer Science and Engineering University of South Carolina
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
CPSC 322, Lecture 5Slide 1 Uninformed Search Computer Science cpsc322, Lecture 5 (Textbook Chpt 3.5) Sept, 13, 2013.
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
By J. Hoffmann and B. Nebel
Causal-link planning 1 Jim Blythe. 2 USC INFORMATION SCIENCES INSTITUTE Causal Link Planning The planning problem Inputs: 1. A description of the world.
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
Heuristic Search Planners. 2 USC INFORMATION SCIENCES INSTITUTE Planning as heuristic search Use standard search techniques, e.g. A*, best-first, hill-climbing.
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
Dept. Computer Science, Korea Univ. Intelligent Information System Lab A I (Artificial Intelligence) Professor I. J. Chung.
Last time: Problem-Solving
Searching for Solutions
Chapter 6 Planning-Graph Techniques
Informed Search Idea: be smart about what paths to try.
UNINFORMED SEARCH -BFS -DFS -DFIS - Bidirectional
The Rich/Knight Implementation
Informed Search Idea: be smart about what paths to try.
Lecture 4: Tree Search Strategies
The Rich/Knight Implementation
Presentation transcript:

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 1 Chapter 9 Heuristics in Planning Lecture slides for Automated Planning: Theory and Practice Dana S. Nau University of Maryland 2:53 PM October 7, 2015

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 2 Planning as Nondeterministic Search

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 3 Making it Deterministic

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 4 Digression: the A* algorithm (on trees) Suppose we’re searching a tree in which each edge (s,s') has a cost c(s,s')  If p is a path, let c(p) = sum of the edge costs  For classical planning, this is the length of p For every state s, let  g(s) = cost of the path from s 0 to s  h*(s) = least cost of all paths from s to goal nodes  f*(s) = g(s) + h*(s) = least cost of all paths from s 0 to goal nodes that go through s Suppose h(s) is an estimate of h*(s)  Let f(s) = g(s) + h(s) »f(s) is an estimate of f*(s)  h is admissible if for every state s, 0 ≤ h(s) ≤ h*(s)  If h is admissible then f is a lower bound on f* g(s) h*(s)

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 5 The A* Algorithm A* on trees: loop choose the leaf node s such that f(s) is smallest if s is a solution then return it and exit expand it (generate its children) On graphs, A* is more complicated  additional machinery to deal with multiple paths to the same node If a solution exists (and certain other conditions are satisfied), then:  If h(s) is admissible, then A* is guaranteed to find an optimal solution  The more “informed” the heuristic is (i.e., the closer it is to h*), the smaller the number of nodes A* expands  If h(s) is within c of being admissible, then A* is guaranteed to find a solution that’s within c of optimal g(s) h*(s)

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 6 Hill Climbing Use h as a node-selection heuristic  Select the node v in C for which h(v) is smallest Why not use f ? Do we care whether h is admissible? u C

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 7 FastForward (FF) Depth-first search Selection heuristic: relaxed Graphplan  Let v be a node in C  Let P v be the planning problem of getting from v to a goal  use Graphplan to find a solution for a relaxation of P v  The length of this solution is a lower bound on the length of a solution to P v u C

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 8 Selection Heuristic Given a planning problem P v, create a relaxed planning problem P' v and use GraphPlan to solve it  Convert to set-theoretic representation »No negative literals; goal is now a set of atoms  Remove the delete lists from the actions  Construct a planning graph until a layer is found that contains all of the goal atoms  The graph will contain no mutexes because the delete lists were removed  Extract a plan π' from the planning graph »No mutexes  no backtracking  polynomial time |π'| is a lower bound on the length of the best solution to P v

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 9 FastForward FF evaluates all the nodes in the set C of u’s successors If none of them has a better heuristic value than u, FF does a breadth-first search for a state with a strictly better evaluation The path to the new state is added to the current plan, and the search continues from this state Works well because plateaus and local minima tend to be small in many benchmark planning problems Can’t guarantee how fast FF will find a solution, or how good a solution it will find  However, it works pretty well on many problems

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 10 AIPS-2000 Planning Competition FastForward did quite well In the this competition, all of the planning problems were classical problems Two tracks:  “Fully automated” and “hand-tailored” planners  FastForward participated in the fully automated track »It got one of the two “outstanding performance” awards  Large variance in how close its plans were to optimal »However, it found them very fast compared with the other fully-automated planners

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: International Planning Competition Among the automated planners, FastForward was roughly in the middle LPG (graphplan + local search) did much better, and got a “distinguished performance of the first order” award It’s interesting to see how FastForward did in problems that went beyond classical planning »Numbers, optimization Example: Satellite domain, numeric version  A domain inspired by the Hubble space telescope (a lot simpler than the real domain, of course) »A satellite needs to take observations of stars »Gather as much data as possible before running out of fuel  Any amount of data gathered is a solution »Thus, FastForward always returned the null plan

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: International Planning Competition FastForward’s author was one of the competition chairs  Thus FastForward did not participate

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 13 Refine = select next flaw to work on Branch = generate resolvers Prune = remove some of the resolvers nondeterministic choice = resolver selection Plan-Space Planning

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 14 Must eventually resolve all of the flaws, regardless of which one we choose first  an “AND” branch Flaw Selection

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 15 The search space is an AND/OR tree Deciding what flaw to work on next = serializing this tree (turning it into a state-space tree)  at each AND branch, choose a child to expand next, and delay expanding the other children Serializing and AND/OR Tree …… … Operator o 1 Operator o n … Goal g 1 Goal g 2 Constrain variable v Order tasks Partial plan p Goal g 1 Operator o 1 Operator o n Partial plan p 1 Partial plan p n …… Goal g 2 Constrain variable v Order tasks …… Goal g 2 Constrain variable v Order tasks

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 16 One Serialization

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 17 Another Serialization

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 18 Why Does This Matter? Different refinement strategies produce different serializations  the search spaces have different numbers of nodes In the worst case, the planner will search the entire serialized search space The smaller the serialization, the more likely that the planner will be efficient One pretty good heuristic: fewest alternatives first

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 19 A Pretty Good Heuristic Fewest Alternatives First (FAF)  Choose the flaw that has the smallest number of alternatives  In this case, unestablished precondition g 1

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 20 How Much Difference Can the Refinement Strategy Make? Case study: build an AND/OR graph from repeated occurrences of this pattern: b Example:  number of levels k = 3  branching factor b = 2 Analysis:  Total number of nodes in the AND/OR graph is n =  (b k )  How many nodes in the best and worst serializations?

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 21 Case Study, Continued The best serialization contains  (b 2 k ) nodes The worst serialization contains  (2 k b 2 k ) nodes  The size differs by an exponential factor  But both serializations are doubly exponentially large This limits how good any flaw-selection heuristic can do  To do better, need good ways to do node selection, branching, pruning

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 22 This is an “or” branch Resolver Selection

Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License: 23