Planning II CSE 573. © Daniel S. Weld 2 Logistics Reading for Wed Ch 18 thru 18.3 Office Hours No Office Hour Today.

Slides:



Advertisements
Similar presentations
Language for planning problems
Advertisements

Planning Module THREE: Planning, Production Systems,Expert Systems, Uncertainty Dr M M Awais.
Causal-link Planning II José Luis Ambite. 2 CS 541 Causal Link Planning II Planning as Search State SpacePlan Space AlgorithmProgression, Regression POP.
Constraint Based Reasoning over Mutex Relations in Graphplan Algorithm Pavel Surynek Charles University, Prague Czech Republic.
Planning Module THREE: Planning, Production Systems,Expert Systems, Uncertainty Dr M M Awais.
CLASSICAL PLANNING What is planning ?  Planning is an AI approach to control  It is deliberation about actions  Key ideas  We have a model of the.
1 Graphplan José Luis Ambite * [* based in part on slides by Jim Blythe and Dan Weld]
Plan Generation & Causal-Link Planning 1 José Luis Ambite.
Planning with Constraints Graphplan & SATplan Yongmei Shi.
Graph-based Planning Brian C. Williams Sept. 25 th & 30 th, J/6.834J.
Planning Graphs * Based on slides by Alan Fern, Berthe Choueiry and Sungwook Yoon.
For Monday Finish chapter 12 Homework: –Chapter 13, exercises 8 and 15.
Planning CSE 473 Chapters 10.3 and 11. © D. Weld, D. Fox 2 Planning Given a logical description of the initial situation, a logical description of the.
Artificial Intelligence 2005/06
AI – Week AI Planning – Plan Generation Algorithms: GraphPlan Lee McCluskey, room 2/09
Planning Copyright, 1996 © Dale Carnegie & Associates, Inc. Chapter 11.
Artificial Intelligence Chapter 11: Planning
Planning: Part 3 Planning Graphs COMP151 April 4, 2007.
Planning CSE 473. © Daniel S. Weld Topics Agency Problem Spaces Search Knowledge Representation Reinforcement Learning InferencePlanning Supervised.
1 Approaches to Agent Control zAgent senses world, acts to affect world zReactive Control ySet of situation-action rules yE.g. x1) if dog-is-behind-me.
Knowledge Representation II CSE 573. © Daniel S. Weld 2 Logistics Reading for Monday ??? Office Hours No Office Hour Next Monday (10/25) Bonus Office.
Planning II CSE 473. © Daniel S. Weld 2 Logistics Tournament! PS3 – later today Non programming exercises Programming component: (mini project) SPAM detection.
1 Logistics z1 Handout yCopies of my slides zReading yRecent Advances in AI Planning, sections 1-2.
1 Planning Chapters 11 and 12 Thanks: Professor Dan Weld, University of Washington.
Dynamic Bayesian Networks CSE 473. © Daniel S. Weld Topics Agency Problem Spaces Search Knowledge Representation Reinforcement Learning InferencePlanningLearning.
Classical Planning via State-space search COMP3431 Malcolm Ryan.
An Introduction to Artificial Intelligence CE Chapter 11 – Planning Ramin Halavati In which we see how an agent can take.
Classical Planning Chapter 10.
GraphPlan Alan Fern * * Based in part on slides by Daniel Weld and José Luis Ambite.
For Wednesday Read chapter 12, sections 3-5 Program 2 progress due.
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
Dana Nau: Lecture slides for Automated Planning Licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License:
CSE 473 Automated Planning Dan Weld (With slides by UW AI faculty & Dana Nau I have a plan - a plan that cannot possibly fail. - Inspector Clousseau.
For Monday Read chapter 12, sections 1-2 Homework: –Chapter 10, exercise 3.
Partial Order Planning 1 Brian C. Williams J/6.834J Sept 16 th, 2002 Slides with help from: Dan Weld Stuart Russell & Peter Norvig.
AI Lecture 17 Planning Noémie Elhadad (substituting for Prof. McKeown)
Partial Order Plan Execution 1 Brian C. Williams J/6.834J Sept. 16 th, 2002 Slides with help from: Dan Weld Stuart Russell & Peter Norvig.
Introduction to Artificial Intelligence Class 1 Planning & Search Henry Kautz Winter 2007.
© Daniel S. Weld 1 Logistics PS3 Project Additional problem Reading Planning & CSP for “today” SAT plan paper review for Wed.
Classical Planning Chapter 10 Mausam / Andrey Kolobov (Based on slides of Dan Weld, Marie desJardins)
Graphplan.
© Daniel S. Weld 1 Logistics Travel Wed class led by Mausam Week’s reading R&N ch17 Project meetings.
Graphplan: Fast Planning through Planning Graph Analysis Avrim Blum Merrick Furst Carnegie Mellon University.
Planning I: Total Order Planners Sections
Automated Planning and Decision Making Prof. Ronen Brafman Automated Planning and Decision Making Graphplan Based on slides by: Ambite, Blyth and.
Graphplan CSE 574 April 4, 2003 Dan Weld. Schedule BASICS Intro Graphplan SATplan State-space Refinement SPEEDUP EBL & DDB Heuristic Gen TEMPORAL Partial-O.
Causal-link planning 1 Jim Blythe. 2 USC INFORMATION SCIENCES INSTITUTE Causal Link Planning The planning problem Inputs: 1. A description of the world.
Outline for 4/11 Bayesian Networks Planning. 2 Sources of Uncertainty Medical knowledge in logic? –Toothache Cavity Problems –Too many exceptions to any.
1 Chapter 6 Planning-Graph Techniques. 2 Motivation A big source of inefficiency in search algorithms is the branching factor  the number of children.
Planning Chapter11 Bayesian Networks (Chapters 14,15)
An Introduction to Artificial Intelligence CE 40417
Fast Propositional Algorithms for Planning
Planning as Satisfiability
Planning as Search State Space Plan Space Algorihtm Progression
Classical Planning via State-space search
Sequential Stochastic Models
Class #17 – Thursday, October 27
Planning José Luis Ambite.
Graph-based Planning Slides based on material from: Prof. Maria Fox
Graphplan/ SATPlan Chapter
Planning CSE 473 AIMA, 10.3 and 11.
Planning CSE 573 A handful of GENERAL SEARCH TECHNIQUES lie at the heart of practically all work in AI We will encounter the SAME PRINCIPLES again and.
Class #19 – Monday, November 3
Chapter 6 Planning-Graph Techniques
Graphplan/ SATPlan Chapter
Graphplan/ SATPlan Chapter
GraphPlan Jim Blythe.
An Introduction to Planning Graph
Graph-based Planning Slides based on material from: Prof. Maria Fox
[* based in part on slides by Jim Blythe and Dan Weld]
Presentation transcript:

Planning II CSE 573

© Daniel S. Weld 2 Logistics Reading for Wed Ch 18 thru 18.3 Office Hours No Office Hour Today

© Daniel S. Weld Topics Agency Problem Spaces Search Knowledge Representation & Inference Planning Supervised Learning Logic-BasedProbabilistic Reinforcement Learning

© Daniel S. Weld 4 Planning Description of initial state of world E.g., Set of propositions: ((block a) (block b) (block c) (on-table a) (on- table b) (clear a) (clear b) (clear c) (arm-empty)) Description of goal: i.e. set of worlds or… E.g., Logical conjunction Any world satisfying conjunction is a goal (and (on a b) (on b c))) Description of available actions Sequence of Actions Input: Output:

© Daniel S. Weld 5 STRIPS Representation Simplifying assumptions Atomic time Agent is omniscient (no sensing necessary). Agent is sole cause of change Actions have deterministic effects STRIPS representation World = set of true propositions Actions: Precondition: (conjunction of literals) Effects (conjunction of literals)

© Daniel S. Weld 6 Action Schemata (:operator pick-up :parameters ((block ?ob1)) :precondition (and (clear ?ob1) (on-table ?ob1) (arm-empty)) :effect (and (not (clear ?ob1)) (not (on-table ?ob1)) (not (arm-empty)) (holding ?ob1))) Instead of defining: pickup-A and pickup-B and … Define a schema: Note: strips doesn’t allow derived effects; you must be complete! }

© Daniel S. Weld 7 Planning Outline The planning problem Representation Compilation to SAT Searching world states Regression Heuristics Graphplan Reachability analysis & heuristics Planning under uncertainty

© Daniel S. Weld 8 Planning as Search Nodes Arcs Initial State Goal State World states Action executions The state satisfying the complete description of the initial conds Any state satisfying the goal propositions

© Daniel S. Weld 9 Forward-Chaining World-Space Search A C B C B A Initial State Goal State

© Daniel S. Weld 10 Backward-Chaining Search Thru Space of Partial World-States D C B A E D C B A E D C B A E * * * Problem: Many possible goal states are equally acceptable. From which one does one search? A C B Initial State is completely defined D E

© Daniel S. Weld 11 Planning as Search - Backward Nodes Arcs Initial State Goal State A conjunctive goal (“set of goals”) Regression of goal through action defn The goal of the planning problem A set of goals  the planning problem’s initial description

© Daniel S. Weld 12 Regression Regressing a goal, G, thru an action, A Yields the weakest precondition G’ Such that: if G’ is true before A is executed G is guaranteed to be true afterwards A G precond effect G’ Represents a set of world states

© Daniel S. Weld 13 Regression Example pick-up :parameters ((block ?ob1)) :precondition (and (clear ?ob1) (on-table ?ob1) (arm-empty)) :effect (and (not (clear ?ob1)) (not (on-table ?ob1)) (not (arm-empty)) (holding ?ob1))) A G precond effect G’ (and (holding C) (on A B)) (and (clear C) (on-table C) (arm-empty) (on A B)) Disjunction  preconditions

© Daniel S. Weld 14 Conditional Effects

© Daniel S. Weld 15 Regressing Conditional Effects A G precond effect G’ (and (at keys home) (at paycheck bank)) (and (at briefcase bank) (in keys briefcase) (not (in paycheck briefcase)) (at paycheck bank)) bank home

© Daniel S. Weld 16 Heuristics Raise issue Defer until…

© Daniel S. Weld 17 Planning Outline The planning problem Representation Compilation to SAT Searching world states Regression Heuristics Graphplan Reachability analysis & heuristics Planning under uncertainty

© Daniel S. Weld 18 Graphplan Phase 1 - Graph Expansion Necessary (insufficient) conditions for plan existence Local consistency of plan-as-CSP Phase 2 - Solution Extraction Variables action execution at a time point Constraints goals, subgoals achieved no side-effects between actions

© Daniel S. Weld 19 The Plan Graph … … … level 0level 2level 4level 6 level 1level 3level 5 propositions actions propositions actions

© Daniel S. Weld 20 Graph Expansion Proposition level 0 initial conditions Action level i no-op for each proposition at level i-1 action for each operator instance whose preconditions exist at level i-1 Proposition level i effects of each no-op and action at level i … … … … i-1ii+10

© Daniel S. Weld 21 Constructing the planning graph… Initial proposition layer Just the initial conditions Action layer i If all of an action’s preconds are in i-1 Then add action to layer I Nop actions have P as precond and effect Proposition layer i+1 For each action at layer i Add all its effects at layer i+1

© Daniel S. Weld 22

© Daniel S. Weld 23 Mutual Exclusion Two actions are mutex if one clobbers the other’s effects or preconditions they have mutex preconditions Two proposition are mutex if all ways of achieving them are mutex

© Daniel S. Weld 24 Mutual Exclusion Actions A,B exclusive (at a level) if A deletes B’s precond, or B deletes A’s precond, or A & B have inconsistent preconds Propositions P,Q inconsistent (at a level) if all ways to achieve P exclude all ways to achieve Q

© Daniel S. Weld 25 Graphplan Create level 0 in planning graph Loop If goal  contents of highest level (nonmutex) Then search graph for solution If find a solution then return and terminate Else extend graph one more level A kind of double search: forward direction checks necessary (but insufficient) conditions for a solution,... Backward search verifies...

© Daniel S. Weld 26 Searching for a Solution For each goal G at time t For each action A making G Select A unless mutex with previously chosen action If no actions work, backup to last G (breadth first search) Recurse on preconditions of actions selected, t-1 Proposition Init State Action Time 1 Proposition Time 1 Action Time 2

© Daniel S. Weld 27 Searching for a solution If goals are present & non-mutex: Choose action to achieve each goal Add preconditions to next goal set Recurse!

© Daniel S. Weld 28 Dinner Date Initial Conditions: (:and (cleanHands) (quiet)) Goal: (:and (noGarbage) (dinner) (present)) Actions: (:operator carry :precondition :effect (:and (noGarbage) (:not (cleanHands))) (:operator dolly :precondition :effect (:and (noGarbage) (:not (quiet))) (:operator cook :precondition (cleanHands) :effect (dinner)) (:operator wrap :precondition (quiet) :effect (present))

© Daniel S. Weld 29 Planning Graph noGarb cleanH quiet dinner present carry dolly cook wrap cleanH quiet 0 Prop 1 Action 2 Prop 3 Action 4 Prop

© Daniel S. Weld 30 Are there any exclusions? noGarb cleanH quiet dinner present carry dolly cook wrap cleanH quiet 0 Prop 1 Action 2 Prop 3 Action 4 Prop

© Daniel S. Weld 31 Do we have a solution? noGarb cleanH quiet dinner present carry dolly cook wrap cleanH quiet 0 Prop 1 Action 2 Prop 3 Action 4 Prop

© Daniel S. Weld 32 Extend the Planning Graph noGarb cleanH quiet dinner present carry dolly cook wrap carry dolly cook wrap cleanH quiet noGarb cleanH quiet dinner present 0 Prop 1 Action 2 Prop 3 Action 4 Prop

© Daniel S. Weld 33 Searching Backwards noGarb cleanH quiet dinner present carry dolly cook wrap carry dolly cook wrap cleanH quiet noGarb cleanH quiet dinner present 0 Prop 1 Action 2 Prop 3 Action 4 Prop

© Daniel S. Weld 34 One (of 4) Possibilities noGarb cleanH quiet dinner present carry dolly cook wrap carry dolly cook wrap cleanH quiet noGarb cleanH quiet dinner present 0 Prop 1 Action 2 Prop 3 Action 4 Prop

© Daniel S. Weld 35 Graphplan Solution Extraction as a Constraint Network Not carry & cook Not dolly & wrap Vars = Domain = Constraints =

© Daniel S. Weld 36 Review: Arc- & Path-Consistency Connect with graph construction What is k?

© Daniel S. Weld 37 Blackbox SAT Encoding … … … level 0level 2level 4level 6 level 1level 3level 5 propositions actions propositions actions

© Daniel S. Weld 38 Heuristics for Regression Planning