2.  Christel Kemke 2007/08 COMP 4060 Natural Language Processing Flakey A Communicating Agent

3. 2007/08  Christel Kemke Flakey - A Communicating Agent  Flakey as Communicating Agent  Case Frame Representation  Concrete and Generic Actions  Effects of Actions  Inference / Reasoning  Two Types of Questions

4. 2007/08  Christel Kemke Intelligent Agent - Flakey Flakey is a mobile robot at Stanford Research Institute (SRI) can navigate and plan its path has visual perception understands speech and language does complex reasoning its "Master" is Kurt Konolige

5. 2007/08  Christel Kemke Flakey Flakey's BackFlakey's Front

6. 2007/08  Christel Kemke Flakey in Action runb.mpeg

7. 2007/08  Christel Kemke Flakey as Communicating Agent "Flakey, bring this file to Karen." verb determiner noun preposition noun Noun Phrase Prepositional Phrase inf-V NP PP agent action patiens recipient listener head direct object indirect object

8. 2007/08  Christel Kemke Case Frames for Representing NL "Flakey, bring this file to Karen.” head direct object indirect object case frame action: bringhead-verb patiens: file-1direct object recipient: Karen indirect object

9. 2007/08  Christel Kemke Mapping Case Frames to Actions robot action precondition: have (Flakey, file1) action: bring (Flakey, file1, Karen) effect: not (have (Flakey, file1)) and have (Karen, file1) case frame agent:Flakey action: bringhead patiens: file-1direct object recipient: Karen indirect object

10. 2007/08  Christel Kemke Concrete and Generic Actions concrete "bring" action (generated instance) precondition: have (Flakey, file1) action: give (Flakey, file1, Karen) effect: not (have (Flakey, file1)) and have (Karen, file1) generic "bring" action (stored concept) precondition: have (agent, object) action: give (agent, object, recipient) effect: not (have (agent, object)) and (have (recipient, object))

11. 2007/08  Christel Kemke Effects of Actions - Change KB Preconditions and effects specify world states. World states are stored in the knowledge base (KB). concrete action: bring (Flakey, file1, Karen) precondition: have (Flakey, file1) effect: not (have (Flakey, file1)) and have (Karen, file1) effect of this action delete from KB have (Flakey, file1) add to KB have (Karen, file1)

12. 2007/08  Christel Kemke Flakey - Reasoning, Inference Integrate General Rules (Axioms; Theory) Reasoning / Inference have (Flakey, object)  at (Flakey, here)  at (object, here) have (Karen, file1)  at (Karen, Karen's-office)  at (file1, Karen's-office) Axiom  x  y  loc: (have (x, y)  (at (x, loc)  at (y, loc)))

13. Flakey - Question Answering I “Flakey, where did you bring the file.” case frame action: bring patiens: file1 destination: ? Compare to stored case frames: case frame action: bring patiens: file1 destination: Karen Conclusion and answer: “I brought the file to Karen.”

14. Flakey - Question Answering II Q: “Flakey, where is the file.” case frame action/status: is subject: the fileidentify with file1 location: ? refers to loc of file1 Access dynamic KB (world state) Stored from effect of bring-action or pre-stored:... at (file1, Karen),... have (Karen, file1),... A: “The file is at Karen.” or "Karen has the file."

15. 2007/08  Christel Kemke Conclusion Artificial Intelligence and Agents Flakey - Example Natural Language Processing Reasoning

16. 2007/08  Christel Kemke References Christel Kemke, COMP 4190 Artificial Intelligence, http://www.cs.umanitoba.ca/~comp4190 http://www.cs.umanitoba.ca/~comp4190 Stuart Russell and Peter Norvig, Artificial Intelligence – A Modern Approach, Prentice Hall, 1995 & 2003 SRI Video Archives, http://www.ai.sri.com/videos/ PBS Video on Flakey, http://vvi.onstreammedia.com/cgi-bin/visearch?user=pbs- saf&template=template.html&query=flakey&category=0& viKeyword=flakey&submit=Search