1. cse@buffalo S.C. Shapiro An Intelligent Interface to a GIS Stuart C. Shapiro Professor, CSE Director, SNePS Research Group Member, Center for Cognitive Science Faculty Member, Interdisciplinary MS in Computational Linguistics Faculty Participant, IGERT

2. cse@buffalo S.C. Shapiro Introduction

3. cse@buffalo S.C. Shapiro Long-Term Goal Theory and Implementation of Natural-Language-Competent Computerized Cognitive Agent/Robot and Supporting Research in Artificial Intelligence Cognitive Science Computational Linguistics.

4. cse@buffalo S.C. Shapiro Research Areas Knowledge Representation and Reasoning Cognitive Robotics Natural-Language Understanding Natural-Language Generation.

5. cse@buffalo S.C. Shapiro Goal A computational cognitive agent that can: –Understand and communicate in English; –Discuss specific, generic, and “rule-like” information; –Reason; –Discuss acts and plans; –Sense; –Act; –Maintain a model of itself; –Remember and report what it has sensed and done.

6. cse@buffalo S.C. Shapiro Cassie A computational cognitive agent –Embodied in hardware –or Software-Simulated –Based on SNePS and GLAIR.

7. cse@buffalo S.C. Shapiro SNePS Knowledge Representation and Reasoning –Propositions as Terms SNIP: SNePS Inference Package –Specialized connectives and quantifiers SNeBR: SNePS Belief Revision SNeRE: SNePS Rational Engine Interface Languages –SNePSUL: Lisp-Like –SNePSLOG: Logic-Like –GATN for Fragments of English.

8. cse@buffalo S.C. Shapiro GLAIR Architecture Knowledge Level Perceptuo-Motor Level Sensory-Actuator Level NL Vision Sonar MotionProprioception Grounded Layered Architecture with Integrated Reasoning SNePS

9. cse@buffalo S.C. Shapiro Interaction with Cassie English (Statement, Question, Command) (Current) Set of Beliefs [SNePS] (Updated) Set of Beliefs [SNePS] Actions [SNeRE] (New Belief) [SNePS] English sentence expressing new belief answering question reporting actions Answer [SNIP] GATN Parser GATN Generator Reasoning Clarification Dialogue Looking in World Reasoning

10. cse@buffalo S.C. Shapiro Example Cassies & Worlds

11. cse@buffalo S.C. Shapiro BlocksWorld

12. cse@buffalo S.C. Shapiro FEVAHR

13. cse@buffalo S.C. Shapiro FEVAHRWorld Simulation

14. cse@buffalo S.C. Shapiro UXO Remediation Cassie Corner flag NonUXO object Corner flag UXO Battery meter Corner flag Drop-off zone Field Safe zone Recharging Station

15. cse@buffalo S.C. Shapiro Crystal Space Environment

16. cse@buffalo S.C. Shapiro Princess from “The Trial, The Trail” A VR drama by Josephine Anstey

17. cse@buffalo S.C. Shapiro Vacuum Cleaner Cassie Using Byron Weber Becker’s Java Karel

18. cse@buffalo S.C. Shapiro Magellan Pro TM Mobile Robot from iRobot

19. cse@buffalo S.C. Shapiro A GIS Interface Agent Based on Jun Xu, 2003, Implement an Intelligent ArcView User Interface Using SNePS, Proceeding of the 23rd Annual ESRI User Conference, San Diego, California, July 7-11, 2003. Stuart C. Shapiro, Hans Chalupsky, Hsueh-Cheng Chou, and David M. Mark. Intelligent user interfaces: Connecting ARC/INFO and SNACTor, a semantic network based system for planning actions. In Proceedings of the Twelfth Annual ESRI User Conference, V. 3, pages 151-165. Environmental Systems Research Institute, Redlands, California, 1992.

20. cse@buffalo S.C. Shapiro View1 is a view. Statetheme is a theme. Open view1. Add statetheme to view1.

21. cse@buffalo S.C. Shapiro Add laketheme to view2. Add rivertheme to view2.

22. cse@buffalo S.C. Shapiro Add roadtheme to view1.

23. cse@buffalo S.C. Shapiro Find New York in statetheme. Zoom in statetheme.

24. cse@buffalo S.C. Shapiro Zoom out statetheme. Add citytheme to view1.

25. cse@buffalo S.C. Shapiro Find San Diego in citytheme. Zoom in citytheme. Show table of citytheme.

26. cse@buffalo S.C. Shapiro For More Information Shapiro: http://www.cse.buffalo.edu/~shapiro/ http://www.cse.buffalo.edu/~shapiro/ SNePS Research Group: http://www.cse.buffalo.edu/sneps/ http://www.cse.buffalo.edu/sneps/ –Meets Fridays 9-11, 242 Bell Hall –Join us!