I1-[OntoSpace] Ontologies for Spatial Communication John Bateman, Kerstin Fischer, Reinhard Moratz Scott Farrar, Thora Tenbrink.

Slides:



Advertisements
Similar presentations
Berliner XML Tage. Humboldt Universität zu Berlin, Oktober 2004 SWEB2004 – Intl Workshop on Semantic Web Technologies in Electronic Business Intelligent.
Advertisements

ISWC Doctoral Symposium Monday, 7 November 2005
MMAP Middle School Math Through Applications Project Dahwun Deepak Gazi Scott Sun-Young.
Architecture Representation
ENTERFACE’08 Multimodal Communication with Robots and Virtual Agents.
Empirical and Data-Driven Models of Multimodality Advanced Methods for Multimodal Communication Computational Models of Multimodality Adequate.
Chapter 1 Introduction. “How do I send picture by ?” “Click on Attach button, or paper clip icon, select the picture and click attach” The instructions.
Environmental Adaptation Proposal for September 2006 CMU-Boeing Experiments.
Dialogue – Driven Intranet Search Suma Adindla School of Computer Science & Electronic Engineering 8th LANGUAGE & COMPUTATION DAY 2009.
Realizing OPM Philosophy in the Context of Full Life- Cycle Support Avi Soffer Technion, Israel Institute of Technology Thesis Advisor: Prof. Dov Dori.
Object-Oriented Analysis and Design
I1-[OntoSpace] Ontologies for Spatial Communication John Bateman, Kerstin Fischer, Reinhard Moratz Scott Farrar, Thora Tenbrink.
CS652 Spring 2004 Summary. Course Objectives  Learn how to extract, structure, and integrate Web information  Learn what the Semantic Web is  Learn.
John Hu Nov. 9, 2004 Multimodal Interfaces Oviatt, S. Multimodal interfaces Mankoff, J., Hudson, S.E., & Abowd, G.D. Interaction techniques for ambiguity.
Knowledge Acquisitioning. Definition The transfer and transformation of potential problem solving expertise from some knowledge source to a program.
Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,
Provisional draft 1 ICT Work Programme Challenge 2 Cognition, Interaction, Robotics NCP meeting 19 October 2006, Brussels Colette Maloney, PhD.
Introduction to Systems CSCI102 - Systems ITCS905 - Systems MCS Systems.
Intelligent User Interfaces Research Group Directed by: Frank Shipman.
Annotating Documents for the Semantic Web Using Data-Extraction Ontologies Dissertation Proposal Yihong Ding.
Spatial Language in Human-Robot Interaction Thora Tenbrink Project I1-OntoSpace.
PRAGMATICS. 3- Pragmatics is the study of how more gets communicated than is said. It explores how a great deal of what is unsaid is recognized. 4.
Second Language Acquisition and Real World Applications Alessandro Benati (Director of CAROLE, University of Greenwich, UK) Making.
Systems Engineering Foundations of Software Systems Integration Peter Denno, Allison Barnard Feeney Manufacturing Engineering Laboratory National Institute.
1212 Management and Communication of Distributed Conceptual Design Knowledge in the Building and Construction Industry Dr.ir. Jos van Leeuwen Eindhoven.
Course Instructor: Aisha Azeem
Building the Design Studio of the Future Aaron Adler Jacob Eisenstein Michael Oltmans Lisa Guttentag Randall Davis October 23, 2004.
Domain-Specific Software Engineering Alex Adamec.
Statistical Natural Language Processing. What is NLP?  Natural Language Processing (NLP), or Computational Linguistics, is concerned with theoretical.
OntoNav: A Semantic Indoor Navigation System Pervasive Computing Research Group, Communication Networks Laboratory (CNL), Dept. of Informatics & Telecommunications,
Knowledge Mediation in the WWW based on Labelled DAGs with Attached Constraints Jutta Eusterbrock WebTechnology GmbH.
PSY 369: Psycholinguistics Language Production & Comprehension: Conversation & Dialog.
Carlos Lamsfus. ISWDS 2005 Galway, November 7th 2005 CENTRO DE TECNOLOGÍAS DE INTERACCIÓN VISUAL Y COMUNICACIONES VISUAL INTERACTION AND COMMUNICATIONS.
Ontology Matching Basics Ontology Matching by Jerome Euzenat and Pavel Shvaiko Parts I and II 11/6/2012Ontology Matching Basics - PL, CS 6521.
Introduction to Behavior- Based Robotics Based on the book Behavior- Based Robotics by Ronald C. Arkin.
Ontology Alignment/Matching Prafulla Palwe. Agenda ► Introduction  Being serious about the semantic web  Living with heterogeneity  Heterogeneity problem.
Role-plays for CALL: System Architecture and Resources Sabrina Wilske & Magdalena Wolska Saarland University ICL, Villach, September.
Working group on multimodal meaning representation Dagstuhl workshop, Oct
APML, a Markup Language for Believable Behavior Generation Soft computing Laboratory Yonsei University October 25, 2004.
Learning Science and Mathematics Concepts, Models, Representations and Talk Colleen Megowan.
PERVASIVE COMPUTING MIDDLEWARE BY SCHIELE, HANDTE, AND BECKER A Presentation by Nancy Shah.
© DATAMAT S.p.A. – Giuseppe Avellino, Stefano Beco, Barbara Cantalupo, Andrea Cavallini A Semantic Workflow Authoring Tool for Programming Grids.
Towards multimodal meaning representation Harry Bunt & Laurent Romary LREC Workshop on standards for language resources Las Palmas, May 2002.
Learning Automata based Approach to Model Dialogue Strategy in Spoken Dialogue System: A Performance Evaluation G.Kumaravelan Pondicherry University, Karaikal.
Towards A Context-Based Dialog Management Layer for Expert Systems Victor Hung, Avelino Gonzalez & Ronald DeMara Intelligent Systems Laboratory University.
Information Systems Engineering. Lecture Outline Information Systems Architecture Information System Architecture components Information Engineering Phases.
Jan 9, 2004 Symposium on Best Practice LSA, Boston, MA 1 Comparability of language data and analysis Using an ontology for linguistics Scott Farrar, U.
PSY 369: Psycholinguistics Conversation & Dialog: Language Production and Comprehension in conjoined action.
A Context Model based on Ontological Languages: a Proposal for Information Visualization School of Informatics Castilla-La Mancha University Ramón Hervás.
DenK and iCat Two Projects on Cooperative Electronic Assistants (CEA’s) Robbert-Jan Beun, Rogier van Eijk & Huub Prüst Department of Information and Computing.
Ontology-Based Computing Kenneth Baclawski Northeastern University and Jarg.
Using RouteGraphs as an Appropriate Data Structure for Navigational Tasks SFB/IQN-Kolloquium Christian Mandel, A1-[RoboMap] Overview Goal scenario.
Intelligent Robot Architecture (1-3)  Background of research  Research objectives  By recognizing and analyzing user’s utterances and actions, an intelligent.
Chapter 6 – Architectural Design Lecture 1 1Chapter 6 Architectural design.
Chapter 10. The Explorer System in Cognitive Systems, Christensen et al. Course: Robots Learning from Humans On, Kyoung-Woon Biointelligence Laboratory.
Ontologies for spatial reasoning, action and interaction Basic problem statement, techniques under development, and plans John Bateman & Till Mossakowski.
Personalized Recommendation of Related Content Based on Automatic Metadata Extraction Andreas Nauerz 1, Fedor Bakalov 2, Birgitta.
Companion Cognitive Systems: A Step toward Human-Level AI
Fluid Concept Architectures An experimentation platform.
The “Spatial Turing Test” Stephan Winter, Yunhui Wu
John Bateman – University of Bremen Some (more) Burning Issues for Ontology Initiatives.
Semantic Data Extraction for B2B Integration Syntactic-to-Semantic Middleware Bruno Silva 1, Jorge Cardoso 2 1 2
“Intelligent User Interfaces” by Hefley and Murray.
1 Adaptive Data Access Interface for STEP Model Repositories- support AEC product lifecycle management Frank Wang Donghoon Yang Chuck Eastman.
WP6 Emotion in Interaction Embodied Conversational Agents WP6 core task: describe an interactive ECA system with capabilities beyond those of present day.
1. Relating Human Markup Language to the Web Services Component Model 1.0 The Human Markup Language-HumanML Codifying Human Characteristics  Basic XML.
Data Grids, Digital Libraries and Persistent Archives: An Integrated Approach to Publishing, Sharing and Archiving Data. Written By: R. Moore, A. Rajasekar,
Visual Information Retrieval
Pervasive Computing Happening?
Intelligent User Interfaces
Presentation transcript:

I1-[OntoSpace] Ontologies for Spatial Communication John Bateman, Kerstin Fischer, Reinhard Moratz Scott Farrar, Thora Tenbrink

2 I1-[OntoSpace] user Rolland Pioneer Provision of natural dialogic interaction concerning user tasks in a spatial context presentation of spatial information communication of spatially-situated actions Focusing on RE-USABILITY of components and EXTENSIBILITY of approach producing NON-TASK SPECIFIC solutions Motivation

3 I1-[OntoSpace] Difficulties different perceptual systems of human and robot: necessity of mediation discourse situation influences linguistic choices determining factors as yet unknown

4 I1-[OntoSpace] Two problem areas for investigation Complexity of negotiating spatial relations Variability of reference systems Discoursal negotiation processes Situational factors Unfamiliarity of interaction situation Communication with an artificial interlocutor Choice of linguistic expressions No knowledge about robot‘s functionalities

5 I1-[OntoSpace] Reference systems Intrinsic: Localisation of object by reference to the intrinsic properties of another entity, e.g. speaker‘s front: “The ball is in front of me” Relative: Presence of relatum required: “The ball is in front of the table” Group-based reference if one of several similar objects is referred to: “The leftmost ball” Absolute: the earth‘s cardinal directions (north, south)

6 I1-[OntoSpace] Perspectives Speaker-centered: Intrinsic: “The ball is in front of me” Relative: “From my point of view, the ball is to the right of the table” Absolute: “to the north of me” Listener-centered: Intrinsic: “The ball is in front of you” Relative: “From your point of view, the ball is to the right of the table” Absolute: “to the north of you”

7 I1-[OntoSpace] Our approach Elicitation of data in experimental settings analysis of linguistic choices in relation to situational parameters (spatial settings and tasks; robot appearance and behavior) Integration in a single functioning system modeling of dialogue mechanisms achieving flexibility of interpretation by modularity Ontology mapping Flexibility of mapping mechanisms required: the discourse model informs how the domain model concept is to be subordinated in a given context

8 I1-[OntoSpace] user Empirical Investigation linguistic negotiation alignment, shaping, grounding conceptualization of spatial agents register, conceptualization, shaping spatial configurations group-based, routes and landmarks, consistency and frames

9 I1-[OntoSpace] speech recognition agents speech recognition output interface where is the beer? analysis component (CG based: string  semantic representation) dialog m a n a g e r generation component speech synthesis agents string with speech synthesis markup in the fridge! Architectural overview (I1/I3)

10 I1-[OntoSpace] speech recognition agents speech recognition output interface where is the beer? analysis component (CG based: string  semantic representation) dialog m a n a g e r generation component speech synthesis agents string with speech synthesis markup in the fridge! Architectural overview (I1/I3)

11 I1-[OntoSpace] analysis component dialog m a n a g e r generation component Architectural overview (I1/I3)

12 I1-[OntoSpace] analysis component dialog m a n a g e r generation component Architectural overview (I1/I3) conceptual linguistic frame of reference linguistic tasks non-linguistic tasks

13 I1-[OntoSpace] Inter-ontology mediation: Close relationship but not identity conceptual linguistic frame of reference linguistic tasks non-linguistic tasks

14 I1-[OntoSpace] SPATIAL REPRESENTATIONSLINGUISTIC REPRESENTATIONS Solution method pursued Achieving interaction between system modules using ONTOLOGIES DOMAINS ONTOLOGIES inter-ontology mediation

15 I1-[OntoSpace] SPATIAL SPACE-INTERVALSPACESPACE-POINT ZERO-D-LOCATION THREE-D-LOCATION ONE-OR-TWO-D-LOCATION Mann, Matthiessen, Bateman, Moore, Kasper, Arens (1985) Upper Model Ontology (small extract) in on at Chat-80 ontology (small extract) Warren and Pereira GEOGRAPHICAL FEATURE AREAPOINTLINE BRIDGE TOWN inter-ontology mediation ? on the bridge* on the town along the bridge* along the town across the bridge* across the town at the bridge at the town * in the bridge in the town Task-dependent mediation required

16 I1-[OntoSpace] I1: Targetted results development of a comprehensive spatial ontology development of linguistic ontology for handling linguistic tasks representation of all ontologies in OWL and CASL specifications specification of principles and methods for inter-ontology mappings specification of discourse-history and robot- conceptualisation conditionalistions of the mappings

17 I1-[OntoSpace] Interest areas spatial ontology linguistic ontology ontology formalisation dialogic linguistic HRI contextual conditioning of linguistic interaction and linguistic form

18 I1-[OntoSpace] Distribution of labour with respect to dialog functionality Human Language Technology Computational Dialogue Components Empirical investigation of dialogue properties Development of spatial and linguistic ontologies I3-[SharC] I1-[OntoSpace] Ontology specification and processing I4-[SPIN]