Spatio-Temporal Visual Ontology VL 2011, 15.09.2011, Brighton, UK. Spatio-Temporal Visual Ontology Dr Joanna Isabelle Olszewska

Contents Ontology Definition Spatio-Temporal Visual Ontology (STVO) VL 2011, 15.09.2011, Brighton, UK. Contents Ontology Definition Spatio-Temporal Visual Ontology (STVO) Motivation Concepts Relations Application: STVO-Coupled Active Contours Experiments Evaluation Conclusions

Ontology Definitions In Philosophy (IVth century BC) In AI (1980’s) VL 2011, 15.09.2011, Brighton, UK. Ontology Definitions In Philosophy (IVth century BC) « study of being »  In AI (1980’s) specific vocabulary used to describe a certain reality + a set of explicit assumptions regarding the meaning of the vocabulary In Computer Science (1993) « specification of a conceptualization »

Spatio-Temporal Visual Ontology VL 2011, 15.09.2011, Brighton, UK. Spatio-Temporal Visual Ontology Motivation mapping of low-level descriptor values to higher-level semantics bridging the gap between visual features and semantic knowledge

Spatio-Temporal Visual Ontology VL 2011, 15.09.2011, Brighton, UK. Spatio-Temporal Visual Ontology Concepts

Spatio-Temporal Visual Ontology VL 2011, 15.09.2011, Brighton, UK. Spatio-Temporal Visual Ontology Relations Spatial Topological relations: Region Connection Calculus (RCC-8) relations Directional relative postions: o’clock intra and inter-object relations Relative distances (close/far relations) Temporal Visual RCC-8 topological relations O’clock inter-object spatial relations O’clock intra-object spatial relations

STVO-Coupled Active Contours VL 2011, 15.09.2011, Brighton, UK. STVO-Coupled Active Contours Experiments

STVO-Coupled Active Contours VL 2011, 15.09.2011, Brighton, UK. STVO-Coupled Active Contours Evaluation Precision of detection Precision of answers = # correct contours / # targets Frame 1216 PAC GAC MTAC precision of detection 0% 50% 100% = # correct answers / # queries CVBASE Spatial onto Visual onto STVO precision of answers 50% 100%

Conclusions Spatio-Temporal Visual Ontology (STVO) VL 2011, 15.09.2011, Brighton, UK. Conclusions Spatio-Temporal Visual Ontology (STVO) Granular conceptualization and a hierarchical representation of the visual observation domain Semantical characterization of each visual scene and its components (e.g. objects of interest) New sematically meanignful inter- and intra-object spatio-temporal relations Support of the reasoning about photomoetric, geometrical and spatio-temporal relations between and within the multiple observed objects or parts of tem for the effective interpretation of visual information. Application to Dynamic Visual Scene Analysis

Spatio-Temporal Visual Ontology VL 2011, 15.09.2011, Brighton, UK. Spatio-Temporal Visual Ontology Thank You Contact Details Dr Ir Joanna Olszewska j.olszewska@hud.ac.uk School of Computing and Engineering University of Huddersfield, Queensgate Huddersfield, HD1 3DH, United Kingdom