MUSCLE/ImageCLEF workshop 2005 Extracting an Ontology of Portrayable Objects from WordNet Atomic Energy Agency of France (CEA) LIC2M (Multilingual Multimedia Knowledge Engineering Laboratory) BP6, 18 Route du Panorama 92265, Fontenay aux Roses, France S. Zinger, C. Millet, B. Mathieu, G. Grefenstette, P. Hède, P.-A. Moëllic
MUSCLE/ImageCLEF workshop Goal: creation of a large-scale image ontology WordNet lexical resourses Image collections acquisition through web- based image mining
MUSCLE/ImageCLEF workshop Building a large-scale image ontology for object recognition: list of portrayable objects WordNet lexical resources basis of ontology
MUSCLE/ImageCLEF workshop Building a large-scale image ontology for object recognition: visual features semantic filtering clustering classification web-based image mining large-scale visual dictionary
MUSCLE/ImageCLEF workshop Pruning approach to WordNet ENTITY has a distinct separate existence (living or nonliving) OBJECT physical object (a tangible a visible entity) simplifying connections selecting branches object living thing life wildlife object living thing plant … tree tree of knowledge object artifact creation classic deleted
MUSCLE/ImageCLEF workshop Extraction from top-level ontology of portrayable objects ENTITY object living thing natural objectartifactfloater organismcelestial body rock articlecommodity consumer goods 102 nodes in total
MUSCLE/ImageCLEF workshop VIKA (Visual Kataloguer) indexing (PIRIA – LIC2M) clustering (shared nearest neighbor) visualisation of clusters web-image search engine (Alltheweb)
MUSCLE/ImageCLEF workshop List of portrayable objects (24000 items) queries to the web (e.g. google image) VIKA (Visual Kataloguer)
MUSCLE/ImageCLEF workshop Composition of queries: upper node + word identifying portrayable object Example of queries: kino tree red sandalwood tree carib wood tree Japanese pagoda tree palm tree... Japanese pagoda buildings Japanese pagoda tree trees
MUSCLE/ImageCLEF workshop VIKA (Visual Kataloguer)
MUSCLE/ImageCLEF workshop Web-image search at presentDesired results query « chair»
MUSCLE/ImageCLEF workshop Future work: face detection (adaboost learning) – to filter web-image search results semantically (images of objects without people) testing VIKA system performances automatic cluster classification – ignoring irrelevant clusters introducing new connections to the ontology: vision principles (scale), co-occurrence rules
MUSCLE/ImageCLEF workshop Future work Vision principles (scale)
MUSCLE/ImageCLEF workshop Future work Co-occurrence rules