SCULPTEUR: Multimedia Retrieval for Museums S. Goodall, P. H. Lewis, K. Martinez, P. A. S. Sinclair, F. Giorgini, M. J. Addis, M. J. Boniface, C. Lahanier, J. Stevenson

Title Project IST SCULPTEUR 1.Present overview of SCULPTEUR Project 2.Present the idea of multimedia retrieval 3.Present the research issues in the project

Overview Project IST SCULPTEUR ● SCULPTEUR (Semantic and content-based multimedia exploitation for European benefit) ● Multidisciplinary partnership with participants from industrial, academic, research and cultural sectors ● Large EU, 3 year project (May 2002 – May 2005)

The SCULPTEUR Vision Project IST SCULPTEUR The vision of SCULPTEUR is to develop both the technology and the expertise to help create, manipulate, manage and present these cultural archives, and make available cultural heritage to European people and the world.

Some of the Aims Project IST SCULPTEUR Multimedia information handling facilities for museums Integrating content, metadata and concept based retrieval and navigation Use of semantic web technology to facilitate this Extension of digital content to 3-D (capture and use) 3-D Content based retrieval “Agents” to cluster and classify content representations “Agents” to try and find missing or additional information on the web Cross collection searching and interoperability

Project Partners Project IST SCULPTEUR Uffizi Gallery

Research Areas Project IST SCULPTEUR Talk about the research areas of the project 3-D CBR Classifier Agent Web Crawler

Types of Questions to Address Project IST SCULPTEUR Find similar objects to my object Find all objects created by Find all objects created in the 19 th century Find all “gold” objects Find all objects of a certain size Find a 3-D object from my 2-D image

Architecture Project IST SCULPTEUR

Architecture Project IST SCULPTEUR Talk about each part of the system Use diagram as a lead in point Mapping of museum systems into sculpteur institution specific process

Knowledge Base Project IST SCULPTEUR Talk about backend parts of system Mysql DB, museums DB Semantic Layer stuff

Multimedia Retrieval Project IST SCULPTEUR Types of Query: ● Content-Based Retreival (2-D and 3-D) ● Concept-Based Retreival ● Meta-data Retrieval

2-D Content-Based Retrieval Project IST SCULPTEUR ● Developed during ARTISTE ● Colour, Texture and Shape based descriptors Sub-image matching Query Best Match

Project IST SCULPTEUR “Cord” Histogram Shape Distribution 3-D Content-Based Retrieval

Concept-Based Retrieval Project IST SCULPTEUR Browser based on Touch Graph Graphically browse system ontology “Shortcuts” allow navigation to commonly used concepts Can obtain instance information from concepts for querying with

Metadata Retrieval Project IST SCULPTEUR Query: Find all “Vases” Free text fields Controlled Lists

Interoperability Project IST SCULPTEUR e-Learning Stuff Learn eXact (sp?) Uses SRW Interface

Knowledge Acqusition Project IST SCULPTEUR Crawler and Classifier Stuff

Challenges Ahead Project IST SCULPTEUR 2-D to 3-D CBR Knowledge Acquistion

Closing Words Project IST SCULPTEUR

More Information Project IST SCULPTEUR Consortium Website: Prototype Sytem:

Title Project IST SCULPTEUR

Title Project IST SCULPTEUR