Multimedia Retrieval Organization 2011/12, term 1 Remco Veltkamp

Schedule 11 lectures Mondays , BBL-079 Thursdays , BBL-079 Practical Assignment

Grading Written exam: 50% Assignment: 50% Retake exam only if original final grade is at least a 4 Form of retake: written exam and/or additional assignment

Exam Motivation: MM retrieval requires critical amount of knowledge About the topics discussed in all lectures Slides are available Make your own notes (academic skill)

Literature M. Lew (ed.). Principles of Visual Information Retrieval. Springer Backgroud: D. Feng, W.C. Siu, H.J. Zhang. Multimedia Information Retrieval and Management, Technological Fundamentals and Applications Springer A. del Bimbo. Visual Information Retrieval. Morgan Kaufmann C. Faloutsos. Searching Multimedia Databases by Content. Kluwer T. Gevers. Image Search Engines. Conference course at CVPR (Computer Vision and Pattern Recognition) (Some of the slides are taken from this course.) O. Marques, B. Furht. Content-Based Image and Video Retrieval. Kluwer R. Veltkamp, M. Tanase. Content-Based Image Retrieval Systems Survey. R. Veltkamp, H. Burkhardt, H.-P. Kriegel. State-of-the-Art in Content-Based Image and Video Retrieval. Kluwer 2001.

Assignments Motivation: MM retrieval requires practical experience Feature extraction, feature matching, performance comparison This year: 3D model retrieval

Shape-based image retrieval: Logo retrieval: project Profi (Perceptually-relevant Retrieval of Figurative Images) Part-based retrieval: project Mindshade (Matching and Indexing through Shape Decomposition) Shape-based retrieval: project Shame (Shame Matching Environment) Indexing: Project AMIS (Advanced Multimedia Indexing and Searching)

Music retrieval: Project COGITCH (COgnition Guided Interoperability beTween Collections of musical Heritage) Project Witchcraft (What Is Topical in Cultural Heritage: Content-based Retrieval Among Folksong Tunes) Project C-Minor (Cognition-based Music Information Notation Oriented Retrieval) Project Orpheus (On-line Retrieval from Polyhymnia: the Human-oriented Experimental Utrecht Searcher 3D Model retrieval: SHREC (3D Shape Retrieval Contests) Project FOCUS-K3D (Foster the Comprehension and Use of Knowledge-intensive 3D-media ) Project (Advanced Innovative Modeling of Shape)

Media Technology Lab Graphic workstations Gaming devices Digitial video and photo camera Video editing software 3D shutter glasses Web and file server 3D scanner (2) Fingerprint scanner (eye tracker) (video wall)