Image Annotation using XML and MPEG-7 Manjeet Rege Department of Computer Science Wayne State University

Introduction Problem Statement: Medical Image queries “Find the possible diagnosis based on the features of the medical image”. “For a given diagnosis, retrieve all the medical images that have the same diagnosis”. Proposed Solution Medical Image Annotation using MPEG-7.

Overview of MPEG-7 MPEG-7 files are XML files that contain a reference to the location of the corresponding image file. MPEG-7 gives us the ability to combine and store the semantic information with the visual features extracted from the image in one XML file.

Example Patient name: John Doe Physician name: Dr Smith Year: 2002 Location: National Hospital

MPEG-7 representation

Advantages of Annotating Medical Images using MPEG-7 Annotation for querying with Demographic Information “Find all images of patient John Doe treated by Dr Smith in the year 2002 at National Hospital”. Annotation for querying with Medical Information “Find all image slices of patient John Doe containing Cortex insularis in the year 2002.”

Related Publications Manjeet Rege, Ming Dong, Farshad Fotouhi, Mohammad-Reza Siadat and Lucia Zamorano, "Using MPEG-7 to build a Human Brain Image Database for Image-guided Neurosurgery", in proc. of SPIE International Symposium on Medical Imaging Manjeet Rege, Ming Dong and Farshad Fotouhi, "XML Path based Relevance Model for Automatic Image Annotation", in proc. of IEEE International Conference on Multimedia & Expo (ICME) 2005.