JISCrte Meeting, May 25,2011 Dr. Yu Qian School of Engineering Information Sciences, Middlesex University

Contents System demonstration Introduction of MIRAGE project – MIRAGE Phase 1 ( ) – MIRAGE 2011, Phase 2 (2011) Project communication Dissemination Obstacles and issues Lessons learned so far Summary

MIRAGE (Middlesex medical Image Repository with a CBIR ArchivinG Environment) Phase 1: MIRAGE - from Creation to Archiving Strand : Start-up Repository funded by JISC Between Apr Sep Aim: To develop a repository of medical images benefiting MSc and research students in the immediate term and serve a wider community in the long term in providing a rich supply of medical images for data mining, to complement MU current online e-learning system OASIS+. Phase 2: MIRAGE 2011 – from Archiving to Creation Strand : Take-up and Embedding funded by JISC Between Feb Oct Aim: To enrich the current repository MIRAGE with two necessities of ‘3D Viewer’ and ‘Uploading’ to meet users’ needs, leading to a sustainable, usable and flexible model of data management.

Framework for MRIAGE

Phase 1: MIRAGE -- from Creation to Archiving

Phase 1: MIRAGE -- GIFT(GNU Image Finding Tool) GIFT is open framework for content-based image retrieval and is developed by University of Geneva.  Query by example and multiple query  Relevance Feedback  Distributed architecture (Client - Server)  MRML---C-S communication protocol

Phase 1: MIRAGE – Online system(1) Server side:  Image collection: Accommodating 100,000 2D images and 100 3D images  Visual feature extraction: Pre-processing off-line using C++ and Perl.  Indexing file creation Client side:  Interface based on PHP generate dynamic web pages. Client – Server communication protocol:  MRML: a XML based protocol

Phase 1: MIRAGE – Online system(2) Repository connection

Phase 1: MIRAGE – Online system(3) Interface

Phase 1: MIRAGE – Online system(4) Query and retrieval results

Phase 1: MIRAGE – Online system(5) Link to OASIS+

Phase 1: MIRAGE – Online system(6) On-line survey On-line survey Survey report show all respondents 'agreed' or 'strongly agreed‘  The retrieved results meets users’ expectations  Fast and easy to use  Useful for teaching and learning

Phase 1: MIRAGE –Limitations (1) 1. At Repository interfaceAt Repository interface Montage

Phase 1: MIRAGE –Limitations (2) 2. Uploading imageUploading image

Phase 2: MIRAGE From Archiving to Creation Aim: To enrich the current repository MIRAGE with two necessities to meet users’ needs, leading to a sustainable, usable and flexible model of data management.

Phase 2: MIRAGE D CBIR Proposed Framework for 3D Image Retrieval

Phase 2: MIRAGE D CBIR 3D texture feature extraction 1)3D Grey Level Co-occurrence Matrices (3D GLCM) 2)3D Wavelet Transform (3D WT) 3)3D Gabor Transform (3D GT) 4)3D Local Binary Pattern (3D LBP) Publications: 1) Qian Y., Gao X. etc, Content-based Retrieval of 3D Medical Images, eTELEMED 2011, February, (Best paper award ) 2) Gao X., Qian Y. etc, Texture-based 3D image retrieval for medical applications, IADIS e-Health2010,, July 2010.

Phase 2: MIRAGE D CBIR 3D Brain Visualization(1)

Phase 2: MIRAGE D CBIR 3D Brain Visualization(2)

Phase 2: MIRAGE D CBIR On-line system(1): Server side:  100 3D brain images(DICOM format to JPG format)  3D visual feature extraction(4 methods): Off-line pre- processing using Matlab.  3D visualization: using Matlab Client side:  Interface based on PHP generate dynamic web pages.

Phase 2: MIRAGE D CBIR Online system(2): Embedding to MIRAGE

Phase 2: MIRAGE D CBIR Online system(3): Interface for 3D images retrieval and visualization

Phase 2: MIRAGE Uploading Development of a plug-in for uploading queries Will integrate various types of textual metadata and ontology in addition to image data.

Phase 2: MIRAGE Uploading Image Annotation(1)

Phase 2: MIRAGE Uploading Image annotation(2) Framework for image annotation

Phase 2: MIRAGE Uploading Image annotation(3) Classified Dataset

Phase 2: MIRAGE Uploading Image (Future work) Two problems need to be solved:  Security  Online query time

Thanks Yu Qian