1. JISCrte Meeting, May 25,2011 Dr. Yu Qian School of Engineering Information Sciences, Middlesex University y.qian@mdx.ac.uk Repository @ http://image.mdx.ac.uk/vin/demo.php y.qian@mdx.ac.ukhttp://image.mdx.ac.uk/vin/demo.php

2. Contents System demonstration http://image.mdx.ac.uk/vin/demo.php Introduction of MIRAGE project – MIRAGE Phase 1 (2009-2010) – MIRAGE 2011, Phase 2 (2011) Project communication Dissemination Obstacles and issues Lessons learned so far Summary

3. MIRAGE (Middlesex medical Image Repository with a CBIR ArchivinG Environment) Phase 1: MIRAGE - from Creation to Archiving Strand : Start-up Repository funded by JISC Between Apr. 2009- Sep. 2010. Aim: To develop a repository of medical images benefiting MSc and research students in the immediate term and serve a wider community in the long term in providing a rich supply of medical images for data mining, to complement MU current online e-learning system OASIS+. Phase 2: MIRAGE 2011 – from Archiving to Creation Strand : Take-up and Embedding funded by JISC Between Feb. 2011- Oct. 2011. Aim: To enrich the current repository MIRAGE with two necessities of ‘3D Viewer’ and ‘Uploading’ to meet users’ needs, leading to a sustainable, usable and flexible model of data management.

4. Framework for MRIAGE

5. Phase 1: MIRAGE -- from Creation to Archiving

6. Phase 1: MIRAGE -- GIFT(GNU Image Finding Tool) GIFT is open framework for content-based image retrieval and is developed by University of Geneva.  Query by example and multiple query  Relevance Feedback  Distributed architecture (Client - Server)  MRML---C-S communication protocol

7. Phase 1: MIRAGE – Online system(1) Server side:  Image collection: Accommodating 100,000 2D images and 100 3D images  Visual feature extraction: Pre-processing off-line using C++ and Perl.  Indexing file creation Client side:  Interface based on PHP generate dynamic web pages. Client – Server communication protocol:  MRML: a XML based protocol

8. Phase 1: MIRAGE – Online system(2) Repository connection

9. Phase 1: MIRAGE – Online system(3) Interface

10. Phase 1: MIRAGE – Online system(4) Query and retrieval results

11. Phase 1: MIRAGE – Online system(5) Link to OASIS+

12. Phase 1: MIRAGE – Online system(6) On-line survey On-line survey Survey report show all respondents 'agreed' or 'strongly agreed‘  The retrieved results meets users’ expectations  Fast and easy to use  Useful for teaching and learning

13. Phase 1: MIRAGE –Limitations (1) 1. At Repository interfaceAt Repository interface Montage

14. Phase 1: MIRAGE –Limitations (2) 2. Uploading imageUploading image

15. Phase 2: MIRAGE2011---- From Archiving to Creation Aim: To enrich the current repository MIRAGE with two necessities to meet users’ needs, leading to a sustainable, usable and flexible model of data management.

16. Phase 2: MIRAGE2011---3D CBIR Proposed Framework for 3D Image Retrieval

17. Phase 2: MIRAGE2011---3D CBIR 3D texture feature extraction 1)3D Grey Level Co-occurrence Matrices (3D GLCM) 2)3D Wavelet Transform (3D WT) 3)3D Gabor Transform (3D GT) 4)3D Local Binary Pattern (3D LBP) Publications: 1) Qian Y., Gao X. etc, Content-based Retrieval of 3D Medical Images, eTELEMED 2011, February, 2011. (Best paper award ) 2) Gao X., Qian Y. etc, Texture-based 3D image retrieval for medical applications, IADIS e-Health2010,, July 2010.

18. Phase 2: MIRAGE2011---3D CBIR 3D Brain Visualization(1)

19. Phase 2: MIRAGE2011---3D CBIR 3D Brain Visualization(2)

20. Phase 2: MIRAGE2011---3D CBIR On-line system(1): Server side:  100 3D brain images(DICOM format to JPG format)  3D visual feature extraction(4 methods): Off-line pre- processing using Matlab.  3D visualization: using Matlab Client side:  Interface based on PHP generate dynamic web pages.

21. Phase 2: MIRAGE2011---3D CBIR Online system(2): Embedding to MIRAGE

22. Phase 2: MIRAGE2011---3D CBIR Online system(3): Interface for 3D images retrieval and visualization

23. Phase 2: MIRAGE2011---Uploading Development of a plug-in for uploading queries Will integrate various types of textual metadata and ontology in addition to image data.

24. Phase 2: MIRAGE2011---Uploading Image Annotation(1)

25. Phase 2: MIRAGE2011---Uploading Image annotation(2) Framework for image annotation

26. Phase 2: MIRAGE2011---Uploading Image annotation(3) Classified Dataset

27. Phase 2: MIRAGE2011---Uploading Image (Future work) Two problems need to be solved:  Security  Online query time

28. Thanks Yu Qian y.qian@mdx.ac.uk