Hierarchical Annotation of Medical Images Ivica Dimitrovski 1, Dragi Kocev 2, Suzana Loškovska 1, Sašo Džeroski 2 1 Department of Computer Science, Faculty.

Slides:



Advertisements
Similar presentations
Pseudo-Relevance Feedback For Multimedia Retrieval By Rong Yan, Alexander G. and Rong Jin Mwangi S. Kariuki
Advertisements

Random Forest Predrag Radenković 3237/10
CHAPTER 9: Decision Trees
Zhimin CaoThe Chinese University of Hong Kong Qi YinITCS, Tsinghua University Xiaoou TangShenzhen Institutes of Advanced Technology Chinese Academy of.
Object Recognition with Features Inspired by Visual Cortex T. Serre, L. Wolf, T. Poggio Presented by Andrew C. Gallagher Jan. 25, 2007.
Evaluating Color Descriptors for Object and Scene Recognition Koen E.A. van de Sande, Student Member, IEEE, Theo Gevers, Member, IEEE, and Cees G.M. Snoek,
Combining Classification and Model Trees for Handling Ordinal Problems D. Anyfantis, M. Karagiannopoulos S. B. Kotsiantis, P. E. Pintelas Educational Software.
Decision trees for hierarchical multilabel classification A case study in functional genomics.
Carolina Galleguillos, Brian McFee, Serge Belongie, Gert Lanckriet Computer Science and Engineering Department Electrical and Computer Engineering Department.
Addressing the Medical Image Annotation Task using visual words representation Uri Avni, Tel Aviv University, Israel Hayit GreenspanTel Aviv University,
Texture Segmentation Based on Voting of Blocks, Bayesian Flooding and Region Merging C. Panagiotakis (1), I. Grinias (2) and G. Tziritas (3)
São Paulo Advanced School of Computing (SP-ASC’10). São Paulo, Brazil, July 12-17, 2010 Looking at People Using Partial Least Squares William Robson Schwartz.
MCS Multiple Classifier Systems, Cagliari 9-11 June Giorgio Valentini Random aggregated and bagged ensembles.
Outline Introduction Anotation Segmentation Detection.
Recognition using Regions CVPR Outline Introduction Overview of the Approach Experimental Results Conclusion.
EE 7730 Image Segmentation.
1 Learning to Detect Objects in Images via a Sparse, Part-Based Representation S. Agarwal, A. Awan and D. Roth IEEE Transactions on Pattern Analysis and.
1 Lecture 5: Automatic cluster detection Lecture 6: Artificial neural networks Lecture 7: Evaluation of discovered knowledge Brief introduction to lectures.
A Study of Approaches for Object Recognition
Robust Real-time Object Detection by Paul Viola and Michael Jones ICCV 2001 Workshop on Statistical and Computation Theories of Vision Presentation by.
Lecture 5 (Classification with Decision Trees)
Presented by Zeehasham Rasheed
Multiple Object Class Detection with a Generative Model K. Mikolajczyk, B. Leibe and B. Schiele Carolina Galleguillos.
MACHINE LEARNING. What is learning? A computer program learns if it improves its performance at some task through experience (T. Mitchell, 1997) A computer.
Rotation Forest: A New Classifier Ensemble Method 交通大學 電子所 蕭晴駿 Juan J. Rodríguez and Ludmila I. Kuncheva.
Biomedical Image Analysis and Machine Learning BMI 731 Winter 2005 Kun Huang Department of Biomedical Informatics Ohio State University.
CSC 478 Programming Data Mining Applications Course Summary Bamshad Mobasher DePaul University Bamshad Mobasher DePaul University.
Entropy and some applications in image processing Neucimar J. Leite Institute of Computing
Graph-based consensus clustering for class discovery from gene expression data Zhiwen Yum, Hau-San Wong and Hongqiang Wang Bioinformatics, 2007.
Machine Learning CS 165B Spring 2012
K.U.Leuven Department of Computer Science Predicting gene functions using hierarchical multi-label decision tree ensembles Celine Vens, Leander Schietgat,
Thien Anh Dinh1, Tomi Silander1, Bolan Su1, Tianxia Gong
Gene id GO GO GO Feature_1Feature_2... Feature_t
Machine Vision for Robots
Exploiting Ontologies for Automatic Image Annotation M. Srikanth, J. Varner, M. Bowden, D. Moldovan Language Computer Corporation
Studying the Presence of Genetically Modified Variants in Organic Oilseed Rape by using Relational Data Mining Aneta Ivanovska 1, Celine Vens 2, Sašo Džeroski.
Texture. Texture is an innate property of all surfaces (clouds, trees, bricks, hair etc…). It refers to visual patterns of homogeneity and does not result.
Hierarchical multilabel classification trees for gene function prediction Leander Schietgat Hendrik Blockeel Jan Struyf Katholieke Universiteit Leuven.
LOGO Ensemble Learning Lecturer: Dr. Bo Yuan
Phase Congruency Detects Corners and Edges Peter Kovesi School of Computer Science & Software Engineering The University of Western Australia.
Combining multiple learners Usman Roshan. Bagging Randomly sample training data Determine classifier C i on sampled data Goto step 1 and repeat m times.
Exploiting Context Analysis for Combining Multiple Entity Resolution Systems -Ramu Bandaru Zhaoqi Chen Dmitri V.kalashnikov Sharad Mehrotra.
Study of Protein Prediction Related Problems Ph.D. candidate Le-Yi WEI 1.
MedIX – Summer 07 Lucia Dettori (room 745)
1Ellen L. Walker Category Recognition Associating information extracted from images with categories (classes) of objects Requires prior knowledge about.
Image Classification for Automatic Annotation
Ivica Dimitrovski 1, Dragi Kocev 2, Suzana Loskovska 1, Sašo Džeroski 2 1 Faculty of Electrical Engineering and Information Technologies, Department of.
Random Forests Ujjwol Subedi. Introduction What is Random Tree? ◦ Is a tree constructed randomly from a set of possible trees having K random features.
Virtual Examples for Text Classification with Support Vector Machines Manabu Sassano Proceedings of the 2003 Conference on Emprical Methods in Natural.
Learning Photographic Global Tonal Adjustment with a Database of Input / Output Image Pairs.
Using decision trees to build an a framework for multivariate time- series classification 1 Present By Xiayi Kuang.
Computational Biology Group. Class prediction of tumor samples Supervised Clustering Detection of Subgroups in a Class.
CSC 478 Programming Data Mining Applications Course Summary Bamshad Mobasher DePaul University Bamshad Mobasher DePaul University.
On Using SIFT Descriptors for Image Parameter Evaluation Authors: Patrick M. McInerney 1, Juan M. Banda 1, and Rafal A. Angryk 2 1 Montana State University,
DECISION TREES Asher Moody, CS 157B. Overview  Definition  Motivation  Algorithms  ID3  Example  Entropy  Information Gain  Applications  Conclusion.
Decision Trees for Hierarchical Multilabel Classification : A Case Study in Functional Genomics Hendrik Blockeel 1, Leander Schietgat 1, Jan Struyf 1,2,
1 A Methodology for automatic retrieval of similarly shaped machinable components Mark Ascher - Dept of ECE.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology Decision trees for hierarchical multi-label classification.
Combining Bagging and Random Subspaces to Create Better Ensembles
Combining Models Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya.
Data Transformation: Normalization
Hyunghoon Cho, Bonnie Berger, Jian Peng  Cell Systems 
DIGITAL SIGNAL PROCESSING
Saliency detection Donghun Yeo CV Lab..
Basic machine learning background with Python scikit-learn
Cheng-Ming Huang, Wen-Hung Liao Department of Computer Science
Multiple Feature Learning for Action Classification
Ensembles for predicting structured outputs
Hyunghoon Cho, Bonnie Berger, Jian Peng  Cell Systems 
Advisor: Dr.vahidipour Zahra salimian Shaghayegh jalali Dec 2017
Presentation transcript:

Hierarchical Annotation of Medical Images Ivica Dimitrovski 1, Dragi Kocev 2, Suzana Loškovska 1, Sašo Džeroski 2 1 Department of Computer Science, Faculty of Electrical Engineering and Information Technologies, Skopje, Macedonia 2 Department of Knowledge Technologies, Jožef Stefan Institute, Ljubljana, Slovenia

Overview Introduction and problem definition Feature extraction –Edge Histogram Descriptor (EHD) Classifier –PCTs for HMLC Experiments and results Conclusions and future work

Introduction The amount of medical images is constantly growing The cost of manually annotating these images is very high –automatic image annotation algorithms to perform the task reliably Feature extraction from images Classifier to distinguish between different classes Application: Multilingual image annotations and DICOM standard header corrections

IRMA code IRMA coding system: Four axes marked with {0, …, 9, a, …, z} –T (Technical): image modality –D (Directional): body orientation –A (Anatomical): body region –B (Biological): biological system IRMA code: TTTT – DDD – AAA – BBB The code is strictly hierarchical –Example: 2 cardiovascular system 21 cardiovascular system; heart 216 cardiovascular system; heart; aortic valve

IRMA code - example IRMA code: a0 –1123 (x-ray, projection radiography, analog, high energy) –211 (sagittal, left lateral descubitus, inspiration) –520 (chest, lung) –3a0 (respiratory system, lung)

Feature extraction Obtain features that describe the visual content of an image Histogram of local edges –Mark the points in a digital image at which the luminous intensity changes sharply –Reduction of the amount of data to be processed, while retaining important information about the shapes of objects in the image –Frequency and the directionality of the brightness changes in the image

Feature extraction

Classification Methodology Predictive Clustering Trees framework (PCTs) (Blockeel et al. Top-down induction of clustering trees. In Proc. of the 15th ICML, p.55-63, 1998) Ensemble methods to improve the predictive performance –Bagging (L. Breiman. Bagging predictors, Machine Learning Journal, vol. 24 Issue 2, p , 1996) –Random Forests (L. Breiman. Random Forests, Machine Learning Journal, vol. 45, p.5-32, 2001)

Predictive Clustering Trees (PCTs) A tree is a hierarchy of clusters Standard top-down induction of decision trees (TDIDT) algorithm best acceptable attribute-value test that can be put in a node The heuristic for selecting the tests is the reduction in variance in the induces subsets –Maximizes cluster homogeneity and improves predictive performance PCTs can handle different types of target concepts: multiple targets, time series, hierarchy –Instantiation of the variance and prototype function

Hierarchical Multi-Label Classification HMLC: an example can be labeled with multiple labels that are organized in a hierarchy { 1, 2, 2.2 }

Hierarchical Multi-Label Classification HMLC: an example can be labeled with multiple labels that are organized in a hierarchy { 1, 2, 2.2 } Variance instantiation: average squared distance between each example’s label and the set’s mean label the arithmetic mean of a set of such vectors contains as i’th component the proportion of examples of the set belonging to class c i

Ensemble methods Ensemble - Set of classifiers Classification of new example by combination of the predictions of each classifier from the ensemble –Regression: Average –Classification: Majority Vote Bagging Random Forests

Ensemble methods

Experimental design Goal: provide the IRMA code for an image Data –ImageCLEF 2008 – images sorted in 197 classes –82 classes have less than 10 elements (129 images) –Each image is described with 80 features Feature extraction –Contrast enhancement –Histogram equalization

Experimental design Classifier –Number of classifiers: 100 un-pruned trees –Random Forests Feature Subset Size: 7 (log) Comparison of the performance of a single tree and an ensemble –Precision-Recall (PR) curves - “area under the PR curve” (AUPRC) –10 fold cross-validation Two scenarios 1) Each axis is an dataset (4 in total) 2) Single dataset for all axes

Results per axis

Results for all axes

Discussion Increase of the predictive performance with ensembles compared to a single tree Excellent performance for axes T and B (AUPRC of and ) –The hierarchies for axes T and B contain only few nodes (9 and 27, respectively) The classifiers for axes A and D have high predictive performance (AUPRC of and ) –The hierarchies for axes A and D contain 110 and 36 nodes, respectively Predicting the complete hierarchy at-once yields improvements

Summary Medical image annotation using Hierarchical Multi-Label Classification (HMLC) Local Edge Histogram Descriptor (EHD) to represent gray-scale radiological (X-Ray) images Images annotated with IRMA code Ensembles of PCTs for HMLC as classifier

Future work Other algorithms for feature extraction: –SIFT, TAMURA, Scale, Color Histogram… Combination of the features obtained from different techniques: –Each technique captures different aspects of an image Extension of the classification algorithm: –Distance measures for hierarchies –Learning under covariate shift