1. CSE 5331/7331 F'071 CSE 5331/7331 Fall 2007 Image Mining Margaret H. Dunham Department of Computer Science and Engineering Southern Methodist University

2. 2CSE 5331/7331 F'07 The 2000 ozone hole over the antarctic seen by EPTOMS http://jwocky.gsfc.nasa.gov/multi/multi.html#hole

3. 3CSE 5331/7331 F'07 Table of Contents Image Mining – What is it? Image Mining – What is it? Feature Extraction Feature Extraction Shape Detection Shape Detection Color Techniques Color Techniques Video Mining Video Mining Facial Recognition Facial Recognition Bioinformatics Bioinformatics

4. 4CSE 5331/7331 F'07 Image Mining – What is it? Image Retrieval Image Retrieval Image Classification Image Classification Image Clustering Image Clustering Video Mining Video Mining Applications Applications –Bioinformatics –Geology/Earth Science –Security –…

5. 5CSE 5331/7331 F'07 Feature Extraction Identify major components of image Identify major components of image Color Color Texture Texture Shape Shape Spatial relationships Spatial relationships Feature Extraction & Image Processing Feature Extraction & Image Processing http://users.ecs.soton.ac.uk/msn/book/ Feature Extraction Tutorial Feature Extraction Tutorial http://facweb.cs.depaul.edu/research/vc/VC_Worksh op/presentations/pdf/daniela_tutorial2.pdf http://facweb.cs.depaul.edu/research/vc/VC_Worksh op/presentations/pdf/daniela_tutorial2.pdf

6. 6CSE 5331/7331 F'07 Shape Detection Blob Blob http://elib.cs.berkeley.edu/blobworld/ Boundary/Edge Detection Boundary/Edge Detection Time Series – Eamonn Keogh Time Series – Eamonn Keogh http://www.engr.smu.edu/~mhd/8337sp07/sh apes.ppt http://www.engr.smu.edu/~mhd/8337sp07/sh apes.ppt

7. 7CSE 5331/7331 F'07 Color Techniques Color Representations Color RepresentationsRGB: http://en.wikipedia.org/wiki/Rgb HSV: http://en.wikipedia.org/wiki/HSV_color_space http://en.wikipedia.org/wiki/HSV_color_space Color Histogram Color Histogram Color Anglogram Color Anglogram http://www.cs.sunysb.edu/~rzhao/publications/Video DB.pdf http://www.cs.sunysb.edu/~rzhao/publications/Video DB.pdf

8. 8CSE 5331/7331 F'07 What is Similarity ? (c) Eamonn Keogh, eamonn@cs.ucr.edu

9. 9CSE 5331/7331 F'07 Video Mining Boundaries between shots Boundaries between shots Movement between frames Movement between frames ANSES: ANSES: http://mmir.doc.ic.ac.uk/demos/anses.html

10. 10CSE 5331/7331 F'07 Facial Recognition Based upon features in face Based upon features in face Convert face to a feature vector Convert face to a feature vector Less invasive than other biometric techniques Less invasive than other biometric techniques http://www.face-rec.org http://www.face-rec.org http://www.face-rec.org http://computer.howstuffworks.com/facial- recognition.htm http://computer.howstuffworks.com/facial- recognition.htm http://computer.howstuffworks.com/facial- recognition.htm http://computer.howstuffworks.com/facial- recognition.htm SIMS: SIMS: http://www.casinoincidentreporting.com/Products. aspx http://www.casinoincidentreporting.com/Products. aspx

11. 11CSE 5331/7331 F'07 Microarray Data Analysis Each probe location associated with gene Each probe location associated with gene Measure the amount of mRNA Measure the amount of mRNA Color indicates degree of gene expression Color indicates degree of gene expression Compare different samples (normal/disease) Compare different samples (normal/disease) Track same sample over time Track same sample over time Questions Questions –Which genes are related to this disease? –Which genes behave in a similar manner? –What is the function of a gene? Clustering Clustering –Hierarchical –K-means

12. 12CSE 5331/7331 F'07 Affymetrix GeneChip ® Array http://www.affymetrix.com/corporate/outreach/lesson_plan/educator_resources.affx

13. 13CSE 5331/7331 F'07 Microarray Data - Clustering "Gene expression profiling identifies clinically relevant subtypes of prostate cancer" Proc. Natl. Acad. Sci. USA, Vol. 101, Issue 3, 811-816, January 20, 2004