1. Content Based Image Retrieval Romit Das · Ryan Scotka

3. GIS Problems Search based on filename –Verbatim match –Noun replacement Potential for Abuse (Google Hack)

4. Possible Solutions Metadata –Standards –Re-index existing images Manual Classification –Time Content-based Classification

5. CBIR – Training 1.Choose features to distinguish images. 2.Extract said features. 3.Apply statistical method to model features. 4.Categorize based on textual description.

6. Example Dimensions Color Frequencies Spatial Distribution 200 x 200 + Mostly flesh tones + Flesh tones concentrated in the center = baby

7. Author’s Feature Set Feature Set (6 dimensions): –Color averages (LUV) –High-frequency energy bands “Effectively discern local texture” Wavelet transform on 4x4 blocks Use HL, LH, and HH “high energy bands” Use the LL for lower resolution analysis

8. Author’s Implementation Statistical Modeling –Use machine learning to build concepts Concept = Paris Training Set =

9. Markov Models Take known facts Deduce hidden/unknown data

10. Markov Model Example Given: –Queues of people, shelves, price labels, disgruntled workers Possible Results: –Post office –Supermarket –Record Store

11. Markov Model Example Given: –Queues of people, shelves, price labels, disgruntled workers, food products Possible Results: –Post office –Supermarket –Record Store

12. Ninja Model Person, outdoors

13. Ninja Model People, ninjas, outdoor

14. Ninja Model People, ninjas, weapons, outdoors

15. Ninja Markov Model Person, outdoors People, ninjas, outdoors weapons, class photo

16. Creating Concepts Training Concept –Created from hand-picked images –Must choose statistically significant training size Resulting Concept –Used in automatic cataloging of future images

18. Observations Images are associated with multiple concepts. Not foolproof Example: People, ninjas, outdoors weapons, class photo

19. Advantages Automatic categorization

20. Disadvantages False positives –Concepts may require a vast amount of images Increases training time Dissimilar images needed for training of a concept

21. Future Additions Further refinement of conflicting semantics Weights assigned to classifications

22. Our Implementation Perform classification with alternate learners (Weka)