By Pradeep C.Venkat Srinath Srinivasan

Slides:



Advertisements
Similar presentations
A Graph based Geometric Approach to Contour Extraction from Noisy Binary Images Amal Dev Parakkat, Jiju Peethambaran, Philumon Joseph and Ramanathan Muthuganapathy.
Advertisements

Wavelets Fast Multiresolution Image Querying Jacobs et.al. SIGGRAPH95.
Evaluating Color Descriptors for Object and Scene Recognition Koen E.A. van de Sande, Student Member, IEEE, Theo Gevers, Member, IEEE, and Cees G.M. Snoek,
Feature Detection and Outline Registration in Dorsal Fin Images A. S. Russell, K. R. Debure, Eckerd College, St. Petersburg, FL Most Prominent Notch analyze.
Matching and Retrieval Based on the Vocabulary and Grammar of Color Patterns Aleksandra Mojsilovic, Jelena Kovacevic, Jianying Hu, Robert J. Safranek,
ICIP 2000, Vancouver, Canada IVML, ECE, NTUA Face Detection: Is it only for Face Recognition?  A few years earlier  Face Detection Face Recognition 
Effective Image Database Search via Dimensionality Reduction Anders Bjorholm Dahl and Henrik Aanæs IEEE Computer Society Conference on Computer Vision.
1 Texture Texture is a description of the spatial arrangement of color or intensities in an image or a selected region of an image. Structural approach:
Content-based Image Retrieval CE 264 Xiaoguang Feng March 14, 2002 Based on: J. Huang. Color-Spatial Image Indexing and Applications. Ph.D thesis, Cornell.
Region Segmentation. Find sets of pixels, such that All pixels in region i satisfy some constraint of similarity.
Image Search Presented by: Samantha Mahindrakar Diti Gandhi.
Texture Texture is a description of the spatial arrangement of color or intensities in an image or a selected region of an image. Structural approach:
Visual Information Systems Image Content. Visual cues to recover 3-D information There are number of cues available in the visual stimulus There are number.
Color a* b* Brightness L* Texture Original Image Features Feature combination E D 22 Boundary Processing Textons A B C A B C 22 Region Processing.
Texture Readings: Ch 7: all of it plus Carson paper
CS292 Computational Vision and Language Visual Features - Colour and Texture.
Image Processing David Kauchak cs458 Fall 2012 Empirical Evaluation of Dissimilarity Measures for Color and Texture Jan Puzicha, Joachim M. Buhmann, Yossi.
Distinctive Image Features from Scale-Invariant Keypoints By David G. Lowe, University of British Columbia Presented by: Tim Havinga, Joël van Neerbos.
1 Faculty of Information Technology Generic Fourier Descriptor for Shape-based Image Retrieval Dengsheng Zhang, Guojun Lu Gippsland School of Comp. & Info.
FRIP: A Region-Based Image Retrieval Tool Using Automatic Image Segmentation and Stepwise Boolean AND Matching IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 7,
Eigenedginess vs. Eigenhill, Eigenface and Eigenedge by S. Ramesh, S. Palanivel, Sukhendu Das and B. Yegnanarayana Department of Computer Science and Engineering.
Image and Video Retrieval INST 734 Doug Oard Module 13.
Geodesic Minimal Paths Vida Movahedi Elder Lab, January 2010.
Recognition and Matching based on local invariant features Cordelia Schmid INRIA, Grenoble David Lowe Univ. of British Columbia.
Local invariant features Cordelia Schmid INRIA, Grenoble.
Content-Based Image Retrieval
Texture. Texture is an innate property of all surfaces (clouds, trees, bricks, hair etc…). It refers to visual patterns of homogeneity and does not result.
Shape Analysis and Retrieval Structural Shape Descriptors Notes courtesy of Funk et al., SIGGRAPH 2004.
COLOR HISTOGRAM AND DISCRETE COSINE TRANSFORM FOR COLOR IMAGE RETRIEVAL Presented by 2006/8.
10/24/2015 Content-Based Image Retrieval: Feature Extraction Algorithms EE-381K-14: Multi-Dimensional Digital Signal Processing BY:Michele Saad
Object Detection with Discriminatively Trained Part Based Models
IEEE Int'l Symposium on Signal Processing and its Applications 1 An Unsupervised Learning Approach to Content-Based Image Retrieval Yixin Chen & James.
Data Extraction using Image Similarity CIS 601 Image Processing Ajay Kumar Yadav.
A survey of different shape analysis techniques 1 A Survey of Different Shape Analysis Techniques -- Huang Nan.
Non-Photorealistic Rendering and Content- Based Image Retrieval Yuan-Hao Lai Pacific Graphics (2003)
Local invariant features Cordelia Schmid INRIA, Grenoble.
1 A Compact Feature Representation and Image Indexing in Content- Based Image Retrieval A presentation by Gita Das PhD Candidate 29 Nov 2005 Supervisor:
Chittampally Vasanth Raja 10IT05F vasanthexperiments.wordpress.com.
Colour and Texture. Extract 3-D information Using Vision Extract 3-D information for performing certain tasks such as manipulation, navigation, and recognition.
Methods for 3D Shape Matching and Retrieval
Student: Chih-Wei Fang ( 方志偉 ) Adviser: Jenn-Jier James Lien ( 連震杰 ) Robotics Laboratory, Department of Computer Science and Information Engineering, National.
Query by Image and Video Content: The QBIC System M. Flickner et al. IEEE Computer Special Issue on Content-Based Retrieval Vol. 28, No. 9, September 1995.
Relevance Feedback in Image Retrieval System: A Survey Tao Huang Lin Luo Chengcui Zhang.
Content-Based Image Retrieval Using Color Space Transformation and Wavelet Transform Presented by Tienwei Tsai Department of Information Management Chihlee.
Finding Clusters within a Class to Improve Classification Accuracy Literature Survey Yong Jae Lee 3/6/08.
A. M. R. R. Bandara & L. Ranathunga
CS262: Computer Vision Lect 09: SIFT Descriptors
Personalized Social Image Recommendation
The Earth Mover's Distance
Color-Texture Analysis for Content-Based Image Retrieval
Content-based Image Retrieval
Self-Organizing Maps for Content-Based Image Database Retrieval
Jeremy Bolton, PhD Assistant Teaching Professor
Image Segmentation Techniques
Fall 2012 Longin Jan Latecki
Ying Dai Faculty of software and information science,
Aim of the project Take your image Submit it to the search engine
Improving Retrieval Performance of Zernike Moment Descriptor on Affined Shapes Dengsheng Zhang, Guojun Lu Gippsland School of Comp. & Info Tech Monash.
Multimedia Information Retrieval
A Computational Darkroom for BW Photography
Ying Dai Faculty of software and information science,
Source: Pattern Recognition Vol. 38, May, 2005, pp
Outline Announcement Perceptual organization, grouping, and segmentation Hough transform Read Chapter 17 of the textbook File: week14-m.ppt.
Descriptions of 3-D Objects and Scenes
Color Image Retrieval based on Primitives of Color Moments
Blobworld Texture Features
Recognition and Matching based on local invariant features
Review and Importance CS 111.
Color Image Retrieval based on Primitives of Color Moments
Presentation transcript:

By Pradeep C.Venkat Srinath Srinivasan Matching and Retrieval System Based on Vocabulary and Grammar of Color Patterns By Pradeep C.Venkat Srinath Srinivasan

The Problem To design an intelligent perception based system for pattern matching and retrieval of patterns from a database System must retrieve the closest match(es) in terms of ‘similarity’ to a user-inputted query image Matching must be done so as to emulate human perception to the extent possible

Mimicking Humans is a Tough Job! How do humans judge ‘similarity’ of images? What factors would best characterize the subjective phenomenon of human perception? Can these factors be generalized over all kinds of images?

Our Approach - Vocabulary and Grammar Four perceptual criteria (Mojsilovic, et al.) were identified for comparison of color patterns: Overall color Color purity Regularity and Placement Directionality Grammar: A set of rules governing the use of these criteria in judging similarity of patterns

Overview of the System Image Decomposition Estimation of Color Distribution Image Database Generation of Pattern Map Similarity Measurement Feature Extraction query Extraction of Texture Primitives Estimation of Primitive Distribution Similarity Judgment

Steps for Feature Extraction (Color Based) The input image is transformed into the Lab Color Space for compact perceptually based color representation Color distribution is determined using a vector quantization approach Significant features are determined from the histogram Color features are used in conjunction with an L2-norm distance measure to determine similarity

Steps for Feature Extraction (Texture Based) Spatial smoothing to remove background noise Construction of the achromatic pattern map (APM) Construction of an edge map from the APM Orientation processing to extract the distribution of pattern contours along different spatial directions Computation of scale-spatial texture edge distribution

The Database Our database consisted of over 300 images of color patterns, sceneries, buildings, plants, etc.

Results (Obvious Matches) Query Closest Matches

Results (contd.) - Obvious Matches Query Closest Matches

Results contd. (Non Obvious Matches?) Query Closest Matches

References A. Mojsilovic, et. al, Matching and retrieval based on vocabulary and grammar of color patterns, IEEE Trans. Image Processing, vol. 9, no. 1 (Special issue on Digital Libraries), Jan. 2000, pp.38-54. A. Mojsilovic, et. al, The vocabulary and Grammar of Color Patterns, IEEE Trans. Image Processing, vol. 9, no. 3 (Special issue on Digital Libraries), Jan. 2000, pp.38-54.