Chapter 8 Content-Based Image Retrieval. Query By Keyword: Some textual attributes (keywords) should be maintained for each image. The image can be indexed.

Slides:



Advertisements
Similar presentations
Feature extraction: Corners
Advertisements

Object Recognition from Local Scale-Invariant Features David G. Lowe Presented by Ashley L. Kapron.
電腦視覺 Computer and Robot Vision I
November 12, 2013Computer Vision Lecture 12: Texture 1Signature Another popular method of representing shape is called the signature. In order to compute.
CSE 473/573 Computer Vision and Image Processing (CVIP)
Computer vision: models, learning and inference Chapter 13 Image preprocessing and feature extraction.
1 Texture Texture is a description of the spatial arrangement of color or intensities in an image or a selected region of an image. Structural approach:
1 Texture Texture is a description of the spatial arrangement of color or intensities in an image or a selected region of an image. Structural approach:
Concepts of Database Management Sixth Edition
Concepts of Database Management Seventh Edition
Computer Vision Lecture 16: Texture
Image Indexing and Retrieval using Moment Invariants Imran Ahmad School of Computer Science University of Windsor – Canada.
Image Retrieval by Content (CBIR)
Instructor: Mircea Nicolescu Lecture 13 CS 485 / 685 Computer Vision.
Robust and large-scale alignment Image from
1 Texture Texture is a description of the spatial arrangement of color or intensities in an image or a selected region of an image. Structural approach:
Feature extraction: Corners 9300 Harris Corners Pkwy, Charlotte, NC.
A Study of Approaches for Object Recognition
Lecture 4: Feature matching
Automatic Image Alignment (feature-based) : Computational Photography Alexei Efros, CMU, Fall 2005 with a lot of slides stolen from Steve Seitz and.
Lecture 3a: Feature detection and matching CS6670: Computer Vision Noah Snavely.
1Ellen L. Walker Matching Find a smaller image in a larger image Applications Find object / pattern of interest in a larger picture Identify moving objects.
CS4670: Computer Vision Kavita Bala Lecture 7: Harris Corner Detection.
Lecture 6: Feature matching and alignment CS4670: Computer Vision Noah Snavely.
Content-based Image Retrieval (CBIR)
Introduction --Classification Shape ContourRegion Structural Syntactic Graph Tree Model-driven Data-driven Perimeter Compactness Eccentricity.
Computer vision.
Digital Image Processing
Image and Video Retrieval INST 734 Doug Oard Module 13.
Chapter 7 Web Content Mining Xxxxxx. Introduction Web-content mining techniques are used to discover useful information from content on the web – textual.
Content-Based Image Retrieval Readings: Chapter 8: Queries Commercial Systems Retrieval Features Indexing in the FIDS System Lead-in to Object.
Image Retrieval Part I (Introduction). 2 Image Understanding Functions Image indexing similarity matching image retrieval (content-based method)
Digital Image Processing, 2nd ed. © 2002 R. C. Gonzalez & R. E. Woods Chapter 11 Representation & Description Chapter 11 Representation.
Digital Image Processing Lecture 20: Representation & Description
Local invariant features Cordelia Schmid INRIA, Grenoble.
A 3D Model Alignment and Retrieval System Ding-Yun Chen and Ming Ouhyoung.
Digital Camera and Computer Vision Laboratory Department of Computer Science and Information Engineering National Taiwan University, Taipei, Taiwan, R.O.C.
CSE 185 Introduction to Computer Vision Local Invariant Features.
Feature extraction: Corners 9300 Harris Corners Pkwy, Charlotte, NC.
Lecture 7: Features Part 2 CS4670/5670: Computer Vision Noah Snavely.
Local invariant features Cordelia Schmid INRIA, Grenoble.
2005/12/021 Content-Based Image Retrieval Using Grey Relational Analysis Dept. of Computer Engineering Tatung University Presenter: Tienwei Tsai ( 蔡殿偉.
Automatic License Plate Location Using Template Matching University of Wisconsin - Madison ECE 533 Image Processing Fall 2004 Project Kerry Widder.
CS654: Digital Image Analysis Lecture 36: Feature Extraction and Analysis.
Content-Based Image Retrieval QBIC Homepage The State Hermitage Museum db2www/qbicSearch.mac/qbic?selLang=English.
Methods for 3D Shape Matching and Retrieval
CS654: Digital Image Analysis
Image features and properties. Image content representation The simplest representation of an image pattern is to list image pixels, one after the other.
1 Faculty of Information Technology Enhanced Generic Fourier Descriptor for Object-Based Image Retrieval Dengsheng Zhang, Guojun Lu Gippsland School of.
1 Review and Summary We have covered a LOT of material, spending more time and more detail on 2D image segmentation and analysis, but hopefully giving.
CSE 185 Introduction to Computer Vision Local Invariant Features.
Content-Based Image Retrieval Readings: Chapter 8:
Goals of Computer Vision
Image Representation and Description – Representation Schemes
Digital Image Processing Lecture 20: Representation & Description
Content-Based Image Retrieval Readings: Chapter 8:
Content-based Image Retrieval (CBIR)
Slope and Curvature Density Functions
Paper Presentation: Shape and Matching
Feature description and matching
Shape matching and object recognition using shape contexts
Computer Vision Lecture 16: Texture II
بازیابی تصاویر بر اساس محتوا
Aim of the project Take your image Submit it to the search engine
Improving Retrieval Performance of Zernike Moment Descriptor on Affined Shapes Dengsheng Zhang, Guojun Lu Gippsland School of Comp. & Info Tech Monash.
Midterm Exam Closed book, notes, computer Similar to test 1 in format:
Transformation Operators
Comparing Images Using Hausdorff Distance
Feature descriptors and matching
Presentation transcript:

Chapter 8 Content-Based Image Retrieval

Query By Keyword: Some textual attributes (keywords) should be maintained for each image. The image can be indexed according to these attributes, so that they can be rapidly retrieved when a query is issued. This type of query can be expressed in Structured Query Language (SQL). Query By Example (QBE): User just show the system a sample image, then the system should be able to return similar images or images containing similar objects. Image Database Queries

Image Distance & Similarity Measures 1.Color Similarity 2.Texture Similarity 3.Shape Similarity 4.Object & Relationship similarity

Color Similarity Color percentages matching: R:20%, G:50%, B:30% Color histogram matching D hist (I,Q)=(h(I)-h(Q)) T A(h(I)-h(Q)) A is a similarity matrix  colors that are very similar should have similarity values close to one.

Color layout matching: compares each grid square of the query to the corresponding grid square of a potential matching image and combines the results into a single image distance  where C I (g) represents the color in grid square g of a database image I and C Q (g) represents the color in the corresponding grid square g of the query image Q. some suitable representations of color are 1.Mean 2.Mean and standard deviation 3.Multi-bin histogram Color Similarity

IQ based on Color Layout

Pick and click Suppose T(I) is a texture description vector which is a vector of numbers that summarizes the texture in a given image I (for example: Laws texture energy measures), then the texture distance measure is defined by Texture layout Texture Similarity

IQ based on Pick and Click

Shape Similarity 1.Shape Histogram 2.Boundary Matching 3.Sketch Matching

1. Shape Histogram Projection matching Horizontal & vertical projection: Each row and each column become a bin in the histogram. The count that is stored in a bin is the number of 1-pixels that appear in that row or column. Diagonal projection: An alternative is to define the bins from the top left to the bottom right of the shape. Size invariant  the number of row bins and the number of column bins in the bounding box can be fixed, histograms can be normalized before matching. Translation invariant Rotation invariant  compute the axis of the best-fitting ellipse and rotate the shape

Horizontal and vertical projections

Diagonal projection

Orientation histogram Construct a histogram over the tangent angle at each pixel on the boundary of the shape. Size invariant  histograms can be normalized before matching. Translation invariant Rotation invariant  choosing the bin with the largest count to be the first bin. Starting point invariant 1. Shape Histogram

2. Boundary Matching 1D Fourier Transform 1D Fourier Transform on the boundary

If only the first M coefficients (a 0, a 1, …, a M-1 ) are used, then is an approximation of u n Fourier Descriptors the coefficients (a 0, a 1, …, a M-1 ) is called Fourier Descriptors The Fourier distance measure is defined as: Fourier Descriptors

Properties of Fourier Descriptors Simple geometric transformations of a boundary, such as translation, rotation, and scaling, are related to simple operations of the boundary’s Fourier descriptors.

A formula for Fourier Descriptor that is invariant to translation, scaling, rotation, and starting point. A secret formula

IQ based on Boundary Matching

3. Sketch Matching 1.Affine transformation to specified size and applying median filter. 2.Edge detection using a gradient-based edge-finding algorithm  Refined edge image 3.Thinning and shrinking  Abstract image 4.The images are divided into grid squares and matching is performed based on local correlation.

The sketch distance measure is the inverse of the sum of each of the local correlations  where I(g) refres to grid square g of the abstract image I, Q(g) refers to grid square g of the linear sketch resulting from query image Q. 3. Sketch Matching

Object and Relational Similarity Face finding: Neural net classifier Flesh finding: then threshold based on