Project 2 SIFT Matching by Hierarchical K-means Quantization 2014-4-21.

Slides:



Advertisements
Similar presentations
Zhimin CaoThe Chinese University of Hong Kong Qi YinITCS, Tsinghua University Xiaoou TangShenzhen Institutes of Advanced Technology Chinese Academy of.
Advertisements

Multi-layer Orthogonal Codebook for Image Classification Presented by Xia Li.
CS395: Visual Recognition Spatial Pyramid Matching Heath Vinicombe The University of Texas at Austin 21 st September 2012.
Query Specific Fusion for Image Retrieval
Herv´ eJ´ egouMatthijsDouzeCordeliaSchmid INRIA INRIA INRIA
1 Part 1: Classical Image Classification Methods Kai Yu Dept. of Media Analytics NEC Laboratories America Andrew Ng Computer Science Dept. Stanford University.
CS4670 / 5670: Computer Vision Bag-of-words models Noah Snavely Object
Bag-of-features models. Origin 1: Texture recognition Texture is characterized by the repetition of basic elements or textons For stochastic textures,
Image alignment Image from
Empowering visual categorization with the GPU Present by 陳群元 我是強壯 !
Bag-of-features models Many slides adapted from Fei-Fei Li, Rob Fergus, and Antonio Torralba.
Packing bag-of-features ICCV 2009 Herv´e J´egou Matthijs Douze Cordelia Schmid INRIA.
Bundling Features for Large Scale Partial-Duplicate Web Image Search Zhong Wu ∗, Qifa Ke, Michael Isard, and Jian Sun CVPR 2009.
Effective Image Database Search via Dimensionality Reduction Anders Bjorholm Dahl and Henrik Aanæs IEEE Computer Society Conference on Computer Vision.
Non-metric affinity propagation for unsupervised image categorization Delbert Dueck and Brendan J. Frey ICCV 2007.
Li-Jia Li Yongwhan Lim Li Fei-Fei Chong Wang David M. Blei B UILDING AND U SING A S EMANTIVISUAL I MAGE H IERARCHY CVPR, 2010.
First Law Of Geography:
Lecture 28: Bag-of-words models
1 Abstract This paper presents a novel modification to the classical Competitive Learning (CL) by adding a dynamic branching mechanism to neural networks.
Video Google: Text Retrieval Approach to Object Matching in Videos Authors: Josef Sivic and Andrew Zisserman ICCV 2003 Presented by: Indriyati Atmosukarto.
Beyond bags of features: Adding spatial information Many slides adapted from Fei-Fei Li, Rob Fergus, and Antonio Torralba.
Bag-of-features models
Video Google: Text Retrieval Approach to Object Matching in Videos Authors: Josef Sivic and Andrew Zisserman University of Oxford ICCV 2003.
Introduction to Bioinformatics - Tutorial no. 12
APPLICATION OF K-MEANS CLUSTERING The Matlab function “kmeans()” was used for clustering The parameters to the function were : 1. The matrix of entire.
Multiple Object Class Detection with a Generative Model K. Mikolajczyk, B. Leibe and B. Schiele Carolina Galleguillos.
Review: Intro to recognition Recognition tasks Machine learning approach: training, testing, generalization Example classifiers Nearest neighbor Linear.
Bag-of-features models. Origin 1: Texture recognition Texture is characterized by the repetition of basic elements or textons For stochastic textures,
Indexing Techniques Mei-Chen Yeh.
Exercise Session 10 – Image Categorization
Project 4 Image Search based on BoW model with Inverted File System
Learning Visual Similarity Measures for Comparing Never Seen Objects By: Eric Nowark, Frederic Juric Presented by: Khoa Tran.
Special Topic on Image Retrieval
AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL Ming Chen, Yueting Zhuang, Fei Wu College of Computer Science, Zhejiang.
Learning Visual Bits with Direct Feature Selection Joel Jurik 1 and Rahul Sukthankar 2,3 1 University of Central Florida 2 Intel Research Pittsburgh 3.
Presented by Tienwei Tsai July, 2005
An Example of Course Project Face Identification.
Bag-of-features models. Origin 1: Texture recognition Texture is characterized by the repetition of basic elements or textons For stochastic textures,
A Statistical Approach to Speed Up Ranking/Re-Ranking Hong-Ming Chen Advisor: Professor Shih-Fu Chang.
Svetlana Lazebnik, Cordelia Schmid, Jean Ponce
Video Google: A Text Retrieval Approach to Object Matching in Videos Josef Sivic and Andrew Zisserman.
Machine Learning Neural Networks (3). Understanding Supervised and Unsupervised Learning.
Fast Direct Super-Resolution by Simple Functions
Beyond Sliding Windows: Object Localization by Efficient Subwindow Search The best paper prize at CVPR 2008.
Efficient Subwindow Search: A Branch and Bound Framework for Object Localization ‘PAMI09 Beyond Sliding Windows: Object Localization by Efficient Subwindow.
SIFT Algorithm Scale-invariant feature transform Extracts features that are robust to changes in image scale, noise, illumination, and local geometric.
Locality-constrained Linear Coding for Image Classification
Week 8 Shelby Thompson. This week: Continued to work with PubFig83 dataset Saved.mat files for each training and testing image.mat files include information.
Towards Semantic Embedding in Visual Vocabulary Towards Semantic Embedding in Visual Vocabulary The Twenty-Third IEEE Conference on Computer Vision and.
Kylie Gorman WEEK 1-2 REVIEW. CONVERTING AN IMAGE FROM RGB TO HSV AND DISPLAY CHANNELS.
Delivering Business Value through IT Face feature detection using Java and OpenCV 1.
A Multiresolution Symbolic Representation of Time Series Vasileios Megalooikonomou Qiang Wang Guo Li Christos Faloutsos Presented by Rui Li.
Final Project Mei-Chen Yeh May 15, General In-class presentation – June 12 and June 19, 2012 – 15 minutes, in English 30% of the overall grade In-class.
Computer Vision Group Department of Computer Science University of Illinois at Urbana-Champaign.
Matlab Demo Feature Matching SIFT Source
R 朱冠宇 r 李哲君 2012/04/17. Hierarchical K-means.
Given a set of data points as input Randomly assign each point to one of the k clusters Repeat until convergence – Calculate model of each of the k clusters.
Project 3 SIFT Matching by Binary SIFT
COS 429 PS3: Stitching a Panorama Due November 10 th.
Height Estimation from Egocentric Video- Week 1 Dr. Ali Borji Aisha Urooj Khan Jessie Finocchiaro UCF CRCV REU 2016.
Does one size really fit all? Evaluating classifiers in a Bag-of-Visual-Words classification Christian Hentschel, Harald Sack Hasso Plattner Institute.
Zachary Starr Dept. of Computer Science, University of Missouri, Columbia, MO 65211, USA Digital Image Processing Final Project Dec 11 th /16 th, 2014.
Course Project Lists for ITCS6157 Jianping Fan. Project Implementation Lists Automatic Image Clustering You can download 1,000,000 images from You can.
Lecture IX: Object Recognition (2)
Open Source Robotics Vision and Mapping System
By Suren Manvelyan, Crocodile (nile crocodile?) By Suren Manvelyan,
Brewing Deep Networks With Caffe
CVPR 2014 Orientational Pyramid Matching for Recognizing Indoor Scenes
REU Week 1 Ivette Carreras UCF.
ECE734 Project-Scale Invariant Feature Transform Algorithm
Presentation transcript:

Project 2 SIFT Matching by Hierarchical K-means Quantization

Experiment Setting Image database – UKBench dataset: images from 2550 categories Feature extraction – SIFT feature The source code will be provided –

Tasks Codebook training – Sample SIFT features from the UKB data set Training sample number: 100K – Train visual codebook by hierarchical k-means Codebook size: 10K (level = 4, branch = 10) – Each cluster center is regarded as a visual word Feature quantization with visual codebook – Identify the closest visual word for a test feature – Assign the cluster ID to the feature as quantization result Feature matching based on quantization – Two features from two images are considered as a match if they are quantized to the same visual word – Select 5 relevant image pairs to conduct feature matching – Select 5 irrelevant image pairs to conduct feature matching

Implementation Program with C++ or Matlab – You may need Open CV when programing with C++ OpenCV 210 library files are provided – You do not need to install the OpenCV source file Refer to OpenCV China for instructions to set programming environment – Refer to OpenCV China for instructions to process images : –