Object Recognition with Features Inspired by Visual Cortex T. Serre, L. Wolf, T. Poggio Presented by Andrew C. Gallagher Jan. 25, 2007.

Slides:



Advertisements
Similar presentations
Distinctive Image Features from Scale-Invariant Keypoints
Advertisements

Complex Networks for Representation and Characterization of Images For CS790g Project Bingdong Li 9/23/2009.
Standard Brain Model for Vision
Distinctive Image Features from Scale-Invariant Keypoints David Lowe.
3D Model Matching with Viewpoint-Invariant Patches(VIP) Reporter :鄒嘉恆 Date : 10/06/2009.
Zhimin CaoThe Chinese University of Hong Kong Qi YinITCS, Tsinghua University Xiaoou TangShenzhen Institutes of Advanced Technology Chinese Academy of.
Object recognition and scene “understanding”
Presented by Xinyu Chang
Foreground Focus: Finding Meaningful Features in Unlabeled Images Yong Jae Lee and Kristen Grauman University of Texas at Austin.
Multi-layer Orthogonal Codebook for Image Classification Presented by Xia Li.
HMAX Models Architecture Jim Mutch March 31, 2010.
The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features Kristen Grauman Trevor Darrell MIT.
AGE ESTIMATION: A CLASSIFICATION PROBLEM HANDE ALEMDAR, BERNA ALTINEL, NEŞE ALYÜZ, SERHAN DANİŞ.
Semi-Supervised Hierarchical Models for 3D Human Pose Reconstruction Atul Kanaujia, CBIM, Rutgers Cristian Sminchisescu, TTI-C Dimitris Metaxas,CBIM, Rutgers.
Robust Object Tracking via Sparsity-based Collaborative Model
Ghunhui Gu, Joseph J. Lim, Pablo Arbeláez, Jitendra Malik University of California at Berkeley Berkeley, CA
Instructor: Mircea Nicolescu Lecture 13 CS 485 / 685 Computer Vision.
Learning Convolutional Feature Hierarchies for Visual Recognition
Model: Parts and Structure. History of Idea Fischler & Elschlager 1973 Yuille ‘91 Brunelli & Poggio ‘93 Lades, v.d. Malsburg et al. ‘93 Cootes, Lanitis,
Recognition using Regions CVPR Outline Introduction Overview of the Approach Experimental Results Conclusion.
Patch Descriptors CSE P 576 Larry Zitnick
A new face detection method based on shape information Pattern Recognition Letters, 21 (2000) Speaker: M.Q. Jing.
1 Interest Operators Find “interesting” pieces of the image –e.g. corners, salient regions –Focus attention of algorithms –Speed up computation Many possible.
Generic Object Detection using Feature Maps Oscar Danielsson Stefan Carlsson
Robust Object Recognition with Cortex-Like Mechanisms Thomas Serre, Lior Wolf, Stanley Bileshi, Maximilian Riesenhuber, and Tomaso Poggio, Member, IEEE.
(1) Feature-point matching by D.J.Duff for CompVis Online: Feature Point Matching Detection, Extraction.
5/30/2006EE 148, Spring Visual Categorization with Bags of Keypoints Gabriella Csurka Christopher R. Dance Lixin Fan Jutta Willamowski Cedric Bray.
Smart Traveller with Visual Translator. What is Smart Traveller? Mobile Device which is convenience for a traveller to carry Mobile Device which is convenience.
Smart Traveller with Visual Translator for OCR and Face Recognition LYU0203 FYP.
Overview of Back Propagation Algorithm
1 Interest Operators Find “interesting” pieces of the image Multiple possible uses –image matching stereo pairs tracking in videos creating panoramas –object.
Multiclass object recognition
Bag-of-Words based Image Classification Joost van de Weijer.
Distinctive Image Features from Scale-Invariant Keypoints By David G. Lowe, University of British Columbia Presented by: Tim Havinga, Joël van Neerbos.
 C. C. Hung, H. Ijaz, E. Jung, and B.-C. Kuo # School of Computing and Software Engineering Southern Polytechnic State University, Marietta, Georgia USA.
Computer vision.
1 Interest Operators Harris Corner Detector: the first and most basic interest operator Kadir Entropy Detector and its use in object recognition SIFT interest.
Recognition and Matching based on local invariant features Cordelia Schmid INRIA, Grenoble David Lowe Univ. of British Columbia.
Hurieh Khalajzadeh Mohammad Mansouri Mohammad Teshnehlab
Hierarchical model for pattern recognition based on parallel and distributed computing Olivier Bornet, University Joseph Fourier Grenoble Martin Kalany,
SVM-KNN Discriminative Nearest Neighbor Classification for Visual Category Recognition Hao Zhang, Alex Berg, Michael Maire, Jitendra Malik.
Hierarchical Neural Networks for Object Recognition and Scene “Understanding”
Generalized Hough Transform
Group Sparse Coding Samy Bengio, Fernando Pereira, Yoram Singer, Dennis Strelow Google Mountain View, CA (NIPS2009) Presented by Miao Liu July
Representations for object class recognition David Lowe Department of Computer Science University of British Columbia Vancouver, Canada Sept. 21, 2006.
Puzzle Solver Sravan Bhagavatula EE 638 Project Stanford ECE.
Gang WangDerek HoiemDavid Forsyth. INTRODUCTION APROACH (implement detail) EXPERIMENTS CONCLUSION.
Tree and leaf recognition
Histograms of Oriented Gradients for Human Detection Navneet Dalal and Bill Triggs CVPR 2005 Another Descriptor.
Similar Figures, Day 2. Warm Up Two figures are similar if one can be obtained from the other using a sequence of transformations in the plane.
Ivica Dimitrovski 1, Dragi Kocev 2, Suzana Loskovska 1, Sašo Džeroski 2 1 Faculty of Electrical Engineering and Information Technologies, Department of.
Introduction to Pattern Recognition (การรู้จํารูปแบบเบื้องต้น)
Describing People: A Poselet-Based Approach to Attribute Classification.
Goggle Gist on the Google Phone A Content-based image retrieval system for the Google phone Manu Viswanathan Chin-Kai Chang Ji Hyun Moon.
Type of Vehicle Recognition Using Template Matching Method Electrical Engineering Department Petra Christian University Surabaya - Indonesia Thiang, Andre.
WLD: A Robust Local Image Descriptor Jie Chen, Shiguang Shan, Chu He, Guoying Zhao, Matti Pietikäinen, Xilin Chen, Wen Gao 报告人:蒲薇榄.
Activity Recognition Journal Club “Neural Mechanisms for the Recognition of Biological Movements” Martin Giese, Tomaso Poggio (Nature Neuroscience Review,
1 How the Visual Cortex Recognizes Objects, The Tale of the Standard Model Greg McChesney Texas Tech University Jan 23, 2009 CS5331:
Distinctive Image Features from Scale-Invariant Keypoints
Bag-of-Visual-Words Based Feature Extraction
Learning Mid-Level Features For Recognition
Recognition using Nearest Neighbor (or kNN)
Paper Presentation: Shape and Matching
Feature description and matching
Object Recognition in the Dynamic Link Architecture
Categorization by Learning and Combing Object Parts
CSE 455 – Guest Lectures 3 lectures Contact Interest points 1
SIFT keypoint detection
ECE734 Project-Scale Invariant Feature Transform Algorithm
Recognition and Matching based on local invariant features
Presentation transcript:

Object Recognition with Features Inspired by Visual Cortex T. Serre, L. Wolf, T. Poggio Presented by Andrew C. Gallagher Jan. 25, 2007

Overview Motivation Biological Model The Features Results Conclusions

Motivation We know the human visual system works. So, let’s try to build a recognition system that is modeled after the HVS.

Recognition Background Template-Based Methods- lack robustness to object transformation. Histogram-Based Descriptors (e.g. SIFT) have so much flexibility that discrimination can be degraded. This paper introduces new features (inspired by the human visual system) that exhibit a better trade-off between invariance and selectivity.

Biological Model

The Feature Algorithm The Primary Visual Cortex (V1) contains simple (S1) and complex (C1) cells. S1: Apply a battery of Gabor Filters. C1: Take a maximum over scales.

S1 Simple Cells S1: Apply a battery of Gabor Filters, varying in size and orientation.

C1 Complex Cells C1: Take a maximum over scales (within each band) over each of the four orientations, providing robustness to scale and translation.

S2 and C2 A set of patches (n x n x 4 orientations) is randomly created. N = {4,8,12, or 16}. In S2, the stored patches are correlated with the C1 layers. This image has 1 plane per band, but no longer has different orientations (as it describes similarity across the orientations.) Basically, S2 is a Euclidean distance from an image patch C1 to a learned, labeled patch P. (About ~1000 randomly selected, unsupervised, patches are used). In C2, the max over positions and scales from the S2 map is found.

The Features

Another Feature Summary

Experimental Results Tested with images that either contain or do not contain a single instance of the target. The system must decide if the object is present. Datasets: MIT-CBCL, Caltech.

Experimental Results Results on 50 positive and 50 negative examples.

More Experimental Results

Learned Features

Conclusions Biologically motivated features are extracted and then used for classification. Based on a feedforward model of object recognition in the cortex. Performance is excellent.