1 Challenge the future HON4D: Histogram of Oriented 4D Normals for Activity Recognition from Depth Sequences Omar Oreifej Zicheng Liu CVPR 2013.

Slides:



Advertisements
Similar presentations
Distinctive Image Features from Scale-Invariant Keypoints David Lowe.
Advertisements

STOR 892 Object Oriented Data Analysis Radial Distance Weighted Discrimination Jie Xiong Advised by Prof. J.S. Marron Department of Statistics and Operations.
Road-Sign Detection and Recognition Based on Support Vector Machines Saturnino, Sergio et al. Yunjia Man ECG 782 Dr. Brendan.
Histograms of Oriented Gradients for Human Detection
Three things everyone should know to improve object retrieval
RGB-D object recognition and localization with clutter and occlusions Federico Tombari, Samuele Salti, Luigi Di Stefano Computer Vision Lab – University.
Human Identity Recognition in Aerial Images Omar Oreifej Ramin Mehran Mubarak Shah CVPR 2010, June Computer Vision Lab of UCF.
Classification using intersection kernel SVMs is efficient Joint work with Subhransu Maji and Alex Berg Jitendra Malik UC Berkeley.
Learning Globally-Consistent Local Distance Functions for Shape-Based Image Retrieval and Classification Computer Vision, ICCV IEEE 11th International.
MIT CSAIL Vision interfaces Approximate Correspondences in High Dimensions Kristen Grauman* Trevor Darrell MIT CSAIL (*) UT Austin…
The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features Kristen Grauman Trevor Darrell MIT.
Ivan Laptev IRISA/INRIA, Rennes, France September 07, 2006 Boosted Histograms for Improved Object Detection.
Computer Vision for Human-Computer InteractionResearch Group, Universität Karlsruhe (TH) cv:hci Dr. Edgar Seemann 1 Computer Vision: Histograms of Oriented.
Lecture 31: Modern object recognition
LPP-HOG: A New Local Image Descriptor for Fast Human Detection Andy Qing Jun Wang and Ru Bo Zhang IEEE International Symposium.
Detecting Categories in News Video Using Image Features Slav Petrov, Arlo Faria, Pascal Michaillat, Alex Berg, Andreas Stolcke, Dan Klein, Jitendra Malik.
Image and video descriptors
Activity Recognition Aneeq Zia. Agenda What is activity recognition Typical methods used for action recognition “Evaluation of local spatio-temporal features.
Juergen Gall Action Recognition.
Real-Time Human Pose Recognition in Parts from Single Depth Images Presented by: Mohammad A. Gowayyed.
Face Recognition & Biometric Systems, 2005/2006 Face recognition process.
Fast intersection kernel SVMs for Realtime Object Detection
São Paulo Advanced School of Computing (SP-ASC’10). São Paulo, Brazil, July 12-17, 2010 Looking at People Using Partial Least Squares William Robson Schwartz.
DISCRIMINATIVE DECORELATION FOR CLUSTERING AND CLASSIFICATION ECCV 12 Bharath Hariharan, Jitandra Malik, and Deva Ramanan.
Recognition using Regions CVPR Outline Introduction Overview of the Approach Experimental Results Conclusion.
3-D Depth Reconstruction from a Single Still Image 何開暘
Distinguishing Photographic Images and Photorealistic Computer Graphics Using Visual Vocabulary on Local Image Edges Rong Zhang,Rand-Ding Wang, and Tian-Tsong.
Feature Screening Concept: A greedy feature selection method. Rank features and discard those whose ranking criterions are below the threshold. Problem:
CS292 Computational Vision and Language Visual Features - Colour and Texture.
The Terrapins Computer Vision Laboratory University of Maryland.
Unsupervised Learning of Categories from Sets of Partially Matching Image Features Kristen Grauman and Trevor Darrel CVPR 2006 Presented By Sovan Biswas.
CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu Lecture 35 – Review for midterm.
Image and Video Retrieval INST 734 Doug Oard Module 13.
Watch, Listen and Learn Sonal Gupta, Joohyun Kim, Kristen Grauman and Raymond Mooney -Pratiksha Shah.
Jifeng Dai 2011/09/27.  Introduction  Structural SVM  Kernel Design  Segmentation and parameter learning  Object Feature Descriptors  Experimental.
Classifying Images with Visual/Textual Cues By Steven Kappes and Yan Cao.
Lecture 31: Modern recognition CS4670 / 5670: Computer Vision Noah Snavely.
Support Vector Machines Reading: Ben-Hur and Weston, “A User’s Guide to Support Vector Machines” (linked from class web page)
Discriminative Local Binary Patterns for Human Detection in Personal Album.
Pedestrian Detection and Localization
Beyond Sliding Windows: Object Localization by Efficient Subwindow Search The best paper prize at CVPR 2008.
ECE 8443 – Pattern Recognition EE 3512 – Signals: Continuous and Discrete Objectives: Spectrograms Revisited Feature Extraction Filter Bank Analysis EEG.
Pattern Recognition April 19, 2007 Suggested Reading: Horn Chapter 14.
Chao-Yeh Chen and Kristen Grauman University of Texas at Austin Efficient Activity Detection with Max- Subgraph Search.
Human pose recognition from depth image MS Research Cambridge.
Gang WangDerek HoiemDavid Forsyth. INTRODUCTION APROACH (implement detail) EXPERIMENTS CONCLUSION.
Sean M. Ficht.  Problem Definition  Previous Work  Methods & Theory  Results.
Support Vector Machines. Notation Assume a binary classification problem. –Instances are represented by vector x   n. –Training examples: x = (x 1,
Text From Corners: A Novel Approach to Detect Text and Caption in Videos Xu Zhao, Kai-Hsiang Lin, Yun Fu, Member, IEEE, Yuxiao Hu, Member, IEEE, Yuncai.
+ Speed Up Texture Classification in Clothing Retrieval System 電機三 吳瑋凌.
Presented by David Lee 3/20/2006
Classifying Covert Photographs CVPR 2012 POSTER. Outline  Introduction  Combine Image Features and Attributes  Experiment  Conclusion.
Support Vector Machines Reading: Ben-Hur and Weston, “A User’s Guide to Support Vector Machines” (linked from class web page)
More sliding window detection: Discriminative part-based models
3D Face Recognition Using Range Images Literature Survey Joonsoo Lee 3/10/05.
Finding Clusters within a Class to Improve Classification Accuracy Literature Survey Yong Jae Lee 3/6/08.
1 Bilinear Classifiers for Visual Recognition Computational Vision Lab. University of California Irvine To be presented in NIPS 2009 Hamed Pirsiavash Deva.
Support Vector Machines Reading: Textbook, Chapter 5 Ben-Hur and Weston, A User’s Guide to Support Vector Machines (linked from class web page)
Action-Grounded Push Affordance Bootstrapping of Unknown Objects
Data Driven Attributes for Action Detection
An Additive Latent Feature Model
Paper Presentation: Shape and Matching
A Tutorial on HOG Human Detection
Context-Aware Modeling and Recognition of Activities in Video
Tremor Detection Using Motion Filtering and SVM Bilge Soran, Jenq-Neng Hwang, Linda Shapiro, ICPR, /16/2018.
Applications of Cellular Neural Networks to Image Understanding
Solid Geometry.
Filtering Things to take away from this lecture An image as a function
Papers 15/08.
Visualization CSE 694L Roger Crawfis The Ohio State University.
Presentation transcript:

1 Challenge the future HON4D: Histogram of Oriented 4D Normals for Activity Recognition from Depth Sequences Omar Oreifej Zicheng Liu CVPR 2013

2 Challenge the future Research Question Input: Depth sequences information (only) of segmented video (1 video for 1 activity) Output: Feature (activity descriptor) for Activity recognition: Classify the activity Why use depth information rather than color information? Depth reflects pure geometry and shape cues. Depth is insensitive to changes in lighting conditions.

3 Challenge the future Two key points about activity recognition feature Capture the shape cues at a specific time instance Capture the motion cues over the time

4 Challenge the future HON4D: Histogram of Oriented 4D Normals Analogous to HOG feature Calculated in 4D space: 2D images (x, y), depth (z), time (t) Surface normals capture the shape cues Change in the surface normals over time capture the motion cues. Normals in 3D example

5 Challenge the future 4D surface normal Depth (z) considered as a function of time (t), space (x, y) A surface S in a 4D space The normal to the surface S is

6 Challenge the future Histogram of 4D normals How to quantize the 4D space, i.e., get the bin of histogram? Polychoron: 4D regular geometric objects, analogous to cube in 3D space Dvide the 4D space uniformly with its vertices use 600-cell polychoron with 120 vertices Each vertex is referred as a projector, i.e., one bin of histogram. Histogram: Project 4D normals into 120 projectors HON4D: 120-dimension feature

7 Challenge the future Histogram of 4D normals Projection of 4D normals set of 120 projectors set of unit normals computed over all depth sequences Projection with inner product 120-dimensional HON4D descriptor feature by Normalization

8 Challenge the future Non-Uniform Quantization == Projectors Refinement Uniform space quantization is not always optimal. A better Non-Uniform Quantization could lead to better classification. = refine the projectors to better capture the distribution of the normals. How to evaluate the importance of each projector?

9 Challenge the future Non-Uniform Quantization == Projectors Refinement First intuition: calculate the projector density is the training video set. High density does not necessarily means high contribution in classification

10 Challenge the future Recall SVM

11 Challenge the future Non-Uniform Quantization == Projectors Refinement Consider a SVM classifier for the training set, is the set of support vectors in the training set. Discriminative projector density 1.High accumulation of normal vectors 2.High contribution in the final classification

12 Challenge the future Projectors Refinement Augment the density-learned projectors In experiments: 120  300

13 Challenge the future Flow chart

14 Challenge the future Experiments