HCI/ComS 575X: Computational Perception

Slides:



Advertisements
Similar presentations
Detecting Faces in Images: A Survey
Advertisements

EE462 MLCV Lecture 5-6 Object Detection – Boosting Tae-Kyun Kim.
Rapid Object Detection using a Boosted Cascade of Simple Features Paul Viola, Michael Jones Conference on Computer Vision and Pattern Recognition 2001.
Rapid Object Detection using a Boosted Cascade of Simple Features Paul Viola, Michael Jones Conference on Computer Vision and Pattern Recognition 2001.
Face detection Behold a state-of-the-art face detector! (Courtesy Boris Babenko)Boris Babenko.
Face Detection & Synthesis using 3D Models & OpenCV Learning Bit by Bit Don Miller ITP, Spring 2010.
AdaBoost & Its Applications
Face detection Many slides adapted from P. Viola.
Cos 429: Face Detection (Part 2) Viola-Jones and AdaBoost Guest Instructor: Andras Ferencz (Your Regular Instructor: Fei-Fei Li) Thanks to Fei-Fei Li,
EE462 MLCV Lecture 5-6 Object Detection – Boosting Tae-Kyun Kim.
The Viola/Jones Face Detector Prepared with figures taken from “Robust real-time object detection” CRL 2001/01, February 2001.
The Viola/Jones Face Detector (2001)
HCI Final Project Robust Real Time Face Detection Paul Viola, Michael Jones, Robust Real-Time Face Detetion, International Journal of Computer Vision,
1 Learning to Detect Objects in Images via a Sparse, Part-Based Representation S. Agarwal, A. Awan and D. Roth IEEE Transactions on Pattern Analysis and.
Rapid Object Detection using a Boosted Cascade of Simple Features
Robust Real-time Object Detection by Paul Viola and Michael Jones ICCV 2001 Workshop on Statistical and Computation Theories of Vision Presentation by.
Face detection and recognition Many slides adapted from K. Grauman and D. Lowe.
A Robust Real Time Face Detection. Outline  AdaBoost – Learning Algorithm  Face Detection in real life  Using AdaBoost for Face Detection  Improvements.
A Robust Real Time Face Detection. Outline  AdaBoost – Learning Algorithm  Face Detection in real life  Using AdaBoost for Face Detection  Improvements.
Robust Real-Time Object Detection Paul Viola & Michael Jones.
Viola and Jones Object Detector Ruxandra Paun EE/CS/CNS Presentation
Computer Vision CSPP Artificial Intelligence March 3, 2004.
Foundations of Computer Vision Rapid object / face detection using a Boosted Cascade of Simple features Presented by Christos Stoilas Rapid object / face.
Face Detection CSE 576. Face detection State-of-the-art face detection demo (Courtesy Boris Babenko)Boris Babenko.
FACE DETECTION AND RECOGNITION By: Paranjith Singh Lohiya Ravi Babu Lavu.
Face Detection using the Viola-Jones Method
Using Statistic-based Boosting Cascade Weilong Yang, Wei Song, Zhigang Qiao, Michael Fang 1.
Object Detection Using the Statistics of Parts Presented by Nicholas Chan – Advanced Perception Robust Real-time Object Detection Henry Schneiderman.
Detecting Pedestrians Using Patterns of Motion and Appearance Paul Viola Microsoft Research Irfan Ullah Dept. of Info. and Comm. Engr. Myongji University.
Window-based models for generic object detection Mei-Chen Yeh 04/24/2012.
Sign Classification Boosted Cascade of Classifiers using University of Southern California Thang Dinh Eunyoung Kim
Lecture 29: Face Detection Revisited CS4670 / 5670: Computer Vision Noah Snavely.
Face detection Slides adapted Grauman & Liebe’s tutorial
DIEGO AGUIRRE COMPUTER VISION INTRODUCTION 1. QUESTION What is Computer Vision? 2.
Robust Real-time Face Detection by Paul Viola and Michael Jones, 2002 Presentation by Kostantina Palla & Alfredo Kalaitzis School of Informatics University.
ECE738 Advanced Image Processing Face Detection IEEE Trans. PAMI, July 1997.
Face Detection Ying Wu Electrical and Computer Engineering Northwestern University, Evanston, IL
Robust Real Time Face Detection
Adaboost and Object Detection Xu and Arun. Principle of Adaboost Three cobblers with their wits combined equal Zhuge Liang the master mind. Failure is.
HCI/ComS 575X: Computational Perception Instructor: Alexander Stoytchev
Lecture 09 03/01/2012 Shai Avidan הבהרה: החומר המחייב הוא החומר הנלמד בכיתה ולא זה המופיע / לא מופיע במצגת.
The Viola/Jones Face Detector A “paradigmatic” method for real-time object detection Training is slow, but detection is very fast Key ideas Integral images.
Bibek Jang Karki. Outline Integral Image Representation of image in summation format AdaBoost Ranking of features Combining best features to form strong.
Learning to Detect Faces A Large-Scale Application of Machine Learning (This material is not in the text: for further information see the paper by P.
Hand Gesture Recognition Using Haar-Like Features and a Stochastic Context-Free Grammar IEEE 高裕凱 陳思安.
FACE DETECTION : AMIT BHAMARE. WHAT IS FACE DETECTION ? Face detection is computer based technology which detect the face in digital image. Trivial task.
Notes on HW 1 grading I gave full credit as long as you gave a description, confusion matrix, and working code Many people’s descriptions were quite short.
Face detection Many slides adapted from P. Viola.
Hand Detection with a Cascade of Boosted Classifiers Using Haar-like Features Qing Chen Discover Lab, SITE, University of Ottawa May 2, 2006.
AdaBoost Algorithm and its Application on Object Detection Fayin Li.
1 Munther Abualkibash University of Bridgeport, CT.
Things iPhoto thinks are faces
CS262: Computer Vision Lect 06: Face Detection
Reading: R. Schapire, A brief introduction to boosting
2. Skin - color filtering.
Cascade for Fast Detection
Recognition Part II: Face Detection via AdaBoost
Session 7: Face Detection (cont.)
Presented by Minh Hoai Nguyen Date: 28 March 2007
Lit part of blue dress and shadowed part of white dress are the same color
High-Level Vision Face Detection.
In summary C1={skin} C2={~skin} Given x=[R,G,B], is it skin or ~skin?
Learning to Detect Faces Rapidly and Robustly
Cos 429: Face Detection (Part 2) Viola-Jones and AdaBoost Guest Instructor: Andras Ferencz (Your Regular Instructor: Fei-Fei Li) Thanks to Fei-Fei.
Face Detection via AdaBoost
ADABOOST(Adaptative Boosting)
Novel Face Detection Method Based on Gabor Features
HCI/ComS 575X: Computational Perception
Lecture 29: Face Detection Revisited
HCI/ComS 575X: Computational Perception
Presentation transcript:

HCI/ComS 575X: Computational Perception Instructor: Alexander Stoytchev http://www.cs.iastate.edu/~alex/classes/2006_Spring_575X/

Face Detection March 22, 2006 HCI/ComS 575X: Computational Perception Iowa State University, SPRING 2006 Copyright © 2006, Alexander Stoytchev

Lecture Plan HW3: Sample Solutions Face Detection: Neural Networks Approach Face Detection: Cascades OpenCV Demo HW4

HW3: Some of the better results (according to the TA) Wen-Chieh Chang (did all 3) In no specific order: Dongheng Li Ethan Slattery Jace Otting Matt Swanson Krista M. Thompson

HW3 Movies

Face Detection v.s. Face Recognition

Henry A. Rowley, Shumeet Baluja and Takeo Kanade (1997). ``Rotation Invariant Neural Network-Based Face Detection,'‘ Carnegie Mellon Technical Report, CMU-CS-97-201.

Rotation Invariant Face Detection

The Algorithm

Router Network

Router Network

Training Examples

Detection Network

Detection Network

Testing on Images with no Faces All detections are automatically salse positives They are added as negative examples in the training database

Results

Face Detection Movies

Web Demo of Face Detection http://demo.pittpatt.com/

Face Detection Using Cascades

Paul Viola and Michael Jones (2001). ``Robust Real-time Object Detection'', Second International Workshop on Statistical and Computational Theories of Vision Modeling, Learning, Computing, and Sampling, Vancouver, Canada, July 13, 2001.

Classical Face Detection Large Scale Painful! Small Scale

Viola/Jones Face Detector Technical advantages: Uses lots of very simple box features, enabling an efficient image representation Scales features rather than source image Cascaded classifier is very fast on non-faces Practical benefits: Very fast, compact footprint You don’t have to implement it! (should be in latest version of OpenCV)

This next set of slides is from: Robust Real-time Object Detection by Paul Viola and Michael Jones ICCV 2001 Workshop on Statistical and Computation Theories of Vision Presentation by Gyozo Gidofalvi Computer Science and Engineering Department University of California, San Diego gyozo@cs.ucsd.edu October 25, 2001

Object detection task Object detection framework: Given a set of images find regions in these images which contain instances of a certain kind of object. Task: Develop an algorithm to learn an fast and accurate method for object detection. To capture ad-hoc domain knowledge classifiers for images do not operate on raw grayscale pixel values but rather on values obtained from applying simple filters to the pixels.

Definition of simple features for object detection 3 rectangular features types: two-rectangle feature type (horizontal/vertical) three-rectangle feature type four-rectangle feature type Using a 24x24 pixel base detection window, with all the possible combination of horizontal and vertical location and scale of these feature types the full set of features has 49,396 features. The motivation behind using rectangular features, as opposed to more expressive steerable filters is due to their extreme computational efficiency.

Integral image s(x,y) = s(x,y-1) + i(x,y) ii(x,y) = ii(x-1,y) + s(x,y) Def: The integral image at location (x,y), is the sum of the pixel values above and to the left of (x,y), inclusive. Using the following two recurrences, where i(x,y) is the pixel value of original image at the given location and s(x,y) is the cumulative column sum, we can calculate the integral image representation of the image in a single pass. x (0,0) s(x,y) = s(x,y-1) + i(x,y) ii(x,y) = ii(x-1,y) + s(x,y) (x,y) y

Rapid evaluation of rectangular features Using the integral image representation one can compute the value of any rectangular sum in constant time. For example the integral sum inside rectangle D we can compute as: ii(4) + ii(1) – ii(2) – ii(3) As a result two-, three-, and four-rectangular features can be computed with 6, 8 and 9 array references respectively.

Challenges for learning a classification function Given a feature set and labeled training set of images one can apply number of machine learning techniques. Recall however, that there is 45,396 features associated with each image sub-window, hence the computation of all features is computationally prohibitive. Hypothesis: A combination of only a small number of these features can yield an effective classifier. Challenge: Find these discriminant features.

Performance of 200 feature face detector The ROC curve of the constructed classifies indicates that a reasonable detection rate of 0.95 can be achieved while maintaining an extremely low false positive rate of approximately 10-4. First features selected by AdaBoost are meaningful and have high discriminative power By varying the threshold of the final classifier one can construct a two-feature classifier which has a detection rate of 1 and a false positive rate of 0.4.

Speed-up through the Attentional Cascade Simple, boosted classifiers can reject many of negative sub-windows while detecting all positive instances. Series of such simple classifiers can achieve good detection performance while eliminating the need for further processing of negative sub-windows.

Processing in / training of the Attentional Cascade Processing: is essentially identical to the processing performed by a degenerate decision tree, namely only a positive result from a previous classifier triggers the evaluation of the subsequent classifier. Training: is also much like the training of a decision tree, namely subsequent classifiers are trained only on examples which pass through all the previous classifiers. Hence the task faced by classifiers further down the cascade is more difficult. To achieve efficient cascade for a given false positive rate F and detection rate D we would like to minimize the expected number of features evaluated N: Since this optimization is extremely difficult the usual framework is to choose a minimal acceptable false positive and detection rate per layer.

Experiments (dataset for training) 4916 positive training example were hand picked aligned, normalized, and scaled to a base resolution of 24x24 10,000 negative examples were selected by randomly picking sub-windows from 9500 images which did not contain faces

Experiments cont. (structure of the detector cascade) The final detector had 32 layers and 4297 features total Speed of the detector ~ total number of features evaluated On the MIT-CMU test set the average number of features evaluated is 8 (out of 4297). The processing time of a 384 by 288 pixel image on a conventional personal computer about .067 seconds. Processing time should linearly scale with image size, hence processing of a 3.1 mega pixel images taken from a digital camera should approximately take 2 seconds.

Results Testing of the final face detector was performed using the MIT+CMU frontal face test which consists of: 130 images 505 labeled frontal faces Results in the table compare the performance of the detector to best face detectors known. Rowley at al.: use a combination of 1wo neural networks (simple network for prescreening larger regions, complex network for detection of faces). Schneiderman at al.: use a set of models to capture the variation in facial appearance; each model describes the statistical behavior of a group of wavelet coefficients.

Results cont.

Conclusion The paper presents general object detection method which is illustrated on the face detection task. Using the integral image representation and simple rectangular features eliminate the need of expensive calculation of multi-scale image pyramid. Simple modification to AdaBoost gives a general technique for efficient feature selection. A general technique for constructing a cascade of homogeneous classifiers is presented, which can reject most of the negative examples at early stages of processing thereby significantly reducing computation time. A face detector using these techniques is presented which is comparable in classification performance to, and orders of magnitude faster than the best detectors know today.

Live OpenCV Demo of Face Detection Using Cascades

HW4 Face Detection and/or face recogniton. The PDF is posted on the website.

Can you find these faces in the sidewalk movies?

THE END