Unsupervised Face Alignment by Robust Nonrigid Mapping

Slides:



Advertisements
Similar presentations
Real-Time Detection, Alignment and Recognition of Human Faces
Advertisements

Shape Matching and Object Recognition using Low Distortion Correspondence Alexander C. Berg, Tamara L. Berg, Jitendra Malik U.C. Berkeley.
Coherent Laplacian 3D protrusion segmentation Oxford Brookes Vision Group Queen Mary, University of London, 11/12/2009 Fabio Cuzzolin.
Active Appearance Models
Image Registration  Mapping of Evolution. Registration Goals Assume the correspondences are known Find such f() and g() such that the images are best.
Face Alignment by Explicit Shape Regression
Foreground Focus: Finding Meaningful Features in Unlabeled Images Yong Jae Lee and Kristen Grauman University of Texas at Austin.
Image Congealing (batch/multiple) image (alignment/registration) Advanced Topics in Computer Vision (048921) Boris Kimelman.
Face Alignment with Part-Based Modeling
Mixture of trees model: Face Detection, Pose Estimation and Landmark Localization Presenter: Zhang Li.
Steerable Part Models Hamed Pirsiavash and Deva Ramanan
Joint Eye Tracking and Head Pose Estimation for Gaze Estimation
Yuanlu Xu Advisor: Prof. Liang Lin Person Re-identification by Matching Compositional Template with Cluster Sampling.
Face Alignment at 3000 FPS via Regressing Local Binary Features
Proportion Priors for Image Sequence Segmentation Claudia Nieuwenhuis, etc. ICCV 2013 Oral.
Robust Object Tracking via Sparsity-based Collaborative Model
Wangfei Ningbo University A Brief Introduction to Active Appearance Models.
A KLT-Based Approach for Occlusion Handling in Human Tracking Chenyuan Zhang, Jiu Xu, Axel Beaugendre and Satoshi Goto 2012 Picture Coding Symposium.
Instructor: Mircea Nicolescu Lecture 13 CS 485 / 685 Computer Vision.
Reverse Engineering Niloy J. Mitra.
INFORMATIK Differential Coordinates for Interactive Mesh Editing Yaron Lipman Olga Sorkine Daniel Cohen-Or David Levin Tel-Aviv University Christian Rössl.
Modeling Pixel Process with Scale Invariant Local Patterns for Background Subtraction in Complex Scenes (CVPR’10) Shengcai Liao, Guoying Zhao, Vili Kellokumpu,
Final Class: Range Data registration CISC4/689 Credits: Tel-Aviv University.
A Multi-Scale Tikhonov Regularization Scheme for Implicit Surface Modelling Jianke Zhu, Steven C.H. Hoi and Michael R. Lyu Department of CS&E, The Chinese.
Real-Time Non-Rigid Shape Recovery via AAMs for Augmented Reality Jackie Zhu Oct. 24, 2006.
A Study of Approaches for Object Recognition
Direct Methods for Visual Scene Reconstruction Paper by Richard Szeliski & Sing Bing Kang Presented by Kristin Branson November 7, 2002.
Real-time Combined 2D+3D Active Appearance Models Jing Xiao, Simon Baker,Iain Matthew, and Takeo Kanade CVPR 2004 Presented by Pat Chan 23/11/2004.
Recovering Articulated Object Models from 3D Range Data Dragomir Anguelov Daphne Koller Hoi-Cheung Pang Praveen Srinivasan Sebastian Thrun Computer Science.
Linear Solution to Scale and Rotation Invariant Object Matching Professor: 王聖智 教授 Student : 周 節.
Stereo matching Class 10 Read Chapter 7 Tsukuba dataset.
Wang, Z., et al. Presented by: Kayla Henneman October 27, 2014 WHO IS HERE: LOCATION AWARE FACE RECOGNITION.
Matching 3D Shapes Using 2D Conformal Representations Xianfeng Gu 1, Baba Vemuri 2 Computer and Information Science and Engineering, Gainesville, FL ,
Gwangju Institute of Science and Technology Intelligent Design and Graphics Laboratory Multi-scale tensor voting for feature extraction from unstructured.
Mining Discriminative Components With Low-Rank and Sparsity Constraints for Face Recognition Qiang Zhang, Baoxin Li Computer Science and Engineering Arizona.
A General Framework for Tracking Multiple People from a Moving Camera
TTH 1:30-2:48 Winter DL266 CIS 788v04 Zhu Topic 5. Human Faces Human face is extensively studied.
Building local part models for category-level recognition C. Schmid, INRIA Grenoble Joint work with G. Dorko, S. Lazebnik, J. Ponce.
Object Detection with Discriminatively Trained Part Based Models
80 million tiny images: a large dataset for non-parametric object and scene recognition CS 4763 Multimedia Systems Spring 2008.
Adaptive Rigid Multi-region Selection for 3D face recognition K. Chang, K. Bowyer, P. Flynn Paper presentation Kin-chung (Ryan) Wong 2006/7/27.
Real-Time Detection, Alignment and Recognition of Human Faces Rogerio Schmidt Feris Changbo Hu Matthew Turk Pattern Recognition Project June 12, 2003.
Paper Reading Dalong Du Nov.27, Papers Leon Gu and Takeo Kanade. A Generative Shape Regularization Model for Robust Face Alignment. ECCV08. Yan.
Bundle Adjustment A Modern Synthesis Bill Triggs, Philip McLauchlan, Richard Hartley and Andrew Fitzgibbon Presentation by Marios Xanthidis 5 th of No.
Recognition Using Visual Phrases
Skuller: A volumetric shape registration algorithm for modeling skull deformities Yusuf Sahillioğlu 1 and Ladislav Kavan 2 Medical Image Analysis 2015.
Lucas-Kanade Image Alignment Iain Matthews. Paper Reading Simon Baker and Iain Matthews, Lucas-Kanade 20 years on: A Unifying Framework, Part 1
CS 548 Spring 2016 Model and Regression Trees Showcase by Yanran Ma, Thanaporn Patikorn, Boya Zhou Showcasing work by Gabriele Fanelli, Juergen Gall, and.
Deformation Modeling for Robust 3D Face Matching Xioguang Lu and Anil K. Jain Dept. of Computer Science & Engineering Michigan State University.
Age-invariant Face Recognition
Guillaume-Alexandre Bilodeau
Zeyu You, Raviv Raich, Yonghong Huang (presenter)
Nearest-neighbor matching to feature database
Learning Mid-Level Features For Recognition
You can check broken videos in this slide here :
Fast Preprocessing for Robust Face Sketch Synthesis
Hybrid Features based Gender Classification
Recovery from Occlusion in Deep Feature Space for Face Recognition
Object Recognition in the Dynamic Link Architecture
Nearest-neighbor matching to feature database
Combining Geometric- and View-Based Approaches for Articulated Pose Estimation David Demirdjian MIT Computer Science and Artificial Intelligence Laboratory.
PRAKASH CHOCKALINGAM, NALIN PRADEEP, AND STAN BIRCHFIELD
Projective Transformations for Image Transition Animations
Single Image Rolling Shutter Distortion Correction
Outline Background Motivation Proposed Model Experimental Results
Liyuan Li, Jerry Kah Eng Hoe, Xinguo Yu, Li Dong, and Xinqi Chu
George Bebis and Wenjing Li Computer Vision Laboratory
Image Registration  Mapping of Evolution
Presentation transcript:

Unsupervised Face Alignment by Robust Nonrigid Mapping Experimental Results 1. Experimental Testbed Google Image Dataset 3467 face images collected by Google image search 101 individuals, 17-62 images for each individual LFW dataset Oxford VGG facial feature locator PC with Intel Core-2 Duo 2G Hz CPU and 2GB RAM Http://www.vision.ee.ethz.ch/~zhuji/facealign/index.html 2. Face Alignment Unsupervised Face Alignment by Robust Nonrigid Mapping Jianke Zhu¹, Luc Van Gool¹², Steven C.H. Hoi³ ¹ETH Zurich, ²K. U. Leuven, ³Nanyang Technological University Overview and Motivation Related Work Supervised Face Alignment Active appearance models, T. Cootes et al. TPAMI’01. Generalized shape regularization model, L. Gu and T. Kanade ECCV’08 Congealing Learned-Miller’s congealing, G.B. Huang et al. ICCV’07. Least square congealing, M. Cox et al. CVPR’08. Patch-based Rectification Kanade-Yamada algorithm, CIRA’03. Viewpoint invariant face recognition, A. Ashraf et al. CVPR’08. Nonrigid Shape Recovery Nonrigid surface detection, Pilet et al. CVPR’05, J. Zhu et al.CVPR’07 Deformable Lucas-Kanade algorithm, J. Zhu et al. TPAMI’09. Fig 3. Average of aligned facial images 3. Numerical Evaluation on Face Recognition Fig.1 We first fit a set of template images to the input image by a robust deformable Lucas-Kanade fitting scheme. Then, the input face image is rectified into the canonical frontal view. Fig. 4 Comparison of face alignment for various head poses. We show the results of the congealing, CMU’s online system , and the proposed joint deformable Lucas-Kanade method. Contributions of Unsupervised Face Alignment A new promising approach for face alignment Avoid the needs of manual labeling Only make assumption on the parameterization Flexible and practical for real applications Fig. 6 Correct recognition rate on 3467 Google face images (Intensity) Unsupervised Face Alignment Problem Formulation Fig.2 Example of image-to-image face alignment. We overlay a triangular mesh (Fig. 2(a)) and directly parameterize the transformation by the mesh vertex coordinates s. With its 2N free variables, the problem is ill-posed. To overcome this challenge, we adopt the algorithm proposed by Zhu et al. TPAMI’09 by introducing a regularization term: where is regularization coefficient, is the increments of mesh vertices and K is a sparse banded stiffness matrix. The solution for above optimization can be computed as below: where H is the Hessian matrix, and update equation: Robust Deformable Lucas-Kanade Algorithm To effectively handle outliers in intensities, we apply a robust estimator to the image differences u: Joint Face Alignment To increase the chances of homing in on the solution, we introduce multiple template images into the energy function. These jointly drive forward the evolution of the mesh on the input – i.e. target – face. We have the following energy function for joint face alignment: To preserve the texture variations, we employ the steepest descent matrices computed from each of the template images: where Ai is the steepest descent image, and Hessian matrix is computed as follows: Fig. 7 ROC curves on LFW dataset. 4. Face Swapping Application Fig. 5 Comparison of face alignment results for various expressions. ~ Conclusions A novel unsupervised face alignment method without assuming a rigid affine transformation for alignment A robust and efficient optimization scheme to make the solution reliable against outliers; A joint face alignment scheme that allows to use multiple templates to deal with large appearance changes Experiments on large sets of images, comparing against state-of-the-art face alignment techniques The Twelfth IEEE International Conference on Computer Vision (ICCV2009)