Face Model Fitting with Generic, Group-specific, and Person- specific Objective Functions Chair for Image Understanding and Knowledge-based Systems Institute.

Slides:



Advertisements
Similar presentations
Real-Time Template Tracking
Advertisements

Matthias Wimmer, Bernd Radig, Michael Beetz Chair for Image Understanding Computer Science TU München, Germany A Person and Context.
Active Appearance Models
12 th International Fall Workshop VISION, MODELING, AND VISUALIZATION 2007 November 7-9, 2007 Saarbrücken, Germany Estimating Natural Activity by Fitting.
Face Alignment by Explicit Shape Regression
Model-based Image Interpretation with Application to Facial Expression Recognition Matthias Wimmer
Technische Universität München Face Model Fitting based on Machine Learning from Multi-band Images of Facial Components Institute for Informatics Technische.
Matthias Wimmer, Ursula Zucker and Bernd Radig Chair for Image Understanding Computer Science Technische Universität München { wimmerm, zucker, radig
Welcome to the Ocean Color Bio-optical Algorithm Mini Workshop Goals, Motivation, and Guidance Janet W. Campbell University of New Hampshire Durham, New.
Automatically Annotating and Integrating Spatial Datasets Chieng-Chien Chen, Snehal Thakkar, Crail Knoblock, Cyrus Shahabi Department of Computer Science.
Face Alignment with Part-Based Modeling
Multi-Local Feature Manifolds for Object Detection Oscar Danielsson Stefan Carlsson Josephine Sullivan
Facial feature localization Presented by: Harvest Jang Spring 2002.
Multiple People Detection and Tracking with Occlusion Presenter: Feifei Huo Supervisor: Dr. Emile A. Hendriks Dr. A. H. J. Stijn Oomes Information and.
Autocorrelation and Linkage Cause Bias in Evaluation of Relational Learners David Jensen and Jennifer Neville.
Ao-Jan Su † Y. Charlie Hu ‡ Aleksandar Kuzmanovic † Cheng-Kok Koh ‡ † Northwestern University ‡ Purdue University How to Improve Your Google Ranking: Myths.
Instructor: Mircea Nicolescu Lecture 13 CS 485 / 685 Computer Vision.
Multiple Criteria for Evaluating Land Cover Classification Algorithms Summary of a paper by R.S. DeFries and Jonathan Cheung-Wai Chan April, 2000 Remote.
Robust Moving Object Detection & Categorization using self- improving classifiers Omar Javed, Saad Ali & Mubarak Shah.
Region labelling Giving a region a name. Image Processing and Computer Vision: 62 Introduction Region detection isolated regions Region description properties.
1 Learning to Detect Objects in Images via a Sparse, Part-Based Representation S. Agarwal, A. Awan and D. Roth IEEE Transactions on Pattern Analysis and.
Feature Screening Concept: A greedy feature selection method. Rank features and discard those whose ranking criterions are below the threshold. Problem:
Automatic Facial Landmark Tracking in Video Sequences using Kalman Filter Assisted Active Shape Models Utsav Prabhu, Keshav Seshadri, Marios Savvides 報告人.
Automatic Spelling Correction Probability Models and Algorithms Motivation and Formulation Demonstration of a Prototype Program The Underlying Probability.
Presented by Zeehasham Rasheed
Active Appearance Models Computer examples A. Torralba T. F. Cootes, C.J. Taylor, G. J. Edwards M. B. Stegmann.
Augmented Reality: Object Tracking and Active Appearance Model
Parameterizing Random Test Data According to Equivalence Classes Chris Murphy, Gail Kaiser, Marta Arias Columbia University.
Face Processing System Presented by: Harvest Jang Group meeting Fall 2002.
A Vision-Based System that Detects the Act of Smoking a Cigarette Xiaoran Zheng, University of Nevada-Reno, Dept. of Computer Science Dr. Mubarak Shah,
Learning the Appearance of Faces: A Unifying Approach for the Analysis and Synthesis of Images. Thomas Vetter Germany University of Freiburg
Face Recognition and Retrieval in Video Basic concept of Face Recog. & retrieval And their basic methods. C.S.E. Kwon Min Hyuk.
Introduction to machine learning
12 August 2015 Chair for Computer Aided Medical Procedures & Augmented Reality Department of Computer Science | Technische Universität München Chair for.
Chair for Computer Aided Medical Procedures & Augmented Reality Department of Computer Science | Technische Universität München Chair for Computer Aided.
Matthias Wimmer, Bernd Radig, Michael Beetz Chair for Image Understanding Computer Science Technische Universität München Adaptive.
Matthias Wimmer, Sylvia Pietzsch, Freek Stulp and Bernd Radig Chair for Image Understanding Institute for Computer Science Technische Universität München.
EE392J Final Project, March 20, Multiple Camera Object Tracking Helmy Eltoukhy and Khaled Salama.
Wang, Z., et al. Presented by: Kayla Henneman October 27, 2014 WHO IS HERE: LOCATION AWARE FACE RECOGNITION.
Facial Feature Detection
Face Alignment Using Cascaded Boosted Regression Active Shape Models
1 Template-Based Classification Method for Chinese Character Recognition Presenter: Tienwei Tsai Department of Informaiton Management, Chihlee Institute.
Final Exam Review CS485/685 Computer Vision Prof. Bebis.
Data Mining Joyeeta Dutta-Moscato July 10, Wherever we have large amounts of data, we have the need for building systems capable of learning information.
Multimodal Interaction Dr. Mike Spann
Prakash Chockalingam Clemson University Non-Rigid Multi-Modal Object Tracking Using Gaussian Mixture Models Committee Members Dr Stan Birchfield (chair)
1 TEMPLATE MATCHING  The Goal: Given a set of reference patterns known as TEMPLATES, find to which one an unknown pattern matches best. That is, each.
Classification. An Example (from Pattern Classification by Duda & Hart & Stork – Second Edition, 2001)
Slides are based on Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems.
X-ray Image Segmentation using Active Shape Models
Phase Congruency Detects Corners and Edges Peter Kovesi School of Computer Science & Software Engineering The University of Western Australia.
Automatic Image Annotation by Using Concept-Sensitive Salient Objects for Image Content Representation Jianping Fan, Yuli Gao, Hangzai Luo, Guangyou Xu.
Vision-based human motion analysis: An overview Computer Vision and Image Understanding(2007)
1 Reconstructing head models from photograph for individualized 3D-audio processing Matteo Dellepiane, Nico Pietroni, Nicolas Tsingos, Manuel Asselot,
1 Document Image Matching Based on Component Blocks Fuhui Long, Hanchuan Peng, Zheru Chi, and Wanchi Siu Center for Multimedia Signal Processing, Department.
GENDER AND AGE RECOGNITION FOR VIDEO ANALYTICS SOLUTION PRESENTED BY: SUBHASH REDDY JOLAPURAM.
Sylvia Pietzsch Chair for Image Understanding Computer Science Technische Universität München Learning Generic and Person Specific Objective.
Identifying “Best Bet” Web Search Results by Mining Past User Behavior Author: Eugene Agichtein, Zijian Zheng (Microsoft Research) Source: KDD2006 Reporter:
Face Recognition Summary –Single pose –Multiple pose –Principal components analysis –Model-based recognition –Neural Networks.
Tracking Groups of People for Video Surveillance Xinzhen(Elaine) Wang Advisor: Dr.Longin Latecki.
Novel Approaches to Optimised Self-configuration in High Performance Multiple Experts M.C. Fairhurst and S. Hoque University of Kent UK A.F. R. Rahman.
Stephan Tschechne Chair for Image Understanding Computer Science Technische Universität München Designing vs. Learning the Objective.
IEEE AI - BASED POWER SYSTEM TRANSIENT SECURITY ASSESSMENT Dr. Hossam Talaat Dept. of Electrical Power & Machines Faculty of Engineering - Ain Shams.
 Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems n Introduction.
Tracking parameter optimization
Students: Meiling He Advisor: Prof. Brain Armstrong
PRAKASH CHOCKALINGAM, NALIN PRADEEP, AND STAN BIRCHFIELD
Authors: Wai Lam and Kon Fan Low Announcer: Kyu-Baek Hwang
Presentation transcript:

Face Model Fitting with Generic, Group-specific, and Person- specific Objective Functions Chair for Image Understanding and Knowledge-based Systems Institute for Informatics Technische Universität München Sylvia Pietzsch

2008, January 22 nd 2/15 Technische Universität München Sylvia Pietzsch Overview  Model-based Image Interpretation  Generic Objective Functions  Specific Objective Functions  Experimental Results  Conclusion and Outlook

2008, January 22 nd 3/15 Technische Universität München Sylvia Pietzsch Model-based image interpretation  The model The model contains a parameter vector that represents the model’s configuration.  The objective function Calculates a value that indicates how accurately a parameterized model matches an image.  The fitting algorithm Searches for the model parameters that describe the image best, i.e. it minimizes the objective function.

2008, January 22 nd 4/15 Technische Universität München Sylvia Pietzsch Local Objective Functions

2008, January 22 nd 5/15 Technische Universität München Sylvia Pietzsch Ideal Objective Functions P1:Correctness property: Global minimum corresponds to the best fit. P2:Uni-modality property: The objective function has no local extrema. ¬ P1 P1 ¬P2 P2  Don’t exist for real-world images  Only for annotated images: f n ( I, x ) = | c n – x |

2008, January 22 nd 6/15 Technische Universität München Sylvia Pietzsch Learning the Objective Function x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x  Ideal objective function generates training data  Machine Learning technique generates calculation rules

2008, January 22 nd 7/15 Technische Universität München Sylvia Pietzsch Learning the Objective Function (1)

2008, January 22 nd 8/15 Technische Universität München Sylvia Pietzsch Learning the Objective Function (2)

2008, January 22 nd 9/15 Technische Universität München Sylvia Pietzsch Learning the Objective Function (3) 6 styles · 3 sizes · (5 · 5) locations = 450 features

2008, January 22 nd 10/15 Technische Universität München Sylvia Pietzsch Specific Objective Functions  Single Images The objective function has to take any appearance of a human face into consideration. ➱ moderate accuracy  Image Sequence The appearance of a person‘s face only changes slightly.  Consider particular characteristics of the visible person, e.g. beard, glasses, bald head,... ➱ increase of accuracy  Challenges:  Learn specific objective functions for groups of persons offline.  Detect the correct group online.

2008, January 22 nd 11/15 Technische Universität München Sylvia Pietzsch Evaluation: Fitting Results 45 persons from news broadcasts on TV

2008, January 22 nd 12/15 Technische Universität München Sylvia Pietzsch Group-specific Objective Functions  automatically subdivide persons into partitions  learn objective function for each partition  best possible partitioning: minimize the mean fitting error when applying the group-specific objective functions to the partitions  number of partitions influences specificity

2008, January 22 nd 13/15 Technische Universität München Sylvia Pietzsch Experimental Results P26 P44 P42 λ = 3.9

2008, January 22 nd 14/15 Technische Universität München Sylvia Pietzsch Conclusion and Outlook  large variation in facial appearance challenges model fitting  trade-off between generality and accuracy  group-specific objective functions perform substantially better for persons within the group  of avail for tracking face models through image sequences  Further work: automatic classification to determine on-line, which partition a person belongs to

2008, January 22 nd 15/15 Technische Universität München Sylvia Pietzsch Thank you!