1 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Three Dimensional Face Recognition “And in stature he is small, chest broad,

Slides:



Advertisements
Similar presentations
Differential geometry I
Advertisements

3D Face Modelling and Recognition Survey Timur Aksoy Biometrics Course Fall 2011 Sabanci University.
Topology-Invariant Similarity and Diffusion Geometry
1 Numerical Geometry of Non-Rigid Shapes Diffusion Geometry Diffusion geometry © Alexander & Michael Bronstein, © Michael Bronstein, 2010 tosca.cs.technion.ac.il/book.
Discrete Geometry Tutorial 2 1
Isometry-Invariant Similarity
Biometrics & Security Tutorial 7. 1 (a) Please compare two different kinds of biometrics technologies: Retina and Iris. (P8:2-3)
Biometrics: Faces and Identity Verification in a Networked World
1 Numerical geometry of non-rigid shapes Geometry Numerical geometry of non-rigid shapes Shortest path problems Alexander Bronstein, Michael Bronstein,
1 Numerical geometry of non-rigid shapes Consistent approximation of geodesics in graphs Consistent approximation of geodesics in graphs Tutorial 3 © Alexander.
Shape reconstruction and inverse problems
Invariant correspondence
1 Michael Bronstein Computational metric geometry Computational metric geometry Michael Bronstein Department of Computer Science Technion – Israel Institute.
1 Numerical geometry of non-rigid shapes Partial similarity Partial similarity © Alexander & Michael Bronstein, © Michael Bronstein, 2010 tosca.cs.technion.ac.il/book.
Asst. Prof. Yusuf Sahillioğlu
Isometry invariant similarity
1 Michael Bronstein 3D face recognition Face recognition: New technologies, new challenges Michael M. Bronstein.
1 Numerical geometry of non-rigid shapes Lecture I – Introduction Numerical geometry of shapes Lecture I – Introduction non-rigid Michael Bronstein.
Spectral embedding Lecture 6 1 © Alexander & Michael Bronstein
Numerical geometry of non-rigid shapes
Numerical geometry of objects
1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute.
Department of Electrical and Computer Engineering Physical Biometrics Matthew Webb ECE 8741.
Lecture IV – Invariant Correspondence
Correspondence & Symmetry
1 Numerical geometry of non-rigid shapes Partial similarity Partial Similarity Alexander Bronstein, Michael Bronstein © 2008 All rights reserved. Web:
1 Numerical geometry of non-rigid shapes Spectral Methods Tutorial. Spectral Methods Tutorial 6 © Maks Ovsjanikov tosca.cs.technion.ac.il/book Numerical.
1 Numerical geometry of non-rigid shapes Lecture II – Numerical Tools Numerical geometry of shapes Lecture II – Numerical Tools non-rigid Alex Bronstein.
Spectral Embedding Alexander Bronstein, Michael Bronstein
Feature-based methods
Differential geometry II
Numerical geometry of non-rigid shapes
1 Numerical geometry of non-rigid shapes A journey to non-rigid world objects Invariant correspondence and shape synthesis non-rigid Alexander Bronstein.
1 Bronstein, Bronstein, and Kimmel Joint extrinsic and intrinsic similarity of non-rigid shapes Rock, paper, and scissors Joint extrinsic and intrinsic.
Invariant Correspondence
1 Regularized partial similarity of shapes NORDIA – CVPR 2008 Not only size matters: Regularized partial similarity of shapes Alexander Bronstein, Michael.
1 Numerical geometry of non-rigid shapes Spectral embedding Conclusions I hope that posterity will judge me kindly, not only as to the things which I have.
1 Numerical geometry of non-rigid shapes A journey to non-rigid world objects Numerical methods non-rigid Alexander Bronstein Michael Bronstein Numerical.
Non-Euclidean Embedding
Face Recognition: A Comparison of Appearance-Based Approaches
1 Numerical geometry of non-rigid shapes Introduction Numerical geometry of non-rigid shapes Introduction Alexander Bronstein, Michael Bronstein, Ron Kimmel.
1 Numerical geometry of non-rigid shapes Numerical Geometry Numerical geometry of non-rigid shapes Numerical geometry Alexander Bronstein, Michael Bronstein,
Numerical geometry of non-rigid shapes
Paretian similarity for partial comparison of non-rigid objects
1 Bronstein 2 & Kimmel An isometric model for facial animation and beyond AMDO, Puerto de Andratx, 2006 An isometric model for facial animation and beyond.
1 Numerical Geometry of Non-Rigid Shapes Invariant shape similarity Invariant shape similarity © Alexander & Michael Bronstein, © Michael Bronstein,
1 Numerical geometry of non-rigid shapes Non-Euclidean Embedding Non-Euclidean Embedding Lecture 6 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book.
1 Numerical geometry of non-rigid shapes Expression-invariant face recognition Expression-invariant face recognition Lecture 8 © Alexander & Michael Bronstein.
1 Michael M. Bronstein Partial similarity of objects 17 December 2006 Partial similarity of objects, or how to compare a centaur to a horse Michael M.
1 Bronstein 2 & Kimmel Matching 2D articulated shapes using GMDS AMDO, Puerto de Andratx, 2006 Matching 2D articulated shapes using Generalized Multidimensional.
Three-Dimensional Face Recognition Using Surface Space Combinations Thomas Heseltine, Nick Pears, Jim Austin Advanced Computer Architecture Group Department.
1 M. Bronstein Multigrid multidimensional scaling Multigrid Multidimensional Scaling Michael M. Bronstein Department of Computer Science Technion – Israel.
1 Numerical geometry of non-rigid shapes Non-rigid correspondence Numerical geometry of non-rigid shapes Non-rigid correspondence Alexander Bronstein,
1 Numerical geometry of non-rigid shapes Nonrigid Correspondence & Calculus of Shapes Non-Rigid Correspondence and Calculus of Shapes Of bodies changed.
1 M. Bronstein | Expression-invariant representation of faces and its applications for face recognition Expression-invariant representation of faces and.
A Brief Survey on Face Recognition Systems Amir Omidvarnia March 2007.
Biometrics: Ear Recognition
1 Numerical geometry of non-rigid shapes Shortest path problems Shortest path problems Lecture 2 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book.
Introduction to Biometrics Charles Tappert Seidenberg School of CSIS, Pace University.
Expression-invariant Face Recognition using Geodesic Distance Isometries Kerry Widder A Review of ‘Robust expression-invariant face recognition from partially.
BIOMETRICS By: Lucas Clay and Tim Myers. WHAT IS IT?  Biometrics are a method of uniquely identifying a person based on physical or behavioral traits.
The Future of Biometrics. Operation and performance In a typical IT biometric system, a person registers with the system when one or more of his physical.
By Hafez Barghouthi. Definition ”Biometric Technologies” are automated methods of verifying or recognizing the identity of a living person based on a.
Facial Recognition Justin Kwong Megan Thompson Raymundo Vazquez-lugo.
1 Numerical geometry of non-rigid shapes Projects Quasi-isometries Project 1 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book Numerical geometry.
Tom Face Recognition Software in a border control environment: Non-zero-effort-attacks' effect on False Acceptance Rate.
By: Suvigya Tripathi (09BEC094) Ankit V. Gupta (09BEC106) Guided By: Prof. Bhupendra Fataniya Dept. of Electronics and Communication Engineering, Nirma.
FACE RECOGNITION TECHNOLOGY
Tutorial 2 Biological shape descriptors
Spectral Methods Tutorial 6 1 © Maks Ovsjanikov
Presentation transcript:

1 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Three Dimensional Face Recognition “And in stature he is small, chest broad, one arm shorter than the other, blue eyes, red hair, a wart on his cheek, another on his forehead.” Then is it not you, my friend? A.S. Pushkin, Boris Godunov Alexander Bronstein, Michael Bronstein © 2008 All rights reserved. Web: tosca.cs.technion.ac.il

2 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Biometrics in the age of Patriarchs “The voice is the voice of Jacob, but the hands are the hands of Esau”

3 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition First face recognition Galton’s mechanical face recognition machine I contrieved an apparatus […] which I call a mechanical selector. Its object is to find which set out of a standard collection of many sets of measures, resembles any one of given set within specified degree of unlikeness. “ ” Nature, 1888 Sir Francis Galton ( )

4 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Face recognition today = ? Is this the same person?

5 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Some terminology Gallery Instances of faces of a person with known identity Probe A face unseen before with unknown identity Impostor False rejection Probe deemed dissimilar to gallery of same identity False acceptance Probe of different identity deemed similar to gallery

6 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition The coin that betrayed Louis XVI Gallery Probe

7 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition How face recognition works Gallery Probe FACE DISTANCE > threshold? REJECTACCEPT NoYes

8 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Recognition accuracy False acceptance rate (FRR) False rejection rate (FAR) High threshold (loose) Low threshold (conservative) Equal Error Eate (EER) FAR = FRR

9 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Face distance Discriminative Large between faces of different persons Invariant Small between faces of same person in different conditions

10 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition + GEOMETRIC (3D) PHOTOMETRIC (2D) What is a face? =

11 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition What is more important: 2D or 3D? + =

12 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition What is more important: 2D or 3D? + =

13 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition

14 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Conclusion 1 3D data encodes valuable information about person’s identity Less sensitive to external factors (light, pose, makeup) More difficult to forge

15 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition The curse of expressions

16 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Is geometry sensitive to expressions? x x’ y y’ Euclidean distances

17 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Is geometry sensitive to expressions? x x’ y y’ Geodesic distances

18 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Conclusion 2 Distance distortion distribution Extrinsic geometry sensitive to expressions Intrinsic geometry insensitive to expressions

19 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Isometric model of expressions Facial expressions are approximate isometries of the facial surface Identity = intrinsic geometry Expression = extrinsic geometry A. M. Bronstein et al., IJCV, 2005

20 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition

21 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition How to canonize a person? 3D scan Smooting Canonization Cropping

22 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Canonical forms of faces

23 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition SCANNED FACE CANONICAL FORM DISTANCES

24 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Telling identical twins apart Extrinsic similarity Intrinsic similarity MichaelAlex

25 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Telling identical twins apart MichaelAlex

26 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition

27 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition

28 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Comparing photometric properties Facial surface with texture 3D canonical form 2D canonical form Two-dimensional canonical form can be used as a common parametrization of the facial textures

29 Numerical geometry of non-rigid shapes Three-Dimensional Face Recognition Spherical embedding R = 80 mmR = 100 mmR = 150 mm