BioSec © 2004 BioSec Consortium 1 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 Multimodality Solutions: Major Advantages and Drawbacks; Different Understanding of Building a Multimodal System 1st BioSec Workshop Barcelona, June 28th, 2004 Moderator: Dolores Garcia-Plaza Ibermática

BioSec © 2004 BioSec Consortium 2 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004

BioSec © 2004 BioSec Consortium 3 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 Multimodality Solutions: Major Advantages and Drawbacks; Different Understanding of Building a Multimodal System 1st BioSec Workshop Barcelona, June 28th, 2004 Anil K. Jain Michigan State University

BioSec © 2004 BioSec Consortium 4 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004

BioSec © 2004 BioSec Consortium 5 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 Multimodality Solutions: Major Advantages and Drawbacks; Different Understanding of Building a Multimodal System 1st BioSec Workshop Barcelona, June 28th, 2004 Fabio Roli University of Caligary (Italy)

BioSec © 2004 BioSec Consortium 6 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004

BioSec © 2004 BioSec Consortium 7 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 Multimodality Solutions: Major Advantages and Drawbacks; Different Understanding of Building a Multimodal System 1st BioSec Workshop Barcelona, June 28th, 2004 Josef Kittler University of Surrey (England)

BioSec © 2004 BioSec Consortium 8 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004

BioSec © 2004 BioSec Consortium 9 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 Multimodality Solutions: Major Advantages and Drawbacks; Different Understanding of Building a Multimodal System 1st BioSec Workshop Barcelona, June 28th, 2004 Gérard Chollet CNRS-LTCI, GET-ENST (France)

BioSec © 2004 BioSec Consortium 10 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 Biometric Identity Verification within GET (Groupe des Ecoles de Télécommunication) Signature, Fingerprint and Iris (INT) Speaker Verification (ENST and Eurecom) Face (Eurecom), Talking face (ENST) Fingerprint and Hand-shape (ENST) Collection of the BIOMET database (talking faces, infrared faces, 3D faces, fingerprints, signatures, hands) BIOLAB : usability studies in Biometrics Participation to the speaker (NIST), fingerprint (FVC) and signature (SVC) evaluation campaigns Partner in on-going projects : SecurePhone, TRUST-eS Technical coordinator of the NoE-BioSecure

BioSec © 2004 BioSec Consortium 11 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 BioSecure : A Network of Excellence on Multimodal Biometric Identity Authentication Kick-off meeting on July 2nd, 2004, work plan for 3 years Initiator and technical coordinator: GET (Groupement des Ecoles de Télécommunication) 29 Core Partners  Main academic actors in the field  Satisfy excellence criteria : publications, PhD, etc…  Involved in different aspects of Biometrics  With experience in evaluation campaigns Relations with Industrials, small companies... through a Forum of Industrial and end user partners :  Thales, ST-Microelectronics, France Telecom, Bouygues Telecom, Gemplus, OPSIS, ELRA/ELDA, ORGA, etc…

BioSec © 2004 BioSec Consortium 12 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 NoE-BioSecure : specific objectives on multimodal fusion Develop and distribute open-source reference algorithms for each modality and for the fusion of modalities : fingerprint, palmprint, face, iris, signature, handwriting, text-dependent and text-independent speaker verification, talking face, … Define and distribute evaluation protocols on available databases (XM2VTS, DAVID, BANCA, BIOMET, NIST,…) using the concept of ‘virtual’ (chimeric) identity Contribute to the collection of data to complement existing databases. Organise a 4-weeks residential workshop in Sept to experiment and evaluate fusion techniques Organise a 3-weeks residential workshop in July 2007 to ‘fuse’ the improvements made by all partners.

BioSec © 2004 BioSec Consortium 13 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 False acceptance (a topic to be debated…) Some conditions are unfavorable for biometry :  Some fingers cannot be registered  Illumination is a problem in face recognition  Noise and distortions are problems for speech  Cooperation is necessary for iris Most modalities are prone to falsification :  Dummy fingers  Voice transformation  Face morphing  Lenses Multimodality is a solution but :  User friendliness should be maintained  A talking face (with iris capture) could be a natural combination

BioSec © 2004 BioSec Consortium 14 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 Multimodality Solutions: Major Advantages and Drawbacks; Different Understanding of Building a Multimodal System 1st BioSec Workshop Barcelona, June 28th, 2004 Andrew Morris Saarland University (Germany)

BioSec © 2004 BioSec Consortium 15 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 ergal SecurePhone Secure contracts signed by mobile phone IST

BioSec © 2004 BioSec Consortium 16 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 Project aims Secure PKI infrastructure Deal secure m-contracts during a mobile phone call secure: private key stored on SIM card user-friendly: intuitive, non-intrusive flexible: legally binding text/audio transactions dynamic: mobile e-signing “on the fly”

BioSec © 2004 BioSec Consortium 17 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 Multi-modal biometric verification preprocessing modelling preprocessing face voicesignature modelling “welcome” / “access denied” “Please repeat” fusion

BioSec © 2004 BioSec Consortium 18 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 Ear, iris, odour: search for the perfect system Owen Bowcott, The Guardian, Friday June 18, 2004 Many pilot projects launched amid expectations that they would transform retail behaviour or prevent bank card fraud have been quietly shelved. Some encountered consumer resistance, SecurePhone authentication will be psychologically neutral and high-tech functionalities will be masked under the reassuring interface of a smartphone others were technically unreliable SecurePhone will combine only dependable authentication techniques or required massive investments that might never earn their return. The SecurePhone will be assembled only from standard components

BioSec © 2004 BioSec Consortium 19 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004 Multimodality Solutions: Major Advantages and Drawbacks; Different Understanding of Building a Multimodal System 1st BioSec Workshop Barcelona, June 28th, 2004 Tommi Rakshit Home Office – Finland BIOSEC partner

BioSec © 2004 BioSec Consortium 20 Biometrics & Security IST st BioSec Workshop Barcelona, June 28th, 2004