Psychological studies of (normal) face recognition:

Slides:



Advertisements
Similar presentations
Shape Matching and Object Recognition using Low Distortion Correspondence Alexander C. Berg, Tamara L. Berg, Jitendra Malik U.C. Berkeley.
Advertisements

Method Participants 36 healthy participants (19 females) aged from 17 to 24 years (mean = 20; SD = 1,67) Material Participants were randomly allocated.
(2) Face Recognition These notes are the second part of a two-part lecture roughly corresponding to (1) object recognition and (2) face recognition We'll.
Psy 260 Announcements All late CogLab Assignment #1’s due today CogLab #2 (Attention) is due Thurs. 9/21 at the beginning of class Coglab booklets and.
Are faces special?.
The neural basis of face recognition? Tim Andrews.
Chapter 7 Knowledge Terms: concept, categorization, prototype, typicality effect, object concepts, rule-governed, exemplars, hierarchical organization,
Psychological studies of face recognition:
Face Recognition and Biometric Systems
Announcement MIDTERM When: 2/ PM Where: 128 Dennison.
Visual Processing in Fingerprint Experts and Novices
Comparing Thompson’s Thatcher effect with faces and non-face objects Elyssa Twedt 1, David Sheinberg 2 & Isabel Gauthier 1 Vanderbilt University 1, Brown.
A Module in Human Extrastriate Cortex Specialized for Face Perception
Computer Vision Group University of California Berkeley Shape Matching and Object Recognition using Shape Contexts Jitendra Malik U.C. Berkeley (joint.
Perception Putting it together. Sensation vs. Perception A somewhat artificial distinction Sensation: Analysis –Extraction of basic perceptual features.
I. Face Perception II. Visual Imagery. Is Face Recognition Special? Arguments have been made for both functional and neuroanatomical specialization for.
PSY 402 Theories of Learning Chapter 8 – Stimulus Control How Stimuli Guide Instrumental Action.
Visual Cognition II Object Perception. Theories of Object Recognition Template matching models Feature matching Models Recognition-by-components Configural.
Cognitive Processes PSY 334 Chapter 2 – Perception June 30, 2003.
Pattern Recognition Pattern - complex composition of sensory stimuli that the human observer may recognize as being a member of a class of objects Issue.
Visual Cognition II Object Perception. Theories of Object Recognition Template matching models Feature matching Models Recognition-by-components Configural.
Reading. Reading Research Processes involved in reading –Orthography (the spelling of words) –Phonology (the sound of words) –Word meaning –Syntax –Higher-level.
Physical Symbol System Hypothesis
George Lovell (Based on Roth & Bruce)
An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking.
CSE 185 Introduction to Computer Vision
The changing face of face research Vicki Bruce School of Psychology Newcastle University.
Pattern recognition = perception Template theory  has problems Prototype theory  better Distinctive features theory  better.

Visual Processing in Fingerprint Experts and Novices Tom Busey Indiana University, Bloomington John Vanderkolk Indiana State Police, Fort Wayne Expertise.
Prosopagnosia:. Prosopagnosia: Defined as a specific inability to recognise familiar faces. (Bodamer 1947). Contrasted with visual agnosia - inability.
CONNECTIONIST MODELLING
Biometrics Stephen Schmidt Brian Miller Devin Reid.
S EPTEMBER 2008, S LOVENIA 2 ND B ALKAN V ISION S CIENCE M EETING Aspects of face perception: Aspects of face perception: gaze direction and emotional.
Korea University Dept.of Industrial System & Information Engineering User Interface Lab Chapter 3 _ Object Recognition + 이병용.
Horizontally split facial composites show improved identification Alex H. McIntyre, Peter J.B. Hancock and Charlie D. Frowd Department of Psychology University.
School of Engineering and Computer Science Victoria University of Wellington Copyright: Peter Andreae, VUW Image Recognition COMP # 18.
Proportions of the Portrait
Introduction Processing of configurational information is often highly affected by inversion Previous research has focused on the perception of static.
Expertise, Millisecond by Millisecond Tim Curran, University of Colorado Boulder 1.
What impact do they have? Don’t just look at subject matter…look for these too!
Autonomous Robots Vision © Manfred Huber 2014.
EMPATH: A Neural Network that Categorizes Facial Expressions Matthew N. Dailey and Garrison W. Cottrell University of California, San Diego Curtis Padgett.
Face Recognition. Name these famous faces Cohen (1989) distinguishes between a) Face identification: looking at a person’s face and knowing who it is.
The anatomical basis of face recognition: evidence from studies of intact individuals:
Visual Agnosias Specification: Theories of perceptual organisation
High level vision.
PSY 402 Theories of Learning Chapter 8 – Stimulus Control How Stimuli Guide Instrumental Action.
Face Detection Final Presentation Mark Lee Nic Phillips Paul Sowden Andy Tait 9 th May 2006.
Visual Vocabulary Elements of art, principles of design, and much more!
Cognitive - perception.ppt © 2001 Laura Snodgrass, Ph.D.1 Perception The final image we are consciously aware of is a “constructed” representation of the.
Image features and properties. Image content representation The simplest representation of an image pattern is to list image pixels, one after the other.
By Kyle Bickel. Road Map Biometric Authentication Biometric Factors User Authentication Factors Biometric Techniques Conclusion.
CONTENTS:  Introduction.  Face recognition task.  Image preprocessing.  Template Extraction and Normalization.  Template Correlation with image database.
FACE RECOGNITION. A facial recognition system is a computer application for automatically identifying or verifying a person from a digital image or a.
Perception & Pattern Recognition 1 Perception Pattern Recognition Theories of Pattern Recognition Bottom-up vs. Top-Down Processing & Pattern Recognition.
Face recognition and visual agnosias Bruce and Young’s theory of face recognition, including case studies and explanations of prosopagnosia.
Do Expression and Identity Need Separate Representations?
Visual Computation and Learning Lab
CLPS0020: Introduction to Cognitive Science
Feature based vs. holistic processing
Perceiving and Recognizing Objects
Prosopagnosia.
INTERVIEWING WITNESSES
Neuropsychology of Vision Anthony Cate April 19, 2001
Feature based vs. holistic processing
Visual Processing in Fingerprint Experts and Novices
Multi-level Crowding and the Paradox of Object Recognition in Clutter
Bruce & Young’s model of face recognition (1986)
Perception & Pattern Recognition
Presentation transcript:

Psychological studies of (normal) face recognition:

The problem of face recognition: How do we distinguish between faces when they are all so similar? How do we recognise familiar faces so quickly and easily? Good-bye, till we meet again!' said Alice as cheerfully as she could. `I shouldn't know you again if we did meet, you're so exactly like other people.' `The face is what one goes by, generally,' Alice remarked in a thoughtful tone. `That's just what I complain of,' said Humpty Dumpty. `Your face is the same as everybody has -- the two eyes, nose in the middle, mouth under. It's always the same. Now if you had the two eyes on the same side of the nose, for instance -- or the mouth at the top -- that would be some help.'

Coping with different views, lighting, expressions: Jenkins, White, van Montfort and Burton (2011).

The Bruce and Young (1986) model of face processing: Structural encoding: "this is a face" Face Recognition Units: stored faces Person Identity Nodes: stored semantic information Name Generation Expression Facial Speech Age, Gender Recognition

Interactive Activation and Competition (IAC) model (Burton, Bruce and Johnston 1990): Blair Politicians Charles Diana Royalty PIN's SIU's FRU's NIU's Diana Charles Blair Diana Charles FRU - face recognition unit PIN - person identity node SIU - semantic information unit NIU - name input unit

Interactive Activation and Competition (IAC) model: Semantic priming: Charles Diana Royalty PIN's SIU's FRU's Diana Charles 1. Charles FRU activates Charles PIN. 2. Charles PIN activates Royalty SIU. 3. Royalty SIU activates Diana PIN. 4. Diana PIN now "primed".

Interactive Activation and Competition (IAC) model: Repetition priming: Charles Diana Royalty PIN's SIU's FRU's Diana Charles 1. Charles FRU activated. 2. Charles PIN activated. 3. FRU-PIN link strengthened. 4. Less Charles FRU activation now required for PIN to be activated.

What does the "structural encoding" consist of? (a) Featural (piecemeal) processing: “Big nose” “Brown hair” “Chubby face” “Eyes close together”

(b) Configural / relational / holistic processing:

Evidence for existence of configural processing: The Inversion Effect: (e.g. Yin 1970, Diamond and Carey 1986). Upside-down faces are hard to recognise. The Thatcher Illusion: (Thompson 1980). Subtle relational changes are not apparent in inverted faces… Evidence for existence of featural processing: Evidence for existence of featural processing: Recognition can still be achieved from features alone (e.g. in scrambled faces, and from isolated features).

The composite face effect (Young, Hellawell and Hay, 1987): Upright (but not inverted) faces are processed in an integrated "holistic" way, that prevents easy access to their constituent features.

Face superiority effects: Features are recognised better if they are presented within a whole face than if presented in isolation or within a scrambled face (Tanaka and Farah 1993).

Other aspects of structural encoding: Haig (1986): people are very sensitive to the precise location of the facial features, especially the eyes and mouth. Negative faces are poorly recognised - representation of shape from shading is important for recognition.

Nose length LongShort Eye separation Narrow Wide Valentine’s “Multidimensional Face Space” Distinctive (big nose, close-set eyes) Distinctive (small nose, widely-set eyes) Typical

What does configural processing actually involve? Hole et al (2003): effects of various affine transformations on familiar-face recognition: Vertical stretching Horizontal stretching Shearing Inversion

What does configural processing actually involve? Bindemann et al (2008): ERP N250r response to face repetition is unaffected by stretching: equivalent priming from stretched and normal faces. Hole (2011): Face Identity After-effect is same for normal and stretched faces.

Conclusions: Configurational processing tolerates linear and global distortions of input. Involves either – Something sophisticated (e.g. ratios of facial metrics); Or A normalisation process (using a prototypical face template?)

(a) Transform input to match prototypical template ("normalisation"): (b) Transform template to match input (“deformable template” theories, e.g. van der Malsburg 1993):

The relationship between configural and featural processing: parallel routes to recognition? Collishaw and Hole (2000): Investigated effects of disruptive manipulations in isolation and in combinations: Blurring impairs processing of local features more than processing of global configuration (Costen et al. 1994) Scrambling and inversion impair configural processing more than featural processing (Valentine, 1988)

If featural and configural processing are parallel routes to recognition, then: (a) Any single manipulation (scrambling, inversion or blurring) will lead to some but not total impairment. (b) Combinations of manipulations that affect the same process will produce no more impairment than the same manipulations singly (scrambling + inversion same as scrambling or inversion). (c) Combinations of manipulations that affect different processes will severely impair recognition (scrambling + blurring or inversion + blurring = chance performance.).

Recognising famous faces: % Correct Chance level

Is configural processing unique to faces?: Probably not - Diamond and Carey (1986): inversion effects with dog breeders. Rhodes and MacLean (1990): caricature effects with birds. Gauthier and Tarr(1997): inversion effects with greebles. greebles of different genders:

Is non-face configural processing equivalent to that for faces?: No – Robbins and McKone (2007): Dog experts showed no face-like processing for dogs on three tasks (inversion, CFE, negation).

Is fine-grain configural processing the primary route to recognition?: No - Burton, Schweinberger, Jenkins and Kaufman (2015): 1. Standardised iris diameter: (a-b) is the same for all images. 2. Distance from (a) to lateral edge of the right iris (red line) is expressed as a multiple of standardised iris diameter. Within-person ranges for this metric are large and overlapping, so that this metric is not individuating.

Are faces "special"?: Yes in the sense that they require fine-grain within- class discriminations between category exemplars (e.g. individual faces). This type of processing may not be unique to faces; may be used with any stimulus class that requires subtle within-class discriminations (Bruce and Humphreys 1994). Gauthier: = general-purpose object-recognition mechanisms, which are most often used with faces. Bentin: = face-specific mechanisms which can be adapted for use with other stimulus classes, given experience.

Overall conclusions: Faces can be recognised by either configural or featural processing (though using both is probably best). Configural processing of upright faces is automatic and involuntary (chimeric face effect). Configural processing involves more than extraction of simple facial metrics (distortion studies). Faces are "special" in involving a type of processing used mainly (but not exclusively) with faces.