Real-Time Parameterized Avatar Face Generation Chris Maltzan Computer Science Adviser: Aaron Cass Psychology Adviser: Carin Perilloux
Imagine You Just Witnessed a Crime How will you describe the suspect? Sketch artist Make a composite yourself
Error in Composite Images Target Composite Memory Drawing Witness Sketch Artist Message Comprehension
Research Question Can we design an algorithm to assist users in real-time with the design of a composite image?
Mental Storage of Physical Appearance Isabelle Boutet and Avi Chaudhuri. Multistability of overlapped face stimuli is dependent upon orientation. Perception, 30(6):743 { 753, 2001.
A Parameterized Image Editor Zhou et al. (2010). Parametric reshaping of human bodies in images. ACM Trans. Graph, 29(4). 126:1-126:10.
How the Image Editor Works Zhou et al. (2010). Parametric reshaping of human bodies in images. ACM Trans. Graph, 29(4). 126:1-126:10.
EvoFIT: Creating a Composite Frowd, Hancock, Carson (2004). EvoFIT: A holistic evolutionary facial imaging technique for creating composites. ACM Trans. Appl. Percept, 1(1). 19-39.
EvoFIT: Under the Hood Frowd, Hancock, Carson (2004). EvoFIT: A holistic evolutionary facial imaging technique for creating composites. ACM Trans. Appl. Percept, 1(1). 19-39.
MakeHuman: A Digital Parameterized System Pros? -Digital representation of appearance -No pictures needed beforehand Cons? -Can create really bad images
A Wide Range of Possibility
The Algorithm
Hypothesis Participants will create composites in less time when using the algorithm. Participants will require less modifications to complete a composite with the algorithm. Composites created using the algorithm will be more similar to the target image than composites created without the algorithm.
Methods Two Treatments Between-subjects design Creation Phase, n = 16 Judgment Phase, n = 13
Creation Phase: Three consecutive targets:
Creation Phase: User Interface
Judgment Phase: New sample of participants Purpose: Are the composites useful (similar)?
Modifications by Factor
Time by Factor
Similarity Score by Factor
Time, Modifications, Similarity
Judgment Phase - Similarity
Composites Control Experimental
Composites Control Experimental
Composites Control Experimental
Discussion Was our hypothesis correct? Speed? Accuracy/Similarity Rating?
Future Work Algorithm Improvement: allowing more variation in symmetry Selective undo Compare with sketch artists
Questions? I would like to thank my advisers, Carin Perilloux and Aaron Cass for all of their guidance in this project. I would also like to thank Union College for the Student Research Grant awarded for use in this research.