1. 1st European CERE meeting Amsterdam, May 13-15, 2004
WHAT ABOUT RECOGNITION OF SPONTANEOUS AND DYNAMIC FACIAL EXPRESSIONS OF EMOTIONS ?
* Lab. of Social Psychology
of Grenoble-Chambéry,
University Pierre Mendès France
& University of Savoie, France
** Lab. Clips-IMAG,
Arcade,
University Joseph Fourier,
Grenoble, France
Tcherkassof Anna *, Bollon Thierry *, Dubois Michel *, Pansu Pascal * & Adam Jean Michel **
The issue of facial expressions' recognition is one of the most debated in the field of emotion. Even though various positions have been taken on this question (Tcherkassof, 1997, for a review), it appears that evidence is based for the most part on methods using a static and unnatural material, namely, still photographs of posed facial expressions of emotion. This kind of methodology raises questions about its ecological validity (Russell, 1994). Yet, despite the fact that this point is crucial in order to understand the facial expression recognition process, little data gathered with spontaneous and vivid expressions of emotion is available (Buck et al., 1972; Wagner et al., 1986). Thus, an attempt is made here to study emotion attribution processes by using dynamic presentation of natural (spontaneous) stimuli.
A significant main effect for the “sex of target” was observed, F(1,65) = 79.62, p < The recognition’s duration of emotions displayed by female targets is lower than the male targets’ one (M = 0,06 vs 0,14). A significant main effect for the “emotional categories” was also observed, F(4,260) = 219,39, p <.000.
Post-hoc contrasts showed that recognition rates are significantly different one from another (p <.00). (Fig. 1).
Aroused facial expressions (amusement & irritation) are recognized at greater length then weakly aroused ones (interest & worry).
The analysis also revealed an interaction between targets’ sex and emotional category, F(4,260) = 25,56, p <.0000 (Fig. 2).
When splitting up the interaction, post-hoc analyses revealed that female vs male pairwise comparison for “irritation” accounts for this main effect, (F(1,65) = 41,53, p <.0000).
Procedure
The proportion of variance attributable to this comparison is 87%. Male targets’ emotion is identified for longer than female targets’ one (M = vs .049).
Sending phase
43 students were covertly videotaped while carrying out 2 (out of 4) emotional eliciting computer tasks (one positive and one negative) plus a neutral one. These emotional tasks were made up in order to induce amusement, interest, irritation, and worry. Based on a pilot study, 10 highly expressive senders were selected for the present study. 10 video clips have therefore been set up, each showing a sender's facial expressions while carrying out an emotional eliciting task, with 2 senders (1 female and 1 male) for each task.
Receiving phase
Participants (34 females and 33 males) each viewed 10 clips. For the purpose of the study, a specific user interface has been developed in order to collect participants' judgments in the process of visualization, that is dynamic records. Thus, participants were asked to assess 'on line', while watching the film, the emotions expressed (if any) by clicking the corresponding keys. The following keys were proposed: no particular emotion, amusement, interest, irritation, worry (e.g. the correct labels), pride, boredom, and perplexity (e.g. distracters labels).
Fig. 1 : Accuracy means for the different emotions
Fig. 2 : Accuracy means for the different emotions according to the target’s sex
Discussion
In accordance with the literature on recognition of spontaneous facial expressions, the recognition rates of the emotions expressed by the dynamic and unposed stimuli are rather low though the levels of accuracy are generally significant. Likewise, by and large, accuracy was found to be highest for amusement followed by irritation. Thus, fairly aroused facial expressions (amusement & irritation) are better recognized then weakly aroused ones (interest & worry). Moreover, an effect of the sex of the sender is found, even though it is explained by the emotional category “irritation” only. Two possible explanations can be drawn up : (a) either display rules operate in the sending situations. Indeed, French culture’s social norms encourage the manifest expression of irritation in men (as it reinforces a virile image) but discourage it in women ; (b) or a stimulus bias exists. It could be that the female sender happened to be unexpressive or the male sender to be “ over expressive ”.
On the whole, this study shows the utility to investigate dynamic emotional judgements of spontaneous and vivid expressions since observers, who didn't have any trouble associating on-line particular emotion labels to facial movements changing over time, have recognized more than a general affective tone and seem to be sensitive to subtle changes in facial expressions. To our knowledge, this study is the first one to propose a paradigm where observers are able to make judgments as the expressions are going along. Thus, an interesting outcome of this research is that this kind of method will probably enable us to improve our knowledge regarding spontaneous emotional communication.
Main results
Recognition of facial expressions was evaluated according to the length of clicks. Confusion matrix were elaborated so that a Wagner's unbiased hit rate (Wagner, 1997) calculated for each participant could be used as dependent variables.
No effect of the “ sex of participant ” has been found (M women = 0,101 vs M men = 0,103 ; ns).
References
Buck, R.W., Savin, V.J., Miller, R.E et Caul, W.F. (1972). Communication of affect through facial expressions in humans. Journal of Personality and Social Psychology, 23,
Russell, J.A. (1994). Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin, 115, 1,
Tcherkassof, A. (1997). La perception et la reconnaissance des expressions émotionnelles faciales. Social Sciences Information, 36,
Wagner, H.L. (1997). Methods for the study of facial behavior. In J.A. Russell & J.M. Fernández-Dols (Eds.), The psychology of facial expression (pp.31-54). Cambridge, UK : Cambridge University Press.
Wagner, H.L., MacDonald, C.J. et Manstead, A.S.R. (1986). Communication of individual emotions by spontaneous facial expressions. Journal of Personality and Social Psychology, 50,
1st European CERE meeting Amsterdam, May 13-15, 2004

2. -