Neuropsychologia 40 (2002) 1523–1533Asymmetry in facial expression of emotions by chimpanzees Samuel Fernández-Carriba a,∗ , Ángela Loeches b , Ana Morcillo b , William D. Hopkins c,d b c a Language Research Center, Georgia State University, Atlanta, GA, USA Área de Psicobiolog´ ıa, Facultad de Psicolog´ ıa, Universidad Autónoma de Madrid, Madrid, Spain Living Links Center, Yerkes Regional Primate Research Center, Emory University, Atlanta, GA, USA d Department of Psychology, Berry College, Mount Berry, GA, USA Received 2 August 2000; received in revised form 1 February 2002; accepted 5 February 2002 Abstract Asymmetries in human facial expressions have long been documented and traditionally interpreted as evidence of brain laterality in emotional behavior. Recent findings in nonhuman primates suggest that this hemispheric specialization for emotional behavior may have precursors in primate evolution. In this study, we present the first data collected on our closest living relative, the chimpanzee. Objective measures (hemimouth length and area) and subjective measures (human judgements of chimeric stimuli) indicate that chimpanzees’ facial expressions are asymmetric, with a greater involvement of the left side of the face in the production of emotional responses. No effect of expression type (positive versus negative) on facial asymmetry was found. Thus, chimpanzees, like humans and some other nonhuman primates, show a right hemisphere specialization for facial expression of emotions. © 2002 Elsevier Science Ltd. All rights reserved. Keywords: Brain asymmetry; Emotions; Facial expressions; Chimeric stimuli; Chimpanzees 1. Introduction The neuropsychological basis of emotional behavior has been investigated for more than three decades in human subjects, with specific attention focused on the issue of brain lateralization in the control and mediation of emotions (for a review, see [11]). Emotion has been understood a biologically based state involving several components: perception, experience, physiological arousal, goal-directed activities and expression [37]. The human literature has typically explored the different processing modes (perception, expression, experience and physiological arousal) as well as different channels at the communication level (facial, prosodic, lexical, gestural and postural) (for a componential theoretical approach to emotional behavior, see [2]). As a result of these studies, two distinct conceptual models of emotion and laterality have emerged. One model proposes that the right hemisphere is dominant or specialized for the processing of all emotions [8,5]. In contrast, the valence theory proposes that there is differential hemispheric involvement as a function of emotional valence, or pleasantness–unpleasantness, and approach–withdrawal ∗ Corresponding author. Present address: Language Research Center, Georgia State University, 3401 Panthersville Road, Decatur, GA 30034, USA. Tel.: +1-404-2445845; fax: +1-404-2445752. E-mail address:
[email protected] (S. Fern´ andez-Carriba). [10,11]. In this model, the right hemisphere is more active during negative/withdrawal emotion in human adults, whereas the left hemisphere is more dominant for positive/ approach emotions. With the aim to explore the phylogeny of brain asymmetries in emotional behavior, as well as the phylogeny of other functional asymmetries, attention has shifted very recently to studies in nonhuman primates and other species [6]. As with other reports on neuroanatomical and functional asymmetries in nonhuman primates (for comprehensive reviews, see [6,23]), evidence emerging from research on emotional behavior supports a human-like pattern of lateralization of emotion in nonhuman primates. Specifically, physiological studies and behavioral studies have found a greater involvement of the right hemisphere in emotional activity, at least in the case of negative emotions (for review, see [29]). In the human literature, the facial channel, at a communicative level, is one of the behavioral components of emotion that has been most extensively investigated in relation to brain asymmetries both in terms of production (for a review and metanalysis, see [5]) and perception of emotions [1,30,42,43]. This is not surprising, since the relationship between facial expressions and emotions has been reported for centuries, particularly in the writings of Charles Darwin [15]. Regarding nonhuman primates, although a few studies have measured asymmetries in perception of faces and perception of emotional expressions [17,18,32,33,48,49], only 0028-3932/02/$ – see front matter © 2002 Elsevier Science Ltd. All rights reserved. PII: S 0 0 2 8 - 3 9 3 2 ( 0 2 ) 0 0 0 2 8 - 3 9 females and 6 males. For the area measure. 5 females and 6 males. the experimenters recorded areas left and right of midline of the mouth to quantify asymmetry in the intensity of the expression. 2 h a day (1 h each group). In addition. not only due to their close genetic relatedness to humans. the left side of the face was reported to be more expressive than the right side in the fear grimace (as reflected in the number of skin folds and height of the corner of the mouth).44–47]). [35] description of the chimpanzee repertoire of facial emotions. That same lone observer. who or when to observe) and all social interactions that spontaneously took place were recorded with a video camera (Sony SVHS) by one of the authors. silent pout.2.e.1. silent bared-teeth display and staring bared-teeth scream face) and a neutral nonemotional category were recorded in nine . play face. Methods 2. Hauser [19] created chimerics (composites made of each half of the face paired with its mirror-reversed duplicate) of three images representing the fear grimace expression of three different individuals and asked 43 human subjects to rate which chimeric expression looked more like the original expression. with a 4 year experience with chimpanzees. open mouth threat and ear flap. three times in the morning and twice in the afternoon. Three facial expressions were experimentally elicited in 8–11 marmosets.1. Hauser [19] tested facial asymmetries in the production of four different facial expressions.44–47].1. Their enclosure consists of an outdoor area 200 m2 and four indoor rooms each 10 m2 . At the YRPRC. at least for the negative ones.16.35. would be ideal subjects for these studies. The left–left chimerics were reported to be more expressive than the right–right chimerics by 41 of the 43 human subjects. Nine chimpanzees at the Madrid zoo also served as subjects. The aim of this study was to address the issue of brain lateralization in the production of emotions by chimpanzees by examining facial asymmetries in spontaneously produced emotional expressions.1524 S. [35] based their descriptions on other classic ethograms for the study of chimpanzees behavior (for example. Two expressions had an accompanying vocalization and were referred to as the tisk (characterized as fearful) and the twitter expression (defined as a social contact call). surround the open area and two of the four indoor rooms. Facial expressions were recorded on 10 adults (older than 16 years of age).6 m2 . and chimpanzees in particular. The outdoor area is surrounded by grate walls 6 m tall with an observation tower in one of the corners from where the chimpanzees were videotaped. including the fear grimace. This resulted in about 600 h of observation in total. To our knowledge. No single study has explored facial asymmetries in the production of facial expressions in great apes despite the fact that apes. copulation grimace. and October 1997 to June 1998). once in the morning and twice in the afternoon. a left side asymmetry was found for the fear and tsik expression while a right side asymmetry was found for the twitter expression. 15 subadults (between 7 and 16). but also because they are highly social individuals with a rich repertoire of facial expressions that have been described in detail elsewhere [9. All walls are made of concrete and 3 m-tall glass screens. Fern´ andez-Carriba et al. then reviewed the videotapes and categorized all present facial expressions according to morphological and functional criteria based on Parr et al. Observations of the two groups at the Yerkes Field Station took place during July–September 1998. October 1996 to June 1997. and 11 juveniles (younger than 7). For the distance to midline measure. in 4–19 rhesus monkeys (the number of different expressions per individual is not specified in this study). [16. Parr et al. Whether that was the case for all three images is something that was not reported in this study. chimpanzees were observed ad libitum (there was no limitation on what. Five categories of facial expressions (pant-hooting.24]. Twenty seven subjects were housed at the YRPRC Field Station in two different groups with 11 belonging to one group and 16 to the other. Procedure The chimpanzees at the Madrid zoo were studied over two 9 month periods (i. Experiment 1: objective measures 2. 2. based on previous findings in humans and monkeys. no study has been conducted on brain asymmetries in the production of facial expressions in great apes. / Neuropsychologia 40 (2002) 1523–1533 two studies have explored facial asymmetries in the production of emotions in monkeys [19. Observations were made three times a week. Subjects and setting Observations were made on a sample of 36 chimpanzees (Pan troglodytes) from the Yerkes Regional Primate Research Center (YRPRC) (Atlanta. through which chimpanzees’ behavior could be recorded. a left side bias was found for the fear and tsik expression but no effect was found for the twitter expression. Hook-Costigan and Rogers [24] found in marmosets slightly different results compared to those reported by Hauser [19]. USA) and the Madrid Zoo-Aquarium (Madrid. Hauser [19] reported that the left side of the face began to move first during the production of the fear grimace and the open mouth threat and it maintained the expression longer than the right in the case of the copulation grimace. 2 h each time on average. We hypothesized that the left side of chimpanzees’ faces and hence the right hemisphere will be more involved in the production of emotional facial expressions. all observations were recorded in the outdoor portion of their home cage. At both locations.1. They also recorded the distance from the midline to the side of the mouth as an indicator of asymmetry. The third expression was simply referred to as the silent fear expression. 8 females and 2 males. five times a week. For each call. depending on the expression (ten different faces in each individual). Moreover. Both compounds have an outdoor area approximately 550 m2 and five indoor rooms each about 12. 2. Spain). Mouth wide or partially open. the two same authors and two trained observers that were na¨ ıve to the study’s hypothesis. silent pout. / Neuropsychologia 40 (2002) 1523–1533 1525 Fig. independently categorized 25% of the facial expressions. Face is relaxed with the mouth open to expose the bottom teeth. silent bared-teeth display. Silent bared-teeth display Grin [16. play face. silent bared-teeth display [35. or to signal the presence of food Individuals also hoot when performing a bluff display. during reconciliations or when soliciting support from another individual.46] Staring bared-teeth scream face [35] Staring bared-teeth scream face . The fact that Morphological description Lips are pushed forward resulting in a round opening in the mouth. lips fully withdrawn exposing the teeth. Performed most often by nervous. No vocalizations are apparent. or more subjects in our sample. Examples of the chimpanzee’s facial expressions. Video images were analyzed using frame-by-frame procedures (24 frames/s) and then digitized in a bitmap format using a video capture card (WinView 601). horizontal bared-teeth expression [45]. 1 shows a visual example of each of these expressions. accompanied by a brief description in Table 1 of each expression in terms of both morphology and function.44].44–47] Four different observers.e. Context Used often in long-distance communication. after being attacked. Fig. rasping screams. although the tone of this expression is one of protest rather than submission. The upper lip may be raised slightly exposing the upper teeth.46] Silent pout Silent pout [35]. i.e. It includes loud harsh.35. Mouth partially open or closed. Play face Play face [16. relaxed open mouth display [35. Fern´ andez-Carriba et al. Table 1 The chimpanzee’s facial expressions recorded in the present study Expression Pant-hooting Other names Pant-hoot [16. 1. those in which the chimpanzee was facing the camera directly).47]. A second observer. From left to right: pant-hooting. when greeting group members after separation. Vocalizations may include a fast rhytmic staccato breathing. It is also exhibited by adults when they are begging. fully exposing the top and bottom teeth. another author. with the mouth corners and lips retracted laterally. Most often seen in individuals who have been the focus of an attack. took part in the task of selecting the best images out of the video sequences that contained facial expressions (i. staring bared-teeth scream face and neutral face. pout [47] Given most often by young infants when they are distressed. It may be given when a more dominant individual is approaching. fearful and submissive individuals. Slightly open mouth in which the lips are pushed forward and rounded creating a small aperture. Vocalizations “hoo-hoo” occur. Expression typically given in the context of play or during a friendly approach. The interobserver reliability in categorizing the images was 93%. the categorization made by one and another observer matched in 42 out of 45 images.S. 2.1. 1 Values of −1 or +1 would be the extreme cases of facial asymmetry in which all the mouth would be respectively in the left and right side of the face. 18. Data analysis For each image.27]). we could assess the degree of variation on the frontal view of the subjects depicted in the image. we subtracted the length FAI calculated for each subject in the neutral category from their corresponding FAI in the rest of the emotion categories. 14 images in the pout category. Quantification of asymmetry in facial expression An objective index of facial asymmetry. 2). The number of individuals subjects represented in each of the six categories were 22. With respect to the measures of length and area. a line surrounding the inner side of the mouth perimeter was drawn and the surface calculated (mm2 ). Such FAI was calculated for both the area and length measures. . 3). and it allowed us to compare the asymmetries of images with different pixel densities and resolutions and interpret them in the same way (negative values as left asymmetry. A criterion used in the selection was to obtain. Frederick. Following the procedure used by Hook-Costigan and Rogers [24]. The distance between the outer corners of the eyes to the midline is also measured. Length FAIs for neutral faces were also used to adjust area FAIs because the neutral faces had their mouths closed. 2). CA) and its midpoint was calculated. because only frontal images were used. For this. Both area and length were measured using Scion Image (Scion Corporation. (Adobe Systems Incorporated. something impossible to obtain. 1 FAI values were calculated also for the measures of the distance from the outer corners of the eyes to the midline. at least.1526 S. assuming that brain asymmetry is not a discrete phenomenon but a continuous one. a straight line was drawn from each outer corner of the mouth to the midline (mm). positive values as right asymmetry and 0 as symmetry). This index consisted of the length and area measures of the left and right hemimouth for each facial expression. chimpanzees had been recorded during their natural interactions limited the number of useful frames to usually one in each suitable sequence.0. Second. This served two purposes: First. the sample was reduced from 183 images to 120 usable measures from 22 different individuals in the hooting category. was employed in this study. 2. the first step was to calculate the average FAI in the case of those subjects for which we had more than one image in a category. San Jose. 9. respectively.1. we also tried to prevent the use of portraits that were not absolutely frontal. The FAI was based on other lateral bias indices (handedness indices) that some investigators working with nonhuman primates have adopted (for example [26. To obtain these data. one image for each subject in each category of emotional expression. For the hemimouth length. In order to prevent the influence of peripheral morphological factors (like the width of each half of a subject’s face) on emotional expressions asymmetries. Therefore. the measure of the left hemimouth was subtracted from the measure of the right hemimouth and divided by the sum of right and left measures (right − left)/(right + left) to derive a facial asymmetry index (FAI). 11 and 30. The total number of useable images of facial expressions was 183 including 39 images in the hooting category. and two. we calculated the distance between the outer corner of each eye to the midline for all the images using the program Scion Image (see Fig. Example of the manipulation of an image. 2. using a freehand tool. If more than one frame was found in the same sequence. this measure allowed us to compare the relative degree of asymmetry of the mouth compared to the symmetry of the image. 19 images in scream face and 51 neutral faces. Fern´ andez-Carriba et al. based on this measure. a line was drawn on the face of the focal subject between the inner corners of the two eyes using the program Adobe Photoshop 4. The midline of the face is calculated and used as a reference to put the image in an upright position. 9 in pout. 20 in silent bared-teeth and 30 in the neutral category. the cleanest and most head-on was selected. To measure the area. 29 images in the play category.3.4. / Neuropsychologia 40 (2002) 1523–1533 Fig. 20. Maryland) (see Fig. 31 images in the silent bared-teeth. A perpendicular line that split the face into two halves was then drawn at the midpoint (see Fig. based on previously published procedures [24].1. where possible. The image was then vertically rotated until the midline made a perfect 90◦ angle with the horizontal line. 18 individuals in play. f . play and scream face no average reached statistical significance when compared with 0 (P > 0. = 71. For both the length (r = 0. play and silent bared-teeth also showed a significant leftward asymmetry.72.65. staring bared-teeth scream face and neutral face. silent bared-teeth display. n.75. hooting. which suggests a low consistency of facial asymmetry across the two different facial expressions of the same emotion. Although the left side was slightly overrepresented in the categories of pout.s.f . Fern´ andez-Carriba et al. = 49. In the case of those individuals for whom we had two different images from the same expression category (72 dyads).00).s. = 17. see Tables 2 and 3 for test values used in the t-test). d. Results An independent observer who was naive to the hypotheses of our study measured hemimouth lengths and areas in 38 different images (10% of the sample in each case). / Neuropsychologia 40 (2002) 1523–1533 1527 Fig. With respect to area measures. the case in nine neutral expressions analyzed). we correlated the facial asymmetry indexes obtained for the two images. silent bared-teeth and scream face categories deviated significantly to the left. The correlation between the two hemimouth measures (length and area) taken in each image was positive and significant (r = 0. Population-level biases in facial expression were tested using a one-sample t-test and compared not to 0 (perfect symmetry) but to the FAI measure that was derived from the category average for the distances from the outer corner of the eyes to the middle line.2. were positive but nonsignificant (r = 0. for length and r = 0. significant correlations were found. even this minimal deviation was taken into consideration when analyzing hemimouth asymmetries. despite the dropping of the lower jaw when relaxed is fairly common among chimpanzees [16]. None of the analyses revealed significant differences. Listed in Tables 2 and 3 are the mean FAIs for each expression type and associated t-values.01) and area (r = 0. However. From left to right: pant-hooting. Examples of length and area measures in the different categories. The correlations for both length and area measures. for area). The FAIs calculated for the distance from the outer corner of each eye to the middle line in each image were analyzed using a one-sample t-test. P < 0. Thus. play face. silent pout.S. indeed.f . 3. silent bared-teeth and neutral and the right side in hooting. = 17. measures 1 and 2 were not significantly different from .f . 2. Six subjects were not represented in the neutral category and.15.20 in all cases. P < 0. an area measure could have only been derived for the neutral face with great difficulty and a high chance of error. d. n. P < 0. These data were then correlated with the primary observers measures in order to assess inter-rater reliability in the measurement of asymmetries. their FAIs in the emotion categories remained the same. d. N = 132. The results indicated that length measures in the hooting.01). However. This was done to determine whether there was significantly more bias toward a greater exposure of one side or the other of the faces that comprised the data set. d. accordingly. like if their neutral FAI was 0 (this was. indicating that on average the images were depicting faces that were head-on.05. ∗∗ P ≤ 0.0029232 The percentage of left bias in each facial expression is also given as a means to help to understand the data %FAI = left /(left + right ) × 100.06340 0. A Pearson product moment correlation between the age of the chimpanzees.0062194 −0.3.830∗ −2. silent-bared-teeth and scream face. 2.1528 S. seems fairly well represented (18 subjects).816∗ −4.75.003543 0.s.028045 −0.05.93.077481 −0.0001915 −0. ∗ P < 0. 0.E. No significant effect of sex was found in any of the categories for neither length nor area measures.03303 0. like in humans [3. mouth length might be an appropriate physical feature to measure facial asymmetry only in those displays in which the mouth is drawn horizontally and not so much in those expressions in . Values under 50 represent right bias. Finally.011 −2. −3.042790 −0.017953 −0. Play.39]. the left hemimouth area was larger than the right in the facial expressions of hooting. 35 of the 36 subjects of the sample received a punctuation (−5.027733 −0.577 −2.003543 0. according to their performance in two tasks of food manipulation described elsewhere [28]. for area). these asymmetries are not merely an extension of morphological asymmetries in the chimpanzees’ faces. However. for length and t (50) = 0. play and silent bared-teeth. Regarding handedness. ∗∗ P ≤ 0. from extremely left-handed to extremely right-handed. / Neuropsychologia 40 (2002) 1523–1533 Table 2 Category averages for the FAIs based on the mouth length N Hooting Play Pout SBTa Scream face Neutral 22 18 9 20 11 30 Mean FAI (mm) −0. as demonstrated by measures of the distance between the outer corner of the eyes to the middle line of the face. is mainly controlled by the contralateral hemisphere.767 −1. on the other hand.007842 0.005281 t (two-tailed) −2.s. sex and handedness) on results from Experiment 1 was analyzed.615 Test values 0. 50 represents symmetry and values over 50 represent left asymmetry. Age was then considered as a covariable in a following analysis of covariance in which sex was the only fixed factor.E.77. Moreover. and it extended laterally more than the right in the categories of hooting.008189 0.039614 −0. −1.01) and scream (r = −0.60. n.057860 Mean FAI (%) 53 54 52 52 53 S.066754 −0.452∗ −0. each other either. a Silent bared-teeth. according to a paired t-test (t (71) = 0. hemimouth length) of such emotional expression.047683 −0.003965 −0. n. Discussion According to our results. 50 represents symmetry and values over 50 represent left asymmetry.0049855 0. these facial asymmetries seem to reflect a functional asymmetry in the production of emotional behavior. the possible influence of demographic characteristics of the chimpanzees (age. The limited sample in the scream category (11 subjects) probably accounts for the lack of significance in the area measure. ∗ P < 0.03167 0.0062194 −0. Values under 50 represent right bias. Fern´ andez-Carriba et al.041991 −0. The fact that the left bias was not significant in the pout category in either the length nor the area measure is probably due to the limited representation of the pout expressions in the sample (nine subjects). %FAI = left/(left + right ) × 100. and both length and area measures was significant only in the case of area FAIs in two categories.01). P < 0. so we must conclude that left facial asymmetry in the play face category did not take place in all components (i.892∗∗ −0.0061722 Mean FAI (%) 52 51 52 51 51 50 S. as demonstrated by an analysis and control for each individual neutral portrait.01. 0.01509 0. that means that the right hemisphere is more involved than the left in the production of emotional expressions by chimpanzees.01575 0.826∗∗ Test values (two-tailed) 0.02487 0. These findings are not the result of a greater exposure of the left side of the chimpanzees’ faces in the recorded images.05.103 −2.0049855 0. taken as a continuous variable.0001915 −0. Spearman correlations between such handedness punctuations and the length and area measures were not significant in any of the categories.02940 t −2.e.02365 0. P < 0. Table 3 Category averages for the FAIs based on the mouth area N Hooting Play Pout SBTa Scream face 22 18 9 20 11 Mean FAI (mm) −0.042∗∗ −0. If the lower portion of the face in chimpanzees. a Silent bared-teeth.01. +3 or +5). play (r = 0. On the contrary. +1.003965 Percentage of left bias in each facial expression is given. and the position (left or right) of the LL and RR chimerics was counterbalanced across the images (i. Participants The human sample consisted of 47 college students.12598. a window on the computer screen was displayed with three icons positioned on the right of the window. like play. Experiment 2: subjective measures 3. One icon was labeled “click here to display new image” a second one was labeled “click here to clear screen” and the last one was labeled “exit”. which resulted in the creation of two chimeric stimuli. difficult to interpret. although it had the advantage of a great ecological validity and the accuracy of the registered emotions. that information is limited to a very particular feature and the extent to which it can be translated into “emotional involvement” of each side of the face is arguable.1. Upon arrival at the laboratory.1. Procedure The stimuli were displayed and the responses were recorded by a program written in Visual Basic 6. 3. it severely limited the data collection and no repeated measures. (Having chimpanzees judge the emotional information in human facial expressions has also been done.0. most of the recent studies about facial asymmetries in emotional behavior in human primates have not found systematic patterns according to age [31]. 3.1. one made of two left halves of the original image (LL) and one right–right chimeric stimulus (RR) (see Fig. a pair of chimeric stimuli were displayed on the screen. the final set of stimuli consisted of 110 pairs of chimeric stimuli created from each original image. and that the same ones had a bigger left side in scream.e. / Neuropsychologia 40 (2002) 1523–1533 1529 which the mouth is opened vertically rather than horizontally. the subjects were instructed to click on icon two. the findings described here do not seem to have been influenced by demographic variables like age. Each half was then duplicated and paired with its mirror-reversed version. Upon clicking icon one. the number of facial expressions was reduced to 110 color images. Facial expressions rarely persist more than 5 s but they are part of dynamic interactions in which the face moves and transitions from one expression to another and the magnitude of the facial asymmetry varies along the whole sequence in both human [38] and nonhuman primates [24]. The fact that the oldest subjects exhibited a bigger area on the right side only in the case of the play category. The program was initiated by the experimenter. The objective asymmetry index obtained so far provided a measure of the differential involvement of the muscles that control each hemimouth during the production of facial expressions. rather than a second image for some subjects. . subjects were asked to sign a consent form and subsequently seated in front of the computer. sex [4] or handedness [5]. The size of the chimeric stimuli was approximately the same as the original images.1. Below each image were two additional dialog boxes labeled “left picture” or “right picture”. The images were then cut 1–21 pixels approximately (0. Although some researchers [25] have reported in chimpanzees an increase as a function of age in the strength of another functional brain asymmetry. The observational approach taken to record the chimpanzees’ facial expressions in this study. 24 females and 23 males. 4). see [32]). Accordingly. Thus. However. for that reason. Upon selecting a dialog box. Fern´ andez-Carriba et al.3. the LL chimeric was on the left 50% of the times).5] and also rhesus monkeys’ faces [19]. 2 The resulting first shot was enlarged or lessened to homogenize the size of all images to 70 mm × 82 mm. Each dyad 2 The equivalence mm/pixels is 1/2. Because human primates have developed particularly good skills in the course of evolution to interpret information coming from facial stimuli [12] they have been traditionally used as judges in tasks that required an emotional assessment of human faces [4. are isolated results and. randomly selecting only one image per chimpanzee and category in the cases where there were two. time during which the pair of chimeric stimuli were exposed was unlimited. The subjects were further instructed to click when ready on the dialog box corresponding to the image that they perceived as being the more intense expression.S. For similar reasons. who participated in the task as part of class requirements. At the onset of testing. the next step in this study was to obtain an assessment of emotional asymmetry in chimpanzees’ facial expressions by having human subjects assess the intensity of expressions in each half of the face (left versus right). handedness. Methods 3. The subjects were instructed to continue in this sequence until the program terminated and all the stimuli had been presented.) above and below the head of the chimpanzee and 0–4 pixels approximately (0–2 mm) at the left and right of their ears. Subjects were individually tested on a PC with a screen (19 in. The vertical midline obtained for the objective measure was now used to split the face into two halves. the lack of correlation between the measures of the two different images of the same individual within the same expression category cannot be accurately interpreted since they could have been easily taken at different intensity peaks of the expression sequence. sex and handedness. The orientation of the dyads was horizontal in order to better adjust them to the shape of a computer screen.1.2. followed by icon one.5–10 mm.) and verbally instructed to select the most emotionally intense chimpanzee’s facial expression within each dyad. On the other hand. Whether this facial asymmetry is consistent within individuals is something that our study cannot address. No one had any expertise on chimpanzees’ behavior and all of them were also naive regarding the hypothesis and procedures of this study. Stimuli In order to prevent subjects’ fatigue. Therefore. The subjects were instructed to click on icon one to initiate testing. 3. could be taken. f . Examples of chimerics in the different categories. 3.f . staring bared-teeth scream face and neutral face. = 108. Left–left chimerics are in the top and the right–right ones in the bottom.3417 t 1. silent bared-teeth and also in the neutral category (see Table 4).) and area (r = 0.01.219∗ Test values (two-tailed) 50 50 50 50 50 50 47 47 47 47 47 47 P < 0.e. 4.10.36.s. i. . That preference reached statistical significance (i. each hemimouth length and area) and the asymmetry in the emotional intensity assessed by the human judges. 3.982∗ 1. a “subjective” facial asymmetry index (SFAI) was calculated for each of the images viewed by the human observers.497 5.01) measures of the very same images were positive in both cases but only significant in the case of the area measures. some authors have suggested that judges may be more sensitive than facial coding procedures in capturing the nuances of human communicative facial expression [7]. We also explored the relationship between the asymmetry found in the physical characteristics of the facial Table 4 Mean percentage of left–left choices per category N Hooting Play Pout SBTa Scream face Neutral ∗ a expressions (in particular. 1. play face.842∗ 1. Overall. The mean percentage of LL preference for each category within the sample was then calculated. d. unless the subject failed to make an accurate response (i. P < 0.9504 1.113 4.6722 1.1530 S. silent pout. one of the cues they were paying attention to was the size of the Mean % of left– left preference 52 58 54 59 53 54 S. were assessing facial expressions of a different species and one in which they had no familiarity. Results The proportion of trials on which each subject selected the LL chimeric image relative to the RR was calculated for each image and averaged across each expression type.E.2.e.3. in which case the same dyad was presented immediately afterwards.e. was presented only once. The new SFAI was based on the number of subjects who had selected the left–left chimeric versus the number that had selected the right–right chimeric. at least. The order of presentation followed four different possibilities that were counterbalanced across subjects. d. Silent bared-teeth. Fern´ andez-Carriba et al. = 78.5407 2. Discussion The human judgements of the emotional intensity of the left and right side of the chimpanzees’ facial expressions were consistent with the objective indexes of facial asymmetry in the case of the play and silent bared-teeth categories. the majority of the human subjects considered the left–left composites as being the most intense facial expressions. Having humans judging the emotional intensity of human chimeric stimuli has been a traditional method to explore facial asymmetries in emotional behavior (see [4] for a review on the human literature). The human judges in this study. silent bared-teeth display. checking either both or neither of the dialog boxes under the images).490 3.6143 2. relative to the total number of human subjects. With this in mind. Pearson product moment correlations between the SFAIs and the “objective” FAIs obtained for the length (r = 0. however. In fact. The low but significant correlation between their judgement and the area measures indicates that. / Neuropsychologia 40 (2002) 1523–1533 Fig.1417 1. SFAI = (# of left − # of right)/(# of left and right). From left to right: pant-hooting. was significantly higher than 50%) in the emotional categories of play. n. humans with no previous chimpanzee experience may be able to correctly identify many chimpanzee facial expressions. In fact. in which both trained judges and muscle quantification have found that facial expressions are left sided [4]. like the size of the mouth. Our results are then contradictory with the left hemisphere advantage reported in monkeys processing or discriminating species-specific auditory stimuli [20–22. is more involved than the left hemisphere in the production of facial expressions of emotion. on the other hand. These authors showed how chimpanzees were able to distinctly categorize photographs of their own facial expressions (including. play. However. The facial expressions in this study which were left sided according to judges or measurement techniques had both positive and negative valence and half of them were accompanied. pout and scream face) and the significant left preference in the neutral category seems warranted. Notwithstanding. The hooting category may be unique among the human-rated chimpanzee expressions because it does not resemble any human emotional facial expression either morphologically or functionally. the two halves of the resting face reflect different qualities [40. since their value as visual communicative discrete signals has been documented and recently demonstrated by Parr et al. skills that are believed to be innate in the case of humans judging humans (see. Apparently. The limited size of the sample in the pout and scream categories (9 and 11 subjects respectively) might account once again for the lack of significance in the subjective measures despite the presence of a left bias. Unfortunately. hooting. was well represented (22 subjects) and the physical evidence of facial asymmetries very consistent. this is the first study to explore and report facial asymmetries in the production of emotions in chimpanzees. Foley’s experiment had failed to demonstrate the ability of college students to accurately identify six chimpanzee facial expressions. we used human judgement capitalizing on the sophisticated skills humans posses to interpret the configurational information in facial features. 4. we have demonstrated that the left side of chimpanzees faces is more involved than the right in the production of emotional behavior. [34]. both judges and area measures found similar patterns of asymmetry in another category. In fact. Experiment 1 in our study was not necessarily measuring facial asymmetry similarly as Experiment 2. Following Hook-Costigan and Rogers [24]. This would imply that the naive human observers in this study may have understood to some extent chimpanzee emotions and approached their faces in similar ways as they would human faces. Fern´ andez-Carriba et al. on the other hand. Hooting. it could be the case that the human subjects would have failed in their attempt to make a judgement about the intensity of that particular emotion (but not in the other cases) basing it on their skills to process human expressions instead of consciously looking at single features. It is again unlikely that humans simply took into account the length or size of the mouth of the chimpanzees’ expressions to make their judgement. General discussion To our knowledge. but once Ekman obtained a second categorization of these emotions. [41]). they replicate what has been traditionally and consistently reported in the case of humans judging humans. Although only the silent bared-teeth display was consistently asymmetric on all measures. a behavior that has been shown in our study to be mainly controlled by the right hemisphere.S. by vocalizations (all but silent bared-teeth and the neutral category). future studies should not only attempt to replicate Ekman’s findings but also have human judges with a high level of expertise in chimpanzee’s behavior judging chimpanzees’ chimeric facial expressions. as suggested by Ekman’s [13] review of Foley’s [14] classic study. What made them consider the left side of the chimpanzees’ faces as the most emotionally intense is something that future research should address. Notwithstanding. to a greater or lesser extent. among others. silent bared-teeth and scream face). where human judgements were possibly influenced by the upper 1/3 of the face (under bilateral hemispheric control). / Neuropsychologia 40 (2002) 1523–1533 1531 chimpanzee mouth. they cannot be simply considered as vocalizations. Whether these subjects were taking into account other single features of the chimpanzees’ faces or applying their innate abilities to process human emotions in the assessment of very similar stimuli is a question that remains unanswered. we objectively measured physical differences between the left and right side of the chimpanzees’ faces. this resembles the findings coming from the human facial asymmetry literature. In . part of the whole communicative behavior.50]. as concluded from studies of homology between human an nonhuman primates [9]. i. how that upper portion of the chimpanzee face affected results from Experiment 2 cannot be assessed in the present study. In addition. The accompanying vocalizations of such visual signals are. Some discussion of the nonsignificant preference (although towards the left half of the chimpanzees’ faces) found in the case of three emotional categories (hooting. for example. Taking advantage of the procedures used by studies with similar objectives. Both the objective and the subjective indexes of facial asymmetry show that the left side of the chimpanzee’s face. and hence the right hemisphere. play.36] since it would make no evolutionary sense that the perception and production of vocalizations were in opposite hemispheres. Future research should attempt to asses separately the upper and lower halves of chimpanzees’ chimeric faces. like it has been done in human studies [5]. Thus.e. The same face-processing mechanism could be invoked to explain the results regarding the neutral category. found that two had been labeled incorrectly and that the three of the four remaining expressions had been identified by the students significantly above chance levels (Foley did not perform statistics). any attempt to find a general explanation for the existence of functional brain asymmetries in human and nonhuman primates must necessarily consider phylogenetic distance among species. Darwin and facial expressions. Beckwith B. 1973:169–222. was also “left-sided” (even though play didn’t reach statistical significance in the length FAI). Furthermore. However. Elva Fernández-Carriba and Mr. valence. Dr. Darwin and facial expressions. Cortex 1984. David Washburn also provided helpful comments on the manuscript. Rubén Gómez Soriano for their inestimable collaboration collecting and manipulating the data. On the other hand. where the communication of the emotional context might be most important. they are consistent with the human literature. The valence of the emotions doesn’t seem to have had an influence on our results. These results are consistent with the findings coming from the studies on emotional facial expressions in human primates that show that the left hemiface is more involved than the right hemiface in the expression of both positive and negative facial emotions [5].36:1209–15. Behavioural Brain Research 1983. [17] Hamilton CR. The lateralization of emotion: a critical review. In: Jay PC. . Asymmetries in affective facial expression: anatomy and behavior. San Diego: Academic Press. Susana Sánchez and Dr. editors.20:243–52. Neuropsychological aspects of facial asymmetry during emotional expression: a review of the normal adult literature. Facial asymmetry during emotional expression: gender. Facial expressions of emotions in nonhuman primates. Acknowledgements Support for this research was provided by the MEC grant AP96. Judgement of facial expression of emotion in the chimpanzee. Vermeire BA. We would like to thank the Madrid Zoo-Aquarium and the YRPRC for their collaboration making possible to carry on this study inside their settlements. 1994. Science 1993. emotion and affective style. [12] Dopson W. Psychological Science 1992. Hugdahl K. / Neuropsychologia 40 (2002) 1523–1533 fact. The psychobiology of affective development. Yecker S. Discrimination of monkey faces by split-brain monkeys. Rogers L. referential information versus emotional signals. In: Fox N.3:39–43. Schmidt JM.6:31–54. A preliminary report on expressive movements and communication in the Gombe Stream chimpanzees. it should not be argue that the right hemisphere has exclusive control over emotional behavior. Parr. Rinehart & Winston. language. The only study in nonhuman primates that has found an effect of the valence in the lateralization of emotional behavior has been the one by Hook-Costigan and Rogers [24]. and measurement technique. Bullard-Bates P. Lisa A.1532 S. Studies of lateralization of emotions in nonhuman primates have mostly focused on negative emotions and a right hemisphere involvement in emotional behavior has overall been reported [29]. [7] Buck R. [9] Chevalier-Skolnikoff S. Journal of Social Psychology 1935. Hillsdale. tool-use and intellect. the distinction between the facial and auditory communicative channels might be diluted in another distinction.9:263–75. Fern´ andez-Carriba et al. Using FACS versus communication scores to measure spontaneous facial expression of emotion in brain-damaged subjects. editor. We also would like to thank Ms. Davidson R.20194893 to SFC and the NIH grants NS-29574 and NS-36605 to WDH. [8] Campbell R. is homologous in all these species. 1995:361–87.17:211–29. [16] Goodall J van Lawick. New York: Academic Press. [5] Borod JC. [19] Hauser MC. Haywood CS. Cambridge. Neuropsychology Review 1997. In: Ekman P. Koff E. [11] Davidson RJ. Cortex 1990. Complimentary hemispheric specialization in monkeys. although this finding may be interpreted in other possible ways (see above). New York: Holt. NJ: Erlbaum. in particular. The evolution of lateral asymmetries. Human facial expression. References [1] Borod JC. 1973:11–89. Neuropsychologia 1998. play. which has also been suggested by Hauser [19].60:339–48. this result is interpreted by the authors as a left hemisphere superiority in the production of a call in which the information about the social identity of the caller is predominant versus a right hemisphere superiority in the fear call. Our study would be thus in the line of those that have shown a greater involvement of the left hemiface in the spontaneous expression of facial emotion. Also in humans. as both hemispheres must participate and coordinate in the production of the facial expressions. 1968:313–519. Science 1988. Santschi C. editor. [4] Borod JC. Dr. [14] Foley Jr JP. 1984:293–323. Asymmetry of facial expression in spontaneous emotion. [3] Borod JC. Emotion and affective style: hemispheric substrates. Neuropsychology 1993.26:275–80. Emotion and the brain—anatomy and theory. editors.261:475–7. Tucker DM. Koff E. [6] Bradshaw JL. since the only expression given in a broadly positive social context. However. Koff E.7:41–60. New York: Academic Press.242:1694–6. the data clearly indicate that the contribution to the signal is not equally distributed. [2] Borod JC.7:427–32. Brain asymmetry. which suggests that this functional asymmetry. [15] Fridlund AJ. Vermeire BA. Interhemispheric and intrahemispheric control of emotion: a focus on unilateral brain damage. Thus. These results are consistent with those reported by the only study that explored brain lateralization in perception of human emotions in chimpanzees [32] and with the literature on nonhuman primate emotional behavior. Furthermore. [13] Ekman P. [18] Hamilton CR. [10] Davidson RJ. Right hemisphere dominance in the production of facial expression in monkeys. In: Davidson RJ. Cerebral Asymmetry. although some data point to the possibility of differential hemispheric involvement as a function of emotional valence. New York: Academic Press. Primates: studies in adaptation and variability. 1993. In summary. this study is the first one to have provided empirical support for the hypothesis of a right hemisphere lateralization in the production of emotions by chimpanzees. Cross-cultural studies of facial expression. left-sided facial asymmetries have been reported for both posed and spontaneous expressions. despite some suggestion about differences and degree of facial asymmetry between the two conditions [5]. MA: MIT Press. Journal of Consulting and Clinical Psychology 1992. Hook-Costigan and Rogers’ [24] finding of a left hemisphere superiority in the production of social contact calls by marmosets is consistent with that left hemisphere specialization in species-specific calls. International Journal of Psychology 1982. Evolution of Communication 1998. Hillsdale. 2002. 44–6. Leonard CM. Welkowitz J. but not infant. In: Scherer KR. In: Morris D. Hemispheric differences in processing emotions and faces. Orienting asymmetries in rhesus monkeys: the effect of time-domain changes on acoustic perception. editor. Brain & Cognition 1993. Hemispheric specialization in infant chimpanzees (Pan troglodytes): evidence for a relation with gender and arousal. Cambridge. Phylogeny and ontogeny of cerebral lateralization. Animal Behaviour 1998. Neuroscience Abstracts 1988. [32] Morris RD. [45] van Hooff J.56:41–7.113:1–7. Neural lateralization of species-specific vocalizations in Japanese macaques (Macaca fuscata). editors. Welkowitz J. Bauer RM. rhesus monkeys: field experiments.20:165–78. Bryden MP. 1967:7–68. Borod JC. Oxford University Press. Facial expressions in higher primates. Fern´ andez-Carriba et al. de Waal FBM. / Neuropsychologia 40 (2002) 1523–1533 [20] Hauser MD. Hemispheric specialization displayed by man but not macaques in the analysis of faces. Alpert M. Emotions: a general psychoevolutionary theory. Heilman KM.21:111–22. [49] Vermeire BA.36:1265–73.36:1003–14. de Waal FBM. The effect of situational factors on hand preferences for feeding in 177 captive chimpanzees (Pan troglodytes). p. Weiman LA. Weingartner H. [36] Petersen MR. Rogers LJ. NJ: Erlbaum.11:370–9. [50] Yecker S. In: Davidson RJ. Science 1978. editor. London: Academic Press. [48] Vermeire BA. Cortex 1984. Laterality in monkeys discriminating inverted faces. Forman BD. 1972:209–41. In: von Cranach M.109:808–12.95:52–77. Beecher MD. [37] Plutchnik R. [44] van Hooff J. Moody DB. 1533 [35] Parr LA. Lateral brain function. Infant chimpanzee. Comparative vertebrate lateralization. New York: Cambridge University Press. Alpert M. Psychological Bulletin 1984.38:403–9. Preuschoft S.28:199–209. editors.2:1–23. Bowers D. Andrews R. A structural analysis of the social behaviour of a semi-captive group of chimpanzees. Hemispheric lateralization of functions related to emotion. [34] Parr LA. Vine I. Neuropsychologia 1982.8:97–125. Zoloth SR. Stebbins WC. Lateralization for the expression and perception of facial emotion as a function of age. Journal of Neuropsychiatry and Clinical Neurosciences 1999. A comparative approach to the phylogeny of laughter and smiling. emotion and conceptualization. In: Hinde R. In: Rogers LJ. Expressive movement and non-verbal communication. editor. Andersson K. Hugdahl K. [40] Sackeim HA. Heffner RS. editors. [41] Serrano JM. Hopkins WD. Borod JC. Brain & Language 1979. New York. [33] Overman WH.38:1028–39. Perception of human chimeric faces by chimpanzees (Pan troglodytes): evidence for a right hemisphere asymmetry. Journal of Comparative Psychology 1999.25:411–25. Martin C. [22] Heffner HE. Bard KA.5:322–53.202:324–7. IL: Aldine. Fernández-Carriba S. 1973:75–162. editors. [31] Moreno CR. Science 1984. Cambridge: Cambridge University Press. Heritability of hand preference in chimpanzees: evidence from a partial interspecies cross-fostering study. Left hemisphere dominance for processing vocalizations in adult.14:1139. The perception of facial expressions by chimpanzees. Doty RW. Evidence of asymmetries in spontaneous head turning in infant chimpanzees (Pan troglodytes). Bard KA. Neuropsychologia 1998. Brozgold A. Visual discrimination and recognition of facial expressions of anger. Fernández-Carriba S. Approaches to emotion. Brain & Cognition 1986.S. Perez C. Iglesias J.7:127–38. [29] Hopkins WD. Temporal lobe lesions and perception of species-specific vocalizations by macaques. Lateralization of facial emotional expression in schizophrenic and depressed patients. [21] Hauser MD. Loeches A. [24] Hook-Costigan MA. Neuropsychologia 2000. Ekman P.26:219–35. Neuropsychology 1998. The neuropsychology of facial expression: a review of the neurological and psychological mechanisms for producing facial expression. Laterality in communicative behaviors in nonhuman primates: a critical analysis. Pan troglodytes. [25] Hopkins WD. Proceeding of the National Academy of Sciences 1994. Chicago. Brain asymmetry. [38] Richardson CK.89:19–46. human child.20:113–28. Research on facial emotion in chimpanzees: 75 years since Kohts. 2002. Kinsbourne M. [42] Silberman EK. [43] Tucker DM. Neuropsychologia 1990. The facial displays of the Catarrhine monkeys and apes. Lateralised use of the mouth in production of vocalizations by marmosets. [39] Rinn WB. Psychological Bulletin 1981. 1995:535–78. In: de Wahl FBM. [23] Hiscock M. [28] Hopkins WD. fear and surprise in 4-to6-month-old infants.91:3946–8. Developmental Psychobiology 1992. area and emotional expression. [47] van Hooff J. 1984:197–219. [30] Ley RG. Hopkins WD. Inversion effect for faces in split-brain monkeys. [46] van Hooff J. Non-verbal communication. Agnetta B. Digitizing the moving face during dynamic displays of emotion. . Asymmetry of the face at rest: size. [26] Hopkins WD. Neuropsychologia 2000.226:75–6. Developmental Psychobiology 1993. Behavioral Neuroscience 1995. Primate ethology. Hamilton CR. Symposia of the Zoological Society of London 1962. MA: MIT Press. Hamilton CR. [27] Hopkins WD.