Individual differences in trust evaluations are shaped mostly by environments, not genes.

People evaluate a stranger's trustworthiness from their facial features in a fraction of a second, despite common advice "not to judge a book by its cover." Evaluations of trustworthiness have critical and widespread social impact, predicting financial lending, mate selection, and even criminal justice outcomes. Consequently, understanding how people perceive trustworthiness from faces has been a major focus of scientific inquiry, and detailed models explain how consensus impressions of trustworthiness are driven by facial attributes. However, facial impression models do not consider variation between observers. Here, we develop a sensitive test of trustworthiness evaluation and use it to document substantial, stable individual differences in trustworthiness impressions. Via a twin study, we show that these individual differences are largely shaped by variation in personal experience, rather than genes or shared environments. Finally, using multivariate twin modeling, we show that variation in trustworthiness evaluation is specific, dissociating from other key facial evaluations of dominance and attractiveness. Our finding that variation in facial trustworthiness evaluation is driven mostly by personal experience represents a rare example of a core social perceptual capacity being predominantly shaped by a person's unique environment. Notably, it stands in sharp contrast to variation in facial recognition ability, which is driven mostly by genes. Our study provides insights into the development of the social brain, offers a different perspective on disagreement in trust in wider society, and motivates new research into the origins and potential malleability of face evaluation, a critical aspect of human social cognition.

Beyond Likert ratings: Improving the robustness of developmental research measurement using best-worst scaling.

Some of the 'best practice' approaches to ensuring reproducibility of research can be difficult to implement in the developmental and clinical domains, where sample sizes and session lengths are constrained by the practicalities of recruitment and testing. For this reason, an important area of improvement to target is the reliability of measurement. Here we demonstrate that best-worst scaling (BWS) provides a superior alternative to Likert ratings for measuring children's subjective impressions. Seventy-three children aged 5-6 years rated the trustworthiness of faces using either Likert ratings or BWS over two sessions. Individual children's ratings in the BWS condition were significantly more consistent from session 1 to session 2 than those in the Likert condition, a finding we also replicate with a large adult sample (N = 72). BWS also produced more reliable ratings at the group level than Likert ratings in the child sample. These findings indicate that BWS is a developmentally appropriate response format that can deliver substantial improvements in reliability of measurement, which can increase our confidence in the robustness of findings with children.

Appearance-based trust processing in schizophrenia.

OBJECTIVES: Schizophrenia is characterized by impaired social interactions and altered trust. In the general population, trust is often based on facial appearance, with limited validity but enormous social consequences. The aim was to examine trust processing in schizophrenia and specifically to examine how people with schizophrenia use facial appearance as well as actual partner fairness to guide trusting decisions. DESIGN: An experimental economic game study. METHODS: Here, we tested how patients with schizophrenia and control participants (each N = 24) use facial trustworthiness appearance and partner fairness behaviour to guide decisions in a multi-round Trust Game. In the Trust Game, participants lent money to 'partners' whose facial appearance was either untrustworthy or trustworthy, and who either played fairly or unfairly. Clinical symptoms were measured as well as explicit trustworthiness impressions. RESULTS: Overall, the patients with schizophrenia showed unimpaired explicit facial trustworthiness impressions and unimpaired facial appearance biases in the Trust Game. Crucially, patients and controls significantly differed so that the patients with schizophrenia did not learn to discriminate in the Trust Game based on actual partner fairness, unlike control participants. CONCLUSION: A failure to discriminate trust has important implications for everyday functioning in schizophrenia, as forming accurate trustworthiness beliefs is an essential social skill. Critically, without relying on more valid trust cues, people with schizophrenia may be especially susceptible to the misleading effect of appearance when making trusting decisions. PRACTITIONER POINTS: Findings People with schizophrenia made very similar facial trustworthiness impressions to healthy controls and also used facial appearance to guide trust decisions similarly to controls. However, the patient group were less able to explicitly distinguish between fair and unfair partners based on their behaviour compared with the control group. Moreover, people with schizophrenia failed to use actual partner fairness to guide their financial decisions in the Trust Game, unlike controls, and this impairment was specific to a social task. People with schizophrenia may be particularly reliant on facial appearance when trusting others, as they may struggle to incorporate more valid trustworthiness information in their decision-making, such as actual partner fairness.

Are expression aftereffects fully explained by tilt adaptation?

Facial expressions are used as critical social cues in everyday life. Adaptation to expressions causes expression aftereffects. These aftereffects are thought to reflect the operation of face-selective neural mechanisms, and are used by researchers to investigate the nature of those mechanisms. However, recent evidence suggests that expression aftereffects could be at least partially explained by the inheritance of lower-level tilt adaptation through the visual hierarchy. We investigated whether expression aftereffects could be entirely explained by tilt adaptation. Participants completed an expression adaptation task in which we controlled for the influence of tilt by changing the orientation of the adaptor relative to the test stimuli. Although tilt adaptation appeared to make some contribution to the expression aftereffect, robust expression aftereffects still remained after minimizing tilt inheritance, indicating that expression aftereffects cannot be fully explained by tilt adaptation. There was also significant reduction in the expression aftereffects after inverting the adapting face, providing evidence that face-selective processing is involved in these aftereffects.

Positive sequential dependency for face attractiveness perception.

Recent findings from several groups have demonstrated that visual perception at a given moment can be biased toward what was recently seen. This is true both for basic visual attributes and for more complex representations, such as face identity, gender, or expression. This assimilation to the recent past is a positive serial dependency, similar to a temporal averaging process that capitalizes on short-term correlations in visual input to reduce noise and boost perceptual continuity. Here we examine serial dependencies in face perception using a simple attractiveness rating task and a rapid series of briefly presented face stimuli. In a series of three experiments, our results confirm a previous report that face attractiveness exhibits a positive serial dependency. This intertrial effect is not only determined by face attractiveness on the previous trial, but also depends on the faces shown up to five trials back. We examine the effect of stimulus presentation duration and find that stimuli as brief as 56 ms produce a significant positive dependency similar in magnitude to that produced by stimuli presented for 1,000 ms. We observed stronger positive dependencies between same-gender faces, and found a task dependency: Alternating gender discrimination trials with attractiveness rating trials produced no serial dependency. In sum, these findings show that a perception-stabilizing assimilation effect operates in face attractiveness perception that is task dependent and is acquired surprisingly quickly.

Ensemble coding of faces occurs in children and develops dissociably from coding of individual faces.

Ensemble coding allows adults to access useful information about average properties of groups, sometimes even in the absence of detailed representations of individual group members. This form of coding may emerge early in development with initial reports of ensemble coding for simple properties (size, numerosity) in young children and even infants. Here we demonstrate that ensemble coding of faces, which provides information about average properties of social groups, is already present in 6-8-year-old children. This access to average information increases with age from 6 to 18 years and its development is dissociable from age-related improvements in the coding of individual face identities. This dissociation provides the first direct evidence that distinct processes underlie ensemble and individual coding of face identity, evidence that has been lacking from adult studies. More generally, our results add to the emerging evidence for impressively mature sensitivity to statistical properties of the visual environment in children. They indicate that children have access to gist information about social groups that may facilitate adaptive social behaviour.

Adaptation to dynamic faces produces face identity aftereffects.

Face aftereffects are well established for static stimuli and have been used extensively as a tool for understanding the neural mechanisms underlying face recognition. It has also been argued that adaptive coding, as demonstrated by face aftereffects, plays a functional role in face recognition by calibrating our face norms to reflect current experience. If aftereffects tap high-level perceptual mechanisms that are critically involved in everyday face recognition then they should also occur for moving faces. Here we asked whether face identity aftereffects can be induced using dynamic adaptors. The face identity aftereffect occurs when adaptation to a particular identity (e.g., Dan) biases subsequent perception toward the opposite identity (e.g., antiDan). We adapted participants to video of real faces that displayed either rigid, non-rigid, or no motion and tested for aftereffects in static antifaces. Adapt and test stimuli differed in size, to minimize low-level adaptation. Aftereffects were found in all conditions, suggesting that face identity aftereffects tap high-level mechanisms important for face recognition. Aftereffects were not significantly reduced in the motion conditions relative to the static condition. Overall, our results support the view that face aftereffects reflect adaptation of high-level mechanisms important for real-world face recognition in which faces are moving.

Watching the brain recalibrate: Neural correlates of renormalization during face adaptation.

The face perception system flexibly adjusts its neural responses to current face exposure, inducing aftereffects in the perception of subsequent faces. For instance, adaptation to expanded faces makes undistorted faces appear compressed, and adaptation to compressed faces makes undistorted faces appear expanded. Such distortion aftereffects have been proposed to result from renormalization, in which the visual system constantly updates a prototype according to the adaptors' characteristics and evaluates subsequent faces relative to that. However, although consequences of adaptation are easily observed in behavioral aftereffects, it has proven difficult to observe renormalization during adaptation itself. Here we directly measured brain responses during adaptation to establish a neural correlate of renormalization. Given that the face-evoked occipito-temporal P2 event-related brain potential has been found to increase with face prototypicality, we reasoned that the adaptor-elicited P2 could serve as an electrophysiological indicator for renormalization. Participants adapted to sequences of four distorted (compressed or expanded) or undistorted faces, followed by a slightly distorted test face, which they had to classify as undistorted or distorted. We analysed ERPs evoked by each of the adaptors and found that P2 (but not N170) amplitudes evoked by consecutive adaptor faces exhibited an electrophysiological pattern of renormalization during adaptation to distorted faces: P2 amplitudes evoked by both compressed and expanded adaptors significantly increased towards asymptotic levels as adaptation proceeded. P2 amplitudes were smallest for the first adaptor, significantly larger for the second, and yet larger for the third adaptor. We conclude that the sensitivity of the occipito-temporal P2 to the perceived deviation of a face from the norm makes this component an excellent tool to study adaptation-induced renormalization.

Reduced adaptability, but no fundamental disruption, of norm-based face coding following early visual deprivation from congenital cataracts.

Faces are adaptively coded relative to visual norms that are updated by experience, and this adaptive coding is linked to face recognition ability. Here we investigated whether adaptive coding of faces is disrupted in individuals (adolescents and adults) who experience face recognition difficulties following visual deprivation from congenital cataracts in infancy. We measured adaptive coding using face identity aftereffects, where smaller aftereffects indicate less adaptive updating of face-coding mechanisms by experience. We also examined whether the aftereffects increase with adaptor identity strength, consistent with norm-based coding of identity, as in typical populations, or whether they show a different pattern indicating some more fundamental disruption of face-coding mechanisms. Cataract-reversal patients showed significantly smaller face identity aftereffects than did controls (Experiments 1 and 2). However, their aftereffects increased significantly with adaptor strength, consistent with norm-based coding (Experiment 2). Thus we found reduced adaptability but no fundamental disruption of norm-based face-coding mechanisms in cataract-reversal patients. Our results suggest that early visual experience is important for the normal development of adaptive face-coding mechanisms.

Assessing early processing of eye gaze in schizophrenia: measuring the cone of direct gaze and reflexive orienting of attention.

INTRODUCTION: The accurate discrimination of another person's eye-gaze direction is vital as it provides a cue to the gazer's focus of attention, which in turn supports joint attention. Patients with schizophrenia have shown a "direct gaze bias" when judging gaze direction. However, current tasks do not dissociate an early perceptual bias from high-level top-down effects. We investigated early stages of gaze processing in schizophrenia by measuring perceptual sensitivity to fine deviations in gaze direction (i.e., the cone of direct gaze: CoDG) and ability to reflexively orient to locations cued by the same deviations. METHODS: Twenty-four patients and 26 controls completed a CoDG discrimination task that used realistic direct-face images with six fine degrees of deviation (i.e., 3, 6 or 9 pixels to the left and right) and direct gaze, and a gaze cueing task that assessed reflexive orienting to the same fine-grained deviations. RESULTS: Our data showed patients exhibited no impairment in gaze discrimination, nor did we observe a reduced orienting response. CONCLUSIONS: These results suggest that while patients may suffer deficits associated with interpreting another person's gaze, the earliest processes concerned with detecting averted gaze and reflexively orienting to the gazed-at location are intact.

The contributions of temporal delay and face exposure to the decay of gaze direction aftereffects.

Gaze direction is a dynamic social signal that provides real-time insight into another person's focus of attention. Gaze adaptation induces aftereffects in the perception of gaze in subsequent faces, typically biasing it away from the adapted direction. Previous studies found that such gaze direction aftereffects persist for about 7 min when repeatedly tested immediately after adaptation, but can survive at least 24 hr when there is no testing immediately after adaptation. These findings suggest that exposure to test faces after adaptation might affect the persistence of gaze direction aftereffects more than the passing of time. The present study systematically established the contributions of time and intervening testing on the longevity of gaze direction aftereffects. Aftereffects were induced and then traced over six postadaptation tests. Participants were assigned to four groups with a delay of either 30 s, 3 min, 5.5 min, or 8 min between adaptation and the first postadaptation test. Aftereffects were strongly affected by the number of preceding postadaptation tests, but unaffected by the delay between adaptation and test, revealing that face exposure affects the longevity of aftereffects more strongly than the passing of time, at least over the time frame studied here. Our findings suggest that exposure to a substantial number of faces with an unbiased distribution of gaze directions may be necessary to overcome gaze direction aftereffects.

Repetition Suppression in Ventral Visual Cortex Is Diminished as a Function of Increasing Autistic Traits.

Repeated viewing of a stimulus causes a change in perceptual sensitivity, known as a visual aftereffect. Similarly, in neuroimaging, repetitions of the same stimulus result in a reduction in the neural response, known as repetition suppression (RS). Previous research shows that aftereffects for faces are reduced in both children with autism and in first-degree relatives. With functional magnetic resonance imaging, we found that the magnitude of RS to faces in neurotypical participants was negatively correlated with individual differences in autistic traits. We replicated this finding in a second experiment, while additional experiments showed that autistic traits also negatively predicted RS to images of scenes and simple geometric shapes. These findings suggest that a core aspect of neural function--the brain's response to repetition--is modulated by autistic traits.

The Influence of Averageness on Adults' Perceptions of Attractiveness: The Effect of Early Visual Deprivation.

Adults who missed early visual input because of congenital cataracts later have deficits in many aspects of face processing. Here we investigated whether they make normal judgments of facial attractiveness. In particular, we studied whether their perceptions are affected normally by a face's proximity to the population mean, as is true of typically developing adults, who find average faces to be more attractive than most other faces. We compared the judgments of facial attractiveness of 12 cataract-reversal patients to norms established from 36 adults with normal vision. Participants viewed pairs of adult male and adult female faces that had been transformed 50% toward and 50% away from their respective group averages, and selected which face was more attractive. Averageness influenced patients' judgments of attractiveness, but to a lesser extent than controls. The results suggest that cataract-reversal patients are able to develop a system for representing faces with a privileged position for an average face, consistent with evidence from identity aftereffects. However, early visual experience is necessary to set up the neural architecture necessary for averageness to influence perceptions of attractiveness with its normal potency.

The timecourse of expression aftereffects.

Adaptation to facial expressions produces aftereffects that bias perception of subsequent expressions away from the adaptor. Studying the temporal dynamics of an aftereffect can help us to understand the neural processes that underlie perception, and how they change with experience. Little is known about the temporal dynamics of the expression aftereffect. We conducted two experiments to measure the timecourse of this aftereffect. In Experiment 1 we examined how the size of the aftereffect varies with changes in the duration of the adaptor and test stimuli. We found that the expression aftereffect follows the classic timecourse pattern of logarithmic build-up and exponential decay that has been demonstrated for many lower level aftereffects, as well as for facial identity and figural face aftereffects. This classic timecourse pattern suggests that the adaptive calibration mechanisms of facial expression are similar to those of lower level visual stimuli, and is consistent with a perceptual locus for the adaptation aftereffect. We also found that aftereffects could be generated by as little as 1 s of adaptation, and in some conditions lasted for as long as 3200 ms. We extended this last finding in Experiment 2, exploring the longevity of the expression aftereffect by adding a stimulus-free gap of varying duration between adaptation and test. We found that significant expression aftereffects were still present 32 s after adaptation. The persistence of the expression aftereffect suggests that they may have a considerable impact on day-to-day expression perception.

Perceived trustworthiness of faces drives trust behaviour in children.

Facial appearances can powerfully influence adults' trust behaviour, despite limited evidence that these cues constitute honest signals of trustworthiness. It is not clear, however, whether the same is also true for children. The current study investigated whether, like adults, 5-year-olds and 10-year-olds are more likely to place their trust in partners that look trustworthy than those that look untrustworthy. A second, closely related question was whether children also explicitly value the information from face cues when making trust decisions. We investigated these questions using Token Quest: an economic trust game that gave participants the opportunity to make investments with a series of partners who might (or might not) repay their trust with large returns. These interactions occurred under different conditions, including one in which participants were shown the face of each partner and another in which they could 'purchase' access to faces with a portion of their investment capital. Results indicated that, like adults, 10-year-old children selectively placed their trust in those partners they perceived as looking trustworthy and many were willing to 'pay' to purchase access to these face cues during the trust game. We observed a similar profile of trust behaviour in 5-year-olds, with no significant group difference in the impact of face cues on behaviour across the three age groups. Together, these findings indicate that the influence of face cues on trust behaviour emerges early, and highlight a capacity for sophisticated social cognition in young children.

Face and body recognition show similar improvement during childhood.

Adults are proficient in extracting identity cues from faces. This proficiency develops slowly during childhood, with performance not reaching adult levels until adolescence. Bodies are similar to faces in that they convey identity cues and rely on specialized perceptual mechanisms. However, it is currently unclear whether body recognition mirrors the slow development of face recognition during childhood. Recent evidence suggests that body recognition develops faster than face recognition. Here we measured body and face recognition in 6- and 10-year-old children and adults to determine whether these two skills show different amounts of improvement during childhood. We found no evidence that they do. Face and body recognition showed similar improvement with age, and children, like adults, were better at recognizing faces than bodies. These results suggest that the mechanisms of face and body memory mature at a similar rate or that improvement of more general cognitive and perceptual skills underlies improvement of both face and body recognition.

Gaze direction affects the magnitude of face identity aftereffects.

The face perception system partly owes its efficiency to adaptive mechanisms that constantly recalibrate face coding to our current diet of faces. Moreover, faces that are better attended produce more adaptation. Here, we investigated whether the social cues conveyed by a face can influence the amount of adaptation that face induces. We compared the magnitude of face identity aftereffects induced by adaptors with direct and averted gazes. We reasoned that faces conveying direct gaze may be more engaging and better attended and thus produce larger aftereffects than those with averted gaze. Using an adaptation duration of 5 s, we found that aftereffects for adaptors with direct and averted gazes did not differ (Experiment 1). However, when processing demands were increased by reducing adaptation duration to 1 s, we found that gaze direction did affect the magnitude of the aftereffect, but in an unexpected direction: Aftereffects were larger for adaptors with averted rather than direct gaze (Experiment 2). Eye tracking revealed that differences in looking time to the faces between the two gaze directions could not account for these findings. Subsequent ratings of the stimuli (Experiment 3) showed that adaptors with averted gaze were actually perceived as more expressive and interesting than adaptors with direct gaze. Therefore it appears that the averted-gaze faces were more engaging and better attended, leading to larger aftereffects. Overall, our results suggest that naturally occurring facial signals can modulate the adaptive impact a face exerts on our perceptual system. Specifically, the faces that we perceive as most interesting also appear to calibrate the organization of our perceptual system most strongly.

How is facial expression coded?

Facial expression is theorized to be visually represented in a multidimensional expression space, relative to a norm. This norm-based coding is typically argued to be implemented by a two-pool opponent coding system. However, the evidence supporting the opponent coding of expression cannot rule out the presence of a third channel tuned to the center of each coded dimension. Here we used a paradigm not previously applied to facial expression to determine whether a central-channel model is necessary to explain expression coding. Participants identified expressions taken from a fear/antifear trajectory, first at baseline and then in two adaptation conditions. In one condition, participants adapted to the expression at the center of the trajectory. In the other condition, participants adapted to alternating images from the two ends of the trajectory. The range of expressions that participants perceived as lying at the center of the trajectory narrowed in both conditions, a pattern that is not predicted by the central-channel model but can be explained by the opponent-coding model. Adaptation to the center of the trajectory also increased identification of both fear and antifear, which may indicate a functional benefit for adaptive coding of facial expression.

Transfer of figural face aftereffects suggests mature orientation selectivity in 8-year-olds' face coding.

Adult face perception mechanisms are tuned to upright faces, and this orientation selectivity is central to adult expertise with upright faces. Children are less expert than adults, and it has been argued that their face mechanisms are less orientation selective than those of adults. Here we used face aftereffects to test this hypothesis by examining whether children's aftereffects show greater transfer across changes in orientation than do adults' aftereffects. We adapted 7- to 8-year-old children and adults to figural face distortions in both upright and inverted orientations and examined the size of resulting aftereffects in both upright and inverted test faces. If children's face mechanisms are less orientation selective than those of adults, then children's aftereffects should transfer more strongly across changes in orientation. We found no evidence to support this prediction. Children's and adults' aftereffects were similarly reduced by orientation differences between adapt and test. These results indicate that children, like adults, show a high degree of orientation selectivity in face shape coding and suggest that neural tuning to face orientation may be mature by 8 years of age. Our findings are consistent with an emerging view that many of the key attributes of specialized face perception emerge much earlier in development than previously thought.