Deep models of superficial face judgments.

The diversity of human faces and the contexts in which they appear gives rise to an expansive stimulus space over which people infer psychological traits (e.g., trustworthiness or alertness) and other attributes (e.g., age or adiposity). Machine learning methods, in particular deep neural networks, provide expressive feature representations of face stimuli, but the correspondence between these representations and various human attribute inferences is difficult to determine because the former are high-dimensional vectors produced via black-box optimization algorithms. Here we combine deep generative image models with over 1 million judgments to model inferences of more than 30 attributes over a comprehensive latent face space. The predictive accuracy of our model approaches human interrater reliability, which simulations suggest would not have been possible with fewer faces, fewer judgments, or lower-dimensional feature representations. Our model can be used to predict and manipulate inferences with respect to arbitrary face photographs or to generate synthetic photorealistic face stimuli that evoke impressions tuned along the modeled attributes.

Vocomotor and Social Brain Networks Work Together to Express Social Traits in Voices.

Voice modulation is important when navigating social interactions-tone of voice in a business negotiation is very different from that used to comfort an upset child. While voluntary vocal behavior relies on a cortical vocomotor network, social voice modulation may require additional social cognitive processing. Using functional magnetic resonance imaging, we investigated the neural basis for social vocal control and whether it involves an interplay of vocal control and social processing networks. Twenty-four healthy adult participants modulated their voice to express social traits along the dimensions of the social trait space (affiliation and competence) or to express body size (control for vocal flexibility). Naïve listener ratings showed that vocal modulations were effective in evoking social trait ratings along the two primary dimensions of the social trait space. Whereas basic vocal modulation engaged the vocomotor network, social voice modulation specifically engaged social processing regions including the medial prefrontal cortex, superior temporal sulcus, and precuneus. Moreover, these regions showed task-relevant modulations in functional connectivity to the left inferior frontal gyrus, a core vocomotor control network area. These findings highlight the impact of the integration of vocal motor control and social information processing for socially meaningful voice modulation.

Cracking the social code of speech prosody using reverse correlation.

Human listeners excel at forming high-level social representations about each other, even from the briefest of utterances. In particular, pitch is widely recognized as the auditory dimension that conveys most of the information about a speaker's traits, emotional states, and attitudes. While past research has primarily looked at the influence of mean pitch, almost nothing is known about how intonation patterns, i.e., finely tuned pitch trajectories around the mean, may determine social judgments in speech. Here, we introduce an experimental paradigm that combines state-of-the-art voice transformation algorithms with psychophysical reverse correlation and show that two of the most important dimensions of social judgments, a speaker's perceived dominance and trustworthiness, are driven by robust and distinguishing pitch trajectories in short utterances like the word "Hello," which remained remarkably stable whether male or female listeners judged male or female speakers. These findings reveal a unique communicative adaptation that enables listeners to infer social traits regardless of speakers' physical characteristics, such as sex and mean pitch. By characterizing how any given individual's mental representations may differ from this generic code, the method introduced here opens avenues to explore dysprosody and social-cognitive deficits in disorders like autism spectrum and schizophrenia. In addition, once derived experimentally, these prototypes can be applied to novel utterances, thus providing a principled way to modulate personality impressions in arbitrary speech signals.

The Effectiveness of Multi-Label Classification and Multi-Output Regression in Social Trait Recognition.

First impressions make up an integral part of our interactions with other humans by providing an instantaneous judgment of the trustworthiness, dominance and attractiveness of an individual prior to engaging in any other form of interaction. Unfortunately, this can lead to unintentional bias in situations that have serious consequences, whether it be in judicial proceedings, career advancement, or politics. The ability to automatically recognize social traits presents a number of highly useful applications: from minimizing bias in social interactions to providing insight into how our own facial attributes are interpreted by others. However, while first impressions are well-studied in the field of psychology, automated methods for predicting social traits are largely non-existent. In this work, we demonstrate the feasibility of two automated approaches-multi-label classification (MLC) and multi-output regression (MOR)-for first impression recognition from faces. We demonstrate that both approaches are able to predict social traits with better than chance accuracy, but there is still significant room for improvement. We evaluate ethical concerns and detail application areas for future work in this direction.

Repeatable social network node-based metrics across populations and contexts in a passerine.

Behavioural traits are considered animal personality traits when individuals differ consistently in their expression across time and across context. Here, we test this idea on three metrics derived from social interaction networks (strength, betweenness and closeness). Using experimental data from house sparrows in captive populations, and observational data from house sparrows in a wild population, we show that all three metrics consistently exhibit repeatability across both study populations and two methods of recording interactions. The highest repeatability values were estimated in male-only captive groups, whereas repeatabilities estimated in single-sex networks subsetted from mixed-sex groups showed no sex specificity. We also show that changes in social group composition led to a decrease in repeatability for up to six months. This work provides substantial and generalizable support for the notion that social network node-based metrics can be considered animal personalities. Our work suggests that social network traits may be heritable and thus could be selected for.

The Dorsomedial Prefrontal Cortex Plays a Causal Role in Integrating Social Impressions from Faces and Verbal Descriptions.

Several neuroimaging studies point to a key role of the dorsomedial prefrontal cortex (dmPFC) in the formation of socially relevant impressions. In 3 different experiments, participants were required to form socially relevant impressions about other individuals on the basis of text descriptions of their social behaviors, and to decide whether a face alone, a trait adjective (e.g., "selfish"), or a face presented with a trait adjective was consistent or inconsistent with the impression they had formed. Before deciding whether the target stimulus matched the impression they had previously formed, participants received transcranial magnetic stimulation (TMS) over the dmPFC, the inferior frontal gyrus (IFG, also implicated in social impression formation), or over a control site (vertex). Results from the 3 experiments converged in showing that interfering with dmPFC activity significantly delayed participants in responding whether a face-adjective pair was consistent with the impression they had formed. No effects of TMS were observed following stimulation of the IFG or when evaluations had to be made on faces or trait adjectives presented alone. Our findings critically extend previous neuroimaging evidence by indicating a causal role of the dmPFC in creating coherent impressions based on the integration of face and verbal description of social behaviors.

Geography of conservation spending, biodiversity, and culture.

We used linear and multivariate models to examine the associations between geography, biodiversity, per capita economic output, national spending on conservation, governance, and cultural traits in 55 countries. Cultural traits and social metrics of modernization correlated positively with national spending on conservation. The global distribution of this spending culture was poorly aligned with the distribution of biodiversity. Specifically, biodiversity was greater in the tropics where cultures tended to spend relatively less on conservation and tended to have higher collectivism, formalized and hierarchical leadership, and weaker governance. Consequently, nations lacking social traits frequently associated with modernization, environmentalism, and conservation spending have the largest component of Earth's biodiversity. This has significant implications for setting policies and priorities for resource management given that biological diversity is rapidly disappearing and cultural traits change slowly. Therefore, we suggest natural resource management adapt to and use characteristics of existing social organization rather than wait for or promote social values associated with conservation spending. Supporting biocultural traditions, engaging leaders to increase conservation commitments, cross-national efforts that complement attributes of cultures, and avoiding interference with nature may work best to conserve nature in collective and hierarchical societies. Spending in modernized nations may be a symbolic response to a symptom of economic development and environmental degradation, and here conservation actions need to ensure that biodiversity is not being lost.

In the eye of the beholder: Social traits predict motor simulation during naturalistic action perception.

Previous research has robustly demonstrated that eye contact between actor and observer promotes the simulation of perceived actions into the observer's own motor system, which in turn facilitates social perception and communication. The socially relevant connotation embedded in eye contact may however be different for individuals with differing social traits. Here, we examined how "normal" (i.e. non-clinical) variability in self-reported social responsiveness/autistic traits, social anxiety and interpersonal relationship style (secure, avoidant or anxious attachment) influences neural motor simulation during action observation in different gaze conditions. To do so, we analyzed an existing dataset involving 124 adult participants (age range: 18-35 years) who underwent transcranial magnetic stimulation (TMS) while observing an actor performing simple hand actions and simultaneously engaging in eye contact or gazing away from the observer. Motor evoked potential (MEP) amplitudes were adopted as an index of motor resonance. Regression-based analyses highlighted the role of social responsiveness and secure attachment in shaping motor resonance, indicating that socially responsive motor resonance during dyadic gaze (i.e., MEPdirect > MEPaverted) was only observed in participants displaying high levels of these traits. Furthermore, a clustering analysis identified two to three distinct subgroups of participants with unique social trait profiles, showing a clear differentiation in motor resonant patterns upon different gaze cues that is in accordance with a recent neurobiological framework of attachment. Together, results demonstrate that motor resonance within a given social interaction may serve as a sensitive tracker of socio-interactive engagement, which allows to capture subclinical inter-individual variation in relevant social traits.

First impressions from faces in the real world: Commentary on Sutherland and Young (2022).

The study of first impressions from faces now emphasizes the need to understand trait inferences made to naturalistic face images (British Journal of Psychology, 113, 2022, 1056). Face recognition algorithms based on deep convolutional neural networks simultaneously represent invariant, changeable and environmental variables in face images. Therefore, we suggest them as a comprehensive 'face space' model of first impressions of naturalistic faces. We also suggest that to understand trait inferences in the real world, a logical next step is to consider trait inferences made to whole people (faces and bodies). On the role of cultural contributions to trait perception, we think it is important for the field to begin to consider the way in which trait inferences motivate (or not) behaviour in independent and interdependent cultures.

Emotional authenticity modulates affective and social trait inferences from voices.

The human voice is a primary tool for verbal and nonverbal communication. Studies on laughter emphasize a distinction between spontaneous laughter, which reflects a genuinely felt emotion, and volitional laughter, associated with more intentional communicative acts. Listeners can reliably differentiate the two. It remains unclear, however, if they can detect authenticity in other vocalizations, and whether authenticity determines the affective and social impressions that we form about others. Here, 137 participants listened to laughs and cries that could be spontaneous or volitional and rated them on authenticity, valence, arousal, trustworthiness and dominance. Bayesian mixed models indicated that listeners detect authenticity similarly well in laughter and crying. Speakers were also perceived to be more trustworthy, and in a higher arousal state, when their laughs and cries were spontaneous. Moreover, spontaneous laughs were evaluated as more positive than volitional ones, and we found that the same acoustic features predicted perceived authenticity and trustworthiness in laughter: high pitch, spectral variability and less voicing. For crying, associations between acoustic features and ratings were less reliable. These findings indicate that emotional authenticity shapes affective and social trait inferences from voices, and that the ability to detect authenticity in vocalizations is not limited to laughter. This article is part of the theme issue 'Voice modulation: from origin and mechanism to social impact (Part I)'.

The interplay between gaze cueing and facial trait impressions.

The gaze cueing effect involves the rapid orientation of attention to follow the gaze direction of another person. Previous studies reported reciprocal influences between social variables and the gaze cueing effect, with modulation of gaze cueing by social features of face stimuli and modulation of the observer's social judgements from the validity of the gaze cues themselves. However, it remains unclear which social dimensions can affect-and be affected by-gaze cues. We used computer-averaged prototype face-like images with high and low levels of perceived trustworthiness and dominance to investigate the impact of these two fundamental social impression dimensions on the gaze cueing effect. Moreover, by varying the proportions of valid and invalid gaze cues across three experiments, we assessed whether gaze cueing influences observers' impressions of dominance and trustworthiness through incidental learning. Bayesian statistical analyses provided clear evidence that the gaze cueing effect was not modulated by facial social trait impressions (Experiments 1-3). However, there was uncertain evidence of incidental learning of social evaluations following the gaze cueing task. A decrease in perceived trustworthiness for non-cooperative low dominance faces (Experiment 2) and an increase in dominance ratings for faces whose gaze behaviour contradicted expectations (Experiment 3) appeared, but further research is needed to clarify these effects. Thus, this study confirms that attentional shifts triggered by gaze direction involve a robust and relatively automatic process, which could nonetheless influence social impressions depending on perceived traits and the gaze behaviour of faces providing the cues.

Nice or nerdy? The neural representation of social and competence traits.

This study investigates to what extent social and competence traits are represented in a similar or different neural trait code. To localize these trait codes, we used functional magnetic resonance imaging repetition suppression, which is a rapid reduction of neuronal responses upon repeated presentation of the same implied trait. Participants had to infer an agent's trait from brief trait-implying behavioral descriptions. In each trial, the critical target sentence was preceded by a prime sentence that implied the same trait or a different competence-related trait which was also opposite in valence. The results revealed robust repetition suppression from prime to target in the ventral medial prefrontal cortex (mPFC) given a similar (social) as well as a dissimilar (competence) prime. The suppression given a similar prime confirms earlier research demonstrating that a trait code is represented in the ventral mPFC. The suppression given a dissimilar prime is interpreted as indicating that participants categorize a combination of competence and social information into novel subcategories, reflecting nice (but incompetent) or nerdy (but socially awkward) traits. A multi-voxel pattern analysis broadly confirmed these results, and pinpointed the inferior parietal cortex, cerebellum, temporo-parietal junction and mPFC as areas that differentiate between social and competence traits.

Mu opioid receptor polymorphism, early social adversity, and social traits.

A polymorphism in the mu opioid receptor gene OPRM1 (rs1799971) has been investigated for its role in sensitivity to social contexts. Evidence suggests that the G allele of this polymorphism is associated with higher levels of sensitivity. This study tested for main effects of the polymorphism and its interaction with a self-report measure of childhood adversity as an index of negative environment. Outcomes were several personality measures relevant to social connection. Significant interactions were obtained, such that the negative impact of childhood adversity on personality was greater among G carriers than among A homozygotes on measures of agreeableness, interdependence, anger proneness, hostility, authentic pride, life engagement, and an index of (mostly negative) feelings coloring one's world view. Findings support the role of OPRM1 in sensitivity to negative environments. Limitations are noted, including the lack of a measure of advantageous social environment to assess sensitivity to positive social contexts.