The Compositionality of Facial Expressions.

The principle of compositionality, an important postulation in language and cognition research, posits that the meaning of a complex expression is determined by the meaning of its constituting parts and the operation performed on those parts. Here, we provide strong evidence that this principle plays a significant role also in interpreting facial expressions. In three studies in which perceivers interpreted sequences of two emotional facial expression images, we show that the composite meaning of facial expressions results from the meaning of its constituting expressions and an algebraic operation performed on those expressions. Our study offers a systematic account as to how the meaning of facial expressions (single and sequences) are being formed and perceived. In a broader context, our results raise the possibility that the principle of compositionality may apply to human communication modalities beyond spoken language, whereby a minimal number of components are expanded to a much greater number of meanings.

Erratum to: Comment on "Quantifying the informational value of classification images": Miscomputation of infoVal metric was a minor issue and is now corrected.

One of the two miscomputations identified in the infoVal metric, namely the omission of the k constant, turns out not to be a miscomputation, since the constant was already taken into account by default in the mad() function from R (see https://www.rdocumentation.org/packages/stats/versions/3.6.2/topics/mad ).

Quantifying the informational value of classification images.

Reverse correlation is an influential psychophysical paradigm that uses a participant's responses to randomly varying images to build a classification image (CI), which is commonly interpreted as a visualization of the participant's mental representation. It is unclear, however, how to statistically quantify the amount of signal present in CIs, which limits the interpretability of these images. In this article, we propose a novel metric, infoVal, which assesses informational value relative to a resampled random distribution and can be interpreted like a z score. In the first part, we define the infoVal metric and show, through simulations, that it adheres to typical Type I error rates under various task conditions (internal validity). In the second part, we show that the metric correlates with markers of data quality in empirical reverse-correlation data, such as the subjective recognizability, objective discriminability, and test-retest reliability of the CIs (convergent validity). In the final part, we demonstrate how the infoVal metric can be used to compare the informational value of reverse-correlation datasets, by comparing data acquired online with data acquired in a controlled lab environment. We recommend a new standard of good practice in which researchers assess the infoVal scores of reverse-correlation data in order to ensure that they do not read signal in CIs where no signal is present. The infoVal metric is implemented in the open-source rcicr R package, to facilitate its adoption.

The Relationship Between Mental Representations of Welfare Recipients and Attitudes Toward Welfare.

Scholars have argued that opposition to welfare is, in part, driven by stereotypes of African Americans. This argument assumes that when individuals think about welfare, they spontaneously think about Black recipients. We investigated people's mental representations of welfare recipients. In Studies 1 and 2, we used a perceptual task to visually estimate participants' mental representations of welfare recipients. Compared with the average non-welfare-recipient image, the average welfare-recipient image was perceived (by a separate sample) as more African American and more representative of stereotypes associated with welfare recipients and African Americans. In Study 3, participants were asked to determine whether they supported giving welfare benefits to the people pictured in the average welfare-recipient and non-welfare-recipient images generated in Study 2. Participants were less supportive of giving welfare benefits to the person shown in the welfare-recipient image than to the person shown in the non-welfare-recipient image. The results suggest that mental images of welfare recipients may bias attitudes toward welfare policies.

For Your Local Eyes Only: Culture-Specific Face Typicality Influences Perceptions of Trustworthiness.

Recent findings show that typical faces are judged as more trustworthy than atypical faces. However, it is not clear whether employment of typicality cues in trustworthiness judgment happens across cultures and if these cues are culture specific. In two studies, conducted in Japan and Israel, participants judged trustworthiness and attractiveness of faces. In Study 1, faces varied along a cross-cultural dimension ranging from a Japanese to an Israeli typical face. Own-culture typical faces were perceived as more trustworthy than other-culture typical faces, suggesting that people in both cultures employ typicality cues when judging trustworthiness, but that the cues, indicative of typicality, are culture dependent. Because perceivers may be less familiar with other-culture typicality cues, Study 2 tested the extent to which they rely on available facial information other than typicality, when judging other-culture faces. In Study 2, Japanese and Israeli faces varied from either Japanese or Israeli attractive to unattractive with the respective typical face at the midpoint. For own-culture faces, trustworthiness judgments peaked around own-culture typical face. However, when judging other-culture faces, both cultures also employed attractiveness cues, but this effect was more apparent for Japanese participants. Our findings highlight the importance of culture when considering the effect of typicality on trustworthiness judgments.

Social attributions from faces: determinants, consequences, accuracy, and functional significance.

Since the early twentieth century, psychologists have known that there is consensus in attributing social and personality characteristics from facial appearance. Recent studies have shown that surprisingly little time and effort are needed to arrive at this consensus. Here we review recent research on social attributions from faces. Section I outlines data-driven methods capable of identifying the perceptual basis of consensus in social attributions from faces (e.g., What makes a face look threatening?). Section II describes nonperceptual determinants of social attributions (e.g., person knowledge and incidental associations). Section III discusses evidence that attributions from faces predict important social outcomes in diverse domains (e.g., investment decisions and leader selection). In Section IV, we argue that the diagnostic validity of these attributions has been greatly overstated in the literature. In the final section, we offer an account of the functional significance of these attributions.

What is typical is good: the influence of face typicality on perceived trustworthiness.

The role of face typicality in face recognition is well established, but it is unclear whether face typicality is important for face evaluation. Prior studies have focused mainly on typicality's influence on attractiveness, although recent studies have cast doubt on its importance for attractiveness judgments. Here, we argue that face typicality is an important factor for social perception because it affects trustworthiness judgments, which approximate the basic evaluation of faces. This effect has been overlooked because trustworthiness and attractiveness judgments have a high level of shared variance for most face samples. We show that for a continuum of faces that vary on a typicality-attractiveness dimension, trustworthiness judgments peak around the typical face. In contrast, perceived attractiveness increases monotonically past the typical face, as faces become more like the most attractive face. These findings suggest that face typicality is an important determinant of face evaluation.

The development of race-based perceptual categorization: skin color dominates early category judgments.

Prior research on the development of race-based categorization has concluded that children understand the perceptual basis of race categories from as early as age 4 (e.g. Aboud, 1988). However, such work has rarely separated the influence of skin color from other physiognomic features considered by adults to be diagnostic of race categories. In two studies focusing on Black-White race categorization judgments in children between the ages of 4 and 9, as well as in adults, we find that categorization decisions in early childhood are determined almost entirely by attention to skin color, with attention to other physiognomic features exerting only a small influence on judgments as late as middle childhood. We further find that when skin color cues are largely eliminated from the stimuli, adults readily shift almost entirely to focus on other physiognomic features. However, 6- and 8-year-old children show only a limited ability to shift attention to facial physiognomy and so perform poorly on the task. These results demonstrate that attention to 'race' in younger children is better conceptualized as attention to skin color, inviting a reinterpretation of past work focusing on children's race-related cognition.

Religion insulates ingroup evaluations: the development of intergroup attitudes in India.

Research on the development of implicit intergroup attitudes has placed heavy emphasis on race, leaving open how social categories that are prominent in other cultures might operate. We investigate two of India's primary means of social distinction, caste and religion, and explore the development of implicit and explicit attitudes towards these groups in minority-status Muslim children and majority-status Hindu children, the latter drawn from various positions in the Hindu caste system. Results from two tests of implicit attitudes find that caste attitudes parallel previous findings for race: higher-caste children as well as lower-caste children have robust high-caste preferences. However, results for religion were strikingly different: both lower-status Muslim children and higher-status Hindu children show strong implicit ingroup preferences. We suggest that religion may play a protective role in insulating children from the internalization of stigma.

The attentional cost of comparisons: Evidence for a general comparison induced delay.

The current work aimed to uncover the pattern of attention given to external comparison standards when engaged in social judgments. In a series of 5 experiments (N = 463), a Modified Spatial Cueing Task provided evidence for a general Comparison Induced Delay (CID), but found no signs of visuospatial attention (Pilot, Study 1 & 2). However, the CID did not occur if cues did not remain visually available throughout the trials (Study 3 & 4). Heterogeneity in results prompted the use of a single-paper meta-analysis including all secondary studies. A consistent CID effect was found across studies when standards remained visually available (K = 5), but not when they were masked (K = 2). No direct signs of visuospatial attentional bias were found. These results suggest that the attentional cost of engaging with external comparisons is mainly cognitive in nature, although a minor reoccurring visual component could not be excluded.

Facing Europe: visualizing spontaneous in-group projection.

Individuals perceive their own group to be more typical of a shared superordinate identity than other groups are. This in-group projection process has been demonstrated with both self-report and indirect measures. The two studies reported here extend this research to the visual level, specifically, within the domain of faces. Using an innovative reverse-correlation approach, we found that German and Portuguese participants' visual representations of European faces resembled the appearance typical for their own national identity. This effect was found even among participants who explicitly denied that one nation was more typical of Europe than the other (Study 1). Moreover, Study 2 provides experimental evidence that in-group projection is restricted to inclusive superordinate groups, as the effect was not observed for visual representations of a category ("Australian") that did not include participants' in-group. Implications for the in-group projection model, as well as for the applicability of reverse-correlation paradigms, are discussed.

Perspective taking eliminates differences in co-representation of out-group members' actions.

Coordinated action relies on shared representations between interaction partners: people co-represent actions of others in order to respond appropriately. However, little is known about the social factors that influence shared representations. We investigated whether actions performed by in-group and out-group members are represented differently, and if so, what role perspective-taking plays in this process. White participants performed a joint Simon task with an animated image of a hand with either white or black skin tone. Results of study I demonstrated that actions performed by in-group members were co-represented while actions of out-group members were not. In study II, it was found that participants co-represented actions of out-group members when they had read about an out-group member and to take his perspective prior to the actual experiment. Possible explanations for these findings are discussed.

Did you see it? Robust individual differences in the speed with which meaningful visual stimuli break suppression.

Perceptual conscious experiences result from non-conscious processes that precede them. We document a new characteristic of the cognitive system: the speed with which visual meaningful stimuli are prioritized to consciousness over competing noise in visual masking paradigms. In ten experiments (N = 399) we find that an individual's non-conscious visual prioritization speed (NVPS) is ubiquitous across a wide variety of stimuli, and generalizes across visual masks, suppression tasks, and time. We also find that variation in NVPS is unique, in that it cannot be explained by variation in general speed, perceptual decision thresholds, short-term visual memory, or three networks of attention (alerting, orienting and executive). Finally, we find that NVPS is correlated with subjective measures of sensitivity, as they are measured by the Highly Sensitive Person scale. We conclude by discussing the implications of variance in NVPS for understanding individual variance in behavior and the neural substrates of consciousness.

Hypoglycemia is associated with intensive care unit mortality.

OBJECTIVE: The implementation of intensive insulin therapy in the intensive care unit is accompanied by an increase in hypoglycemia. We studied the relation between hypoglycemia on intensive care unit mortality, because the evidence on this subject is conflicting. DESIGN: Retrospective database cohort study. SETTING: An 18-bed medical/surgical intensive care unit in a teaching hospital (Onze Lieve Vrouwe Gasthuis Hospital, Amsterdam, The Netherlands). PATIENTS: A total of 5961 patients admitted to from 2004 to 2007 were analyzed. Readmissions and patients with a withholding care policy or with hypoglycemia on the first glucose measurement were excluded. Patients were treated with a computerized insulin algorithm (target glucose range, 72-126 mg/dL). INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: All first episodes of hypoglycemia (glucose < or =45 mg/dL) were derived from 154,015 glucose values. Using Poisson regression, the incidence rates for intensive care unit death and incidence rate ratio comparing exposure and nonexposure to hypoglycemia were calculated. Patients were considered to be exposed to hypoglycemia from the event until the end of intensive care unit admittance. We corrected for severity of disease using the daily Sequential Organ Failure Assessment score. Age, sex, cardiothoracic surgery, sepsis, and diabetes mellitus were also included as possible confounders. Two hundred eighty-eight (4.8%) patients experienced at least one episode of hypoglycemia. Median age was 68 yrs (range, 58-75 yrs), 66% were male, and 6.4% died in the intensive care unit. The incidence rate of death in patients exposed to hypoglycemia was 40 per 1000 intensive care unit days compared with 17 per 1000 intensive care unit days in patients without exposure. The adjusted incidence rate ratio for intensive care unit death was 2.1 (95% confidence interval, 1.6-2.8; p < .001). CONCLUSIONS: Hypoglycemia is related to intensive care unit mortality, also when adjusted for a daily adjudicated measure of disease severity, indicating the possibility of a causal relationship.

Bidirectional contextual influence between faces and bodies in emotion perception.

Recent evidence shows that body context may alter the categorization of facial expressions. However, less is known about how facial expressions influence the categorization of emotional bodies. We hypothesized that context effects would be displayed bidirectionally, from bodies to faces and from faces to bodies. Participants viewed emotional face-body compounds and were required to categorize emotions of faces (Condition 1), bodies (Condition 2), or full persons (Condition 3). Results showed evidence for bidirectional context effects: faces were influenced by bodies, and bodies were influenced by faces. However, because the specific confusability patterns differ for faces and bodies (e.g., disgust and anger expressions are confusable in the face, but less so in the body) we found unique patterns of contextual influence in each expression channel. Together, the findings suggest that the emotional expressions of faces and bodies contextualize each other bidirectionally and that emotion categorization is sensitive to the perceptual focus determined by task instructions. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Gender biases in impressions from faces: Empirical studies and computational models.

Trustworthiness and dominance impressions summarize trait judgments from faces. Judgments on these key traits are negatively correlated to each other in impressions of female faces, implying less differentiated impressions of female faces. Here we test whether this is true across many trait judgments and whether less differentiated impressions of female faces originate in different facial information used for male and female impressions or different evaluation of the same information. Using multidimensional rating datasets and data-driven modeling, we show that (a) impressions of women are less differentiated and more valence-laden than impressions of men and find that (b) these impressions are based on similar visual information across face genders. Female face impressions were more highly intercorrelated and were better explained by valence (Study 1). These intercorrelations were higher when raters more strongly endorsed gender stereotypes. Despite the gender difference, male and female impression models-derived from separate trustworthiness and dominance ratings of male and female faces-were similar to each other (Study 2). Further, both male and female models could manipulate impressions of faces of both genders (Study 3). The results highlight the high-level, evaluative effect of face gender in impression formation-women are judged negatively to the extent their looks do not conform to expectations, not because people use different facial information across genders but because people evaluate the information differently across genders. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Evidence of Validity for a Newly Developed Digital Cognitive Test Battery.

Clinical practice still relies heavily on traditional paper-and-pencil testing to assess a patient's cognitive functions. Digital technology has the potential to be an efficient and powerful alternative, but for many of the existing digital tests and test batteries the psychometric properties have not been properly established. We validated a newly developed digital test battery consisting of digitized versions of conventional neuropsychological tests. Two confirmatory factor analysis models were specified: a model based on traditional neuropsychological theory and expert consensus and one based on the Cattell-Horn-Carroll (CHC) taxonomy. For both models, the outcome measures of the digital tests loaded on the cognitive domains in the same way as established in the neuropsychological literature. Interestingly, no clear distinction could be made between the CHC model and traditional neuropsychological model in terms of model fit. Taken together, these findings provide preliminary evidence for the structural validity of the digital cognitive test battery.

Contributions of shape and reflectance information to social judgments from faces.

Face perception is based on both shape and reflectance information. However, we know little about the relative contribution of these kinds of information to social judgments of faces. In Experiment 1, we generated faces using validated computational models of attractiveness, competence, dominance, extroversion, and trustworthiness. Faces were manipulated orthogonally on five levels of shape and reflectance for each model. Both kinds of information had linear and additive effects on participants' social judgments. Shape information was more predictive of dominance, extroversion, and trustworthiness judgments, whereas reflectance information was more predictive of competence judgments. In Experiment 2, to test whether the amount of visual information alters the relative contribution of shape and reflectance information, we presented faces - varied on attractiveness, competence, and dominance - for five different durations (33-500 ms). For all judgments, the linear effect of both shape and reflectance increased as duration increased. Importantly, the relative contribution did not change across durations. These findings show that that the judged dimension is critical for which kind of information is weighted more heavily in judgments and that the relative contribution of shape and reflectance is stable across the amount of visual information available.

Stereotypes and prejudice affect the recognition of emotional body postures.

Most research on emotion recognition focuses on facial expressions. However, people communicate emotional information through bodily cues as well. Prior research on facial expressions has demonstrated that emotion recognition is modulated by top-down processes. Here, we tested whether this top-down modulation generalizes to the recognition of emotions from body postures. We report three studies demonstrating that stereotypes and prejudice about men and women may affect how fast people classify various emotional body postures. Our results suggest that gender cues activate gender associations, which affect the recognition of emotions from body postures in a top-down fashion. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Visualizing mental representations in schizophrenia patients: A reverse correlation approach.

Schizophrenia patients have difficulties recognizing emotional states from faces, in particular those with negative valence, with severe consequences for daily life. What do these patients see in their minds eye, when they think of a face expressing a particular emotion or trait? The content of such mental representations can shed light into the nature of their deficits, but are usually inaccessible. For the first time, we explored the applicability of reverse correlation, which has been successfully used to visualize mental representations in healthy populations, to visualize mental representations in schizophrenia patients. We investigated mental representations of trustworthy faces, a primary dimension of social face evaluation that is highly correlated with valence. Patients (n = 23) and healthy controls (n = 34) classified images of noise-distorted faces as 'trustworthy', 'untrustworthy' or 'neutral'. We visualized their mental representations of these concepts by averaging the noise patterns based on their classifications. These visualizations were then rated on trustworthiness by an independent sample of participants. Patients were able to perform the reverse correlation task, with response times and biases similar to those of healthy controls, and the obtained images vividly reflected the respective constructs of interest. However, there were no significant differences between the ratings of the visualizations of patients and controls. Conclusion: These novel findings provide a proof of principle that the reverse correlation technique can be applied to investigate mental representations in schizophrenia patients.