Multimodal evidence on shape and surface information in individual face processing.

The significance of shape and surface information for face perception is well established, yet their relative contribution to recognition and their neural underpinnings await clarification. Here, we employ image reconstruction to retrieve, assess and visualize such information using behavioral, electroencephalography and functional magnetic resonance imaging data. Our results indicate that both shape and surface information can be successfully recovered from each modality but that the latter is better recovered than the former, consistent with its key role for face representations. Further, shape and surface information exhibit similar spatiotemporal profiles, rely on the extraction of specific visual features, such as eye shape or skin tone, and reveal a systematic representational structure, albeit with more cross-modal consistency for shape than surface. More generally, the present work illustrates a novel approach to relating and comparing different modalities in terms of perceptual information content. Thus, our results help elucidate the representational basis of individual face recognition while, methodologically, they showcase the utility of image reconstruction and clarify its reliance on diagnostic visual information.

Perception and memory-based representations of facial emotions: Associations with personality functioning, affective states and recognition abilities.

Personality traits and affective states are associated with biases in facial emotion perception. However, the precise personality impairments and affective states that underlie these biases remain largely unknown. To investigate how relevant factors influence facial emotion perception and recollection, Experiment 1 employed an image reconstruction approach in which community-dwelling adults (N = 89) rated the similarity of pairs of facial expressions, including those recalled from memory. Subsequently, perception- and memory-based expression representations derived from such ratings were assessed across participants and related to measures of personality impairment, state affect, and visual recognition abilities. Impairment in self-direction and level of positive affect accounted for the largest components of individual variability in perception and memory representations, respectively. Additionally, individual differences in these representations were impacted by face recognition ability. In Experiment 2, adult participants (N = 81) rated facial image reconstructions derived in Experiment 1, revealing that individual variability was associated with specific visual face properties, such as expressiveness, representation accuracy, and positivity/negativity. These findings highlight and clarify the influence of personality, affective state, and recognition abilities on individual differences in the perception and recollection of facial expressions.

Image reconstruction reveals the impact of aging on face perception.

Extensive work has demonstrated an age-related decline in face recognition, but the nature and the extent of aging-related alterations in face representations remain unclear. Here, we address these issues using an image reconstruction approach to reveal the content of visual representations. Healthy young and older adults provided similarity judgments for pairs of face images. Facial shape and surface features were subsequently derived and combined into image reconstructions of facial appearance. Both objective and experimental evaluations revealed that reconstructions were successful for every participant. Critically, shape and surface properties, such as eye shape and skin tone, were less accurately represented in older than young individuals. Yet, age-related differences in face representations, though significant, were less pronounced than those due to individual variability. Our results provide novel insights into age-related changes in visual perception and demonstrate the utility of image reconstruction to uncovering internal representations across a variety of populations. (PsycInfo Database Record (c) 2021 APA, all rights reserved).