Humans' extreme face recognition abilities challenge the well-established familiarity effect.

Classification performance is better for learned than unlearned stimuli. This was also reported for faces, where identity matching of unfamiliar faces is worse than for familiar faces. This familiarity advantage led to the conclusion that variability across appearances of the same identity is partly idiosyncratic and cannot be generalized from familiar to unfamiliar identities. Recent advances in machine vision challenge this claim by showing that the performance for untrained (unfamiliar) identities reached the level of trained identities as the number of identities that the algorithm is trained with increases. We therefore asked whether humans who reportedly can identify a vast number of identities, such as super recognizers, may close the gap between familiar and unfamiliar face classification. Consistent with this prediction, super recognizers classified unfamiliar faces just as well as typical participants who are familiar with the same faces, on a task that generates a sizable familiarity effect in controls. Additionally, prosopagnosics' performance for familiar faces was as bad as that of typical participants who were unfamiliar with the same faces, indicating that they struggle to learn even identity-specific information. Overall, these findings demonstrate that by studying the extreme ends of a system's ability we can gain novel insights into its actual capabilities.

Autistic adults have insight into their relative face recognition ability.

The PI20 is a self-report questionnaire that assesses the presence of lifelong face recognition difficulties. The items on this scale ask respondents to assess their face recognition ability relative to the rest of the population, either explicitly or implicitly. Recent reports suggest that the PI20 scores of autistic participants exhibit little or no correlation with their performance on the Cambridge Face Memory Test-a key measure of face recognition ability. These reports are suggestive of a meta-cognitive deficit whereby autistic individuals are unable to infer whether their face recognition is impaired relative to the wider population. In the present study, however, we observed significant correlations between the PI20 scores of 77 autistic adults and their performance on two variants of the Cambridge Face Memory Test. These findings indicate that autistic individuals can infer whether their face recognition ability is impaired. Consistent with previous research, we observed a wide spread of face recognition abilities within our autistic sample. While some individuals approached ceiling levels of performance, others met the prevailing diagnostic criteria for developmental prosopagnosia. This variability showed little or no association with non-verbal intelligence, autism severity, or the presence of co-occurring alexithymia or ADHD.

Improving the DSM-5 approach to cognitive impairment: Developmental prosopagnosia reveals the need for tailored diagnoses.

The Diagnostic Statistical Manual of Mental Disorders (DSM-5) recommends diagnosing neurocognitive disorders (i.e., cognitive impairment) when a patient scores beyond - 1 SD below neurotypical norms on two tests. I review how this approach will fail due to cognitive tests' power limitations, validity issues, imperfect reliabilities, and biases, before summarizing their resulting negative consequences. As a proof of concept, I use developmental prosopagnosia, a condition characterized by difficulties recognizing faces, to show the DSM-5 only diagnoses 62-70% (n1 = 61, n2 = 165) versus 100% (n1 = 61) through symptoms alone. Pooling the DSM-5 missed cases confirmed the presence of group-level impairments on objective tests, which were further evidenced through meta-analyses, thus validating their highly atypical symptoms. These findings support a paradigm shift towards bespoke diagnostic approaches for distinct cognitive impairments, including a symptom-based method when validated effective. I reject dogmatic adherence to the DSM-5 approach to neurocognitive disorders, and underscore the importance of a data driven, transdiagnostic approach to understanding patients' subjective cognitive impairments. This will ultimately benefit patients, their families, clinicians, and scientific progress.

Normative data of the Italian Famous Face Test.

The faces we see in daily life exist on a continuum of familiarity, ranging from personally familiar to famous to unfamiliar faces. Thus, when assessing face recognition abilities, adequate evaluation measures should be employed to discriminate between each of these processes and their relative impairments. We here developed the Italian Famous Face Test (IT-FFT), a novel assessment tool for famous face recognition in typical and clinical populations. Normative data on a large sample (N = 436) of Italian individuals were collected, assessing both familiarity (d') and recognition accuracy. Furthermore, this study explored whether individuals possess insights into their overall face recognition skills by correlating the Prosopagnosia Index-20 (PI-20) with the IT-FFT; a negative correlation between these measures suggests that people have a moderate insight into their face recognition skills. Overall, our study provides the first online-based Italian test for famous faces (IT-FFT), a test that could be used alongside other standard tests of face recognition because it complements them by evaluating real-world face familiarity, providing a more comprehensive assessment of face recognition abilities. Testing different aspects of face recognition is crucial for understanding both typical and atypical face recognition.

Familiarity enhances functional connectivity between visual and nonvisual regions of the brain during natural viewing.

We explored the neural correlates of familiarity with people and places using a naturalistic viewing paradigm. Neural responses were measured using functional magnetic resonance imaging, while participants viewed a movie taken from Game of Thrones. We compared inter-subject correlations and functional connectivity in participants who were either familiar or unfamiliar with the TV series. Higher inter-subject correlations were found between familiar participants in regions, beyond the visual brain, that are typically associated with the processing of semantic, episodic, and affective information. However, familiarity also increased functional connectivity between face and scene regions in the visual brain and the nonvisual regions of the familiarity network. To determine whether these regions play an important role in face recognition, we measured responses in participants with developmental prosopagnosia (DP). Consistent with a deficit in face recognition, the effect of familiarity was significantly attenuated across the familiarity network in DP. The effect of familiarity on functional connectivity between face regions and the familiarity network was also attenuated in DP. These results show that the neural response to familiarity involves an extended network of brain regions and that functional connectivity between visual and nonvisual regions of the brain plays an important role in the recognition of people and places during natural viewing.

Perceptual heterogeneity in developmental prosopagnosia is continuous, not categorical.

Developmental prosopagnosia (DP) is associated with considerable perceptual heterogeneity, though the nature of this heterogeneity and whether there are discrete subgroups versus continuous deficits remains unclear. Bennetts et al. (2022) recently found that holistic versus featural processing deficits distinguished discrete DP subgroups, but their sample was relatively small (N = 37), and subgroups were defined using a single task. To characterize perceptual heterogeneity in DPs more comprehensively, we administered a broad face perception battery to a large sample of 109 DPs and 134 controls, including validated measures of face matching (Cambridge Face Perception Test - CFPT, Computerized Benton Facial Recognition Test, Same/Different Face Matching Task), holistic processing (Part-Whole Task), and feature processing (Georges Task and Part-Whole part trials). When examining face matching measures, DPs exhibited a similar distribution of performance as controls, though shifted towards impairment by an average of 1.4 SD. We next applied Bennetts (2022) hierarchical clustering approach and k-means clustering to the CFPT upright, inverted, and inversion index measures, similarly finding one group of DPs with poorer inverted face performance and another with a decreased face inversion effect (holistic processing). However, these subgroup differences failed to generalize to other measures of feature and holistic processing beyond the CFPT. We finally ran hierarchical and k-means cluster analyses on our larger battery of face matching, feature, and holistic processing measures. Results clearly showed subgroups with generally better versus worse performance across all measures, with the distinction between groups being somewhat arbitrary. Together, these findings support a continuous account of DP perceptual heterogeneity, with performance differing primarily across all aspects of face perception.

Disentangling developmental prosopagnosia: A scoping review of terms, tools and topics.

The goal of this preregistered scoping review is to create an overview of the research on developmental prosopagnosia (DP). Through analysis of all empirical studies of DP in adults, we investigate 1) how DP is conceptualized and defined, 2) how individuals are classified with DP and 3) which aspects of DP are investigated in the literature. We reviewed 224 peer-reviewed studies of DP. Our analysis of the literature reveals that while DP is predominantly defined as a lifelong face recognition impairment in the absence of acquired brain injury and intellectual/cognitive problems, there is far from consensus on the specifics of the definition with some studies emphasizing e.g., deficits in face perception, discrimination and/or matching as core characteristics of DP. These differences in DP definitions is further reflected in the vast heterogeneity in classification procedures. Only about half of the included studies explicitly state how they classify individuals with DP, and these studies adopt 40 different assessment tools. The two most frequently studied aspects of DP are the role of holistic processing and the specificity of face processing, and alongside a substantial body of neuroimaging studies of DP, this paints a picture of a research field whose scientific interests and aims are rooted in cognitive neuropsychology and neuroscience. We argue that these roots - alongside the heterogeneity in DP definition and classification - may have limited the scope and interest of DP research unnecessarily, and we point to new avenues of research for the field.

Neural computations in prosopagnosia.

We report an investigation of the neural processes involved in the processing of faces and objects of brain-lesioned patient PS, a well-documented case of pure acquired prosopagnosia. We gathered a substantial dataset of high-density electrophysiological recordings from both PS and neurotypicals. Using representational similarity analysis, we produced time-resolved brain representations in a format that facilitates direct comparisons across time points, different individuals, and computational models. To understand how the lesions in PS's ventral stream affect the temporal evolution of her brain representations, we computed the temporal generalization of her brain representations. We uncovered that PS's early brain representations exhibit an unusual similarity to later representations, implying an excessive generalization of early visual patterns. To reveal the underlying computational deficits, we correlated PS' brain representations with those of deep neural networks (DNN). We found that the computations underlying PS' brain activity bore a closer resemblance to early layers of a visual DNN than those of controls. However, the brain representations in neurotypicals became more akin to those of the later layers of the model compared to PS. We confirmed PS's deficits in high-level brain representations by demonstrating that her brain representations exhibited less similarity with those of a DNN of semantics.

The neuropsychological evaluation of face identity recognition.

Facial identity recognition (FIR) is arguably the ultimate form of recognition for the adult human brain. Even if the term prosopagnosia is reserved for exceptionally rare brain-damaged cases with a category-specific abrupt loss of FIR at adulthood, subjective and objective impairments or difficulties of FIR are common in the neuropsychological population. Here we provide a critical overview of the evaluation of FIR both for clinicians and researchers in neuropsychology. FIR impairments occur following many causes that should be identified objectively by both general and specific, behavioral and neural examinations. We refute the commonly used dissociation between perceptual and memory deficits/tests for FIR, since even a task involving the discrimination of unfamiliar face images presented side-by-side relies on cortical memories of faces in the right-lateralized ventral occipito-temporal cortex. Another frequently encountered confusion is between specific deficits of the FIR function and a more general impairment of semantic memory (of people), the latter being most often encountered following anterior temporal lobe damage. Many computerized tests aimed at evaluating FIR have appeared over the last two decades, as reviewed here. However, despite undeniable strengths, they often suffer from ecological limitations, difficulties of instruction, as well as a lack of consideration for processing speed and qualitative information. Taking into account these issues, a recently developed behavioral test with natural images manipulating face familiarity, stimulus inversion, and correct response times as a key variable appears promising. The measurement of electroencephalographic (EEG) activity in the frequency domain from fast periodic visual stimulation also appears as a particularly promising tool to complete and enhance the neuropsychological assessment of FIR.

Human genetics of face recognition: discovery of MCTP2 mutations in humans with face blindness (congenital prosopagnosia).

Face recognition is important for both visual and social cognition. While prosopagnosia or face blindness has been known for seven decades and face-specific neurons for half a century, the molecular genetic mechanism is not clear. Here we report results after 17 years of research with classic genetics and modern genomics. From a large family with 18 congenital prosopagnosia (CP) members with obvious difficulties in face recognition in daily life, we uncovered a fully cosegregating private mutation in the MCTP2 gene which encodes a calcium binding transmembrane protein expressed in the brain. After screening through cohorts of 6589, we found more CPs and their families, allowing detection of more CP associated mutations in MCTP2. Face recognition differences were detected between 14 carriers with the frameshift mutation S80fs in MCTP2 and 19 noncarrying volunteers. Six families including one with 10 members showed the S80fs-CP correlation. Functional magnetic resonance imaging found association of impaired recognition of individual faces by MCTP2 mutant CPs with reduced repetition suppression to repeated facial identities in the right fusiform face area. Our results have revealed genetic predisposition of MCTP2 mutations in CP, 76 years after the initial report of prosopagnosia and 47 years after the report of the first CP. This is the first time a gene required for a higher form of visual social cognition was found in humans.

What is developmental about developmental prosopagnosia?

Developmental prosopagnosia (DP) is characterised by difficulties recognising face identities and is associated with diverse co-occurring object recognition difficulties. The high co-occurrence rate and heterogeneity of associated difficulties in DP is an intrinsic feature of developmental conditions, where co-occurrence of difficulties is the rule, rather than the exception. However, despite its name, cognitive and neural theories of DP rarely consider the developmental context in which these difficulties occur. This leaves a large gap in our understanding of how DP emerges in light of the developmental trajectory of face recognition. Here, we argue that progress in the field requires re-considering the developmental origins of differences in face recognition abilities, rather than studying the end-state alone. In practice, considering development in DP necessitates a re-evaluation of current approaches in recruitment, design, and analyses.

Binocular rivalry reveals differential face processing in congenital prosopagnosia.

Congenital Prosopagnosia (CP) is an innate impairment in face perception with heterogeneous characteristics. It is still unclear if and to what degree holistic processing of faces is disrupted in CP. Such disruption would be expected to lead to a focus on local features of the face. In this study, we used binocular rivalry (BR) to implicitly measure face perception in conditions that favour holistic or local processing. The underlying assumption is that if stimulus saliency affects the perceptual dominance of a given stimulus in BR, one can deduce how salient a stimulus is for a given group (here: participants with and without CP) based on the measured perceptual dominance. A further open question is whether the deficit in face processing in CP extends to the processing of the facial display of emotions. In experiment 1, we compared predominance of upright and inverted faces displaying different emotions (fearful, happy, neutral) vs. houses between participants with CP (N = 21) and with normal face perception (N = 21). The results suggest that CP observers process emotions in faces automatically but rely more on local features than controls. The inversion of faces, which is supposed to disturb holistic processing, affected controls in a more pronounced way than participants with CP. In experiment 2, we introduced the Thatcher effect in BR by inverting the eye and mouth regions of the presented faces in the hope of further increasing the effect of face inversion. However, our expectations were not borne out by the results. Critically, both experiments showed that inversion effects were more pronounced in controls than in CP, suggesting that holistic face processing is less relevant in CP. We find BR to be a useful implicit test for assessing visual processing specificities in neurological participants.

Both identity and non-identity face perception tasks predict developmental prosopagnosia and face recognition ability.

Developmental prosopagnosia (DP) is characterised by deficits in face identification. However, there is debate about whether these deficits are primarily perceptual, and whether they extend to other face processing tasks (e.g., identifying emotion, age, and gender; detecting faces in scenes). In this study, 30 participants with DP and 75 controls completed a battery of eight tasks assessing four domains of face perception (identity; emotion; age and gender; face detection). The DP group performed worse than the control group on both identity perception tasks, and one task from each other domain. Both identity perception tests uniquely predicted DP/control group membership, and performance on two measures of face memory. These findings suggest that deficits in DP may arise from issues with face perception. Some non-identity tasks also predicted DP/control group membership and face memory, even when face identity perception was accounted for. Gender perception and speed of face detection consistently predicted unique variance in group membership and face memory; several other tasks were only associated with some measures of face recognition ability. These findings indicate that face perception deficits in DP may extend beyond identity perception. However, the associations between tasks may also reflect subtle aspects of task demands or stimuli.

Relationship between face recognition ability and anxiety tendencies in healthy young individuals: A prosopagnosia index and state-trait anxiety inventory study.

Developmental prosopagnosia (DP) is a condition that indicates the inability to recognize individuals by their faces from birth, without any history of brain damage. The assessment of face recognition ability and diagnosis of DP involve the use of face tests such as the Cambridge Face Memory Test (CFMT) and the Cambridge Face Perception Test, along with self-reported measures like the 20-Item Prosopagnosia Index (PI20). Face recognition accuracy is affected by anxiety. However, previous studies on the relationship between face recognition ability and anxiety have not used the PI20 measure. This study aimed to investigate the relationship between self-reported measures of face recognition ability and anxiety tendencies among healthy young individuals for DP diagnosis and its implications. We used a face recognition test, involving the PI20, CFMT, Visual Perception Test for Agnosia-Famous Face Test (VPTA-FFT), and State-Trait Anxiety Inventory (STAI). We assessed the performance of 116 Japanese young adults (75 females, median age of 20.7 years, with a standard deviation of 1.2). Subsequently, we conducted a statistical analysis to examine the relationship between the outcomes of the face recognition tests and STAI scores using Pearson correlation analysis and single correlation coefficients. The results showed a positive correlation between state anxiety and PI20 (r = 0.308, p = 0.007), and a weak positive correlation was also observed between trait anxiety and PI20 (r = 0.268, p = 0.04). In contrast, there was no correlation between CFMT and VPTA-FFT with respect to STAI. The results of the hierarchical multiple regression analysis also suggested that the correlation between the performance on the PI20 (self-report) and objective measures of face recognition performance (the CFMT and the VPTA-FFT) are driven by differences in anxiety. This study is the first to explore the relationship between face recognition abilities and anxiety using the PI20 self-report measure. There are implications for future research on the diagnosis of DP and the relationship between anxiety and face recognition.

A new way of classifying developmental prosopagnosia: Balanced Integration Score.

Despite severe everyday problems recognising faces, some individuals with developmental prosopagnosia (DP) can achieve typical accuracy scores on laboratory face recognition tests. To address this, studies sometimes also examine response times (RTs), which tend to be longer in DPs relative to control participants. In the present study, 24 potential (according to self-report) DPs and 110 age-matched controls completed the Cambridge Face and Bicycle Memory Tests, old new faces task, and a famous faces test. We used accuracy and the Balanced Integration Score (BIS), a measure that adjusts accuracy for RTs, to classify our sample at the group and individual levels. Subjective face recognition ability was assessed using the PI20 questionnaire and semi structured interviews. Fifteen DPs showed a major impairment using BIS compared with only five using accuracy alone. Logistic regression showed that a model incorporating the BIS measures was the most sensitive for classifying DP and showed highest area under the curve (AUC). Furthermore, larger between-group effect sizes were observed for a derived global (averaged) memory measure calculated using BIS versus accuracy alone. BIS is thus an extremely sensitive novel measure for attenuating speed-accuracy trade-offs that can otherwise mask impairment measured only by accuracy in DP.

The anterior fusiform gyrus: The ghost in the cortical face machine.

Face-selective regions in the human ventral occipito-temporal cortex (VOTC) have been defined for decades mainly with functional magnetic resonance imaging. This face-selective VOTC network is traditionally divided in a posterior 'core' system thought to subtend face perception, and regions of the anterior temporal lobe as a semantic memory component of an extended general system. In between these two putative systems lies the anterior fusiform gyrus and surrounding sulci, affected by magnetic susceptibility artifacts. Here we suggest that this methodological gap overlaps with and contributes to a conceptual gap between (visual) perception and semantic memory for faces. Filling this gap with intracerebral recordings and direct electrical stimulation reveals robust face-selectivity in the anterior fusiform gyrus and a crucial role of this region, especially in the right hemisphere, in identity recognition for both familiar and unfamiliar faces. Based on these observations, we propose an integrated theoretical framework for human face (identity) recognition according to which face-selective regions in the anterior fusiform gyrus join the dots between posterior and anterior cortical face memories.

Intracerebral electrical stimulation of the face-selective right lateral fusiform gyrus transiently impairs face identity recognition.

Neuroimaging and intracranial electrophysiological studies have consistently shown the largest and most consistent face-selective neural activity in the middle portion of the human right lateral fusiform gyrus ('fusiform face area(s)', FFA). Yet, direct evidence for the critical role of this region in face identity recognition (FIR) is still lacking. Here we report the first evidence of transient behavioral impairment of FIR during focal electrical stimulation of the right FFA. Upon stimulation of an electrode contact within this region, subject CJ, who shows typical FIR ability outside of stimulation, was transiently unable to point to pictures of famous faces among strangers and to match pictures of famous or unfamiliar faces presented simultaneously for their identity. Her performance at comparable tasks with other visual materials (written names, pictures of buildings) remained unaffected by stimulation at the same location. During right FFA stimulation, CJ consistently reported that simultaneously presented faces appeared as being the same identity, with little or no distortion of the spatial face configuration. Independent electrophysiological recordings showed the largest neural face-selective and face identity activity at the critical electrode contacts. Altogether, this extensive multimodal case report supports the causal role of the right FFA in FIR.

Provoked overt recognition in acquired prosopagnosia using multiple different images of famous faces.

Provoked overt recognition refers to the fact that patients with acquired prosopagnosia can sometimes recognize faces when presented in arrays of individuals from the same category (e.g., actors or politicians). We ask whether a prosopagnosic patient might experience recognition when presented with multiple different images of the same face simultaneously. Over two sessions, patient Herschel, a 66-year-old British man with acquired prosopagnosia, viewed face images individually or in arrays. On several occasions he failed to recognize single photos of an individual but successfully identified that person when the same photos were presented together. For example, Herschel failed to recognize any individual images of King Charles or Paul McCartney but recognised both in arrays of the same photos. Like reports based on category membership, overt recognition was transient and inconsistent. These findings are discussed in terms of models of covert recognition, alongside more recent research on within-person variability for face perception.