A Robust Neural Index of High Face Familiarity.

Humans are remarkably accurate at recognizing familiar faces, whereas their ability to recognize, or even match, unfamiliar faces is much poorer. However, previous research has failed to identify neural correlates of this striking behavioral difference. Here, we found a clear difference in brain potentials elicited by highly familiar faces versus unfamiliar faces. This effect starts 200 ms after stimulus onset and reaches its maximum at 400 to 600 ms. This sustained-familiarity effect was substantially larger than previous candidates for a neural familiarity marker and was detected in almost all participants, representing a reliable index of high familiarity. Whereas its scalp distribution was consistent with a generator in the ventral visual pathway, its modulation by repetition and degree of familiarity suggests an integration of affective and visual information.

Same-gender distractors are not so easy to reject: ERP evidence of gender categorization.

Social categorization appears to be an automatic process that occurs during person perception. Understanding social categorization better is important because mere categorization can lead to stereotype activation and, in turn, to discrimination. In the present study we used a novel approach to examine event-related potentials (ERPs) of gender categorization in the "Who said what?" memory paradigm, thus allowing for a more in-depth understanding of the specific mechanisms underlying identity versus categorization processing. After observing video clips showing a "discussion" among female and male targets, participants were shown individual statements, each accompanied by one of the discussants' faces. While we measured ERPs, participants had to decide whether or not a given statement had previously been made by the person with the accompanying face. In same-person trials, statements were paired with the correct person, whereas in the distractor trials, either a same-gender or a different-gender distractor was shown. As expected, participants were able to reject different-gender distractors faster than same-gender distractors, and they were more likely to falsely choose yes for a same-gender than for a different-gender distractor. Both findings indicate gender-based categorization. ERPs, analyzed in a 300- to 400-ms time window at occipito-temporal channels, indicated more negative amplitudes for yes responses both for the same person and for same-gender distractors, relative to different-gender distractors. Overall, these results show gender-based categorization even when the task was to assess the identifying information in a gender-neutral context. These findings are interpreted as showing that gender categorization occurs automatically during person perception, but later than race- or age-based categorization.

The own-age bias in face memory is unrelated to differences in attention--evidence from event-related potentials.

Participants are more accurate at remembering faces from their own relative to a different age group (the own-age bias, or OAB). A recent socio-cognitive account has suggested that differential allocation of attention to old versus young faces underlies this phenomenon. Critically, empirical evidence for a direct relationship between attention to own- versus other-age faces and the OAB in memory is lacking. To fill this gap, we tested the roles of attention in three different experimental paradigms, and additionally analyzed event-related brain potentials (ERPs). In Experiment 1, we compared the learning of old and young faces during focused versus divided attention, but revealed similar OABs in subsequent memory for both attention conditions. Similarly, manipulating attention during learning did not differentially affect the ERPs elicited by young versus old faces. In Experiment 2, we examined the repetition effects from task-irrelevant old and young faces presented under varying attentional loads on the N250r ERP component as an index of face recognition. Independent of load, the N250r effects were comparable for both age categories. Finally, in Experiment 3 we measured the N2pc as an index of attentional selection of old versus young target faces in a visual search task. The N2pc was not significantly different for the young versus the old target search conditions, suggesting similar orientations of attention to either face age group. Overall, we propose that the OAB in memory is largely unrelated to early attentional processes. Our findings therefore contrast with the predictions from socio-cognitive accounts on own-group biases in recognition memory, and are more easily reconciled with expertise-based models.

The neural signature of the own-race bias: evidence from event-related potentials.

Participants are more accurate at remembering faces of their own relative to another ethnic group (own-race bias, ORB). This phenomenon has been explained by reduced perceptual expertise, or alternatively, by the categorization of other-race faces into social out-groups and reduced effort to individuate such faces. We examined event-related potential (ERP) correlates of the ORB, testing recognition memory for Asian and Caucasian faces in Caucasian and Asian participants. Both groups demonstrated a significant ORB in recognition memory. ERPs revealed more negative N170 amplitudes for other-race faces in both groups, probably reflecting more effortful structural encoding. Importantly, the ethnicity effect in left-hemispheric N170 during learning correlated significantly with the behavioral ORB. Similarly, in the subsequent N250, both groups demonstrated more negative amplitudes for other-race faces, and during test phases, this effect correlated significantly with the ORB. We suggest that ethnicity effects in the N170 reflect an early categorization of other-race faces into a social out-group, resulting in less efficient encoding and thus decreased memory. Moreover, ethnicity effects in the N250 may represent the "tagging" of other-race faces as perceptually salient, which hampers the recognition of these faces.

Fluency affects source memory for familiar names in younger and older adults: evidence from event-related brain potentials.

A current debate in memory research is whether and how the access to source information depends not only on recollection, but on fluency-based processes as well. In three experiments, we used event-related brain potentials (ERPs) to examine influences of fluency on source memory for famous names. At test, names were presented visually throughout, whereas visual or auditory presentation was used at learning. In Experiment 1, source decisions following old/new judgments were more accurate for repeated relative to non-repeated visually and auditorily learned names. ERPs were more positive between 300 and 600 ms for visually learned as compared to both auditorily learned and new names, resembling an N400 priming effect. In Experiment 2, we omitted the old/new decision to more directly test fast-acting fluency effects on source memory. We observed more accurate source judgments for repeated versus non-repeated visually learned names, but no such effect for repeated versus non-repeated auditorily learned names. Again, an N400 effect (300-600 ms) differentiated between visually and auditorily learned names. Importantly, this effect occurred for correct source decisions only. We interpret it as indexing fluency arising from within-modality priming of visually learned names at test. This idea was further supported in Experiment 3, which revealed an analogous pattern of results in older adults, consistent with the assumption of spared fluency processes in older age. In sum, our findings suggest that fluency affects person-related source memory via within-modality repetition priming in both younger and older adults.

The temporal dynamics of familiar face recognition: Event-related brain potentials reveal the efficient activation of facial identity representations.

While it is widely known that humans are typically highly accurate at recognizing familiar faces, it is less clear how efficiently recognition is achieved. In a series of three experiments, we used event-related brain potentials (ERP) in a repetition priming paradigm to examine the efficiency of familiar face recognition. Specifically, we varied the presentation time of the prime stimulus between 500 ms and 33 ms (Experiments 1 and 2), and additionally used backward masks (Experiment 3) to prevent the potential occurrence of visual aftereffects. Crucially, to test for the recognition of facial identity rather than a specific picture, we used different images of the same facial identities in repetition conditions. We observed clear ERP repetition priming effects between 300 and 500 ms after target onset at all prime durations, which suggests that the prime stimulus was sufficiently well processed to allow for facilitated recognition of the target in all conditions. This finding held true even in severely restricted viewing conditions including very brief prime durations and backward masks. We conclude that the facial recognition system is both highly effective and efficient, thus allowing for our impressive ability to recognise the faces that we know.

How neural representations of newly learnt faces change over time: Event-related brain potential evidence for overnight consolidation.

Previous experiments have shown that a brief encounter with a previously unfamiliar person leads to the establishment of new facial representations, which can be activated by completely novel pictures of the newly learnt face. The present study examined how stable such novel neural representations are over time, and, specifically, how they become consolidated within the first 24 h after learning. Using event-related brain potentials (ERPs) in a between-participants design, we demonstrate that clear face familiarity effects in the occipito-temporal N250 are evident immediately after learning. These effects then undergo change, with a nearly complete absence of familiarity-related ERP differences 4 h after the initial encounter. Critically, 24 h after learning, the original familiarity effect re-emerges. These findings suggest that the neural correlates of novel face representations are not stable over time but change during the first day after learning. The resulting pattern of change is consistent with a process of consolidation.

Holistic face processing of own- and other-age faces in young and older adults: ERP evidence from the composite face task.

Participants more accurately remember own-age relative to other-age faces (own-age bias, OAB). The present study tested whether this effect is related to more efficient holistic processing of own-age faces. Young adult and older participants performed a composite face task with young and old faces, in which they indicated whether the upper half of two subsequent composite faces was identical or not. The lower half of the second face was always different, and face halves were horizontally misaligned in 50% of the trials. Both participant groups were more efficient to correctly identify same upper halves in the misaligned relative to the aligned condition, and this composite face effect (CFE), a marker of holistic face processing, was stronger for young faces. Analysis of event-related potentials revealed strong misalignment effects in the N170, which were more pronounced for young faces in both groups. Critically, in the subsequent N250r a stronger misalignment effect for young faces was detected in young participants only. Since N250r may reflect the facilitated access of a perceptual representation of a previously presented face, this finding is interpreted to reflect young participants' more efficient representation of own-age faces as a whole, which may contribute to their OAB in memory.

How quickly do we learn new faces in everyday life? Neurophysiological evidence for face identity learning after a brief real-life encounter.

Faces learnt in a single experimental session elicit a familiarity effect in event-related brain potentials (ERPs), with more negative amplitudes for newly learnt relative to unfamiliar faces in the N250 component. However, no ERP study has examined face learning following a brief real-life encounter, and it is not clear how long it takes to learn new faces in such ecologically more valid conditions. To investigate these questions, the present study examined whether robust image-independent representations, as reflected in the N250 familiarity effect, could be established after a brief unconstrained social interaction by analysing the ERPs elicited by highly variable images of the newly learnt identity and an unfamiliar person. Significant N250 familiarity effects were observed after a 30-min (Experiment 1) and a 10-min (Experiment 2) encounter, and a trend was observed after 5 min of learning (Experiment 3), demonstrating that 5-10 min of exposure were sufficient for the initial establishment of image-independent representations. Additionally, the magnitude of the effects reported after 10 and 30 min was comparable suggesting that the first 10 min of a social encounter might be crucial, with extra 20 min from the same encounter not adding further benefit for the initial formation of robust face representations.

Developing familiarity during the first eight months of knowing a person: A longitudinal EEG study on face and identity learning.

It is well-established that familiar and unfamiliar faces are processed differently, but surprisingly little is known about how familiarity builds up over time and how novel faces gradually become represented in the brain. Here, we used event-related brain potentials (ERPs) in a pre-registered, longitudinal study to examine the neural processes accompanying face and identity learning during the first eight months of knowing a person. Specifically, we examined how increasing real-life familiarity affects visual recognition (N250 Familiarity Effect) and the integration of person-related knowledge (Sustained Familiarity Effect, SFE). Sixteen first-year undergraduates were tested in three sessions, approximately one, five, and eight months after the start of the academic year, with highly variable "ambient" images of a new friend they had met at university and of an unfamiliar person. We observed clear ERP familiarity effects for the new friend after one month of familiarity. While there was an increase in the N250 effect over the course of the study, no change in the SFE was observed. These results suggest that visual face representations develop faster relative to the integration of identity-specific knowledge.

The role of the eye region for familiar face recognition: Evidence from spatial low-pass filtering and contrast negation.

What information is used for familiar face recognition? While previous research suggests a particular importance of the eye region, information from the rest of the face also needs to be integrated. What type of information is used in conjunction with the eyes is largely unclear. In three experiments, participants were asked to recognise so-called face chimeras, in which the eye region was not manipulated, while the rest of the face was either presented in negative contrast (contrast chimeras) or low-pass filtered (blur chimeras). We show (1) that both chimeras are recognised substantially better than fully blurred faces, (2) that the recognition advantage for blur chimeras is specific to the eye region but cannot be explained by cues available in this part of the face alone, and (3) that a combination of negative contrast and blurring outside of the eye region eliminates the chimera advantage. We conclude that full-frequency but distorted surface reflectance cues (in contrast chimeras) or coarse shape information (in blur chimeras) can be used in combination with the eye region for effective face recognition. Our findings further suggest that the face recognition system can flexibly use both types of information, depending on availability.

Event-related brain potential correlates of the other-race effect: A review.

People are better at remembering own-race relative to other-race faces. Here, we review event-related brain potential (ERP) correlates of this so-called other-'race' effect (ORE) by discussing three critical aspects that characterize the neural signature of this phenomenon. First, difficulties with other-race faces initially emerge during perceptual processing, which is indexed by an increased N170. Second, as evidenced by 'difference due to subsequent memory' effects, more effortful processing of other-race faces is needed for successful encoding into long-term memory. Third, ERP old/new effects reveal that a stronger engagement of processing resources is also required for successful retrieval of other-race faces from memory. The ERP evidence available to date thus suggests widespread ethnicity-related modulations during both perceptual and mnemonic processing stages. We further discuss how findings from the ORE compared with potentially related memory biases (e.g. other-gender or other-age effects) and how ERP findings inform the ongoing debate regarding the mechanisms underlying the ORE. Finally, we outline open questions and potential future directions with an emphasis on using multiple, ecologically more valid 'ambient' images for each face to assess the ORE in paradigms that capture identity rather than image recognition.

Personal familiarity of faces, animals, objects, and scenes: Distinct perceptual and overlapping conceptual representations.

While face, object, and scene recognition are often studied at a basic categorization level (e.g. "a face", "a car", "a kitchen"), we frequently recognise individual items of these categories as unique entities (e.g. "my mother", "my car", "my kitchen"). This recognition of individual identity is essential to appropriate behaviour in our world. However, relatively little is known about how we recognise individually familiar visual stimuli. Using event-related brain potentials, the present study examined whether and to what extent the underlying neural representations of personally familiar items are similar or different across different categories. In three experiments, we examined the recognition of personally highly familiar faces, animals, indoor scenes, and objects. We observed relatively distinct familiarity effects in an early time window (200-400 ms), with a clearly right-lateralized occipito-temporal scalp distribution for human faces and more bilateral and posterior distributions for other stimulus categories, presumably reflecting access to at least partly discrete visual long-term representations. In contrast, we found clearly overlapping familiarity effects in a later time window (starting 400 to 500 ms after stimulus onset), again with a mainly right occipito-temporal scalp distribution, for all stimulus categories. These later effects appear to reflect the sustained activation of conceptual properties relevant to any potential interaction. We conclude that familiarity for items from the various visual stimulus categories tested here is represented differently at the perceptual level, while relatively overlapping conceptual mechanisms allow for the preparation of impending potential interaction with the environment.

Perceiving age and gender in unfamiliar faces: an fMRI study on face categorization.

Efficient processing of unfamiliar faces typically involves their categorization (e.g., into old vs. young or male vs. female). However, age and gender categorization may pose different perceptual demands. In the present study, we employed functional magnetic resonance imaging (fMRI) to compare the activity evoked during age vs. gender categorization of unfamiliar faces. In different blocks, participants performed age and gender classifications for old or young unfamiliar faces (50% female respectively). Both tasks elicited activations in the bilateral fusiform gyri (fusiform face area, FFA) and bilateral inferior occipital gyri (occipital face area, OFA). Importantly, the same stimuli elicited enhanced activation during gender as compared to age categorization. This enhancement was significant in the right FFA and the left OFA, and may be related to increased configural processing. Our findings replicate and extend recent work, and shows that the activation of core components of the face processing network is strongly dependent on task demands.

The time it takes to truly know someone: Neurophysiological correlates of face and identity learning during the first two years.

How long does it take to truly know a person? To answer this question, we investigated how event-related brain potential (ERP) correlates of facial familiarity (N250) and the integration of identity-specific knowledge (Sustained Familiarity Effect, SFE) develop over time. Sixty undergraduate students from three year groups were tested with images of a university friend (with two, 14, and 26 months of familiarity for Year 1, Year 2, and Year 3 students), a highly familiar friend from home, and an unfamiliar identity. While clear ERP familiarity effects for home friends were observed in all groups, university friends yielded a clear N250 effect but only a small SFE in Year 1. Importantly, both effects significantly increased for university friends from Year 1 to Year 2, but not afterwards. Our results demonstrate that neural representations of visual familiarity and identity-specific knowledge build up over time and are fully developed by 14 months of familiarity.

Characterizing the shared signals of face familiarity: Long-term acquaintance, voluntary control, and concealed knowledge.

In a recent study using cross-experiment multivariate classification of EEG patterns, we found evidence for a shared familiarity signal for faces, patterns of neural activity that successfully separate trials for familiar and unfamiliar faces across participants and modes of familiarization. Here, our aim was to expand upon this research to further characterize the spatio-temporal properties of this signal. By utilizing the information content present for incidental exposure to personally familiar and unfamiliar faces, we tested how the information content in the neural signal unfolds over time under different task demands - giving truthful or deceptive responses to photographs of genuinely familiar and unfamiliar individuals. For this goal, we re-analyzed data from two previously published experiments using within-experiment leave-one-subject-out and cross-experiment classification of face familiarity. We observed that the general face familiarity signal, consistent with its previously described spatio-temporal properties, is present for long-term personally familiar faces under passive viewing, as well as for acknowledged and concealed familiarity responses. Also, central-posterior regions contain information related to deception. We propose that signals in the 200-400 ms window are modulated by top-down task-related anticipation, while the patterns in the 400-600 ms window are influenced by conscious effort to deceive. To our knowledge, this is the first report describing the representational dynamics of concealed knowledge for faces, using time-resolved multivariate classification.

Detecting a viewer's familiarity with a face: Evidence from event-related brain potentials and classifier analyses.

Human observers recognize the faces of people they know efficiently and without apparent effort. Consequently, recognizing a familiar face is often assumed to be an automatic process beyond voluntary control. However, there are circumstances in which a person might seek to hide their recognition of a particular face. The present study therefore used event-related potentials (ERPs) and a classifier based on logistic regression to determine if it is possible to detect whether a viewer is familiar with a particular face, regardless of whether the participant is willing to acknowledge it or not. In three experiments, participants were presented with highly variable "ambient" images of personally familiar and unfamiliar faces, while performing an incidental butterfly detection task (Experiment 1), an explicit familiarity judgment task (Experiment 2), and a concealed familiarity task in which they were asked to deny familiarity with one truly known facial identity while acknowledging familiarity with a second known identity (Experiment 3). In all three experiments, we observed substantially more negative ERP amplitudes at occipito-temporal electrodes for familiar relative to unfamiliar faces starting approximately 200 ms after stimulus onset. Both the earlier N250 familiarity effect, reflecting visual recognition of a known face, and the later sustained familiarity effect, reflecting the integration of visual with additional identity-specific information, were similar across experiments and thus independent of task demands. These results were further supported by the classifier analysis. We conclude that ERP correlates of familiar face recognition are largely independent of voluntary control and discuss potential applications in forensic settings.

Familiarity is familiarity is familiarity: Event-related brain potentials reveal qualitatively similar representations of personally familiar and famous faces.

Humans excel in familiar face recognition, but often find it hard to make identity judgements of unfamiliar faces. Understanding of the factors underlying the substantial benefits of familiarity is at present limited, but the effect is sometimes qualified by the way in which a face is known-for example, personal acquaintance sometimes gives rise to stronger familiarity effects than exposure through the media. Given the different quality of personal versus media knowledge, for example in one's emotional response or level of interaction, some have suggested qualitative differences between representations of people known personally or from media exposure. Alternatively, observed differences could reflect quantitative differences in the level of familiarity. We present 4 experiments investigating potential contributory influences to face familiarity effects in which observers view pictures showing their friends, favorite celebrities, celebrities they dislike, celebrities about whom they have expressed no opinion, and their own face. Using event-related potential indices with high temporal resolution and multiple highly varied everyday ambient images as a strong test of face recognition, we focus on the N250 and the later Sustained Familiarity Effect (SFE). All known faces show qualitatively similar responses relative to unfamiliar faces. Regardless of personal- or media-based familiarity, N250 reflects robust visual representations, successively refined over increasing exposure, while SFE appears to reflect the amount of identity-specific semantic information known about a person. These modulations of visual and semantic representations are consistent with face recognition models which emphasize the degree of familiarity but do not distinguish between different types of familiarity. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Accessing semantic person knowledge: temporal dynamics of nonstrategic categorical and associative priming.

Recent theories of semantic memory suggest a subdivision into several separate domains of knowledge. The present study examined the structure of semantic person knowledge by analyzing both behavioral and ERP correlates of associative priming (via co-occurrence and/or shared semantic information) versus purely categorical priming (via shared occupational information). Participants performed familiarity decisions for target faces, which were preceded by sandwich-masked prime names at either short (33 msec) or long (1033 msec) SOAs. Although masking effectively prevented explicit prime recognition, faster RTs were generally observed for both associative and categorical priming (relative to an unrelated prime-target condition). At the short SOA, both associatively and categorically primed targets similarly elicited more positive going ERPs compared with unrelated targets in the N400 time range (N400 priming effect), suggesting a common initial mechanism mediating both forms of priming. By contrast, at the long SOA, a typical N400 priming effect was observed for associative priming only, whereas the corresponding effect for categorical priming was small and restricted to a left parietal site. This hitherto unreported interaction of relatedness, and SOA in the N400 suggests an initial fast spreading of activation to a wide range of related targets, which subsequently focuses to more closely related people at longer SOAs. This ability of ERPs to trace the neural dynamics of activation for different forms of prime/target relatedness can be exploited for testing different models of semantic priming.

Recognising other-race faces is more effortful: The effect of individuation instructions on encoding-related ERP Dm effects.

Humans are better at recognising faces from their own vs. another ethnic background. Socio-cognitive theories of this own-race bias (ORB) propose that reduced recognition of other-race faces results from less motivation to attend to individuating information during encoding. Accordingly, individuation instructions that explain the phenomenon and instruct participants to attend to other-race faces during learning attenuate or eliminate the ORB. However, it is still unclear how exactly such instructions affect other-race face processing. We addressed this question by investigating encoding-related event-related brain potentials, contrasting neural activity of subsequently remembered and forgotten items (Dm effects). In line with socio-cognitive accounts, individuation instructions reduced the ORB. Critically, instructions increased Dm effects for other-race faces, suggesting that more processing resources were allocated to these faces during encoding. Thus, compensating for reduced experience with other-race faces is possible to some extent, but additional resources are needed to decrease difficulties resulting from a lack of perceptual expertise.