Information sampling differences supporting superior face identity processing ability.

Face recognition in humans is often cited as a model example of perceptual expertise that is characterized by an increased tendency to process faces as holistic percepts. However emerging evidence across different domains of expertise points to a critical role of feature-based processing strategies during the initial encoding of information. Here, we examined the eye-movement patterns of super-recognisers-individuals with extremely high face identification ability compared with the average person-using gaze-contingent "spotlight" apertures that restrict visual face information in real time around their point of fixation. As an additional contrast, we also compared their performance with that of facial examiners-highly trained individuals whose superiority has been shown to rely heavily on featural processing. Super-recognisers and facial examiners showed equivalent face matching accuracy in both spotlight aperture and natural viewing conditions, suggesting that they were equally adept at using featural information for face identity processing. Further, both groups sampled more information across the face than controls. Together, these results show that the active exploration of facial features is an important determinant of face recognition ability that generalizes across different types of experts.

The role of transitional probabilities in word holistic processing.

In recent years, increased attention has been devoted to visual word recognition under a perceptual expertise framework. Because the information required to identify words is distributed across the word, a holistic attentional strategy is optimal and develops with experience. It is, however, an open question the extent to which other information embedded in a word may contribute to word holistic processing, namely sublexical word properties. In the present research, we therefore explore the role of sublexical properties-specifically bigram transition probabilities-in this processing strategy. We used a common task in the holistic processing literature (i.e., composite task) and four-letter disyllabic words, where two of the bigrams reinforce the cohesiveness of each syllable and one of the bigrams reinforces the cohesiveness between the syllables. We found preliminary evidence of a role of these sublexical properties in word holistic processing.

Rigid facial motion at study facilitates the holistic processing of own-race faces during the structural encoding stage.

Holistic processing is a fundamental element of face-recognition studies. Some behavioral studies have investigated the impact of rigid facial motion on holistic face processing, yet it is still unclear how rigid motion affects the time course of holistic face processing for different face races. The current study investigated this issue, using the composite face effect (CFE) as a direct measure of holistic processing. Participants were asked to match the identity of the top half of a static composite face with the study face during the test stage, where the study face was either static or rigidly-moving. ERP results showed that rigidly-moving study faces elicited a larger CFE relative to static study faces in the N170 component when recognizing own-race faces. The amplitude of P1, N170 and P2 components indicated that rigid motion facilitated holistic face processing, with differences observed between the hemispheres over time. Specifically, the CFE was only observed after exposure to rigidly-moving faces in the P1 and P2 components of the right hemisphere. Additionally, a greater CFE was observed following exposure to rigidly-moving faces compared to static faces, particularly in the N170 component of the left hemisphere. This study suggests that holistic processing is a fundamental aspect of face perception that applies to both static and moving faces, not just static ones. Furthermore, rigid facial motion improves holistic processing of own-race faces during the structural encoding stage. These findings provide evidence of distinct neural mechanisms underlying the holistic processing of static and moving faces.

The heterogeneity of holistic processing profiles in developmental prosopagnosia: holistic processing is impaired but not absent.

Although it is generally assumed that face recognition relies on holistic processing, whether face recognition deficits observed in Developmental Prosopagnosics (DPs) can be explained by impaired holistic processing is currently under debate. The mixed findings from past studies could be the consequence of DP's heterogeneous deficit nature and the use of different measures of holistic processing-the inversion, part-whole, and composite tasks-which showed a poor association among each other. The present study aimed to gain further insight into the role of holistic processing in DPs. Groups of DPs and neurotypicals completed three tests measuring holistic face processing and non-face objects (i.e., Navon task). At a group level, DPs showed (1) diminished, but not absent, inversion and part-whole effects, (2) comparable magnitudes of the composite face effect and (3) global precedence effect in the Navon task. However, single-case analyses showed that these holistic processing deficits in DPs are heterogeneous.

Learned Attentional Strategies in Word Holistic Processing.

Previous research has shown that, like faces, words are processed either holistically or through the automatic representation of their parts combined. The automaticity assumed to underlie the holistic processing of words presupposes that individuals have a relatively low level of control over these processes. However, they may also be capable of learning from their environments whether processing words as a whole is the most efficient processing strategy-which would require at least some control over the corresponding processes. In fact, previous research supports this latter account in the context of the holistic processing of faces: when provided a task in which participants should ignore half of a stimuli (the irrelevant part) and pay selective attention to the other half (the target part), the participants become better at ignoring the irrelevant part when it is commonly misleading (i.e., this suggests a response that is different from that of the relevant part in the context of the task). In the present work, we extend these considerations to holistic word processing. Our results support a learned attentional account in the context of holistic word processing. When an irrelevant word part is systematically helpful for the judgment of a target word half, participants engage more in holistic processing (vs. when the irrelevant word half is misleading). This reflects an incidental statistical learning process in which individuals identify the irrelevant word half as either providing helpful or misleading information about the target half.

Perceptual heterogeneity in developmental prosopagnosia is continuous, not categorical.

Developmental prosopagnosia (DP) is associated with considerable perceptual heterogeneity, though the nature of this heterogeneity and whether there are discrete subgroups versus continuous deficits remains unclear. Bennetts et al. (2022) recently found that holistic versus featural processing deficits distinguished discrete DP subgroups, but their sample was relatively small (N = 37), and subgroups were defined using a single task. To characterize perceptual heterogeneity in DPs more comprehensively, we administered a broad face perception battery to a large sample of 109 DPs and 134 controls, including validated measures of face matching (Cambridge Face Perception Test - CFPT, Computerized Benton Facial Recognition Test, Same/Different Face Matching Task), holistic processing (Part-Whole Task), and feature processing (Georges Task and Part-Whole part trials). When examining face matching measures, DPs exhibited a similar distribution of performance as controls, though shifted towards impairment by an average of 1.4 SD. We next applied Bennetts (2022) hierarchical clustering approach and k-means clustering to the CFPT upright, inverted, and inversion index measures, similarly finding one group of DPs with poorer inverted face performance and another with a decreased face inversion effect (holistic processing). However, these subgroup differences failed to generalize to other measures of feature and holistic processing beyond the CFPT. We finally ran hierarchical and k-means cluster analyses on our larger battery of face matching, feature, and holistic processing measures. Results clearly showed subgroups with generally better versus worse performance across all measures, with the distinction between groups being somewhat arbitrary. Together, these findings support a continuous account of DP perceptual heterogeneity, with performance differing primarily across all aspects of face perception.

Understanding of facial features in face perception: insights from deep convolutional neural networks.

Introduction: Face recognition has been a longstanding subject of interest in the fields of cognitive neuroscience and computer vision research. One key focus has been to understand the relative importance of different facial features in identifying individuals. Previous studies in humans have demonstrated the crucial role of eyebrows in face recognition, potentially even surpassing the importance of the eyes. However, eyebrows are not only vital for face recognition but also play a significant role in recognizing facial expressions and intentions, which might occur simultaneously and influence the face recognition process. Methods: To address these challenges, our current study aimed to leverage the power of deep convolutional neural networks (DCNNs), an artificial face recognition system, which can be specifically tailored for face recognition tasks. In this study, we investigated the relative importance of various facial features in face recognition by selectively blocking feature information from the input to the DCNN. Additionally, we conducted experiments in which we systematically blurred the information related to eyebrows to varying degrees. Results: Our findings aligned with previous human research, revealing that eyebrows are the most critical feature for face recognition, followed by eyes, mouth, and nose, in that order. The results demonstrated that the presence of eyebrows was more crucial than their specific high-frequency details, such as edges and textures, compared to other facial features, where the details also played a significant role. Furthermore, our results revealed that, unlike other facial features, the activation map indicated that the significance of eyebrows areas could not be readily adjusted to compensate for the absence of eyebrow information. This finding explains why masking eyebrows led to more significant deficits in face recognition performance. Additionally, we observed a synergistic relationship among facial features, providing evidence for holistic processing of faces within the DCNN. Discussion: Overall, our study sheds light on the underlying mechanisms of face recognition and underscores the potential of using DCNNs as valuable tools for further exploration in this field.

Facilitation and interference are asymmetric in holistic face processing.

A hallmark of face specificity is holistic processing. It is typically measured by paradigms such as the part-whole and composite tasks. However, these tasks show little evidence for common variance, so a comprehensive account of holistic processing remains elusive. One aspect that varies between tasks is whether they measure facilitation or interference from holistic processing. In this study, we examined facilitation and interference in a single paradigm to determine the way in which they manifest during a face perception task. Using congruent and incongruent trials in the complete composite face task, we found that these two aspects are asymmetrically influenced by the location and cueing probabilities of the target facial half, suggesting that they may operate somewhat independently. We argue that distinguishing facilitation and interference has the potential to disentangle mixed findings from different popular paradigms measuring holistic processing in one unified framework.

The productive processing of formulaic sequences by second language learners in writing.

There has been much debate in psycholinguistic research on whether formulaic sequences (FSs) are processed holistically or in a compositional manner. Whereas most previous studies on this issue focused on the receptive processing of FSs, few have investigated the productive processing of FSs, particularly in the second language (L2) learning context. Besides, most previous studies on L2 FSs examined learner-external FSs, or those identified by external criteria such as corpus frequency with little attention to learner-internal FSs, or psychological units perceived as wholes by learners themselves, although there might be much overlap between learner-external and learner-internal FSs. This study was designed to explore the productive processing of FSs by L2 learners from their own perspective, while taking into account the effects of L2 proficiency and topic familiarity. It made a distinction between internal FSs and purely external FSs as the primary criterion of categorizing learners' processing behaviors. Ten Chinese English learners from two proficiency levels completed two writing tasks differing in topic familiarity. Upon the completion of each task, each participant and the researcher identified the FSs separately and then distinguished internal FSs and purely external FSs (termed as assembled FSs, since they were perceived as being assembled from scratch) collectively. Next, each participant performed video stimulated recall (VSR) for the production process of each FS. The results showed that the learners' conscious processing (i.e., retrieval/assembly and integration into the text) of FSs can be categorized on two levels (lexical and syntactic). There was more holistic processing than compositional processing on the lexical level, but not on the syntactic level, indicating the learners' sizable storages of FSs and the syntactic flexibility of FSs. Furthermore, between-group differences and between-task differences were detected on two processing levels: higher-proficiency students retrieved more internal FSs and made more modifications to them than their lower-proficiency counterparts; in the familiar-topic writing, learners retrieved more internal FSs and made less modifications to them. Based on the findings, a model of L2 FS production is proposed, and pedagogical implications for the teaching of L2 FSs are provided.

Holistic processing and face expertise after pediatric resection of occipitotemporal cortex.

The nature and extent of hemispheric lateralization and its potential for reorganization continues to be debated, although there is general agreement that there is a right hemisphere (RH) advantage for face processing in human adults. Here, we examined face processing and its lateralization in individuals with a single preserved occipitotemporal cortex (OTC), either in the RH or left hemisphere (LH), following early childhood resection for the management of drug-resistant epilepsy. The matched controls and those with a lesion outside of OTC evinced the standard superiority in processing upright over inverted faces and the reverse sensitivity to a nonface category (bicycles). In contrast, the LH and the RH patient groups were significantly less accurate than the controls and showed mild orientation sensitivities at best (and not always in the predicted directions). For the two patient groups, the accuracies of face and bicycle processing did not differ from each other and were not obviously related to performance on intermediate level global form tasks with, again, poorer thresholds for both patient groups than controls and no difference between the patient groups. These findings shed light on the complexity of hemispheric lateralization and face and nonface object processing in individuals following surgical resection of OTC. Overall, this study highlights the unique dynamics and potential for plasticity in those with childhood cortical resection.

Opposite size illusions for inverted faces and letters.

Words are the primary means by which we communicate meaning and ideas, while faces provide important social cues. Studying visual illusions involving faces and words can elucidate the hierarchical processing of information as different regions of the brain are specialised for face recognition and word processing. A size illusion has previously been demonstrated for faces, whereby an inverted face is perceived as larger than the same stimulus upright. Here, two experiments replicate the face size illusion, and investigate whether the illusion is also present for individual letters (Experiment 1), and visual words and pseudowords (Experiment 2). Results confirm a robust size Illusion for faces. Letters, words and pseudowords and unfamiliar letters all show a reverse size illusion, as we previously demonstrated for human bodies. Overall, results indicate the illusion occurs in early perceptual stages upstream of semantic processing. Results are consistent with the idea of a general-purpose mechanism that encodes curvilinear shapes found in both scripts and our environment. Word and face perception rely on specialised, independent cognitive processes. The underestimation of the size of upright stimuli is specific to faces. Opposite size illusions may reflect differences in how size information is encoded and represented in stimulus-specialised neural networks, resulting in contrasting perceptual effects. Though words and faces differ visually, there is both symmetry and asymmetry in how the brain 'reads' them.

From Perugino to Picasso revisited: Electrophysiological responses to faces in paintings from different art styles.

Behavioral research (Ventura, et al., 2023) suggested that pictorial representations of faces varying along a realism-distortion spectrum elicit holistic processing as natural faces. Whether holistic face neural responses are engaged similarly remains, however, underexplored. In the present study, we evaluated the neural correlates of naturalist and artistic face processing, by exploring electrophysiological responses to faces in photographs versus in four major painting styles. The N170 response to faces in photographs was indistinguishable from that elicited by faces in the renaissance art style (depicting the most realistic faces), whilst both categories elicited larger N170 than faces in other art styles (post-impressionism, expressionism, and cubism), with a gradation in brain activity. The present evidence suggest that visual processing may become finer grained the more the realistic nature of the face. Despite behavioral equivalence, the neural mechanisms for holistic processing of natural faces and faces in diverse art styles are not equivalent.

The face inversion effect does not provide a pure measure of holistic face processing.

It is widely held that upright faces are processed more holistically than inverted faces and that this difference is reflected in the face inversion effect. It is not clear, however, how the inversion effect can best be measured, whether it is task specific, or even whether it specifically correlates with processing of upright faces. We examined these questions in a large sample (N = 420) who provided data on processing of upright and inverted stimuli in two different tasks with faces and one with objects. We find that the inversion effects are task dependent, and that they do not correlate better among face processing tasks than they do across face and object processing tasks. These findings were obtained regardless of whether inversion effects were measured by means of difference scores or regression. In comparison, only inversion effects based on regression predicted performance with upright faces in tasks other than those the inversion effects were derived from. Critically, however, inversion effects based on regression also predicted performance with inverted faces to a similar degree as they predicted performance with upright faces. Consequently, and contrary to what is commonly assumed, inversion effects do not seem to capture effects specific to holistic processing of upright faces. While the present findings do not bring us closer to an understanding of which changes in cognitive processing are induced by inversion, they do suggest that inversion effects do not reflect a unitary construct; an implicit assumption that seems to characterize much of the research regarding face processing.

Holistic processing is modulated by the probability that parts contain task-congruent information.

Holistic processing of face and non-face stimuli has been framed as a perceptual strategy, with classic hallmarks of holistic processing, such as the composite effect, reflecting a failure of selective attention, which is a consequence of this strategy. Further, evidence that holistic processing is impacted by training different patterns of attentional prioritization suggest that it may be a result of learned attention to the whole, which renders it difficult to attend to only part of a stimulus. If so, holistic processing should be modulated by the same factors that shape attentional selection, such as the probability that distracting or task-relevant information will be present. In contrast, other accounts suggest that it is the match to an internal face template that triggers specialized holistic processing mechanisms. Here we probed these accounts by manipulating the probability, across different testing sessions, that the task-irrelevant face part in the composite face task will contain task-congruent or -incongruent information. Attentional accounts of holistic processing predict that when the probability that the task-irrelevant part contains congruent information is low (25%), holistic processing should be attenuated compared to when this probability is high (75%). In contrast, template-based accounts of holistic face processing predict that it will be unaffected by manipulation given the integrity of the faces remains intact. Experiment 1 found evidence consistent with attentional accounts of holistic face processing and Experiment 2 extends these findings to holistic processing of non-face stimuli. These findings are broadly consistent with learned attention accounts of holistic processing.

Working memory for gaze benefits from the face context.

Retaining gaze in working memory (WM) is essential for successfully navigating through the social world. In the current study, we investigated how WM stores gaze direction by focusing on the role of face context in gaze WM. To address this question, we propose two competing hypotheses. The independence hypothesis predicts that eye gaze is stored independently and is not susceptible to the influence of the surrounding face context. Conversely, the embedding hypothesis claims that gaze WM involves face context and that disruption of holistic face processing would also impair memory for embedded gaze. In three experiments, we adopted different manipulations to disrupt holistic face processing and compared WM performance for gaze within and without face context. In Experiments 1 and 2, we tested WM for gaze direction with schematic upright or inverted faces. We found better performance for gaze within upright faces (vs. inverted faces) by increasing the probability of being remembered. In Experiment 3, we replaced schematic faces with photographic faces, and disrupted holistic processing by using scrambled faces. Results replicated our previous findings, showing that photographic gaze within intact faces was better remembered than gaze presented alone or gaze within scrambled faces. These findings indicate that gaze memory is face-dependent and support the embedding hypothesis.

Measuring the Contributions of Perceptual and Attentional Processes in the Complete Composite Face Paradigm.

Theories of holistic face processing vary widely with respect to conceptualizations, paradigms, and stimuli. These divergences have left several theoretical questions unresolved. Namely, the role of attention in face perception is understudied. To rectify this gap in the literature, we combined the complete composite face task (allowing for predictions of multiple theoretical conceptualizations and connecting with a large body of research) with a secondary auditory discrimination task at encoding (to avoid a visual perceptual bottleneck). Participants studied upright, intact faces within a continuous recognition paradigm, which intermixes study and test trials at multiple retention intervals. Within subjects, participants studied faces under full or divided attention. Test faces varied with respect to alignment, congruence, and retention intervals. Overall, we observed the predicted beneficial outcomes of holistic processing (e.g., higher discriminability for Congruent, Aligned faces relative to Congruent, Misaligned faces) that persisted across retention intervals and attention. However, we did not observe the predicted detrimental outcomes of holistic processing (e.g., higher discriminability for Incongruent, Misaligned faces relative to Incongruent, Aligned faces). Because the continuous recognition paradigm exerts particularly strong demands on attention, we interpret these findings through the lens of resource dependency and domain specificity.

Navon letters and composite faces: same or different processing mechanisms?

Navon letters and composite faces are two fascinating demonstrations of hierarchical organization in perception. Many researchers believe that the two types of stimuli and their associated tasks gauge comparable holistic mechanisms. This belief is so common that the two paradigms are now being applied in tandem to measure impaired holistic processing in prosopagnosic patients. But are Navon letters and composite faces processed in a similar fashion? In the present study we take a closer look at their apparent affinity. We gain novel insights into their underlying mechanisms by fitting parameters of the linear ballistic accumulator (LBA) model to empirical correct and incorrect response times (RTs). The results reveal major differences in processing between the two tasks. We conclude that despite the presence of a compelling surface similarity, Navon compound letters and composite faces tap into separate psychological processes.

High familiar faces have both eye recognition and holistic processing advantages.

People recognize familiar faces better than unfamiliar faces. However, it remains unknown whether familiarity affects part-based and/or holistic processing. Wang et al., Frontiers in Psychology, 6, 559 (2015), Vision Research, 157, 89-96 (2019) found both enhanced part-based and holistic processing in eye relative to mouth regions (i.e., in a region-selective manner) for own-race and own-species faces, i.e., faces with more experience. Here, we examined the role of face familiarity in eyes (part-based, region-selective) and holistic processing. Face familiarity was tested at three levels: high-familiar (faces of students from the same department and the same class who attended almost all courses together), low-familiar (faces of students from the same department but different classes who attended some courses together), and unfamiliar (faces of schoolmates from different departments who seldom attended the same courses). Using the old/new task in Experiment 1, we found that participants recognized eyes of high-familiar faces better than low-familiar and unfamiliar ones, while similar performance was observed for mouths, indicating a region-selective, eyes familiarity effect. Using the "Perceptual field" paradigm in Experiment 2, we observed a stronger inversion effect for high-familiar faces, a weaker inversion effect for low-familiar faces, but a non-significant inversion effect for unfamiliar faces, indicating that face familiarity plays a role in holistic processing. Taken together, our results suggest that familiarity, like other experience-based variables (e.g., race and species), can improve both eye processing and holistic processing.

Face motion form at learning influences the time course of face spatial frequency processing during test.

Studies that use static faces suggest that facial processing follows a coarse-to-fine sequence; i.e., holistic precedes featural processing, due to low and high spatial frequencies (LSF, HSF) transmitting holistic/global and featural/local information respectively. Although recent studies have focused on the role of facial movement in holistic facial processing, it is unclear whether moving faces have the same processing mechanism as static ones, especially in the time course of processing. The current study uses the event-related potential technique to investigate this issue by manipulating the facial format at study and face spatial frequency during the test. ERP results showed that the P1 amplitude was increased by LSF faces relative to HSF ones, using both moving and static study faces, with the former larger than the latter. The N170 amplitude was more sensitive to HSF than LSF faces when only static study faces were used, while the P2 amplitude was more sensitive to LSF faces regardless of the facial study format. The above results were not modulated by the race of the faces. These results favor the view that regardless of face race, moving study faces promote holistic processing during the earliest stage of face recognition. Furthermore, holistic processing is observed to be the same for both static and moving study faces at a later stage associated with more in-depth processing. It is evident that facial motion should be factored into further studies of face recognition, given the distinctions between holistic and featural processing for moving and static study faces.

Change detection versus change localization for faces, houses, and words.

Holistic processing aids in the discrimination of visually similar objects, but it may also come with a cost. Indeed holistic processing may improve the ability to detect changes to a face while impairing the ability to locate where the changes occur. We investigated the capacity to detect the occurrence of a change versus the capacity to detect the localization of a change for faces, houses, and words. Change detection was better than change localization for faces. Change localization outperformed change detection for houses. For words, there was no difference between detection and localization. We know from previous studies that words are processed holistically. However, being an object of visual expertise processed holistically, visual words are also a linguistic entity. Previously, the word composite effect was found for phonologically consistent words but not for phonologically inconsistent words. Being an object of visual expertise for which linguistic information is important, letter position information, is also crucial. Thus, the importance of localization of letters and features may augment the capacity to localize a change in words making the detection of a change and the detection of localization of a change equivalent.