The heterogeneity of holistic processing profiles in developmental prosopagnosia: holistic processing is impaired but not absent.

Although it is generally assumed that face recognition relies on holistic processing, whether face recognition deficits observed in Developmental Prosopagnosics (DPs) can be explained by impaired holistic processing is currently under debate. The mixed findings from past studies could be the consequence of DP's heterogeneous deficit nature and the use of different measures of holistic processing-the inversion, part-whole, and composite tasks-which showed a poor association among each other. The present study aimed to gain further insight into the role of holistic processing in DPs. Groups of DPs and neurotypicals completed three tests measuring holistic face processing and non-face objects (i.e., Navon task). At a group level, DPs showed (1) diminished, but not absent, inversion and part-whole effects, (2) comparable magnitudes of the composite face effect and (3) global precedence effect in the Navon task. However, single-case analyses showed that these holistic processing deficits in DPs are heterogeneous.

The role of transitional probabilities in word holistic processing.

In recent years, increased attention has been devoted to visual word recognition under a perceptual expertise framework. Because the information required to identify words is distributed across the word, a holistic attentional strategy is optimal and develops with experience. It is, however, an open question the extent to which other information embedded in a word may contribute to word holistic processing, namely sublexical word properties. In the present research, we therefore explore the role of sublexical properties-specifically bigram transition probabilities-in this processing strategy. We used a common task in the holistic processing literature (i.e., composite task) and four-letter disyllabic words, where two of the bigrams reinforce the cohesiveness of each syllable and one of the bigrams reinforces the cohesiveness between the syllables. We found preliminary evidence of a role of these sublexical properties in word holistic processing.

The face inversion effect does not provide a pure measure of holistic face processing.

It is widely held that upright faces are processed more holistically than inverted faces and that this difference is reflected in the face inversion effect. It is not clear, however, how the inversion effect can best be measured, whether it is task specific, or even whether it specifically correlates with processing of upright faces. We examined these questions in a large sample (N = 420) who provided data on processing of upright and inverted stimuli in two different tasks with faces and one with objects. We find that the inversion effects are task dependent, and that they do not correlate better among face processing tasks than they do across face and object processing tasks. These findings were obtained regardless of whether inversion effects were measured by means of difference scores or regression. In comparison, only inversion effects based on regression predicted performance with upright faces in tasks other than those the inversion effects were derived from. Critically, however, inversion effects based on regression also predicted performance with inverted faces to a similar degree as they predicted performance with upright faces. Consequently, and contrary to what is commonly assumed, inversion effects do not seem to capture effects specific to holistic processing of upright faces. While the present findings do not bring us closer to an understanding of which changes in cognitive processing are induced by inversion, they do suggest that inversion effects do not reflect a unitary construct; an implicit assumption that seems to characterize much of the research regarding face processing.

Developmental emergence of holistic processing in word recognition.

Holistic processing (HP) of faces refers to the obligatory, simultaneous processing of the parts and their relations, and it emerges over the course of development. HP is manifest in a decrement in the perception of inverted versus upright faces and a reduction in face processing ability when the relations between parts are perturbed. Here, adopting the HP framework for faces, we examined the developmental emergence of HP in another domain for which human adults have expertise, namely, visual word processing. Children, adolescents, and adults performed a lexical decision task and we used two established signatures of HP for faces: the advantage in perception of upright over inverted words and nonwords and the reduced sensitivity to increasing parts (word length). Relative to the other groups, children showed less of an advantage for upright versus inverted trials and lexical decision was more affected by increasing word length. Performance on these HP indices was strongly associated with age and with reading proficiency. Also, the emergence of HP for word perception was not simply a result of improved visual perception over the course of development as no group differences were observed on an object decision task. These results reveal the developmental emergence of HP for orthographic input, and reflect a further instance of experience-dependent tuning of visual perception. These results also add to existing findings on the commonalities of mechanisms of word and face recognition. RESEARCH HIGHLIGHTS: Children showed less of an advantage for upright versus inverted trials compared to adolescents and adults. Relative to the other groups, lexical decision in children was more affected by increasing word length. Performance on holistic processing (HP) indices was strongly associated with age and with reading proficiency. HP emergence for word perception was not due to improved visual perception over development as there were no group differences on an object decision task.

Change detection versus change localization for faces, houses, and words.

Holistic processing aids in the discrimination of visually similar objects, but it may also come with a cost. Indeed holistic processing may improve the ability to detect changes to a face while impairing the ability to locate where the changes occur. We investigated the capacity to detect the occurrence of a change versus the capacity to detect the localization of a change for faces, houses, and words. Change detection was better than change localization for faces. Change localization outperformed change detection for houses. For words, there was no difference between detection and localization. We know from previous studies that words are processed holistically. However, being an object of visual expertise processed holistically, visual words are also a linguistic entity. Previously, the word composite effect was found for phonologically consistent words but not for phonologically inconsistent words. Being an object of visual expertise for which linguistic information is important, letter position information, is also crucial. Thus, the importance of localization of letters and features may augment the capacity to localize a change in words making the detection of a change and the detection of localization of a change equivalent.

The mechanisms supporting holistic perception of words and faces are not independent.

The question of whether word and face recognition rely on overlapping or dissociable neural and cognitive mechanisms received considerable attention in the literature. In the present work, we presented words (aligned or misaligned) superimposed on faces (aligned or misaligned) and tested the interference from the unattended stimulus category on holistic processing of the attended category. In Experiment 1, we found that holistic face processing is reduced when a face was overlaid with an unattended, aligned word (processed holistically). In Experiment 2, we found a similar reduction of holistic processing for words when a word was superimposed on an unattended, aligned face (processed holistically). This reciprocal interference effect indicates a trade-off in holistic processing of the two stimuli, consistent with the idea that word and face recognition may rely on non-independent, overlapping mechanisms.

Learning facilitates dual-process face recognition regardless of holistic processing.

Much evidence suggests that faces are recognized based on their global familiarity in a signal-detection manner. However, experiments drawing this conclusion typically present study lists of faces only once or twice, and the nature of face recognition at higher levels of learning remains unclear. Here, three experiments are reported in which participants studied some faces eight times and others twice and then took a recognition test containing previously viewed faces, entirely new faces, and faces which recombined the parts of previously viewed faces. Three measures converged to suggest that study list repetition increased the likelihood of participants rejecting recombined faces as new by recollecting that their parts were studied but in a different combination, and that manipulating holistic or Gestalt-like processing-a hallmark of face perception-qualitatively preserved its effect on how memory judgments are made. This suggests that face learning causes a shift from the use of a signal-detection strategy to the use of a dual-process strategy of face recognition regardless of holistic processing.

Using compositionality to understand parts in whole objects.

A fundamental question for any visual system is whether its image representation can be understood in terms of its components. Decomposing any image into components is challenging because there are many possible decompositions with no common dictionary, and enumerating the components leads to a combinatorial explosion. Even in perception, many objects are readily seen as containing parts, but there are many exceptions. These exceptions include objects that are not perceived as containing parts, properties like symmetry that cannot be localized to any single part and special categories like words and faces whose perception is widely believed to be holistic. Here, I describe a novel approach we have used to address these issues and evaluate compositionality at the behavioural and neural levels. The key design principle is to create a large number of objects by combining a small number of pre-defined components in all possible ways. This allows for building component-based models that explain neural and behavioural responses to whole objects using a combination of these components. Importantly, any systematic error in model fits can be used to detect the presence of emergent or holistic properties. Using this approach, we have found that whole object representations are surprisingly predictable from their components, that some components are preferred to others in perception and that emergent properties can be discovered or explained using compositional models. Thus, compositionality is a powerful approach for understanding how whole objects relate to their parts.

Face-Information Sampling in Super-Recognizers.

Perceptual processes underlying individual differences in face-recognition ability remain poorly understood. We compared visual sampling of 37 adult super-recognizers-individuals with superior face-recognition ability-with that of 68 typical adult viewers by measuring gaze position as they learned and recognized unfamiliar faces. In both phases, participants viewed faces through "spotlight" apertures that varied in size, with face information restricted in real time around their point of fixation. We found higher accuracy in super-recognizers at all aperture sizes-showing that their superiority does not rely on global sampling of face information but is also evident when they are forced to adopt piecemeal sampling. Additionally, super-recognizers made more fixations, focused less on eye region, and distributed their gaze more than typical viewers. These differences were most apparent when learning faces and were consistent with trends we observed across the broader ability spectrum, suggesting that they are reflective of factors that vary dimensionally in the broader population.

Recognition of Masked Faces in the Era of the Pandemic: No Improvement Despite Extensive Natural Exposure.

Face masks, which became prevalent across the globe during the COVID-19 pandemic, have had a negative impact on face recognition despite the availability of critical information from uncovered face parts, especially the eyes. An outstanding question is whether face-mask effects would be attenuated following extended natural exposure. This question also pertains, more generally, to face-recognition training protocols. We used the Cambridge Face Memory Test in a cross-sectional study (N = 1,732 adults) at six different time points over a 20-month period, alongside a 12-month longitudinal study (N = 208). The results of the experiments revealed persistent deficits in recognition of masked faces and no sign of improvement across time points. Additional experiments verified that the amount of individual experience with masked faces was not correlated with the mask effect. These findings provide compelling evidence that the face-processing system does not easily adapt to visual changes in face stimuli, even following prolonged real-life exposure.

A more featural based processing for the self-face: An eye-tracking study.

Studies have suggested that the holistic advantage in face perception is not always reported for the own face. With two eye-tracking experiments, we explored the role of holistic and featural processing in the processing and the recognition of self, personally familiar, and unfamiliar faces. Observers were asked to freely explore (Exp.1) and recognize (Exp.2) their own, a friend's, and an unfamiliar face. In Exp.1, self-face was fixated more and longer and there was a preference for the mouth region when seeing the own face and for the nose region when seeing a friend and unfamiliar faces. In Exp.2, the viewing strategies did not differ across all faces, with eye fixations mostly directed to the nose region. These results suggest that task demands might modulate the way that the own face is perceived and highlights the importance of considering the role of the distinct visual experience people have for the own face in the processing and recognition of the self-face.

Partial overlap between holistic processing of words and Gestalt line stimuli at an early perceptual stage.

A dual-route account of holistic processing has been proposed, which includes a stimulus-based and experience-based approach to holistic processing. The bottom-up route was suggested by the observation of holistic processing for novel Gestalt line patterns in the absence of expertise. For words, there is mainly evidence for a late, lexical, experience-based locus of holistic processing with scarce evidence for an early, stimulus-based locus. However, salient early Gestalt information (i.e., connectedness, closure, and continuity between parts) are important for letter and word identification. Thus, there might be an overlap at an early, perceptual processing stage, between Gestalt stimulus-based holistic processing and word holistic processing. In the task we used, words and Gestalt line patterns were superimposed, and we evaluated whether one class of stimuli was processed less holistically when an aligned other class pattern (processed holistically) was superimposed. There was some evidence supporting an early locus for the influence of word processing on Gestalt line patterns, but the interaction between the two stimuli was not reciprocal, which needs further clarification. When an aligned word (processed holistically) was overlaid on a line pattern, the line pattern was processed less holistically. However, when an aligned line pattern (processed holistically) was overlaid on a word, the word was not processed less holistically. This pattern might result from the higher cohesiveness of words and their automaticity and feedback from the lexicon.

The perception of food size and food shape in anorexia nervosa.

Visual perception of food size and shape in anorexia nervosa (AN) is an understudied topic, notwithstanding its relevance in approaching food, key-element in weight restoration. In addition, it is unclear how visual perception in AN is related to the age and the duration of illness. Here, we compared patients with AN to healthy controls (HCs) on their spatial resolution, biases in perceived food size, and holistic processing of food shape. A total of 122 participants were enrolled: 48 adolescents (27 AN and 21 HCs) and 74 adults (33 AN and 41 HCs). Participants at two academic sites (Israel and Italy) completed measures of psychopathology and experiments measuring visual resolution (Just Noticeable Difference), biases in food-size perception (Points of Subjective Equality), and holistic processing of food shape (indicated by the height-width illusion). Adolescents and adults with AN differed in the duration of illness and body mass index but showed comparable eating psychopathology and body measures. Patients with AN showed preserved visual resolution but distorted perception of food size, perceiving food as bigger than non-food objects, in both age groups. Patients with AN, both adolescents and adults, also processed food stimuli in a more analytic fashion, and were immune to the height-width illusion. The preserved perception of non-food stimuli in AN coupled with biases in food-size perception and in analytic processing of food shape highlight patients' real-world difficulties in approaching food. Future treatments on AN may consider taking these differences into account.

Featural vs. Holistic processing and visual sampling in the influence of social category cues on emotion recognition.

Past research demonstrates that emotion recognition is influenced by social category cues present on faces. However, little research has investigated whether holistic processing is required to observe these influences of social category information on emotion perception, and no studies have investigated whether different visual sampling strategies (i.e. differences in the allocation of attention to different regions of the face) contribute to the interaction between social cues and emotional expressions. The current study aimed to address this. Participants categorised happy and angry expressions on own- and other-race faces, and male and female faces. In Experiments 1 and 2, holistic processing was disrupted by presenting inverted faces (Experiment 1) or part faces (Experiment 2). In Experiments 3 and 4 participants' eye-gaze to eye and mouth regions was also tracked. Disrupting holistic processing did not alter the moderating influence of sex and race cues on emotion recognition (Experiments 1, 2, 4). Gaze patterns differed as a function of emotional expression, and social category cues, however, eye-gaze patterns did not reflect response time patterns (Experiments 3 and 4). Results indicate that the interaction between social category cues and emotion does not require holistic processing and is not driven by differences in visual sampling.

Implicit evidence on the dissociation of identity and emotion recognition.

Recognition of identity and of emotional facial expressions of individuals are both based on processing of the human face. While most studies show these abilities to be dissociated, some others find evidence of a connection. One possible explanation for these contradictory results comes from neurological evidence, which points to identity recognition being mostly based on holistic processing, while emotion recognition seems to be based on both an explicit, fine-grained process, and an implicit, mostly-holistic one. Our main hypothesis, that would explain the contradictory findings, is that holistic implicit emotion recognition, specifically, would be related to identity recognition, while explicit emotion recognition would be a process separate to identity recognition. To test this hypothesis, we employed an experimental paradigm in which spatial frequencies of visual stimuli are manipulated so that automatic, holistic-based, implicit emotion recognition influences perceived friendliness of unfamiliar faces. We predicted the effect to be related to identity recognition ability, since they both require holistic face processing. After a successful replication study, we employed the paradigm with 140 participants, measuring also identity recognition ability and explicit emotion recognition ability. Results showed that the effect is not moderated by these two variables (p = .807 and .373, respectively), suggesting that the independence of identity and emotion recognition holds even when considering, specifically, implicit emotion recognition.

Investigating holistic face processing within and outside of face-responsive brain regions.

It has been shown that human faces are processed holistically (i.e. as indecomposable wholes, rather than by their component parts) and this holistic face processing is linked to brain activity in face-responsive brain regions. Although several brain regions outside of the face-responsive network are also sensitive to relational processing and perceptual grouping, whether these non-face-responsive regions contribute to holistic processing remains unclear. Here, we investigated holistic face processing in the composite face paradigm both within and outside of face-responsive brain regions. We recorded participants' brain activity using fMRI while they performed a composite face task. Behavioural results indicate that participants tend to judge the same top face halves as different when they are aligned with different bottom face halves but not when they are misaligned, demonstrating a composite face effect. Neuroimaging results revealed significant differences in responses to aligned and misaligned faces in the lateral occipital complex (LOC), and trends in the anterior part of the fusiform face area (FFA2) and transverse occipital sulcus (TOS), suggesting that these regions are sensitive to holistic versus part-based face processing. Furthermore, the retrosplenial cortex (RSC) and the parahippocampal place area (PPA) showed a pattern of neural activity consistent with a holistic representation of face identity, which also correlated with the strength of the behavioural composite face effect. These results suggest that neural activity in brain regions both within and outside of the face-responsive network contributes to the composite-face effect.

Subcortical regions of the human visual system do not process faces holistically.

Face perception is considered to be evolutionarily adaptive and conserved across species. While subcortical visual brain areas are implicated in face perception based on existing evidence from phylogenetic and ontogenetic studies, whether these subcortical structures contribute to more complex visual computations such as the holistic processing (HP) of faces in humans is unknown. To address this issue, we used a well-established marker of HP, the composite face effect (CFE), with a group of adult human observers, and presented two sequential faces in a trial monocularly or interocularly using a Wheatstone stereoscope. HP refers to the finding that two identical top (or bottom) halves of a face are judged to be different when their task-irrelevant bottom (or top) halves belong to different faces. Because humans process faces holistically, they are unable to ignore the information from the irrelevant half of the composite face, and this is true to an even greater extent when the two halves of the faces are aligned compared with when they are misaligned ('Alignment effect'). The results revealed the HP effect and also uncovered the Alignment effect, a key marker of the CFE. The findings also indicated a monocular advantage, replicating the known subcortical contribution to face perception. There was, however, no statistically significant difference in the CFE when the images were presented in the monocular versus interocular conditions. These findings indicate that HP is not necessarily mediated by the subcortical visual pathway, and suggest that further investigation of cortical, rather than subcortical, structures might advance our understanding of HP and its role in face processing.

Chinese Aesthetic Mask: Three Forehead and Five Eyes-Holistic Processing and Facial Attractiveness.

Human face processing has been attributed to holistic processing. Here, we ask whether humans are sensitive to configural information when perceiving facial attractiveness. By referring to a traditional Chinese aesthetic theory-Three Forehead and Five Eyes-we generated a series of faces that differed in spacing between facial features. We adopted a two-alternative forced-choice task in Experiment 1 and a rating task in Experiment 2 to assess attractiveness. Both tasks showed a consistent result: The faces which fit the Chinese aesthetic theory were chosen or rated as most attractive. This effect of configural information on facial attractiveness was larger for faces with highly attractive features than for faces with low attractive features. These findings provide experimental evidence for the traditional Chinese aesthetic theory. This issue can be further explored from the perspective of culture in the future.

Recognizing Chinese Characters in Peripheral Vision: Different Levels of Processing of Character.

It hasn't been clear how holistic and analytic processing contribute to character recognition yet. The current study focused on two issues: (1) whether configural processing is sufficient to support the performance of identifying characters in absence of analytic processing; (2) whether configural processing involves multiple levels of character recognition. We examined the inversion effect in different levels of character processing from foveal to peripheral vision. Participants were asked to identify the stimulus from nine alternatives after a stimulus (character, radical, and stroke) is presented either in upright or inverted orientation. The results showed that the identification of characters and radicals had robust peripheral inversion effects at the locations of 6.2° and 12.2°, but the identification accuracies of inverted stimulus (parts only) remained above chance. These findings suggested that the configural processing of characters could not be isolated from analytical processing in the periphery in the current study. Furthermore, the greater inversion effect shown for characters than radicals at 6.2° might indicate that holistic processing of characters involves two levels of configurations: character structure and radical processing. The peripheral inversion effect for stroke was also observed and the role of stroke-based analytic in character recognition was discussed.

Premature birth affects visual body representation and body schema in preterm children.

Research has demonstrated that from the first six months of life infants show early sensitivity to body visual features and rely on sensorimotor and proprioceptive inputs in forming representations of their own bodies. Premature birth interferes with typical exposition to visual, sensorimotor and proprioceptive stimulation, thus presumably affecting the development of body representations. Here, we tested this hypothesis by comparing the performance of preterm children with that of age-matched full-termchildren in two tasks assessing, respectively, visual body processing and body schema. We found that preterm children had spared configural processing but altered holistic processing of others' bodies and showed a general difficulty in expressing visuospatial judgements on body stimuli. Furthermore, body-centered visuospatial abilities were associated with specific impairments in operating object-based visuospatial transformations. The findings of this study indicate that preterm birth might interfere with the development of body representations at the levels of body visual perceptual processing and of body schema, with effects even on visuo-spatial abilities for non-bodily stimuli. Body-centered rehabilitative interventions should be proposed to preterm children in order to enhance visuo-spatial abilities and higher-level cognitive functions.