Influence of gaze, vision, and memory on hand kinematics in a placement task.

People usually reach for objects to place them in some position and orientation, but the placement component of this sequence is often ignored. For example, reaches are influenced by gaze position, visual feedback, and memory delays, but their influence on object placement is unclear. Here, we tested these factors in a task where participants placed and oriented a trapezoidal block against two-dimensional (2-D) visual templates displayed on a frontally located computer screen. In experiment 1, participants matched the block to three possible orientations: 0° (horizontal), +45° and -45°, with gaze fixated 10° to the left/right. The hand and template either remained illuminated (closed-loop), or visual feedback was removed (open-loop). Here, hand location consistently overshot the template relative to gaze, especially in the open-loop task; likewise, orientation was influenced by gaze position (depending on template orientation and visual feedback). In experiment 2, a memory delay was added, and participants sometimes performed saccades (toward, away from, or across the template). In this task, the influence of gaze on orientation vanished, but location errors were influenced by both template orientation and final gaze position. Contrary to our expectations, the previous saccade metrics also impacted placement overshoot. Overall, hand orientation was influenced by template orientation in a nonlinear fashion. These results demonstrate interactions between gaze and orientation signals in the planning and execution of hand placement and suggest different neural mechanisms for closed-loop, open-loop, and memory delay placement.NEW & NOTEWORTHY Eye-hand coordination studies usually focus on object acquisition, but placement is equally important. We investigated how gaze position influences object placement toward a 2-D template with different levels of visual feedback. Like reach, placement overestimated goal location relative to gaze and was influenced by previous saccade metrics. Gaze also modulated hand orientation, depending on template orientation and level of visual feedback. Gaze influence was feedback-dependent, with location errors having no significant effect after a memory delay.

The large-scale organization of shape processing in the ventral and dorsal pathways is dissociable from attention.

The two visual pathways model posits that visual information is processed through two distinct cortical systems: The ventral pathway promotes visual recognition, while the dorsal pathway supports visuomotor control. Recent evidence suggests the dorsal pathway is also involved in shape processing and may contribute to object perception, but it remains unclear whether this sensitivity is independent of attentional mechanisms that were localized to overlapping cortical regions. To address this question, we conducted two fMRI experiments that utilized different parametric scrambling manipulations in which human participants viewed novel objects in different levels of scrambling and were instructed to attend to either the object or to another aspect of the image (e.g. color of the background). Univariate and multivariate analyses revealed that the large-scale organization of shape selectivity along the dorsal and ventral pathways was preserved regardless of the focus of attention. Attention did modulate shape sensitivity, but these effects were similar across the two pathways. These findings support the idea that shape processing is at least partially dissociable from attentional processes and relies on a distributed set of cortical regions across the visual pathways.

Functional Resilience of the Neural Visual Recognition System Post-Pediatric Occipitotemporal Resection.

In the typically developing (TD) brain, neural representations for visual stimulus categories (e.g., faces, objects, and words) emerge in bilateral occipitotemporal cortex (OTC), albeit with weighted asymmetry; in parallel, recognition behavior continues to be refined. A fundamental question is whether two hemispheres are necessary or redundant for the emergence of neural representations and recognition behavior typically distributed across both hemispheres. The rare population of patients undergoing unilateral OTC resection in childhood offers a unique opportunity to evaluate whether neural computations for visual stimulus individuation suffice for recognition with only a single developing OTC. Here, using functional magnetic resonance imaging, we mapped category selectivity (CS) and neural representations for individual stimulus exemplars using repetition suppression (RS) in the non-resected hemisphere of pediatric OTC resection patients (n = 9) and control patients with resection outside of OTC (n = 12), as well as in both hemispheres of TD controls (n = 21). There were no univariate group differences in the magnitude of CS or RS or any multivariate differences (per representational similarity analysis) in neural activation to faces, objects, or words across groups. Notwithstanding their comparable neural profiles, accuracy of OTC resection patients on face and object recognition, but not word recognition, was statistically inferior to that of controls. The comparable neural signature of the OTC resection patients' preserved hemisphere and the other two groups highlights the resilience of the system following damage to the contralateral homologue. Critically, however, a single OTC does not suffice for normal behavior, and, thereby, implicates the necessity for two hemispheres.

Reduced perception-action dissociation in children with amblyopia.

The functional distinction between vision-for-perception and vision-for-action is a key aspect of understanding the primate visual system. While this dissociation has been well-established in adulthood, its development and dependence on typical visual experience remain unclear. To address these questions, we examined two groups of children: typically developed children and those with amblyopia, who presumably have a sub-optimal visual experience. The Ponzo illusion, known to impact perception but not visuomotor behaviors across age groups, was employed to assess the extent of dissociation. Participants engaged in two tasks involving the Ponzo illusion: a grasping task (vision-for-action) and a manual estimation task (vision-for-perception), with objects placed on the "close" and "far" surfaces of the illusion. Typically developed children displayed grasping movements that were unaffected by the illusion, as their grasping apertures were scaled based on object size, independent of its location. In contrast, children with amblyopia exhibited a clear susceptibility to the illusion, showing larger apertures for objects placed on the 'far' surface of the illusion, and smaller apertures for objects placed on the 'close' surface. Interestingly, both groups of children demonstrated similar susceptibility to the illusion during the perceptual task, with objects placed on the far surface being perceived as longer compared to objects placed on the close surface. These findings shed light on the impact of atypical visual development on the emergence of the dissociation between perception and action, highlighting the crucial role of typical visual experience in establishing this distinction.

Mask-wearing selectivity alters observers' face perception.

Face masks became prevalent across the globe as an efficient tool to stop the spread of COVID-19. A host of studies already demonstrated that masks lead to changes in facial identification and emotional expression processing. These changes were documented across ages and were consistent even with the increased exposure to masked faces. Notably, mask-wearing also changes the state of the observers in regard to their own bodies and other agents. Previous research has already demonstrated a plausible association between observers' states and their perceptual behaviors. Thus, an outstanding question is whether mask-wearing would alter face recognition abilities. To address this question, we conducted a set of experiments in which participants were asked to recognize non-masked faces (Experiment 1), masked faces (Experiment 2) and novel objects (Experiment 3) while they were either masked or unmasked. Mask wearing hindered face perception abilities but did not modulate object recognition ability. Finally, we demonstrated that the decrement in face perception ability relied on wearing the mask on distinctive facial features (Experiment 4). Together, these findings reveal a novel effect of mask-wearing on face recognition. We discuss these results considering the plausible effect of somatosensory stimulation on visual processing as well as the effect of involuntary perspective taking.

Recognition of Masked Faces in the Era of the Pandemic: No Improvement Despite Extensive Natural Exposure.

Face masks, which became prevalent across the globe during the COVID-19 pandemic, have had a negative impact on face recognition despite the availability of critical information from uncovered face parts, especially the eyes. An outstanding question is whether face-mask effects would be attenuated following extended natural exposure. This question also pertains, more generally, to face-recognition training protocols. We used the Cambridge Face Memory Test in a cross-sectional study (N = 1,732 adults) at six different time points over a 20-month period, alongside a 12-month longitudinal study (N = 208). The results of the experiments revealed persistent deficits in recognition of masked faces and no sign of improvement across time points. Additional experiments verified that the amount of individual experience with masked faces was not correlated with the mask effect. These findings provide compelling evidence that the face-processing system does not easily adapt to visual changes in face stimuli, even following prolonged real-life exposure.

Are reaching and grasping effector-independent? Similarities and differences in reaching and grasping kinematics between the hand and foot.

While reaching and grasping are highly prevalent manual actions, neuroimaging studies provide evidence that their neural representations may be shared between different body parts, i.e., effectors. If these actions are guided by effector-independent mechanisms, similar kinematics should be observed when the action is performed by the hand or by a cortically remote and less experienced effector, such as the foot. We tested this hypothesis with two characteristic components of action: the initial ballistic stage of reaching, and the preshaping of the digits during grasping based on object size. We examined if these kinematic features reflect effector-independent mechanisms by asking participants to reach toward and to grasp objects of different widths with their hand and foot. First, during both reaching and grasping, the velocity profile up to peak velocity matched between the hand and the foot, indicating a shared ballistic acceleration phase. Second, maximum grip aperture and time of maximum grip aperture of grasping increased with object size for both effectors, indicating encoding of object size during transport. Differences between the hand and foot were found in the deceleration phase and time of maximum grip aperture, likely due to biomechanical differences and the participants' inexperience with foot actions. These findings provide evidence for effector-independent visuomotor mechanisms of reaching and grasping that generalize across body parts.

Face masks disrupt holistic processing and face perception in school-age children.

Face perception is considered a remarkable visual ability in humans that is subject to a prolonged developmental trajectory. In response to the COVID-19 pandemic, mask-wearing has become mandatory for adults and children alike. Recent research shows that mask-wearing hinders face recognition abilities in adults, but it is unknown if the same holds true in school-age children in whom face perception is not fully developed. Here we tested children (n = 72, ages 6-14 years old) on the Cambridge Face Memory Test - Kids (CFMT-K), a validated measure of face perception performance. Faces were presented with or without masks and across two orientations (upright/inverted). The inclusion of face masks led to a profound deficit in face perception abilities. This decrement was more pronounced in children compared to adults, but only when task difficulty was adjusted across the two age groups. Additionally, children exhibited reliable correlations between age and the CFMT-K score for upright faces for both the mask and no-mask conditions. Finally, as previously observed in adults, children also showed qualitative differences in the processing of masked versus non-masked faces. Specifically, holistic processing, a hallmark of face perception, was disrupted for masked faces as suggested by a reduced face-inversion effect. Together, these findings provide evidence for substantial quantitative and qualitative alterations in the processing of masked faces in school-age children.

Unilateral resection of both cortical visual pathways in a pediatric patient alters action but not perception.

The human cortical visual system consists of two major pathways, a ventral pathway which subserves perception and a dorsal pathway which primarily subserves visuomotor control. Previous studies have found that children with cortical resections of the ventral visual pathway retain largely normal visuoperceptual abilities. Whether visually guided actions, supported by computations carried out by the dorsal pathway, follow a similar pattern of preservation remains unknown. To address this question, we examined visuoperceptual and visuomotor behaviors in a pediatric patient, TC, who underwent a cortical resection that included portions of the left ventral and dorsal pathways. We collected kinematic data when TC used her right and left hands to perceptually estimate the width of blocks that varied in width and length, and, separately, to grasp the same blocks. TC's perceptual estimation performance was comparable to that of controls, independent of the hand used. In contrast, relative to controls, she showed reduced visuomotor sensitivity to object shape and this was more evident when she grasped the objects with her contralesional right hand. These results provide novel evidence for a striking difference in the competence of the two visual pathways to cortical injuries acquired in childhood.

Perceived depth modulates perceptual resolution.

Humans constantly use depth information to support perceptual decisions about object size and location in space, as well as planning and executing actions. It was recently reported that perceived depth modulates perceptual performance even when depth information is not relevant to the task, with faster shape discrimination for objects perceived as being close to the observer. However, it is yet to be determined if the observed "close advantage" reflects differences in psychophysical sensitivity or response bias. Moreover, it is unclear whether this advantage is generalizable to other viewing situations and tasks. To address these outstanding issues, we evaluated whether visual resolution is modulated by perceived depth defined by 2D pictorial cues. In a series of experiments, we used the method of constant stimuli to measure the precision of perceptual judgements for stimuli positioned at close, far, and flat perceived distances. In Experiment 1, we found that size discrimination was more precise when the object was perceived to be closer to the observers. Experiments 2a and 2b extended this finding to a visual property orthogonal to depth information, by showing superior orientation discrimination for "close" objects. Finally, Experiment 3 demonstrated that the close advantage also occurs when performing high-level perceptual tasks such as face perception. Taken together, our results provide novel evidence that the perceived depth of an object, as defined by pictorial cues, modulates the precision of visual processing for close objects.

Double dissociation between perception and action in children.

Previous research has demonstrated a functional dissociation between vision for perception and vision for action. However, the developmental trajectory of this functional dissociation is not well understood. We directly compared the sensitivity of grasping and perceptual estimations within the same experimental design to the real and illusory sizes of objects positioned in the Ponzo illusion display. Two different-sized objects were placed such that the differences between their real sizes and their perceived sizes were pitted against each other. Children aged 5-8 years and adults made perceptual size discriminations and then grasped (action) or estimated (perception) one of the objects based on its perceived size. Consistent with previous results, for the action task, grasping apertures of adults were scaled with the physical differences in the objects' sizes, even in trials where their overt perceptual decisions were deceived by the illusion. In contrast, perceptual estimations were robustly modulated by the illusion. Interestingly, children outperformed adults in their perceptual discriminations but exhibited adult-like behavior in grasping and in perceptual estimations of the objects, demonstrating a dissociation between perception and action. These results suggest that although the two visual functions are not operating at fully mature levels during childhood, some key mechanisms that support a dissociation between these functions are already in place.

The COVID-19 pandemic masks the way people perceive faces.

The unprecedented efforts to minimize the effects of the COVID-19 pandemic introduce a new arena for human face recognition in which faces are partially occluded with masks. Here, we tested the extent to which face masks change the way faces are perceived. To this end, we evaluated face processing abilities for masked and unmasked faces in a large online sample of adult observers (n = 496) using an adapted version of the Cambridge Face Memory Test, a validated measure of face perception abilities in humans. As expected, a substantial decrease in performance was found for masked faces. Importantly, the inclusion of masks also led to a qualitative change in the way masked faces are perceived. In particular, holistic processing, the hallmark of face perception, was disrupted for faces with masks, as suggested by a reduced inversion effect. Similar changes were found whether masks were included during the study or the test phases of the experiment. Together, we provide novel evidence for quantitative and qualitative alterations in the processing of masked faces that could have significant effects on daily activities and social interactions.

Large-scale resculpting of cortical circuits in children after surgical resection.

Despite the relative successes in the surgical treatment of pharmacoresistant epilepsy, there is rather little research on the neural (re)organization that potentially subserves behavioral compensation. Here, we examined the post-surgical functional connectivity (FC) in children and adolescents who have undergone unilateral cortical resection and, yet, display remarkably normal behavior. Conventionally, FC has been investigated in terms of the mean correlation of the BOLD time courses extracted from different brain regions. Here, we demonstrated the value of segregating the voxel-wise relationships into mutually exclusive populations that were either positively or negatively correlated. While, relative to controls, the positive correlations were largely normal, negative correlations among networks were increased. Together, our results point to reorganization in the contralesional hemisphere, possibly suggesting competition for cortical territory due to the demand for representation of function. Conceivably, the ubiquitous negative correlations enable the differentiation of function in the reduced cortical volume following a unilateral resection.

What Does Dorsal Cortex Contribute to Perception?

According to the influential "Two Visual Pathways" hypothesis, the cortical visual system is segregated into two pathways, with the ventral, occipitotemporal pathway subserving object perception, and the dorsal, occipitoparietal pathway subserving the visuomotor control of action. However, growing evidence suggests that the dorsal pathway also plays a functional role in object perception. In the current article, we present evidence that the dorsal pathway contributes uniquely to the perception of a range of visuospatial attributes that are not redundant with representations in ventral cortex. We describe how dorsal cortex is recruited automatically during perception, even when no explicit visuomotor response is required. Importantly, we propose that dorsal cortex may selectively process visual attributes that can inform the perception of potential actions on objects and environments, and we consider plausible developmental and cognitive mechanisms that might give rise to these representations. As such, we consider whether naturalistic stimuli, such as real-world solid objects, might engage dorsal cortex more so than simplified or artificial stimuli such as images that do not afford action, and how the use of suboptimal stimuli might limit our understanding of the functional contribution of dorsal cortex to visual perception.

Altered large-scale organization of shape processing in visual agnosia.

Recent findings suggest that both dorsal and ventral visual pathways process shape information. Nevertheless, a lesion to the ventral pathway alone can result in visual agnosia, an impairment in shape perception. Here, we explored the neural basis of shape processing in a patient with visual agnosia following a circumscribed right hemisphere ventral lesion and evaluated longitudinal changes in the neural profile of shape representations. The results revealed a reduction of shape sensitivity slopes along the patient's right ventral pathway and a similar reduction in the contralesional left ventral pathway. Remarkably, posterior parts of the dorsal pathway bilaterally also evinced a reduction in shape sensitivity. These findings were similar over a two-year interval, revealing that a focal cortical lesion can lead to persistent large-scale alterations of the two visual pathways. These alterations are consistent with the view that a distributed network of regions contributes to shape perception.

Effects of unilateral cortical resection of the visual cortex on bilateral human white matter.

Children with unilateral resections of ventral occipito-temporal cortex (VOTC) typically do not evince visual perceptual impairments, even when relatively large swathes of VOTC are resected. In search of possible explanations for this behavioral competence, we evaluated white matter microstructure and connectivity in eight pediatric epilepsy patients following unilateral cortical resection and 15 age-matched controls. To uncover both local and broader resection-induced effects, we analyzed tractography data using two complementary approaches. First, the microstructural properties were measured in the inferior longitudinal and the inferior fronto-occipital fasciculi, the major VOTC association tracts. Group differences were only evident in the ipsilesional, and not in the contralesional, hemisphere, and single-subject analyses revealed that these differences were limited to the site of the resection. Second, graph theory was used to characterize the connectivity of the contralesional occipito-temporal regions. There were no changes to the network properties in patients with left VOTC resections nor in patients with resections outside the VOTC, but altered network efficiency was observed in two cases with right VOTC resections. These results suggest that, in many, although perhaps not all, cases of unilateral VOTC resections in childhood, the white matter profile in the preserved contralesional hemisphere along with residual neural activity might be sufficient for normal visual perception.

Perceptual Function and Category-Selective Neural Organization in Children with Resections of Visual Cortex.

The consequences of cortical resection, a treatment for humans with pharmaco-resistant epilepsy, provide a unique opportunity to advance our understanding of the nature and extent of cortical (re)organization. Despite the importance of visual processing in daily life, the neural and perceptual sequellae of occipitotemporal resections remain largely unexplored. Using psychophysical and fMRI investigations, we compared the neural and visuoperceptual profiles of 10 children or adolescents following unilateral cortical resections and their age- and gender-matched controls. Dramatically, with the exception of two individuals, both of whom had relatively greater cortical alterations, all patients showed normal perceptual performance on tasks of intermediate- and high-level vision, including face and object recognition. Consistently, again with the exception of the same two individuals, both univariate and multivariate fMRI analyses revealed normal selectivity and representational structure of category-selective regions. Furthermore, the spatial organization of category-selective regions obeyed the typical medial-to-lateral topographic organization albeit unilaterally in the structurally preserved hemisphere rather than bilaterally. These findings offer novel insights into the malleability of cortex in the pediatric population and suggest that, although experience may be necessary for the emergence of neural category-selectivity, this emergence is not necessarily contingent on the integrity of particular cortical structures.SIGNIFICANCE STATEMENT One approach to reduce seizure activity in patients with pharmaco-resistant epilepsy involves the resection of the epileptogenic focus. The impact of these resections on the perceptual behaviors and organization of visual cortex remain largely unexplored. Here, we characterized the visuoperceptual and neural profiles of ventral visual cortex in a relatively large sample of post-resection pediatric patients. Two major findings emerged. First, most patients exhibited preserved visuoperceptual performance across a wide-range of visual behaviors. Second, normal topography, magnitude, and representational structure of category-selective organization were uncovered in the spared hemisphere. These comprehensive imaging and behavioral investigations uncovered novel evidence concerning the neural representations and visual functions in children who have undergone cortical resection, and have implications for cortical plasticity more generally.

Protracted Developmental Trajectory of Shape Processing along the Two Visual Pathways.

Studies of the emergence of shape representations in childhood have focused primarily on the ventral visual pathway. Importantly, however, there is increasing evidence that, in adults, the dorsal pathway also represents shape-based information. These dorsal representations follow a gradient with more posterior regions being more shape-sensitive than anterior regions and with representational similarity in some posterior regions that is equivalent to that observed in some ventral regions. To explore the emergence and nature of dorsal shape representations in development, we acquired both fMRI BOLD signals and behavioral data in children (aged 8-10 years) using a parametric image scrambling paradigm. Children exhibited adult-like large-scale organization of shape processing along both ventral and dorsal pathways. Also, as in adults, the activation profiles of children's posterior dorsal and ventral regions were correlated with recognition performance, reflecting a possible contribution of these signals to perception. There were age-related changes, however, with children being more affected by the distortion of shape information than adults, both behaviorally and neurally. These findings reveal that shape-processing mechanisms along both dorsal and ventral pathways are subject to a protracted developmental trajectory.