Neural and behavioral signatures of the multidimensionality of manipulable object processing.

Understanding how we recognize objects requires unravelling the variables that govern the way we think about objects and the neural organization of object representations. A tenable hypothesis is that the organization of object knowledge follows key object-related dimensions. Here, we explored, behaviorally and neurally, the multidimensionality of object processing. We focused on within-domain object information as a proxy for the decisions we typically engage in our daily lives - e.g., identifying a hammer in the context of other tools. We extracted object-related dimensions from subjective human judgments on a set of manipulable objects. We show that the extracted dimensions are cognitively interpretable and relevant - i.e., participants are able to consistently label them, and these dimensions can guide object categorization; and are important for the neural organization of knowledge - i.e., they predict neural signals elicited by manipulable objects. This shows that multidimensionality is a hallmark of the organization of manipulable object knowledge.

Peri-Saccadic Orientation Identification Performance and Visual Neural Sensitivity Are Higher in the Upper Visual Field.

Visual neural processing is distributed among a multitude of sensory and sensory-motor brain areas exhibiting varying degrees of functional specializations and spatial representational anisotropies. Such diversity raises the question of how perceptual performance is determined, at any one moment in time, during natural active visual behavior. Here, exploiting a known dichotomy between the primary visual cortex (V1) and superior colliculus (SC) in representing either the upper or lower visual fields, we asked whether peri-saccadic orientation identification performance is dominated by one or the other spatial anisotropy. Humans (48 participants, 29 females) reported the orientation of peri-saccadic upper visual field stimuli significantly better than lower visual field stimuli, unlike their performance during steady-state gaze fixation, and contrary to expected perceptual superiority in the lower visual field in the absence of saccades. Consistent with this, peri-saccadic superior colliculus visual neural responses in two male rhesus macaque monkeys were also significantly stronger in the upper visual field than in the lower visual field. Thus, peri-saccadic orientation identification performance is more in line with oculomotor, rather than visual, map spatial anisotropies.SIGNIFICANCE STATEMENT Different brain areas respond to visual stimulation, but they differ in the degrees of functional specializations and spatial anisotropies that they exhibit. For example, the superior colliculus (SC) both responds to visual stimulation, like the primary visual cortex (V1), and controls oculomotor behavior. Compared with the primary visual cortex, the superior colliculus exhibits an opposite pattern of upper/lower visual field anisotropy, being more sensitive to the upper visual field. Here, we show that human peri-saccadic orientation identification performance is better in the upper compared with the lower visual field. Consistent with this, monkey superior colliculus visual neural responses to peri-saccadic stimuli follow a similar pattern. Our results indicate that peri-saccadic perceptual performance reflects oculomotor, rather than visual, map spatial anisotropies.

Bilateral increase in MEG planar gradients prior to saccade onset.

Every time we move our eyes, the retinal locations of objects change. To distinguish the changes caused by eye movements from actual external motion of the objects, the visual system is thought to anticipate the consequences of eye movements (saccades). Single neuron recordings have indeed demonstrated changes in receptive fields before saccade onset. Although some EEG studies with human participants have also demonstrated a pre-saccadic increased potential over the hemisphere that will process a stimulus after a saccade, results have been mixed. Here, we used magnetoencephalography to investigate the timing and lateralization of visually evoked planar gradients before saccade onset. We modelled the gradients from trials with both a saccade and a stimulus as the linear combination of the gradients from two conditions with either only a saccade or only a stimulus. We reasoned that any residual gradients in the condition with both a saccade and a stimulus must be uniquely linked to visually-evoked neural activity before a saccade. We observed a widespread increase in residual planar gradients. Interestingly, this increase was bilateral, showing activity both contralateral and ipsilateral to the stimulus, i.e. over the hemisphere that would process the stimulus after saccade offset. This pattern of results is consistent with predictive pre-saccadic changes involving both the current and the future receptive fields involved in processing an attended object, well before the start of the eye movement. The active, sensorimotor coupling of vision and the oculomotor system may underlie the seamless subjective experience of stable and continuous perception.

The 3D Structural Architecture of the Human Hand Area Is Nontopographic.

The functional topography of the human primary somatosensory cortex hand area is a widely studied model system to understand sensory organization and plasticity. It is so far unclear whether the underlying 3D structural architecture also shows a topographic organization. We used 7 Tesla (7T) magnetic resonance imaging (MRI) data to quantify layer-specific myelin, iron, and mineralization in relation to population receptive field maps of individual finger representations in Brodman area 3b (BA 3b) of human S1 in female and male younger adults. This 3D description allowed us to identify a characteristic profile of layer-specific myelin and iron deposition in the BA 3b hand area, but revealed an absence of structural differences, an absence of low-myelin borders, and high similarity of 3D microstructure profiles between individual fingers. However, structural differences and borders were detected between the hand and face areas. We conclude that the 3D structural architecture of the human hand area is nontopographic, unlike in some monkey species, which suggests a high degree of flexibility for functional finger organization and a new perspective on human topographic plasticity.SIGNIFICANCE STATEMENT Using ultra-high-field MRI, we provide the first comprehensive in vivo description of the 3D structural architecture of the human BA 3b hand area in relation to functional population receptive field maps. High similarity of precise finger-specific 3D profiles, together with an absence of structural differences and an absence of low-myelin borders between individual fingers, reveals the 3D structural architecture of the human hand area to be nontopographic. This suggests reduced structural limitations to cortical plasticity and reorganization and allows for shared representational features across fingers.

Mechanisms of speed encoding in the human middle temporal cortex measured by 7T fMRI.

Perception of dynamic scenes in our environment results from the evaluation of visual features such as the fundamental spatial and temporal frequency components of a moving object. The ratio between these two components represents the object's speed of motion. The human middle temporal cortex hMT+ has a crucial biological role in the direct encoding of object speed. However, the link between hMT+ speed encoding and the spatiotemporal frequency components of a moving object is still under explored. Here, we recorded high resolution 7T blood oxygen level-dependent BOLD responses to different visual motion stimuli as a function of their fundamental spatial and temporal frequency components. We fitted each hMT+ BOLD response with a 2D Gaussian model allowing for two different speed encoding mechanisms: (1) distinct and independent selectivity for the spatial and temporal frequencies of the visual motion stimuli; (2) pure tuning for the speed of motion. We show that both mechanisms occur but in different neuronal groups within hMT+, with the largest subregion of the complex showing separable tuning for the spatial and temporal frequency of the visual stimuli. Both mechanisms were highly reproducible within participants, reconciling single cell recordings from MT in animals that have showed both encoding mechanisms. Our findings confirm that a more complex process is involved in the perception of speed than initially thought and suggest that hMT+ plays a primary role in the evaluation of the spatial features of the moving visual input.

Investigating temporal and prosodic markers in clinical high-risk for psychosis participants using automated acoustic analysis.

AIM: Language disturbances are a candidate biomarker for the early detection of psychosis. Temporal and prosodic abnormalities have been observed in schizophrenia patients, while there is conflicting evidence whether such deficits are present in participants meeting clinical high-risk for psychosis (CHR-P) criteria. METHODS: Clinical interviews from CHR-P participants (n = 50) were examined for temporal and prosodic metrics and compared against a group of healthy controls (n = 17) and participants with affective disorders and substance abuse (n = 23). RESULTS: There were no deficits in acoustic variables in the CHR-P group, while participants with affective disorders/substance abuse were characterized by slower speech rate, longer pauses and higher unvoiced frames percentage. CONCLUSION: Our finding suggests that temporal and prosodic aspects of speech are not impaired in early-stage psychosis. Further studies are required to clarify whether such abnormalities are present in sub-groups of CHR-P participants with elevated psychosis-risk.

Topographic organization of eye-position dependent gain fields in human visual cortex.

The ability to move has introduced animals with the problem of sensory ambiguity: the position of an external stimulus could change over time because the stimulus moved, or because the animal moved its receptors. This ambiguity can be resolved with a change in neural response gain as a function of receptor orientation. Here, we developed an encoding model to capture gain modulation of visual responses in high field (7 T) fMRI data. We characterized population eye-position dependent gain fields (pEGF). The information contained in the pEGFs allowed us to reconstruct eye positions over time across the visual hierarchy. We discovered a systematic distribution of pEGF centers: pEGF centers shift from contra- to ipsilateral following pRF eccentricity. Such a topographical organization suggests that signals beyond pure retinotopy are accessible early in the visual hierarchy, providing the potential to solve sensory ambiguity and optimize sensory processing information for functionally relevant behavior.

Stopping in (e)motion: Reactive action inhibition when facing valence-independent emotional stimuli.

Emotions are able to impact our ability to control our behaviors. However, it is not clear whether emotions play a detrimental or an advantageous effect on action control and whether the valence of the emotional stimuli differently affects such motor abilities. One way to measure reactive inhibitory control is the stop-signal task (SST), which estimates the ability to cancel outright a response to the presentation of a stop signal by means of the stop signal reaction times (SSRT). Impaired as well as facilitated action control has been found when faced with emotional stimuli such as stop signals in SSTs and mixed results were observed for positive versus negative stimuli. Here, we aimed to investigate these unresolved issues more deeply. Action control capabilities were tested in 60 participants by means of a SST, in which the stop signals were represented by a fearful and a happy body posture together with their neutral counterpart. Results showed that both positive and negative body postures enhanced the ability to suppress an ongoing action compared to neutral body postures. These results demonstrate that emotional valence-independent emotional stimuli facilitate action control and suggest that emotional stimuli may trigger increased sensory representation and/or attentional processing that may have promote stop-signal processing and hence improved inhibitory performance.

Intracranial recordings show evidence of numerosity tuning in human parietal cortex.

Numerosity is the set size of a group of items. Numerosity perception is a trait shared across numerous species. Numerosity-selective neural populations are thought to underlie numerosity perception. These neurons have been identified primarily using electrical recordings in animal models and blood oxygen level dependent (BOLD) functional magnetic resonance imaging (fMRI) in humans. Here we use electrical intracranial recordings to investigate numerosity tuning in humans, focusing on high-frequency transient activations. These recordings combine a high spatial and temporal resolution and can bridge the gap between animal models and human recordings. In line with previous studies, we find numerosity-tuned responses at parietal sites in two out of three participants. Neuronal populations at these locations did not respond to other visual stimuli, i.e. faces, houses, and letters, in contrast to several occipital sites. Our findings further corroborate the specificity of numerosity tuning of in parietal cortex, and further link fMRI results and electrophysiological recordings.

The Influence of Vicarious Fear-Learning in "Infecting" Reactive Action Inhibition.

Since the dawn of cognitive neuroscience, emotions have been recognized to impact on several executive processes, such as action inhibition. However, the complex interplay between emotional stimuli and action control is not yet fully understood. One way to measure inhibitory control is the stop-signal task (SST), which estimates the ability to cancel outright an action to the presentation of a stop signal by means of the stop-signal reaction times (SSRTs). Impaired as well as facilitated action control has been found when faced with intrinsic emotional stimuli as stop signals in SSTs. Here, we aimed at investigating more deeply the power of negative stimuli to influence our action control, testing the hypothesis that a previously neutral stimulus [i.e., the image of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2)], which has been conditioned through vicarious fear learning, has the same impact on reactive action inhibition performance as an intrinsically negative stimulus (i.e., a fearful face or body). Action control capabilities were tested in 90 participants by means of a SST, in which the stop signals were represented by different negative stimuli. Results showed that the SARS-CoV-2 image enhanced the ability to suppress an ongoing action similarly to observing fearful facial expressions or fearful body postures. Interestingly, we found that this effect was predicted by impulsivity traits: for example, the less self-control the participants had, the less they showed emotional facilitation for inhibitory performance. These results demonstrated that vicarious fear learning has a critical impact on cognitive abilities, making a neutral image as threatening as phylogenetically innate negative stimuli and able to impact on our behavioral control.

Hippocampal structural alterations in early-stage psychosis: Specificity and relationship to clinical outcomes.

Hippocampal dysfunctions are a core feature of schizophrenia, but conflicting evidence exists whether volumetric and morphological changes are present in early-stage psychosis and to what extent these deficits are related to clinical trajectories. In this study, we recruited individuals at clinical high risk for psychosis (CHR-P) (n = 108), patients with a first episode of psychosis (FEP) (n = 37), healthy controls (HC) (n = 70) as well as a psychiatric control group with substance abuse and affective disorders (CHR-N: n = 38). MRI-data at baseline were obtained and volumetric as well as vertex analyses of the hippocampus were carried out. Moreover, volumetric changes were examined in the amygdala, caudate, nucleus accumbens, pallidum, putamen and thalamus. In addition, we obtained follow-up functional and symptomatic assessments in CHR-P individuals to examine the question whether anatomical deficits at baseline predicted clinical trajectories. Our results show that the hippocampus is the only structure showing significant volumetric decrease in early-stage psychosis, with FEPs showing significantly smaller hippocampal volumes bilaterally alongside widespread shape changes in the vertex analysis. For the CHR-P group, volumetric decreases were confined to the left hippocampus. However, hippocampal alterations in the CHR-P group were not robustly associated with clinical outcomes, including the persistence of attenuated psychotic symptoms and functional trajectories. Accordingly, our findings highlight that dysfunctions in hippocampal anatomy are an important feature of early-stage psychosis which may, however, not be related to clinical outcomes in CHR-P participants.

The Neurobiological Correlates of Gaze Perception in Healthy Individuals and Neurologic Patients.

The ability to adaptively follow conspecific eye movements is crucial for establishing shared attention and survival. Indeed, in humans, interacting with the gaze direction of others causes the reflexive orienting of attention and the faster object detection of the signaled spatial location. The behavioral evidence of this phenomenon is called gaze-cueing. Although this effect can be conceived as automatic and reflexive, gaze-cueing is often susceptible to context. In fact, gaze-cueing was shown to interact with other factors that characterize facial stimulus, such as the kind of cue that induces attention orienting (i.e., gaze or non-symbolic cues) or the emotional expression conveyed by the gaze cues. Here, we address neuroimaging evidence, investigating the neural bases of gaze-cueing and the perception of gaze direction and how contextual factors interact with the gaze shift of attention. Evidence from neuroimaging, as well as the fields of non-invasive brain stimulation and neurologic patients, highlights the involvement of the amygdala and the superior temporal lobe (especially the superior temporal sulcus (STS)) in gaze perception. However, in this review, we also emphasized the discrepancies of the attempts to characterize the distinct functional roles of the regions in the processing of gaze. Finally, we conclude by presenting the notion of invariant representation and underline its value as a conceptual framework for the future characterization of the perceptual processing of gaze within the STS.

FMRI and intra-cranial electrocorticography recordings in the same human subjects reveals negative BOLD signal coupled with silenced neuronal activity.

Positive blood oxygenation level-dependent (BOLD) responses (PBR), as measured by functional Magnetic Resonance Imaging (fMRI), are the most utilized measurements to non-invasively map activity in the brain. Recent studies have consistently shown that BOLD responses are not exclusively positive. Negative BOLD responses (NBR) have been reported in response to specific sensory stimulations and tasks. However, the exact relationship between NBR and the underlying metabolic and neuronal demand is still under debate. In this study, we investigated the neurophysiological basis of negative BOLD using fMRI and intra-cranial electrophysiology (electrocorticography, ECoG) measurements from the same human participants. We show that, for those electrodes that responded to visual stimulation, PBR are correlated with high-frequency band (HFB) responses. Crucially, NBR were associated with an absence of HFB power responses and an unpredicted decrease in the alpha power responses.

Point-spread function of the BOLD response across columns and cortical depth in human extra-striate cortex.

Columns and layers are fundamental organizational units of the brain. Well known examples of cortical columns are the ocular dominance columns (ODCs) in primary visual cortex and the column-like stripe-based arrangement in the second visual area V2. The spatial scale of columns and layers is beyond the reach of conventional neuroimaging, but the advent of high field magnetic resonance imaging (MRI) scanners (UHF, 7 Tesla and above) has opened the possibility to acquire data at this spatial scale, in-vivo and non-invasively in humans. The most prominent non-invasive technique to measure brain function is blood oxygen level dependent (BOLD) fMRI, measuring brain activity indirectly, via changes in hemodynamics. A key determinant of the ability of high-resolution BOLD fMRI to accurately resolve columns and layers is the point-spread function (PSF) of the BOLD response in relation to the spatial extent of neuronal activity. In this study we take advantage of the stripe-based arrangement present in visual area V2, coupled with sub-millimetre anatomical and gradient-echo BOLD (GE BOLD) acquisition at 7 T to obtain PSF estimates and along cortical depth in human participants. Results show that the BOLD PSF is maximal in the superficial part of the cortex (1.78 mm), and it decreases with increasing cortical depth (0.83 mm close to white matter).

Laminar processing of numerosity supports a canonical cortical microcircuit in human parietal cortex.

As neural signals travel through the visual hierarchy, spatial precision decreases and specificity for stimulus features increases.1-4 A similar hierarchy has been found for laminar processing in V1, where information from the thalamus predominantly targets the central layers, while spatial precision decreases and feature specificity increases toward superficial and deeper layers.5-17 This laminar processing scheme is proposed to represent a canonical cortical microcircuit that is similar across the cortex.11,18-21 Here, we go beyond early visual cortex and investigate whether processing of numerosity (the set size of a group of items) across cortical depth in the parietal association cortex follows this hypothesis. Numerosity processing is implicated in many tasks such as multiple object tracking,22 mathematics,23-25 decision making,26 and dividing attention.27 Neurons in the parietal association cortex are tuned to numerosity, with both a preferred numerosity tuning and tuning width (i.e., specificity).28-30 We quantified preferred numerosity responses across cortical depth in the parietal association cortex with ultra-high field fMRI and population receptive field-based numerosity modeling.1,28,31 We find that numerosity responses sharpen, i.e., become increasingly specific, moving away from the central layers. This suggests that the laminar processing scheme for numerosity processing in the parietal cortex is similar to primary visual cortex, providing support for the canonical cortical microcircuit hypothesis beyond primary visual cortex.

Size constancy affects the perception and parietal neural representation of object size.

Humans and animals rely on accurate object size perception to guide behavior. Object size is judged from visual input, but the relationship between an object's retinal size and its real-world size varies with distance. Humans perceive object sizes to be relatively constant when retinal size changes. Such size constancy compensates for the variable relationship between retinal size and real-world size, using the context of recent retinal sizes of the same object to bias perception towards its likely real-world size. We therefore hypothesized that object size perception may be affected by the range of recently viewed object sizes, attracting perceived object sizes towards recently viewed sizes. We demonstrate two systematic biases: a central tendency attracting perceived size towards the average size across all trials, and a serial dependence attracting perceived size towards the size presented on the previous trial. We recently described topographic object size maps in the human parietal cortex. We therefore hypothesized that neural representations of object size here would be attracted towards recently viewed sizes. We used ultra-high-field (7T) functional MRI and population receptive field modeling to compare object size representations measured with small (0.05-1.4°diameter) and large objects sizes (0.1-2.8°). We found that parietal object size preferences and tuning widths follow this presented range, but change less than presented object sizes. Therefore, perception and neural representation of object size are attracted towards recently viewed sizes. This context-dependent object size representation reveals effects on neural response preferences that may underlie context dependence of object size perception.

Point-spread function of the BOLD response across columns and cortical depth in human extra-striate cortex.

Columns and layers are fundamental organizational units of the brain. Well known examples of cortical columns are the ocular dominance columns (ODCs) in primary visual cortex and the column-like stripe-based arrangement in the second visual area V2. The spatial scale of columns and layers is beyond the reach of conventional neuroimaging, but the advent of high field magnetic resonance imaging (MRI) scanners (UHF, 7 T and above) has opened the possibility to acquire data at this spatial scale, in-vivo and non-invasively in humans. The most prominent non-invasive technique to measure brain function is blood oxygen level dependent (BOLD) fMRI, measuring brain activity indirectly, via changes in hemodynamics. A key determinant of the ability of high-resolution BOLD fMRI to accurately resolve columns and layers is the point-spread function (PSF) of the BOLD response in relation to the spatial extent of neuronal activity. In this study we take advantage of the stripe-based arrangement present in visual area V2, coupled with sub-millimetre anatomical and gradient-echo BOLD (GE BOLD) acquisition at 7 T to obtain PSF estimates and along cortical depth in human participants. Results show that the BOLD PSF is maximal in the superficial part of the cortex (1.78 mm), and it decreases with increasing cortical depth (0.83 mm close to white matter).

Validating Linear Systems Analysis for Laminar fMRI: Temporal Additivity for Stimulus Duration Manipulations.

Advancements in ultra-high field (7 T and higher) magnetic resonance imaging (MRI) scanners have made it possible to investigate both the structure and function of the human brain at a sub-millimeter scale. As neuronal feedforward and feedback information arrives in different layers, sub-millimeter functional MRI has the potential to uncover information processing between cortical micro-circuits across cortical depth, i.e. laminar fMRI. For nearly all conventional fMRI analyses, the main assumption is that the relationship between local neuronal activity and the blood oxygenation level dependent (BOLD) signal adheres to the principles of linear systems theory. For laminar fMRI, however, directional blood pooling across cortical depth stemming from the anatomy of the cortical vasculature, potentially violates these linear system assumptions, thereby complicating analysis and interpretation. Here we assess whether the temporal additivity requirement of linear systems theory holds for laminar fMRI. We measured responses elicited by viewing stimuli presented for different durations and evaluated how well the responses to shorter durations predicted those elicited by longer durations. We find that BOLD response predictions are consistently good predictors for observed responses, across all cortical depths, and in all measured visual field maps (V1, V2, and V3). Our results suggest that the temporal additivity assumption for linear systems theory holds for laminar fMRI. We thus show that the temporal additivity assumption holds across cortical depth for sub-millimeter gradient-echo BOLD fMRI in early visual cortex.

Blind spot and visual field anisotropy detection with flicker pupil perimetry across brightness and task variations.

The pupil can be used as an objective measure for testing sensitivities across the visual field (pupil perimetry; PP). The recently developed gaze-contingent flicker PP (gcFPP) is a promising novel form of PP, with improved sensitivity due to retinotopically stable and repeated flickering stimulations, in a short time span. As a diagnostic tool gcFPP has not yet been benchmarked in healthy individuals. The main aims of the current study were to investigate whether gcFPP has the sensitivity to detect the blind spot, and upper versus lower visual field differences that were found before in previous studies. An additional aim was to test for the effects of attentional requirements and background luminance. A total of thirty individuals were tested with gcFPP across two separate experiments. The results showed that pupil oscillation amplitudes were smaller for stimuli presented inside as compared to outside the blind spot. Amplitudes also decreased as a function of eccentricity (i.e., distance to fixation) and were larger for upper as compared to lower visual fields. We measured the strongest and most sensitive pupil responses to stimuli presented on dark- and mid-gray backgrounds, and when observers covertly focused their attention to the flickering stimulus. GcFPP thus evokes pupil responses that are sensitive enough to detect local, and global differences in pupil sensitivity. The findings further encourage (1) the use of a gray background to prevent straylight without affecting gcFPPs sensitivity and (2) the use of an attention task to enhance pupil sensitivity.

Low-Level Visual Information Is Maintained across Saccades, Allowing for a Postsaccadic Handoff between Visual Areas.

Experience seems continuous and detailed despite saccadic eye movements changing retinal input several times per second. There is debate whether neural signals related to updating across saccades contain information about stimulus features, or only location pointers without visual details. We investigated the time course of low-level visual information processing across saccades by decoding the spatial frequency of a stationary stimulus that changed from one visual hemifield to the other because of a horizontal saccadic eye movement. We recorded magnetoencephalography while human subjects (both sexes) monitored the orientation of a grating stimulus, making spatial frequency task irrelevant. Separate trials, in which subjects maintained fixation, were used to train a classifier, whose performance was then tested on saccade trials. Decoding performance showed that spatial frequency information of the presaccadic stimulus remained present for ∼200 ms after the saccade, transcending retinotopic specificity. Postsaccadic information ramped up rapidly after saccade offset. There was an overlap of over 100 ms during which decoding was significant from both presaccadic and postsaccadic processing areas. This suggests that the apparent richness of perception across saccades may be supported by the continuous availability of low-level information with a "soft handoff" of information during the initial processing sweep of the new fixation.SIGNIFICANCE STATEMENT Saccades create frequent discontinuities in visual input, yet perception appears stable and continuous. How is this discontinuous input processed resulting in visual stability? Previous studies have focused on presaccadic remapping. Here we examined the time course of processing of low-level visual information (spatial frequency) across saccades with magnetoencephalography. The results suggest that spatial frequency information is not predictively remapped but also is not discarded. Instead, they suggest a soft handoff over time between different visual areas, making this information continuously available across the saccade. Information about the presaccadic stimulus remains available, while the information about the postsaccadic stimulus has also become available. The simultaneous availability of both the presaccadic and postsaccadic information could enable rich and continuous perception across saccades.