A retinotopic code structures the interaction between perception and memory systems.

Conventional views of brain organization suggest that regions at the top of the cortical hierarchy processes internally oriented information using an abstract amodal neural code. Despite this, recent reports have described the presence of retinotopic coding at the cortical apex, including the default mode network. What is the functional role of retinotopic coding atop the cortical hierarchy? Here we report that retinotopic coding structures interactions between internally oriented (mnemonic) and externally oriented (perceptual) brain areas. Using functional magnetic resonance imaging, we observed robust inverted (negative) retinotopic coding in category-selective memory areas at the cortical apex, which is functionally linked to the classic (positive) retinotopic coding in category-selective perceptual areas in high-level visual cortex. These functionally linked retinotopic populations in mnemonic and perceptual areas exhibit spatially specific opponent responses during both bottom-up perception and top-down recall, suggesting that these areas are interlocked in a mutually inhibitory dynamic. These results show that retinotopic coding structures interactions between perceptual and mnemonic neural systems, providing a scaffold for their dynamic interaction.

A retinotopic code structures the interaction between perception and memory systems.

Conventional views of brain organization suggest that the cortical apex processes internally-oriented information using an abstract, amodal neural code. Yet, recent reports have described the presence of retinotopic coding at the cortical apex, including the default mode network. What is the functional role of retinotopic coding atop the cortical hierarchy? Here, we report that retinotopic coding structures interactions between internally-oriented (mnemonic) and externally-oriented (perceptual) brain areas. Using fMRI, we observed robust, inverted (negative) retinotopic coding in category-selective memory areas at the cortical apex, which is functionally linked to the classic (positive) retinotopic coding in category-selective perceptual areas in high-level visual cortex. Specifically, these functionally-linked retinotopic populations in mnemonic and perceptual areas exhibit spatially-specific opponent responses during both bottom-up perception and top-down recall, suggesting that these areas are interlocked in a mutually-inhibitory dynamic. Together, these results show that retinotopic coding structures interactions between perceptual and mnemonic neural systems, thereby scaffolding their dynamic interaction.

Motion-selective areas V5/MT and MST appear resistant to deterioration in choroideremia.

Choroideremia (CHM) is an X-linked recessive form of hereditary retinal degeneration, which preserves only small islands of central retinal tissue. Previously, we demonstrated the relationship between central vision and structure and population receptive fields (pRF) using functional magnetic resonance imaging (fMRI) in untreated CHM subjects. Here, we replicate and extend this work, providing a more in-depth analysis of the visual responses in a cohort of CHM subjects who participated in a retinal gene therapy clinical trial. fMRI was conducted in six CHM subjects and six age-matched healthy controls (HC's) while they viewed drifting contrast pattern stimuli monocularly. A single ∼3-minute fMRI run was collected for each eye. Participants also underwent ophthalmic evaluations of visual acuity and static automatic perimetry (SAP). Consistent with our previous report, a single âˆ¼ 3 min fMRI run accurately characterized ophthalmic evaluations of visual function in most CHM subjects. In-depth analyses of the cortical distribution of pRF responses revealed that the motion-selective regions V5/MT and MST appear resistant to progressive retinal degenerations in CHM subjects. This effect was restricted to V5/MT and MST and was not present in either primary visual cortex (V1), motion-selective V3A or regions within the ventral visual pathway. Motion-selective areas V5/MT and MST appear to be resistant to the continuous detrimental impact of CHM. Such resilience appears selective to these areas and may be mediated by independent retina-V5/MT anatomical connections that bypass V1. We did not observe any significant impact of gene therapy.

Evaluating the efficacy of multi-echo ICA denoising on model-based fMRI.

fMRI is an indispensable tool for neuroscience investigation, but this technique is limited by multiple sources of physiological and measurement noise. These noise sources are particularly problematic for analysis techniques that require high signal-to-noise ratio for stable model fitting, such as voxel-wise modeling. Multi-echo data acquisition in combination with echo-time dependent ICA denoising (ME-ICA) represents one promising strategy to mitigate physiological and hardware-related noise sources as well as motion-related artifacts. However, most studies employing ME-ICA to date are resting-state fMRI studies, and therefore we have a limited understanding of the impact of ME-ICA on complex task or model-based fMRI paradigms. Here, we addressed this knowledge gap by comparing data quality and model fitting performance of data acquired during a visual population receptive field (pRF) mapping (N = 13 participants) experiment after applying one of three preprocessing procedures: ME-ICA, optimally combined multi-echo data without ICA-denoising, and typical single echo processing. As expected, multi-echo fMRI improved temporal signal-to-noise compared to single echo fMRI, with ME-ICA amplifying the improvement compared to optimal combination alone. However, unexpectedly, this boost in temporal signal-to-noise did not directly translate to improved model fitting performance: compared to single echo acquisition, model fitting was only improved after ICA-denoising. Specifically, compared to single echo acquisition, ME-ICA resulted in improved variance explained by our pRF model throughout the visual system, including anterior regions of the temporal and parietal lobes where SNR is typically low, while optimal combination without ICA did not. ME-ICA also improved reliability of parameter estimates compared to single echo and optimally combined multi-echo data without ICA-denoising. Collectively, these results suggest that ME-ICA is effective for denoising task-based fMRI data for modeling analyzes and maintains the integrity of the original data. Therefore, ME-ICA may be beneficial for complex fMRI experiments, including voxel-wise modeling and naturalistic paradigms.

In a case of longstanding low vision regions of visual cortex that respond to tactile stimulation of the finger with Braille characters are not causally involved in the discrimination of those same Braille characters.

Braille reading and other tactile discrimination tasks recruit the visual cortex of both blind and normally sighted individuals undergoing short-term visual deprivation. Prior functional magnetic resonance imaging (fMRI) work in patient 'S', a visually impaired adult with the rare ability to read both highly magnified print visually and Braille by touch, found that foveal representations of S's visual cortex were recruited during tactile perception, whereas peripheral regions were recruited during visual perception. Here, we test the causal nature of tactile responses in the visual cortex of S by combining tactile and visual psychophysics with repetitive transcranial magnetic stimulation. First, we replicate the previous fMRI findings in S. Second, we demonstrate that transient disruption of S's foveal visual cortex has no measurable impact on S's tactile processing performance compared to that of healthy controls - a pattern not predicted by the fMRI results. Third, stimulation of foveal visual cortex maximally disrupted visual processing performance in both S and controls, suggesting the possibility of preserved visual processing within S's foveal representation. Finally, stimulation of somatosensory cortex induced the expected disruption to tactile processing performance in both S and controls. These data suggest that tactile responses in S's foveal representation reflect unmasking of latent connections between visual and somatosensory cortices and not behaviourally relevant cross-modal plasticity. Unlike studies in congenitally blind individuals, it is possible that the absence of complete visual loss in S has limited the degree of causally impactful cross-modal reorganisation.

Direct comparison of contralateral bias and face/scene selectivity in human occipitotemporal cortex.

Human visual cortex is organised broadly according to two major principles: retinotopy (the spatial mapping of the retina in cortex) and category-selectivity (preferential responses to specific categories of stimuli). Historically, these principles were considered anatomically separate, with retinotopy restricted to the occipital cortex and category-selectivity emerging in the lateral-occipital and ventral-temporal cortex. However, recent studies show that category-selective regions exhibit systematic retinotopic biases, for example exhibiting stronger activation for stimuli presented in the contra- compared to the ipsilateral visual field. It is unclear, however, whether responses within category-selective regions are more strongly driven by retinotopic location or by category preference, and if there are systematic differences between category-selective regions in the relative strengths of these preferences. Here, we directly compare contralateral and category preferences by measuring fMRI responses to scene and face stimuli presented in the left or right visual field and computing two bias indices: a contralateral bias (response to the contralateral minus ipsilateral visual field) and a face/scene bias (preferred response to scenes compared to faces, or vice versa). We compare these biases within and between scene- and face-selective regions and across the lateral and ventral surfaces of the visual cortex more broadly. We find an interaction between surface and bias: lateral surface regions show a stronger contralateral than face/scene bias, whilst ventral surface regions show the opposite. These effects are robust across and within subjects, and appear to reflect large-scale, smoothly varying gradients. Together, these findings support distinct functional roles for the lateral and ventral visual cortex in terms of the relative importance of the spatial location of stimuli during visual information processing.

Visuospatial coding as ubiquitous scaffolding for human cognition.

For more than 100 years we have known that the visual field is mapped onto the surface of visual cortex, imposing an inherently spatial reference frame on visual information processing. Recent studies highlight visuospatial coding not only throughout visual cortex, but also brain areas not typically considered visual. Such widespread access to visuospatial coding raises important questions about its role in wider cognitive functioning. Here, we synthesise these recent developments and propose that visuospatial coding scaffolds human cognition by providing a reference frame through which neural computations interface with environmental statistics and task demands via perception-action loops.

Did you see it? A Python tool for psychophysical assessment of the human blind spot.

The blind spot is a region in the temporal monocular visual field in humans, which corresponds to a physiological scotoma within the nasal hemi-retina. This region has no photoreceptors, so is insensitive to visual stimulation. There is no corresponding perceptual scotoma because the visual stimulation is "filled-in" by the visual system. Investigations of visual perception in and around the blind spot allow us to investigate this filling-in process. However, because the location and size of the blind spot are individually variable, experimenters must first map the blind spot in every observer. We present an open-source tool, which runs in Psychopy software, to estimate the location and size of the blind spot psychophysically. The tool will ideally be used with an Eyelink eye-tracker (SR Research), but it can also run in standalone mode. Here, we explain the rationale for the tool and demonstrate its validity in normally-sighted observers. We develop a detailed map of the blind spot in one observer. Then, in a group of 12 observers, we propose a more efficient, pragmatic method to define a "safe zone" within the blind spot, for which the experimenter can be fully confident that visual stimuli will not be seen. Links are provided to this open-source tool and a user manual.

Multiple adjoining word- and face-selective regions in ventral temporal cortex exhibit distinct dynamics.

The map of category-selectivity in human ventral temporal cortex (VTC) provides organizational constraints to models of object recognition. One important principle is lateral-medial response biases to stimuli that are typically viewed in the center or periphery of the visual field. However, little is known about the relative temporal dynamics and location of regions that respond preferentially to stimulus classes that are centrally viewed, like the face- and word-processing networks. Here, word- and face-selective regions within VTC were mapped using intracranial recordings from 36 patients. Partially overlapping, but also anatomically dissociable patches of face- and word-selectivity were found in VTC. In addition to canonical word-selective regions along the left posterior occipitotemporal sulcus, selectivity was also located medial and anterior to face-selective regions on the fusiform gyrus at the group level and within individual male and female subjects. These regions were replicated using 7 Tesla fMRI in healthy subjects. Left hemisphere word-selective regions preceded right hemisphere responses by 125 ms, potentially reflecting the left hemisphere bias for language; with no hemispheric difference in face-selective response latency. Word-selective regions along the posterior fusiform responded first, then spread medially and laterally, then anteriorally. Face-selective responses were first seen in posterior fusiform regions bilaterally, then proceeded anteriorally from there. For both words and faces, the relative delay between regions was longer than would be predicted by purely feedforward models of visual processing. The distinct time-courses of responses across these regions, and between hemispheres, suggest a complex and dynamic functional circuit supports face and word perception.SIGNIFICANCE STATEMENT:Representations of visual objects in the human brain have been shown to be organized by several principles, including whether those objects tend to be viewed centrally or peripherally in the visual field. However, it remains unclear how regions that process objects that are viewed centrally, like words and faces, are organized relative to one another. Here, invasive and non-invasive neuroimaging suggests there is a mosaic of regions in ventral temporal cortex that respond selectively to either words or faces. These regions display differences in the strength and timing of their responses, both within and between brain hemispheres, suggesting they play different roles in perception. These results illuminate extended, bilateral, and dynamic brain pathways that support face perception and reading.

A network linking scene perception and spatial memory systems in posterior cerebral cortex.

The neural systems supporting scene-perception and spatial-memory systems of the human brain are well-described. But how do these neural systems interact? Here, using fine-grained individual-subject fMRI, we report three cortical areas of the human brain, each lying immediately anterior to a region of the scene perception network in posterior cerebral cortex, that selectively activate when recalling familiar real-world locations. Despite their close proximity to the scene-perception areas, network analyses show that these regions constitute a distinct functional network that interfaces with spatial memory systems during naturalistic scene understanding. These "place-memory areas" offer a new framework for understanding how the brain implements memory-guided visual behaviors, including navigation.

Theta-burst TMS of lateral occipital cortex reduces BOLD responses across category-selective areas in ventral temporal cortex.

Human visual cortex contains three scene-selective regions in the lateral, medial and ventral cortex, termed the occipital place area (OPA), medial place area (MPA) and parahippocampal place area (PPA). Using functional magnetic resonance imaging (fMRI), all three regions respond more strongly when viewing visual scenes compared with isolated objects or faces. To determine how these regions are functionally and causally connected, we applied transcranial magnetic stimulation to OPA and measured fMRI responses before and after stimulation, using a theta-burst paradigm (TBS). To test for stimulus category-selectivity, we presented a range of visual categories (scenes, buildings, objects, faces). To test for specificity of any effects to TBS of OPA we employed two control conditions: Sham, with no TBS stimulation, and an active TBS-control with TBS to a proximal face-selective cortical region (occipital face area, or OFA). We predicted that TBS to OPA (but not OFA) would lead to decreased responses to scenes and buildings (but not other categories) in other scene-selective cortical regions. Across both ROI and whole-volume analyses, we observed decreased responses to scenes in PPA as a result of TBS. However, these effects were neither category specific, with decreased responses to all stimulus categories, nor limited to scene-selective regions, with decreases also observed in face-selective fusiform face area (FFA). Furthermore, similar effects were observed with TBS to OFA, thus effects were not specific to the stimulation site in the lateral occipital cortex. Whilst these data are suggestive of a causal, but non-specific relationship between lateral occipital and ventral temporal cortex, we discuss several factors that could have underpinned this result, such as the differences between TBS and online TMS, the role of anatomical distance between stimulated regions and how TMS effects are operationalised. Furthermore, our findings highlight the importance of active control conditions in brain stimulation experiments to accurately assess functional and causal connectivity between specific brain regions.

Representation of Contralateral Visual Space in the Human Hippocampus.

The initial encoding of visual information primarily from the contralateral visual field is a fundamental organizing principle of the primate visual system. Recently, the presence of such retinotopic sensitivity has been shown to extend well beyond early visual cortex to regions not historically considered retinotopically sensitive. In particular, human scene-selective regions in parahippocampal and medial parietal cortex exhibit prominent biases for the contralateral visual field. Here, we used fMRI to test the hypothesis that the human hippocampus, which is thought to be anatomically connected with these scene-selective regions, would also exhibit a biased representation of contralateral visual space. First, population receptive field (pRF) mapping with scene stimuli revealed strong biases for the contralateral visual field in bilateral hippocampus. Second, the distribution of retinotopic sensitivity suggested a more prominent representation in anterior medial portions of the hippocampus. Finally, the contralateral bias was confirmed in independent data taken from the Human Connectome Project (HCP) initiative. The presence of contralateral biases in the hippocampus, a structure considered by many as the apex of the visual hierarchy, highlights the truly pervasive influence of retinotopy. Moreover, this finding has important implications for understanding how visual information relates to the allocentric global spatial representations known to be encoded therein.SIGNIFICANCE STATEMENT Retinotopic encoding of visual information is an organizing principle of visual cortex. Recent work demonstrates this sensitivity in structures far beyond early visual cortex, including those anatomically connected to the hippocampus. Here, using population receptive field (pRF) modeling in two independent sets of data we demonstrate a consistent bias for the contralateral visual field in bilateral hippocampus. Such a bias highlights the truly pervasive influence of retinotopy, with important implications for understanding how the presence of retinotopy relates to more allocentric spatial representations.

Distinct subdivisions of human medial parietal cortex support recollection of people and places.

Human medial parietal cortex (MPC) is implicated in multiple cognitive processes including memory recall, visual scene processing and navigation, and is a core component of the default mode network. Here, we demonstrate distinct subdivisions of MPC that are selectively recruited during memory recall of either specific people or places. First, distinct regions of MPC exhibited differential functional connectivity with medial and lateral regions of ventral temporal cortex (VTC). Second, these same medial regions showed selective, but negative, responses to the visual presentation of different stimulus categories, with clear preferences for scenes and faces. Finally, and most critically, these regions were differentially recruited during memory recall of either people or places with a strong familiarity advantage. Taken together, these data suggest that the organizing principle defining the medial-lateral axis of VTC is reflected in MPC, but in the context of memory recall.

An enhanced role for right hV5/MT+ in the analysis of motion in the contra- and ipsi-lateral visual hemi-fields.

Previous experiments have demonstrated that transcranial magnetic stimulation (TMS) of human V5/MT+, in either the left or right cerebral hemisphere, can induce deficits in visual motion perception in their respective contra- and ipsi-lateral visual hemi-fields. However, motion deficits in the ipsi-lateral hemi-field are greater when TMS is applied to V5/MT + in the right hemisphere relative to the left hemisphere. One possible explanation for this asymmetry might lie in differential stimulation of sub-divisions within V5/MT + across the two hemispheres. V5/MT + has two major sub-divisions; MT/TO-1 and MST/TO-2, the latter area contains neurons with large receptive fields (RFs) that extend up to 15° further into the ipsi-lateral hemi-field than the former. We wanted to examine whether applying TMS to MT/TO-1 and MST/TO-2 separately could explain the previously reported functional asymmetries for ipsi-lateral motion processing in V5/MT + across right and left cerebral hemispheres. MT/TO-1 and MST/TO-2 were identified in seven subjects using fMRI localisers. In psychophysical experiments subjects identified the translational direction (up/down) of coherently moving dots presented in either the left or right visual field whilst repetitive TMS (25 Hz; 70%) was applied synchronously with stimulus presentation. Application of TMS to MT/TO-1 and MST/TO-2 in the right hemisphere affected translational direction discrimination in both contra-lateral and ipsi-lateral visual fields. In contrast, deficits of motion perception following application of TMS to MT/TO-1 and MST/TO-2 in the left hemisphere were restricted to the contra-lateral visual field. This result suggests an enhanced role for the right hemisphere in processing translational motion across the full visual field.

Differential impact of reward and punishment on functional connectivity after skill learning.

Reward and punishment shape behavior, but the mechanisms underlying their effect on skill learning are not well understood. Here, we tested whether the functional connectivity of premotor cortex (PMC), a region known to be critical for learning of sequencing skills, is altered after training when reward or punishment is given during training. Resting-state fMRI was collected in two experiments before and after participants trained on either a serial reaction time task (SRTT; n = 36) or force-tracking task (FTT; n = 36) with reward, punishment, or control feedback. In each experiment, training-related change in PMC functional connectivity was compared across feedback groups. In both tasks, we found that reward and punishment differentially affected PMC functional connectivity. On the SRTT, participants trained with reward showed an increase in functional connectivity between PMC and cerebellum as well as PMC and striatum, while participants trained with punishment showed an increase in functional connectivity between PMC and medial temporal lobe connectivity. After training on the FTT, subjects trained with control and reward showed increases in PMC connectivity with parietal and temporal cortices after training, while subjects trained with punishment showed increased PMC connectivity with ventral striatum. While the results from the two experiments overlapped in some areas, including ventral pallidum, temporal lobe, and cerebellum, these regions showed diverging patterns of results across the two tasks for the different feedback conditions. These findings suggest that reward and punishment strongly influence spontaneous brain activity after training, and that the regions implicated depend on the task learned.

A Posterior-Anterior Distinction between Scene Perception and Scene Construction in Human Medial Parietal Cortex.

Human retrosplenial complex (RSC), located in medial parietal cortex, has been implicated in numerous cognitive functions, including scene perception, spatial navigation, and autobiographical memory retrieval. Recently, a posterior-anterior distinction within RSC was proposed, such that posterior aspects process scene-related visual information (constituting a medial place area [MPA]), whereas anterior aspects process information that is vividly retrieved from memory, thereby supporting remembering and potentially navigation. Here, we tested this proposed distinction in a single group of participants (both male and female) using fMRI with both perceptual and mnemonic tasks. After completing a resting-state scan, participants performed a task that required constructing scenes from memory and completed a scene selectivity localizer task. We tested directly perceptual and mnemonic responses in MPA and an anterior, connectivity-defined region (CON), which showed strong functional connectivity with anterior parahippocampal place area. A double dissociation was observed, such that CON was more strongly activated during scene construction than was MPA, whereas MPA was more perceptually responsive than CON. Further, peak responses from the scene construction task were anterior to perceptual peaks in all but 1 participant and hemisphere. Finally, through analyses of the posterior-anterior response profiles, we identify the fundus of the parieto-occipital sulcus as a potential location for the crossover from perceptual to mnemonic representations and highlight a potential left-hemisphere advantage for mnemonic representations. Collectively, our results support a distinction between posterior and anterior aspects of the RSC, suggesting that more specific functional-anatomic terms should be used in its place in future work.SIGNIFICANCE STATEMENT The retrosplenial complex (RSC) has been implicated in vision, spatial cognition, and memory. We previously speculated on a potential posterior-anterior distinction within RSC for scene perception and memory-based scene construction/navigation. Here, we tested this distinction through a combination of resting-state, perceptual, and mnemonic task data. Consistent with our predictions, we demonstrate that perceptual responses peak consistently posterior of those elicited by memory-based scene construction within the broader RSC. Further, we highlight (1) the fundus of the parieto-occipital sulcus as a landmark for the transition between these representations, (2) the anterior bank of parieto-occipital sulcus as the point of maximal separation between these representations, and (3) identify a potential hemispheric asymmetry in mnemonic representations. These data support functional dissociations within RSC.

Comparing Clinical Perimetry and Population Receptive Field Measures in Patients with Choroideremia.

Purpose: Choroideremia (CHM) is an X-linked recessive form of hereditary retinal degeneration, which, at advanced stages, leaves only small central islands of preserved retinal tissue. Unlike many other retinal diseases, the spared tissue in CHM supports excellent central vision and stable fixation. Such spared topography in CHM presents an ideal platform to explore the relationship between preserved central retinal structure and the retinotopic organization of visual cortex by using functional magnetic resonance imaging (fMRI). Methods: fMRI was conducted in four participants with CHM and four healthy control participants while they viewed drifting contrast pattern stimuli monocularly. A single ∼3-minute fMRI run was collected for each eye separately. fMRI data were analyzed using the population receptive field (pRF) modeling approach. Participants also underwent ophthalmic evaluations of visual acuity and static automatic perimetry. Results: The spatial distribution and strength of pRF estimates correlated positively and significantly with clinical outcome measures in most participants with CHM. Importantly, the positive relationship between clinical and pRF measurements increased with increasing disease progression. A less consistent relationship was observed for control participants. Conclusions: Although reflecting only a small sample size, clinical evaluations of visual function in participants with CHM were well characterized by the spatial distribution and strength of pRF estimates by using a single ∼3-minute fMRI experiment. fMRI data analyzed with pRF modeling may be an efficient and objective outcome measure to complement current ophthalmic evaluations. Specifically, pRF modeling may be a feasible approach for evaluating the impact of interventions to restore visual function.

Transcranial Magnetic Stimulation to the Occipital Place Area Biases Gaze During Scene Viewing.

We can understand viewed scenes and extract task-relevant information within a few hundred milliseconds. This process is generally supported by three cortical regions that show selectivity for scene images: parahippocampal place area (PPA), medial place area (MPA) and occipital place area (OPA). Prior studies have focused on the visual information each region is responsive to, usually within the context of recognition or navigation. Here, we move beyond these tasks to investigate gaze allocation during scene viewing. Eye movements rely on a scene's visual representation to direct saccades, and thus foveal vision. In particular, we focus on the contribution of OPA, which is: (i) located in occipito-parietal cortex, likely feeding information into parts of the dorsal pathway critical for eye movements; and (ii) contains strong retinotopic representations of the contralateral visual field. Participants viewed scene images for 1034 ms while their eye movements were recorded. On half of the trials, a 500 ms train of five transcranial magnetic stimulation (TMS) pulses was applied to the participant's cortex, starting at scene onset. TMS was applied to the right hemisphere over either OPA or the occipital face area (OFA), which also exhibits a contralateral visual field bias but shows selectivity for face stimuli. Participants generally made an overall left-to-right, top-to-bottom pattern of eye movements across all conditions. When TMS was applied to OPA, there was an increased saccade latency for eye movements toward the contralateral relative to the ipsilateral visual field after the final TMS pulse (400 ms). Additionally, TMS to the OPA biased fixation positions away from the contralateral side of the scene compared to the control condition, while the OFA group showed no such effect. There was no effect on horizontal saccade amplitudes. These combined results suggest that OPA might serve to represent local scene information that can then be utilized by visuomotor control networks to guide gaze allocation in natural scenes.