The perception of auditory motion in sighted and early blind individuals.

Motion perception is a fundamental sensory task that plays a critical evolutionary role. In vision, motion processing is classically described using a motion energy model with spatiotemporally nonseparable filters suited for capturing the smooth continuous changes in spatial position over time afforded by moving objects. However, it is still not clear whether the filters underlying auditory motion discrimination are also continuous motion detectors or infer motion from comparing discrete sound locations over time (spatiotemporally separable). We used a psychophysical reverse correlation paradigm, where participants discriminated the direction of a motion signal in the presence of spatiotemporal noise, to determine whether the filters underlying auditory motion discrimination were spatiotemporally separable or nonseparable. We then examined whether these auditory motion filters were altered as a result of early blindness. We found that both sighted and early blind individuals have separable filters. However, early blind individuals show increased sensitivity to auditory motion, with reduced susceptibility to noise and filters that were more accurate in detecting motion onsets/offsets. Model simulations suggest that this reliance on separable filters is optimal given the limited spatial resolution of auditory input.

Responses in area hMT+ reflect tuning for both auditory frequency and motion after blindness early in life.

Previous studies report that human middle temporal complex (hMT+) is sensitive to auditory motion in early-blind individuals. Here, we show that hMT+ also develops selectivity for auditory frequency after early blindness, and that this selectivity is maintained after sight recovery in adulthood. Frequency selectivity was assessed using both moving band-pass and stationary pure-tone stimuli. As expected, within primary auditory cortex, both moving and stationary stimuli successfully elicited frequency-selective responses, organized in a tonotopic map, for all subjects. In early-blind and sight-recovery subjects, we saw evidence for frequency selectivity within hMT+ for the auditory stimulus that contained motion. We did not find frequency-tuned responses within hMT+ when using the stationary stimulus in either early-blind or sight-recovery subjects. We saw no evidence for auditory frequency selectivity in hMT+ in sighted subjects using either stimulus. Thus, after early blindness, hMT+ can exhibit selectivity for auditory frequency. Remarkably, this auditory frequency tuning persists in two adult sight-recovery subjects, showing that, in these subjects, auditory frequency-tuned responses can coexist with visually driven responses in hMT+.

Learning to see again: Perceptual learning of simulated abnormal on- off-cell population responses in sighted individuals.

Many forms of artificial sight recovery, such as electronic implants and optogenetic proteins, generally cause simultaneous, rather than complementary firing of on- and off-center retinal cells. Here, using virtual patients-sighted individuals viewing distorted input-we examine whether plasticity might compensate for abnormal neuronal population responses. Five participants were dichoptically presented with a combination of original and contrast-reversed images. Each image (I) and its contrast-reverse (I') was filtered using a radial checkerboard (F) in Fourier space and its inverse (F'). [I * F'] + [I' * F] was presented to one eye, and [I * F] + [I' * F'] was presented to the other, such that regions of the image that produced on-center responses in one eye produced off-center responses in the other eye, and vice versa. Participants continuously improved in a naturalistic object discrimination task over 20 one-hour sessions. Pre-training and post-training tests suggest that performance improvements were due to two learning processes: learning to recognize objects with reduced visual information and learning to suppress contrast-reversed image information in a non-eye-selective manner. These results suggest that, with training, it may be possible to adapt to the unnatural on- and off-cell population responses produced by electronic and optogenetic sight recovery technologies.

Early Blindness Shapes Cortical Representations of Auditory Frequency within Auditory Cortex.

Early loss of vision is classically linked to large-scale cross-modal plasticity within occipital cortex. Much less is known about the effects of early blindness on auditory cortex. Here, we examine the effects of early blindness on the cortical representation of auditory frequency within human primary and secondary auditory areas using fMRI. We observe that 4 individuals with early blindness (2 females), and a group of 5 individuals with anophthalmia (1 female), a condition in which both eyes fail to develop, have lower response amplitudes and narrower voxelwise tuning bandwidths compared with a group of typically sighted individuals. These results provide some of the first evidence in human participants for compensatory plasticity within nondeprived sensory areas as a result of sensory loss.SIGNIFICANCE STATEMENT Early blindness has been linked to enhanced perception of the auditory world, including auditory localization and pitch perception. Here we used fMRI to compare neural responses with auditory stimuli within auditory cortex across sighted, early blind, and anophthalmic individuals, in whom both eyes fail to develop. We find more refined frequency tuning in blind subjects, providing some of the first evidence in human subjects for compensation within nondeprived primary sensory areas as a result of blindness early in life.

The Effect of Onset Age of Visual Deprivation on Visual Cortex Surface Area Across-Species.

Blindness early in life induces permanent alterations in brain anatomy, including reduced surface area of primary visual cortex (V1). Bilateral enucleation early in development causes greater reductions in primary visual cortex surface area than at later times. However, the time at which cortical surface area expansion is no longer sensitive to enucleation is not clearly established, despite being an important milestone for cortical development. Using histological and MRI techniques, we investigated how reductions in the surface area of V1 depends on the timing of blindness onset in rats, ferrets and humans. To compare data across species, we translated ages of all species to a common neuro-developmental event-time (ET) scale. Consistently, blindness during early cortical expansion induced large (~40%) reductions in V1 surface area, in rats and ferrets, while blindness occurring later had diminishing effects. Longitudinal measurements on ferrets confirmed that early enucleation disrupted cortical expansion, rather than inducing enhanced pruning. We modeled the ET associated with the conclusion of the effect of blindness on surface area at maturity (ETc), relative to the normal conclusion of visual cortex surface area expansion, (ETdev). A final analysis combining our data with extant published data confirmed that ETc occurred well before ETdev.

The visual white matter: The application of diffusion MRI and fiber tractography to vision science.

Visual neuroscience has traditionally focused much of its attention on understanding the response properties of single neurons or neuronal ensembles. The visual white matter and the long-range neuronal connections it supports are fundamental in establishing such neuronal response properties and visual function. This review article provides an introduction to measurements and methods to study the human visual white matter using diffusion MRI. These methods allow us to measure the microstructural and macrostructural properties of the white matter in living human individuals; they allow us to trace long-range connections between neurons in different parts of the visual system and to measure the biophysical properties of these connections. We also review a range of findings from recent studies on connections between different visual field maps, the effects of visual impairment on the white matter, and the properties underlying networks that process visual information supporting visual face recognition. Finally, we discuss a few promising directions for future studies. These include new methods for analysis of MRI data, open datasets that are becoming available to study brain connectivity and white matter properties, and open source software for the analysis of these data.

Resting-State Retinotopic Organization in the Absence of Retinal Input and Visual Experience.

Early visual areas have neuronal receptive fields that form a sampling mosaic of visual space, resulting in a series of retinotopic maps in which the same region of space is represented in multiple visual areas. It is not clear to what extent the development and maintenance of this retinotopic organization in humans depend on retinal waves and/or visual experience. We examined the corticocortical receptive field organization of resting-state BOLD data in normally sighted, early blind, and anophthalmic (in which both eyes fail to develop) individuals and found that resting-state correlations between V1 and V2/V3 were retinotopically organized for all subject groups. These results show that the gross retinotopic pattern of resting-state connectivity across V1-V3 requires neither retinal waves nor visual experience to develop and persist into adulthood. Significance statement: Evidence from resting-state BOLD data suggests that the connections between early visual areas develop and are maintained even in the absence of retinal waves and visual experience.

Re-examining overlap between tactile and visual motion responses within hMT+ and STS.

Here, we examine overlap between tactile and visual motion BOLD responses within the human MT+ complex. Although several studies have reported tactile responses overlapping with hMT+, many used group average analyses, leaving it unclear whether these responses were restricted to subregions of hMT+. Moreover, previous studies either employed a tactile task or passive stimulation, leaving it unclear whether or not tactile responses in hMT+ are simply the consequence of visual imagery. Here, we carried out a replication of one of the classic papers finding tactile responses in hMT+. We mapped MT and MST in individual subjects using visual field localizers. We then examined responses to tactile motion on the arm, either presented passively or in the presence of a visual task performed at fixation designed to minimize visualization of the concurrent tactile stimulation. To our surprise, without a visual task, we found only weak tactile motion responses in MT (6% of voxels showing tactile responses) and MST (2% of voxels). With an unrelated visual task designed to withdraw attention from the tactile modality, responses in MST were reduced to almost nothing (<1% regions). Consistent with previous results, we did observe tactile responses in STS regions superior and anterior to hMT+. Despite the lack of individual overlap, group-averaged responses produced strong spurious overlap between tactile and visual motion responses within hMT+ that resembled those observed in previous studies. The weak nature of tactile responses in hMT+ (and their abolition by withdrawal of attention) suggests that hMT+ may not serve as a supramodal motion processing module.

Population receptive field estimates of human auditory cortex.

Here we describe a method for measuring tonotopic maps and estimating bandwidth for voxels in human primary auditory cortex (PAC) using a modification of the population Receptive Field (pRF) model, developed for retinotopic mapping in visual cortex by Dumoulin and Wandell (2008). The pRF method reliably estimates tonotopic maps in the presence of acoustic scanner noise, and has two advantages over phase-encoding techniques. First, the stimulus design is flexible and need not be a frequency progression, thereby reducing biases due to habituation, expectation, and estimation artifacts, as well as reducing the effects of spatio-temporal BOLD nonlinearities. Second, the pRF method can provide estimates of bandwidth as a function of frequency. We find that bandwidth estimates are narrower for voxels within the PAC than in surrounding auditory responsive regions (non-PAC).

Subcortical functional reorganization due to early blindness.

Lack of visual input early in life results in occipital cortical responses to auditory and tactile stimuli. However, it remains unclear whether cross-modal plasticity also occurs in subcortical pathways. With the use of functional magnetic resonance imaging, auditory responses were compared across individuals with congenital anophthalmia (absence of eyes), those with early onset (in the first few years of life) blindness, and normally sighted individuals. We find that the superior colliculus, a "visual" subcortical structure, is recruited by the auditory system in congenital and early onset blindness. Additionally, auditory subcortical responses to monaural stimuli were altered as a result of blindness. Specifically, responses in the auditory thalamus were equally strong to contralateral and ipsilateral stimulation in both groups of blind subjects, whereas sighted controls showed stronger responses to contralateral stimulation. These findings suggest that early blindness results in substantial reorganization of subcortical auditory responses.

Neurochemical changes in the pericalcarine cortex in congenital blindness attributable to bilateral anophthalmia.

Congenital blindness leads to large-scale functional and structural reorganization in the occipital cortex, but relatively little is known about the neurochemical changes underlying this cross-modal plasticity. To investigate the effect of complete and early visual deafferentation on the concentration of metabolites in the pericalcarine cortex, (1)H magnetic resonance spectroscopy was performed in 14 sighted subjects and 5 subjects with bilateral anophthalmia, a condition in which both eyes fail to develop. In the pericalcarine cortex, where primary visual cortex is normally located, the proportion of gray matter was significantly greater, and levels of choline, glutamate, glutamine, myo-inositol, and total creatine were elevated in anophthalmic relative to sighted subjects. Anophthalmia had no effect on the structure or neurochemistry of a sensorimotor cortex control region. More gray matter, combined with high levels of choline and myo-inositol, resembles the profile of the cortex at birth and suggests that the lack of visual input from the eyes might have delayed or arrested the maturation of this cortical region. High levels of choline and glutamate/glutamine are consistent with enhanced excitatory circuits in the anophthalmic occipital cortex, which could reflect a shift toward enhanced plasticity or sensitivity that could in turn mediate or unmask cross-modal responses. Finally, it is possible that the change in function of the occipital cortex results in biochemical profiles that resemble those of auditory, language, or somatosensory cortex.

A lack of experience-dependent plasticity after more than a decade of recovered sight.

In 2000, monocular vision was restored to M. M., who had been blind between the ages of 3 and 46 years. Tests carried out over 2 years following the surgery revealed impairments of 3-D form, object, and face processing and an absence of object- and face-selective blood-oxygen-level-dependent responses in ventral visual cortex. In the present research, we reexamined M. M. to test for experience-dependent recovery of visual function. Behaviorally, M. M. remains impaired in 3-D form, object, and face processing. Accordingly, we found little to no evidence of the category-selective organization within ventral visual cortex typically associated with face, body, scene, or object processing. We did observe remarkably normal object selectivity within lateral occipital cortex, consistent with M. M.'s previously reported shape-discrimination performance. Together, these findings provide little evidence for recovery of high-level visual function after more than a decade of visual experience in adulthood.

Auditory motion processing after early blindness.

Studies showing that occipital cortex responds to auditory and tactile stimuli after early blindness are often interpreted as demonstrating that early blind subjects "see" auditory and tactile stimuli. However, it is not clear whether these occipital responses directly mediate the perception of auditory/tactile stimuli, or simply modulate or augment responses within other sensory areas. We used fMRI pattern classification to categorize the perceived direction of motion for both coherent and ambiguous auditory motion stimuli. In sighted individuals, perceived motion direction was accurately categorized based on neural responses within the planum temporale (PT) and right lateral occipital cortex (LOC). Within early blind individuals, auditory motion decisions for both stimuli were successfully categorized from responses within the human middle temporal complex (hMT+), but not the PT or right LOC. These findings suggest that early blind responses within hMT+ are associated with the perception of auditory motion, and that these responses in hMT+ may usurp some of the functions of nondeprived PT. Thus, our results provide further evidence that blind individuals do indeed "see" auditory motion.

A virtual patient simulation modeling the neural and perceptual effects of human visual cortical stimulation, from pulse trains to percepts.

The field of cortical sight restoration prostheses is making rapid progress with three clinical trials of visual cortical prostheses underway. However, as yet, we have only limited insight into the perceptual experiences produced by these implants. Here we describe a computational model or 'virtual patient', based on the neurophysiological architecture of V1, which successfully predicts the perceptual experience of participants across a wide range of previously published human cortical stimulation studies describing the location, size, brightness and spatiotemporal shape of electrically induced percepts in humans. Our simulations suggest that, in the foreseeable future the perceptual quality of cortical prosthetic devices is likely to be limited by the neurophysiological organization of visual cortex, rather than engineering constraints.

A unified model for cross-modal plasticity and skill acquisition.

Historically, cross-modal plasticity following early blindness has been largely studied in the context of visual deprivation. However, more recently, there has been a shift in focus towards understanding cross-modal plasticity from the perspective of skill acquisition: the striking plasticity observed in early blind individuals reflects the extraordinary perceptual and cognitive challenges they solve. Here, inspired by two seminal papers on skill learning (the "cortical recycling" theory) and cross-modal plasticity (the "metamodal" hypothesis) respectively, we present a unified hypothesis of cortical specialization that describes how shared functional, algorithmic, and structural constraints might mediate both types of plasticity.

Improving the Reliability and Accuracy of Population Receptive Field Measures Using a Logarithmically Warped Stimulus.

The population receptive field method, which measures the region in visual space that elicits a BOLD signal in a voxel in retinotopic cortex, is a powerful tool for investigating the functional organization of human visual cortex with fMRI (Dumoulin & Wandell, 2008). However, recent work has shown that population receptive field (pRF) estimates for early retinotopic visual areas can be biased and unreliable, especially for voxels representing the fovea. Here, we show that a 'log-bar' stimulus that is logarithmically warped along the eccentricity dimension produces more reliable estimates of pRF size and location than the traditional moving bar stimulus. The log-bar stimulus was better able to identify pRFs near the foveal representation, and pRFs were smaller in size, consistent with simulation estimates of receptive field sizes in the fovea.

Design and Methods of the Early Age-Related Hearing Loss Investigation Randomized Controlled Trial.

OBJECTIVE: Hearing loss has been identified as a major modifiable risk factor for cognitive decline. The Early Age-Related Hearing Loss Investigation (EARHLI) study will assess the mechanisms linking early age-related hearing loss (ARHL) and cognitive impairment. STUDY DESIGN: Randomized, controlled, single-site, early phase II, superiority trial. SETTING: Tertiary academic medical center. PARTICIPANTS: One hundred fifty participants aged 55 to 75 years with early ARHL (severity defined as borderline to moderate) and amnestic mild cognitive impairment will be included. INTERVENTIONS: Participants will be randomized 1:1 to a best practice hearing intervention or a health education control. MAIN OUTCOME MEASURES: The primary study outcome is cognition measured by the Alzheimer Disease Cooperative Study-Preclinical Alzheimer Cognitive Composite. Secondary outcomes include additional measures of cognition, social engagement, and brain organization/connectivity. RESULTS: Trial enrollment will begin in early 2024. CONCLUSIONS: After its completion in 2028, the EARHLI trial should offer evidence on the effect of hearing treatment versus a health education control on cognitive performance, social engagement, and brain organization/connectivity in 55- to 75-year-old community-dwelling adults with early ARHL and amnestic mild cognitive impairment.