Cortical depth profiles in primary visual cortex for illusory and imaginary experiences.

Visual illusions and mental imagery are non-physical sensory experiences that involve cortical feedback processing in the primary visual cortex. Using laminar functional magnetic resonance imaging (fMRI) in two studies, we investigate if information about these internal experiences is visible in the activation patterns of different layers of primary visual cortex (V1). We find that imagery content is decodable mainly from deep layers of V1, whereas seemingly 'real' illusory content is decodable mainly from superficial layers. Furthermore, illusory content shares information with perceptual content, whilst imagery content does not generalise to illusory or perceptual information. Together, our results suggest that illusions and imagery, which differ immensely in their subjective experiences, also involve partially distinct early visual microcircuits. However, overlapping microcircuit recruitment might emerge based on the nuanced nature of subjective conscious experience.

Spoken language processing activates the primary visual cortex.

Primary visual cortex (V1) is generally thought of as a low-level sensory area that primarily processes basic visual features. Although there is evidence for multisensory effects on its activity, these are typically found for the processing of simple sounds and their properties, for example spatially or temporally-congruent simple sounds. However, in congenitally blind individuals, V1 is involved in language processing, with no evidence of major changes in anatomical connectivity that could explain this seemingly drastic functional change. This is at odds with current accounts of neural plasticity, which emphasize the role of connectivity and conserved function in determining a neural tissue's role even after atypical early experiences. To reconcile what appears to be unprecedented functional reorganization with known accounts of plasticity limitations, we tested whether V1's multisensory roles include responses to spoken language in sighted individuals. Using fMRI, we found that V1 in normally sighted individuals was indeed activated by comprehensible spoken sentences as compared to an incomprehensible reversed speech control condition, and more strongly so in the left compared to the right hemisphere. Activation in V1 for language was also significant and comparable for abstract and concrete words, suggesting it was not driven by visual imagery. Last, this activation did not stem from increased attention to the auditory onset of words, nor was it correlated with attentional arousal ratings, making general attention accounts an unlikely explanation. Together these findings suggest that V1 responds to spoken language even in sighted individuals, reflecting the binding of multisensory high-level signals, potentially to predict visual input. This capability might be the basis for the strong V1 language activation observed in people born blind, re-affirming the notion that plasticity is guided by pre-existing connectivity and abilities in the typically developed brain.

A laminar model for the joint development of ocular dominance columns and CO blobs in the primary visual cortex.

In this paper, we present a multi-layer, activity-dependent model for the joint development of ocular dominance (OD) columns and cytochrome oxidase (CO) blobs in primate V1. For simplicity, we focus on layers 4C and 2/3 with both layers receiving direct thalamic inputs and layer 4C sending vertical projections to layer 2/3. Both the thalamic and the vertical connections are taken to be modifiable by activity. Using a correlation-based Hebbian learning rule with subtractive normalization, we show how the formation of an OD map in layer 4C is inherited by layer 2/3 via the vertical projections. Competition between these feedforward projections and the direct thalamic input to layer 2/3 then results in the formation of CO blobs superimposed upon the ocular dominance map. The spacing of the OD columns is determined by the spatial profile of the intralaminar connections within layer 4, while the spacing of CO blobs depends both on the width of the OD columns inherited from layer 4 and the spatial distribution of intralaminar connections within the superficial layer. The resulting CO blob distribution is shown to be consistent with experimental data. In addition, we numerically simulate monocular deprivation and find that while the CO blob distribution is unaltered, the OD pattern undergoes modification. The OD stripes of the deprived eye narrow, whereas the OD stripes for the remaining open eye widen.

Thalamocortical boutons cluster by ON/OFF responses in mouse primary visual cortex.

In higher mammals, the thalamic afferents to primary visual cortex cluster according to their responses to increases (ON) or decreases (OFF) in luminance. This feature of thalamocortical wiring is thought to create columnar, ON/OFF domains in V1. We have recently shown that mice also have ON/OFF cortical domains, but the organization of their thalamic afferents remains unknown. Here we measured the visual responses of thalamocortical boutons with two-photon imaging and found that they also cluster in space according to ON/OFF responses. Moreover, fluctuations in the relative density of ON/OFF boutons mirror fluctuations in the relative density of ON/OFF receptive field positions on the visual field. These findings indicate a segregation of ON/OFF signals already present in the thalamic input. We propose that ON/OFF clustering may reflect the spatial distribution of ON/OFF responses in retinal ganglion cell mosaics.NEW & NOTEWORTHY Neurons in primary visual cortex cluster into ON and OFF domains, which have been shown to be linked to the organization of receptive fields and cortical maps. Here we show that in the mouse such clustering is already present in the geniculate input, suggesting that the cortical architecture may be shaped by the representation of ON/OFF signals in the thalamus and the retina.

Cross-modal activation of the primary visual cortex by auditory stimulation in RCS rats: considerations in visual prosthesis.

An important brain re-wiring, the so-called cross-modal plasticity, occurs during progression of retinal degenerative diseases to compensate for lack of visual input. The visual cortex does not go 'unused', instead it is devoted to processing other sensory modalities. In this study we recorded, in the visual cortex, visual- and auditory-evoked potentials in an anesthetized murine model of retinal degeneration. The latency to the first peak of the recorded local field potentials was used to assess the speed of the response. Visual responses occurred significantly faster in the control group. Conversely, auditory responses appeared significantly faster in animals with retinal degeneration. This suggests the compensatory neural rewiring is optimizing the performance of other sensory modalities, hearing in this case. This phenomenon may play an important role in visual neuro-rehabilitation. Whether or not it can promote or deter the interpretation of artificially encoded neural signals from a visual prosthesis remains to be studied.

Vividness of visual imagery questionnaire scores and their relationship to visual short-term memory performance.

Mechanisms underlying visual imagery, the ability to create vivid mental representations of a scene in the absence of sensory input, remain to be fully understood. Some previous studies have proposed that visual imagery might be related to visual short-term memory (STM), with a common mechanism involving retention of visual information over short periods of time. Other observations have shown a strong relationship between visual imagery and functional activity in the hippocampus and primary visual cortex, both regions also associated with visual STM. Here we examined the relationship of visual imagery to STM and hippocampal and primary visual cortex volumes, first in a large sample of healthy people across a large age range (N = 229 behavioural data; N = 56 MRI data in older participants) and then in patients with Alzheimer's disease and Parkinson's disease (N = 19 in each group compared to 19 age-matched healthy controls). We used a variant of the "What was where?" visual object-location binding task to assess the quality of remembered information over short delays. In healthy people, no evidence of a relationship between the vividness of visual imagery and any visual STM performance parameter was found. However, there was a significant positive correlation between visual imagery and the volumes of the hippocampus and primary visual cortex. Although visual STM performance was significantly impaired in patients with Alzheimer's disease, their vividness of visual imagery scores were comparable to those of age-matched elderly controls and patients with Parkinson's disease. Despite hippocampal volumes also being reduced in Alzheimer's patients, there appeared to be no impact on their self-reported visual imagery. In conclusion, visual imagery was not significantly related to visual STM performance, either in healthy controls or Alzheimer's or Parkinson's disease but it was related to hippocampal and visual cortex volume in healthy people.

Laminar distribution and arbor density of two functional classes of thalamic inputs to primary visual cortex.

Motion/direction-sensitive and location-sensitive neurons are the two major functional types in mouse visual thalamus that project to the primary visual cortex (V1). It is under debate whether motion/direction-sensitive inputs preferentially target the superficial layers in V1, as opposed to the location-sensitive inputs, which preferentially target the middle layers. Here, by using calcium imaging to measure the activity of motion/direction-sensitive and location-sensitive axons in V1, we find evidence against these cell-type-specific laminar biases at the population level. Furthermore, using an approach to reconstruct axon arbors with identified in vivo response types, we show that, at the single-axon level, the motion/direction-sensitive axons project more densely to the middle layers than the location-sensitive axons. Overall, our results demonstrate that motion/direction-sensitive thalamic neurons project extensively to the middle layers of V1 at both the population and single-cell levels, providing further insight into the organization of thalamocortical projection in the mouse visual system.

Perceived and mentally rotated contents are differentially represented in cortical depth of V1.

Primary visual cortex (V1) in humans is known to represent both veridically perceived external input and internally-generated contents underlying imagery and mental rotation. However, it is unknown how the brain keeps these contents separate thus avoiding a mixture of the perceived and the imagined which could lead to potentially detrimental consequences. Inspired by neuroanatomical studies showing that feedforward and feedback connections in V1 terminate in different cortical layers, we hypothesized that this anatomical compartmentalization underlies functional segregation of external and internally-generated visual contents, respectively. We used high-resolution layer-specific fMRI to test this hypothesis in a mental rotation task. We found that rotated contents were predominant at outer cortical depth bins (i.e. superficial and deep). At the same time perceived contents were represented stronger at the middle cortical bin. These results identify how through cortical depth compartmentalization V1 functionally segregates rather than confuses external from internally-generated visual contents. These results indicate that feedforward and feedback manifest in distinct subdivisions of the early visual cortex, thereby reflecting a general strategy for implementing multiple cognitive functions within a single brain region.

Sparse thalamocortical convergence.

How many thalamic neurons converge onto a cortical cell? This is an important question, because the organization of thalamocortical projections can influence the cortical architecture.1,2 Here, we estimate the degree of thalamocortical convergence in primary visual cortex by taking advantage of the cortical expansion-neurons within a restricted volume in primary visual cortex have overlapping receptive fields driven by a smaller set of inputs from the lateral geniculate nucleus.3-5 Under these conditions, the measurements of cortical receptive fields in a population can be used to infer the receptive fields of their geniculate inputs and the weights of their projections using non-negative matrix factorization.6 The analysis reveals sparse connectivity,7 where a handful (~2-6) of thalamic inputs account for 90% of the total synaptic weight to a cortical neuron. Together with previous findings,8 these results paint a picture consistent with the idea that convergence of a few inputs partly determine the retinotopy and tuning properties of cortical cells.8-13.