Survey of spiking in the mouse visual system reveals functional hierarchy.

The anatomy of the mammalian visual system, from the retina to the neocortex, is organized hierarchically1. However, direct observation of cellular-level functional interactions across this hierarchy is lacking due to the challenge of simultaneously recording activity across numerous regions. Here we describe a large, open dataset-part of the Allen Brain Observatory2-that surveys spiking from tens of thousands of units in six cortical and two thalamic regions in the brains of mice responding to a battery of visual stimuli. Using cross-correlation analysis, we reveal that the organization of inter-area functional connectivity during visual stimulation mirrors the anatomical hierarchy from the Allen Mouse Brain Connectivity Atlas3. We find that four classical hierarchical measures-response latency, receptive-field size, phase-locking to drifting gratings and response decay timescale-are all correlated with the hierarchy. Moreover, recordings obtained during a visual task reveal that the correlation between neural activity and behavioural choice also increases along the hierarchy. Our study provides a foundation for understanding coding and signal propagation across hierarchically organized cortical and thalamic visual areas.

Differential tuning of excitation and inhibition shapes direction selectivity in ferret visual cortex.

To encode specific sensory inputs, cortical neurons must generate selective responses for distinct stimulus features. In principle, a variety of factors can contribute to the response selectivity of a cortical neuron: the tuning and strength of excitatory1-3 and inhibitory synaptic inputs4-6, dendritic nonlinearities7-9 and spike threshold10,11. Here we use a combination of techniques including in vivo whole-cell recording, synaptic- and cellular-resolution in vivo two-photon calcium imaging, and GABA (γ-aminobutyric acid) neuron-selective optogenetic manipulation to dissect the factors that contribute to the direction-selective responses of layer 2/3 neurons in ferret visual cortex (V1). Two-photon calcium imaging of dendritic spines12,13 revealed that each neuron receives a mixture of excitatory synaptic inputs selective for the somatic preferred or null direction of motion. The relative number of preferred- and null-tuned excitatory inputs predicted a neuron's somatic direction preference, but failed to account for the degree of direction selectivity. By contrast, in vivo whole-cell patch-clamp recordings revealed a notable degree of direction selectivity in subthreshold responses that was significantly correlated with spiking direction selectivity. Subthreshold direction selectivity was predicted by the magnitude and variance of the response to the null direction of motion, and several lines of evidence, including conductance measurements, demonstrate that differential tuning of excitation and inhibition suppresses responses to the null direction of motion. Consistent with this idea, optogenetic inactivation of GABAergic neurons in layer 2/3 reduced direction selectivity by enhancing responses to the null direction. Furthermore, by optogenetically mapping connections of inhibitory neurons in layer 2/3 in vivo, we find that layer 2/3 inhibitory neurons make long-range, intercolumnar projections to excitatory neurons that prefer the opposite direction of motion. We conclude that intracortical inhibition exerts a major influence on the degree of direction selectivity in layer 2/3 of ferret V1 by suppressing responses to the null direction of motion.

Shared and distinct transcriptomic cell types across neocortical areas.

The neocortex contains a multitude of cell types that are segregated into layers and functionally distinct areas. To investigate the diversity of cell types across the mouse neocortex, here we analysed 23,822 cells from two areas at distant poles of the mouse neocortex: the primary visual cortex and the anterior lateral motor cortex. We define 133 transcriptomic cell types by deep, single-cell RNA sequencing. Nearly all types of GABA (γ-aminobutyric acid)-containing neurons are shared across both areas, whereas most types of glutamatergic neurons were found in one of the two areas. By combining single-cell RNA sequencing and retrograde labelling, we match transcriptomic types of glutamatergic neurons to their long-range projection specificity. Our study establishes a combined transcriptomic and projectional taxonomy of cortical cell types from functionally distinct areas of the adult mouse cortex.

Three-dimensional topography of eye-specific domains in the lateral geniculate nucleus of pigmented and albino rats.

We previously revealed the presence of ocular dominance columns (ODCs) in the primary visual cortex (V1) of pigmented rats. On the other hand, previous studies have shown that the ipsilateral-eye domains of the dorsal lateral geniculate nucleus (dLGN) are segregated into a handful of patches in pigmented rats. To investigate the three-dimensional (3D) topography of the eye-specific patches of the dLGN and its relationship with ODCs, we injected different tracers into the right and left eyes and examined strain difference, development, and plasticity of the patches. Furthermore, we applied the tissue clearing technique to reveal the 3D morphology of the LGN and were able to observe entire retinotopic map of the rat dLGN at a certain angle. Our results show that the ipsilateral domains of the dLGN appear mesh-like at any angle and are developed at around time of eye-opening. Their development was moderately affected by abnormal visual experience, but the patch formation was not disrupted. In albino Wistar rats, ipsilateral patches were observed in the dLGN, but they were much fewer, especially near the central visual field. These results provide insights into how ipsilateral patches of the dLGN arise, and how the geniculo-cortical arrangement is different between rodents and primates.

Neuropil Variation in the Prefrontal, Motor, and Visual Cortex of Six Felids.

INTRODUCTION: Felids have evolved a specialized suite of morphological adaptations for obligate carnivory. Although the musculoskeletal anatomy of the Felidae has been studied extensively, the comparative neuroanatomy of felids is relatively unexplored. Little is known about how variation in the cerebral anatomy of felids relates to species-specific differences in sociality, hunting strategy, or activity patterns. METHODS: We quantitatively analyzed neuropil variation in the prefrontal, primary motor, and primary visual cortices of six species of Felidae (Panthera leo, Panthera uncia, Panthera tigris, Panthera leopardus, Acinonyx jubatus, Felis sylvestris domesticus) to investigate relationships with brain size, neuronal cell parameters, and select behavioral and ecological factors. Neuropil is the dense, intricate network of axons, dendrites, and synapses in the brain, playing a critical role in information processing and communication between neurons. RESULTS: There were significant species and regional differences in neuropil proportions, with African lion, cheetah, and tiger having more neuropil in all three cortical regions in comparison to the other species. Based on regression analyses, we find that the increased neuropil fraction in the prefrontal cortex supports social and behavioral flexibility, while in the primary motor cortex, this facilitates the neural activity needed for hunting movements. Greater neuropil fraction in the primary visual cortex may contribute to visual requirements associated with diel activity patterns. CONCLUSION: These results provide a cross-species comparison of neuropil fraction variation in the Felidae, particularly the understudied Panthera, and provide evidence for convergence of the neuroanatomy of Panthera and cheetahs.

Unsupervised neural network models of the ventral visual stream.

Deep neural networks currently provide the best quantitative models of the response patterns of neurons throughout the primate ventral visual stream. However, such networks have remained implausible as a model of the development of the ventral stream, in part because they are trained with supervised methods requiring many more labels than are accessible to infants during development. Here, we report that recent rapid progress in unsupervised learning has largely closed this gap. We find that neural network models learned with deep unsupervised contrastive embedding methods achieve neural prediction accuracy in multiple ventral visual cortical areas that equals or exceeds that of models derived using today's best supervised methods and that the mapping of these neural network models' hidden layers is neuroanatomically consistent across the ventral stream. Strikingly, we find that these methods produce brain-like representations even when trained solely with real human child developmental data collected from head-mounted cameras, despite the fact that these datasets are noisy and limited. We also find that semisupervised deep contrastive embeddings can leverage small numbers of labeled examples to produce representations with substantially improved error-pattern consistency to human behavior. Taken together, these results illustrate a use of unsupervised learning to provide a quantitative model of a multiarea cortical brain system and present a strong candidate for a biologically plausible computational theory of primate sensory learning.

Unraveling the mechanisms of surround suppression in early visual processing.

This paper uses mathematical modeling to study the mechanisms of surround suppression in the primate visual cortex. We present a large-scale neural circuit model consisting of three interconnected components: LGN and two input layers (Layer 4Ca and Layer 6) of the primary visual cortex V1, covering several hundred hypercolumns. Anatomical structures are incorporated and physiological parameters from realistic modeling work are used. The remaining parameters are chosen to produce model outputs that emulate experimentally observed size-tuning curves. Our two main results are: (i) we discovered the character of the long-range connections in Layer 6 responsible for surround effects in the input layers; and (ii) we showed that a net-inhibitory feedback, i.e., feedback that excites I-cells more than E-cells, from Layer 6 to Layer 4 is conducive to producing surround properties consistent with experimental data. These results are obtained through parameter selection and model analysis. The effects of nonlinear recurrent excitation and inhibition are also discussed. A feature that distinguishes our model from previous modeling work on surround suppression is that we have tried to reproduce realistic lengthscales that are crucial for quantitative comparison with data. Due to its size and the large number of unknown parameters, the model is computationally challenging. We demonstrate a strategy that involves first locating baseline values for relevant parameters using a linear model, followed by the introduction of nonlinearities where needed. We find such a methodology effective, and propose it as a possibility in the modeling of complex biological systems.

A strategy for mapping biophysical to abstract neuronal network models applied to primary visual cortex.

A fundamental challenge for the theoretical study of neuronal networks is to make the link between complex biophysical models based directly on experimental data, to progressively simpler mathematical models that allow the derivation of general operating principles. We present a strategy that successively maps a relatively detailed biophysical population model, comprising conductance-based Hodgkin-Huxley type neuron models with connectivity rules derived from anatomical data, to various representations with fewer parameters, finishing with a firing rate network model that permits analysis. We apply this methodology to primary visual cortex of higher mammals, focusing on the functional property of stimulus orientation selectivity of receptive fields of individual neurons. The mapping produces compact expressions for the parameters of the abstract model that clearly identify the impact of specific electrophysiological and anatomical parameters on the analytical results, in particular as manifested by specific functional signatures of visual cortex, including input-output sharpening, conductance invariance, virtual rotation and the tilt after effect. Importantly, qualitative differences between model behaviours point out consequences of various simplifications. The strategy may be applied to other neuronal systems with appropriate modifications.

Unveiling functions of the visual cortex using task-specific deep neural networks.

The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach.

Topology of ON and OFF inputs in visual cortex enables an invariant columnar architecture.

Circuits in the visual cortex integrate the information derived from separate ON (light-responsive) and OFF (dark-responsive) pathways to construct orderly columnar representations of stimulus orientation and visual space. How this transformation is achieved to meet the specific topographic constraints of each representation remains unclear. Here we report several novel features of ON-OFF convergence visualized by mapping the receptive fields of layer 2/3 neurons in the tree shrew (Tupaia belangeri) visual cortex using two-photon imaging of GCaMP6 calcium signals. We show that the spatially separate ON and OFF subfields of simple cells in layer 2/3 exhibit topologically distinct relationships with the maps of visual space and orientation preference. The centres of OFF subfields for neurons in a given region of cortex are confined to a compact region of visual space and display a smooth visuotopic progression. By contrast, the centres of the ON subfields are distributed over a wider region of visual space, display substantial visuotopic scatter, and have an orientation-specific displacement consistent with orientation preference map structure. As a result, cortical columns exhibit an invariant aggregate receptive field structure: an OFF-dominated central region flanked by ON-dominated subfields. This distinct arrangement of ON and OFF inputs enables continuity in the mapping of both orientation and visual space and the generation of a columnar map of absolute spatial phase.

Anatomy and function of an excitatory network in the visual cortex.

Circuits in the cerebral cortex consist of thousands of neurons connected by millions of synapses. A precise understanding of these local networks requires relating circuit activity with the underlying network structure. For pyramidal cells in superficial mouse visual cortex (V1), a consensus is emerging that neurons with similar visual response properties excite each other, but the anatomical basis of this recurrent synaptic network is unknown. Here we combined physiological imaging and large-scale electron microscopy to study an excitatory network in V1. We found that layer 2/3 neurons organized into subnetworks defined by anatomical connectivity, with more connections within than between groups. More specifically, we found that pyramidal neurons with similar orientation selectivity preferentially formed synapses with each other, despite the fact that axons and dendrites of all orientation selectivities pass near (<5 µm) each other with roughly equal probability. Therefore, we predict that mechanisms of functionally specific connectivity take place at the length scale of spines. Neurons with similar orientation tuning formed larger synapses, potentially enhancing the net effect of synaptic specificity. With the ability to study thousands of connections in a single circuit, functional connectomics is proving a powerful method to uncover the organizational logic of cortical networks.

Reconsidering the Border between the Visual and Posterior Parietal Cortex of Mice.

The posterior parietal cortex (PPC) contributes to multisensory and sensory-motor integration, as well as spatial navigation. Based on primate studies, the PPC is composed of several subdivisions with differing connection patterns, including areas that exhibit retinotopy. In mice the composition of the PPC is still under debate. We propose a revised anatomical delineation in which we classify the higher order visual areas rostrolateral area (RL), anteromedial area (AM), and Medio-Medial-Anterior cortex (MMA) as subregions of the mouse PPC. Retrograde and anterograde tracing revealed connectivity, characteristic for primate PPC, with sensory, retrosplenial, orbitofrontal, cingulate and motor cortex, as well as with several thalamic nuclei and the superior colliculus in the mouse. Regarding cortical input, RL receives major input from the somatosensory barrel field, while AM receives more input from the trunk, whereas MMA receives strong inputs from retrosplenial, cingulate, and orbitofrontal cortices. These input differences suggest that each posterior PPC subregion may have a distinct function. Summarized, we put forward a refined cortical map, including a mouse PPC that contains at least 6 subregions, RL, AM, MMA and PtP, MPta, LPta/A. These anatomical results set the stage for a more detailed understanding about the role that the PPC and its subdivisions play in multisensory integration-based behavior in mice.

Multiple Visuotopically Organized Subdivisions of the Lateral Pulvinar/Central Lateral Inferior Pulvinar Project into Thin and Thick Stripe Compartments of V2 in Macaques.

The lateral and central lateral inferior pulvinar (PL/PIcl) of primates has been implicated in playing an important role in visual processing, but its physiological and anatomical characteristics remain to be elucidated. It has been suggested that there are two complete visuotopic maps in the PL/PIcl, each of which sends afferents into V2 and V4 in primates. Given that functionally distinct thin and thick stripes of V2 both receive inputs from the PL/PIcl, this raises the possibility of a presence of parallel segregated pathways within the PL/PIcl. To address this question, we selectively injected three types of retrograde tracers (CTB-488, CTB-555, and BDA) into thin or thick stripes in V2 and examined labeling in the PL/PIcl in macaques. As a result, we found that every cluster of retrograde labeling in the PL/PIcl included all three types of signals next to each other, suggesting that thin stripe- and thick stripe-projecting compartments are not segregated into domains. Unexpectedly, we found at least five topographically organized retrograde labeling clusters in the PL/PIcl, indicating the presence of more than two V2-projecting maps. Our results suggest that the PL/PIcl exhibits greater compartmentalization than previously thought. They may be functionally similar but participate in multiple cortico-pulvinar-cortical loops.

Retinotopic specializations of cortical and thalamic inputs to area MT.

Retinotopic specializations in the ventral visual stream, especially foveal adaptations, provide primates with high-acuity vision in the central visual field. However, visual field specializations have not been studied in the dorsal visual stream, dedicated to processing visual motion and visually guided behaviors. To investigate this, we injected retrograde neuronal tracers occupying the whole visuotopic representation of the middle temporal (MT) visual area in marmoset monkeys and studied the distribution and morphology of the afferent primary visual cortex (V1) projections. Contrary to previous reports, we found a heterogeneous population of V1-MT projecting neurons distributed in layers 3C and 6. In layer 3C, spiny stellate neurons were distributed mainly in foveal representations, while pyramidal morphologies were characteristic of peripheral eccentricities. This primate adaptation of the V1 to MT pathway is arranged in a way that we had not previously understood, with abundant stellate projection neurons in the high-resolution foveal portions, suggesting rapid relay of motion information to visual area MT. We also describe that the medial portion of the inferior pulvinar (PIm), which is the main thalamic input to area MT, shows a retinotopic organization, likely reflecting the importance of this pathway during development and the establishment of area MT topography.

Apparent thinning of human visual cortex during childhood is associated with myelination.

Human cortex appears to thin during childhood development. However, the underlying microstructural mechanisms are unknown. Using functional magnetic resonance imaging (fMRI), quantitative MRI (qMRI), and diffusion MRI (dMRI) in children and adults, we tested what quantitative changes occur to gray and white matter in ventral temporal cortex (VTC) from childhood to adulthood, and how these changes relate to cortical thinning. T1 relaxation time from qMRI and mean diffusivity (MD) from dMRI provide independent and complementary measurements of microstructural properties of gray and white matter tissue. In face- and character-selective regions in lateral VTC, T1 and MD decreased from age 5 to adulthood in mid and deep cortex, as well as in their adjacent white matter. T1 reduction also occurred longitudinally in children's brain regions. T1 and MD decreases 1) were consistent with tissue growth related to myelination, which we verified with adult histological myelin stains, and 2) were correlated with apparent cortical thinning. In contrast, in place-selective cortex in medial VTC, we found no development of T1 or MD after age 5, and thickness was related to cortical morphology. These findings suggest that lateral VTC likely becomes more myelinated from childhood to adulthood, affecting the contrast of MR images and, in turn, the apparent gray-white boundary. These findings are important because they suggest that VTC does not thin during childhood but instead gets more myelinated. Our data have broad ramifications for understanding both typical and atypical brain development using advanced in vivo quantitative measurements and clinical conditions implicating myelin.

Predictive masking of an artificial scotoma is associated with a system-wide reconfiguration of neural populations in the human visual cortex.

The visual brain has the remarkable capacity to complete our percept of the world even when the information extracted from the visual scene is incomplete. This ability to predict missing information based on information from spatially adjacent regions is an intriguing attribute of healthy vision. Yet, it gains particular significance when it masks the perceptual consequences of a retinal lesion, leaving patients unaware of their partial loss of vision and ultimately delaying diagnosis and treatment. At present, our understanding of the neural basis of this masking process is limited which hinders both quantitative modeling as well as translational application. To overcome this, we asked the participants to view visual stimuli with and without superimposed artificial scotoma (AS). We used fMRI to record the associated cortical activity and applied model-based analyzes to track changes in cortical population receptive fields and connectivity in response to the introduction of the AS. We found that throughout the visual field and cortical hierarchy, pRFs shifted their preferred position towards the AS border. Moreover, extrastriate areas biased their sampling of V1 towards sections outside the AS projection zone, thereby effectively masking the AS with signals from spared portions of the visual field. We speculate that the signals that drive these system-wide population modifications originate in extrastriate visual areas and, through feedback, also reconfigure the neural populations in the earlier visual areas.

Heritable functional architecture in human visual cortex.

How much of the functional organization of our visual system is inherited? Here we tested the heritability of retinotopic maps in human visual cortex using functional magnetic resonance imaging. We demonstrate that retinotopic organization shows a closer correspondence in monozygotic (MZ) compared to dizygotic (DZ) twin pairs, suggesting a partial genetic determination. Using population receptive field (pRF) analysis to examine the preferred spatial location and selectivity of these neuronal populations, we estimate a heritability around 10-20% for polar angle preferences and spatial selectivity, as quantified by pRF size, in extrastriate areas V2 and V3. Our findings are consistent with heritability in both the macroscopic arrangement of visual regions and stimulus tuning properties of visual cortex. This could constitute a neural substrate for variations in a range of perceptual effects, which themselves have been found to be at least partially genetically determined. These findings also add convergent evidence for the hypothesis that functional map topology is linked with cortical morphology.

Primate extrastriate cortical area MST: a gateway between sensation and cognition.

Primate visual cortex consists of dozens of distinct brain areas, each providing a highly specialized component to the sophisticated task of encoding the incoming sensory information and creating a representation of our visual environment that underlies our perception and action. One such area is the medial superior temporal cortex (MST), a motion-sensitive, direction-selective part of the primate visual cortex. It receives most of its input from the middle temporal (MT) area, but MST cells have larger receptive fields and respond to more complex motion patterns. The finding that MST cells are tuned for optic flow patterns has led to the suggestion that the area plays an important role in the perception of self-motion. This hypothesis has received further support from studies showing that some MST cells also respond selectively to vestibular cues. Furthermore, the area is part of a network that controls the planning and execution of smooth pursuit eye movements and its activity is modulated by cognitive factors, such as attention and working memory. This review of more than 90 studies focuses on providing clarity of the heterogeneous findings on MST in the macaque cortex and its putative homolog in the human cortex. From this analysis of the unique anatomical and functional position in the hierarchy of areas and processing steps in primate visual cortex, MST emerges as a gateway between perception, cognition, and action planning. Given this pivotal role, this area represents an ideal model system for the transition from sensation to cognition.

The structural and functional connectivity neural underpinnings of body image.

How we perceive our bodies is fundamental to our self-consciousness and our experience in the world. There are two types of interrelated internal body representations-a subjective experience of the position of a limb in space (body schema) and the subjective experience of the shape and size of the limb (body image). Body schema has been extensively studied, but there is no evidence of the brain structure and network dynamics underpinning body image. Here, we provide the first evidence for the extrastriate body area (EBA), a multisensory brain area, as the structural and functional neural substrate for body shape and size. We performed a multisensory finger-stretch illusion that elongated the index finger. EBA volume and functional connectivity to the posterior parietal cortex are both related to the participants' susceptibility to the illusion. Taken together, these data suggest that EBA structure and connectivity encode body representation and body perception disturbances.

Development of the visual white matter pathways mediates development of electrophysiological responses in visual cortex.

The latency of neural responses in the visual cortex changes systematically across the lifespan. Here, we test the hypothesis that development of visual white matter pathways mediates maturational changes in the latency of visual signals. Thirty-eight children participated in a cross-sectional study including diffusion magnetic resonance imaging (MRI) and magnetoencephalography (MEG) sessions. During the MEG acquisition, participants performed a lexical decision and a fixation task on words presented at varying levels of contrast and noise. For all stimuli and tasks, early evoked fields were observed around 100 ms after stimulus onset (M100), with slower and lower amplitude responses for low as compared to high contrast stimuli. The optic radiations and optic tracts were identified in each individual's brain based on diffusion MRI tractography. The diffusion properties of the optic radiations predicted M100 responses, especially for high contrast stimuli. Higher optic radiation fractional anisotropy (FA) values were associated with faster and larger M100 responses. Over this developmental window, the M100 responses to high contrast stimuli became faster with age and the optic radiation FA mediated this effect. These findings suggest that the maturation of the optic radiations over childhood accounts for individual variations observed in the developmental trajectory of visual cortex responses.