Reconstruction of neocortex: Organelles, compartments, cells, circuits, and activity.

We assembled a semi-automated reconstruction of L2/3 mouse primary visual cortex from ∼250 × 140 × 90 µm3 of electron microscopic images, including pyramidal and non-pyramidal neurons, astrocytes, microglia, oligodendrocytes and precursors, pericytes, vasculature, nuclei, mitochondria, and synapses. Visual responses of a subset of pyramidal cells are included. The data are publicly available, along with tools for programmatic and three-dimensional interactive access. Brief vignettes illustrate the breadth of potential applications relating structure to function in cortical circuits and neuronal cell biology. Mitochondria and synapse organization are characterized as a function of path length from the soma. Pyramidal connectivity motif frequencies are predicted accurately using a configuration model of random graphs. Pyramidal cells receiving more connections from nearby cells exhibit stronger and more reliable visual responses. Sample code shows data access and analysis.

The Mind of a Mouse.

Large scientific projects in genomics and astronomy are influential not because they answer any single question but because they enable investigation of continuously arising new questions from the same data-rich sources. Advances in automated mapping of the brain's synaptic connections (connectomics) suggest that the complicated circuits underlying brain function are ripe for analysis. We discuss benefits of mapping a mouse brain at the level of synapses.

A hybrid open-top light-sheet microscope for versatile multi-scale imaging of cleared tissues.

Light-sheet microscopy has emerged as the preferred means for high-throughput volumetric imaging of cleared tissues. However, there is a need for a flexible system that can address imaging applications with varied requirements in terms of resolution, sample size, tissue-clearing protocol, and transparent sample-holder material. Here, we present a 'hybrid' system that combines a unique non-orthogonal dual-objective and conventional (orthogonal) open-top light-sheet (OTLS) architecture for versatile multi-scale volumetric imaging. We demonstrate efficient screening and targeted sub-micrometer imaging of sparse axons within an intact, cleared mouse brain. The same system enables high-throughput automated imaging of multiple specimens, as spotlighted by a quantitative multi-scale analysis of brain metastases. Compared with existing academic and commercial light-sheet microscopy systems, our hybrid OTLS system provides a unique combination of versatility and performance necessary to satisfy the diverse requirements of a growing number of cleared-tissue imaging applications.

Oligodendrocyte precursor cells ingest axons in the mouse neocortex.

Neurons in the developing brain undergo extensive structural refinement as nascent circuits adopt their mature form. This physical transformation of neurons is facilitated by the engulfment and degradation of axonal branches and synapses by surrounding glial cells, including microglia and astrocytes. However, the small size of phagocytic organelles and the complex, highly ramified morphology of glia have made it difficult to define the contribution of these and other glial cell types to this crucial process. Here, we used large-scale, serial section transmission electron microscopy (TEM) with computational volume segmentation to reconstruct the complete 3D morphologies of distinct glial types in the mouse visual cortex, providing unprecedented resolution of their morphology and composition. Unexpectedly, we discovered that the fine processes of oligodendrocyte precursor cells (OPCs), a population of abundant, highly dynamic glial progenitors, frequently surrounded small branches of axons. Numerous phagosomes and phagolysosomes (PLs) containing fragments of axons and vesicular structures were present inside their processes, suggesting that OPCs engage in axon pruning. Single-nucleus RNA sequencing from the developing mouse cortex revealed that OPCs express key phagocytic genes at this stage, as well as neuronal transcripts, consistent with active axon engulfment. Although microglia are thought to be responsible for the majority of synaptic pruning and structural refinement, PLs were ten times more abundant in OPCs than in microglia at this stage, and these structures were markedly less abundant in newly generated oligodendrocytes, suggesting that OPCs contribute substantially to the refinement of neuronal circuits during cortical development.

Anatomy and function of an excitatory network in the visual cortex.

Circuits in the cerebral cortex consist of thousands of neurons connected by millions of synapses. A precise understanding of these local networks requires relating circuit activity with the underlying network structure. For pyramidal cells in superficial mouse visual cortex (V1), a consensus is emerging that neurons with similar visual response properties excite each other, but the anatomical basis of this recurrent synaptic network is unknown. Here we combined physiological imaging and large-scale electron microscopy to study an excitatory network in V1. We found that layer 2/3 neurons organized into subnetworks defined by anatomical connectivity, with more connections within than between groups. More specifically, we found that pyramidal neurons with similar orientation selectivity preferentially formed synapses with each other, despite the fact that axons and dendrites of all orientation selectivities pass near (<5 µm) each other with roughly equal probability. Therefore, we predict that mechanisms of functionally specific connectivity take place at the length scale of spines. Neurons with similar orientation tuning formed larger synapses, potentially enhancing the net effect of synaptic specificity. With the ability to study thousands of connections in a single circuit, functional connectomics is proving a powerful method to uncover the organizational logic of cortical networks.

Visual physiology of the layer 4 cortical circuit in silico.

Despite advances in experimental techniques and accumulation of large datasets concerning the composition and properties of the cortex, quantitative modeling of cortical circuits under in-vivo-like conditions remains challenging. Here we report and publicly release a biophysically detailed circuit model of layer 4 in the mouse primary visual cortex, receiving thalamo-cortical visual inputs. The 45,000-neuron model was subjected to a battery of visual stimuli, and results were compared to published work and new in vivo experiments. Simulations reproduced a variety of observations, including effects of optogenetic perturbations. Critical to the agreement between responses in silico and in vivo were the rules of functional synaptic connectivity between neurons. Interestingly, after extreme simplification the model still performed satisfactorily on many measurements, although quantitative agreement with experiments suffered. These results emphasize the importance of functional rules of cortical wiring and enable a next generation of data-driven models of in vivo neural activity and computations.

Inferring cortical function in the mouse visual system through large-scale systems neuroscience.

The scientific mission of the Project MindScope is to understand neocortex, the part of the mammalian brain that gives rise to perception, memory, intelligence, and consciousness. We seek to quantitatively evaluate the hypothesis that neocortex is a relatively homogeneous tissue, with smaller functional modules that perform a common computational function replicated across regions. We here focus on the mouse as a mammalian model organism with genetics, physiology, and behavior that can be readily studied and manipulated in the laboratory. We seek to describe the operation of cortical circuitry at the computational level by comprehensively cataloging and characterizing its cellular building blocks along with their dynamics and their cell type-specific connectivities. The project is also building large-scale experimental platforms (i.e., brain observatories) to record the activity of large populations of cortical neurons in behaving mice subject to visual stimuli. A primary goal is to understand the series of operations from visual input in the retina to behavior by observing and modeling the physical transformations of signals in the corticothalamic system. We here focus on the contribution that computer modeling and theory make to this long-term effort.

Spatial Organization of Chromatic Pathways in the Mouse Dorsal Lateral Geniculate Nucleus.

In both dichromats and trichromats, cone opsin signals are maintained independently in cones and combined at the bipolar and retinal ganglion cell level, creating parallel color opponent pathways to the central visual system. Like other dichromats, the mouse retina expresses a short-wavelength (S) and a medium-wavelength (M) opsin, with the S-opsin shifted to peak sensitivity in the ultraviolet (UV) range. Unlike in primates, nonuniform opsin expression across the retina and coexpression in single cones creates a mostly mixed chromatic signal. Here, we describe the visuotopic and chromatic organization of spiking responses in the dorsal lateral geniculate and of the local field potentials in their recipient zone in primary visual cortex (V1). We used an immersive visual stimulus dome that allowed us to present spatiotemporally modulated UV and green luminance in any region of the visual field of an awake, head-fixed mouse. Consistent with retinal expression of opsins, we observed graded UV-to-green dominated responses from the upper to lower visual fields, with a smaller difference across azimuth. In addition, we identified a subpopulation of cells (<10%) that exhibited spectrally opponent responses along the S-M axis. Luminance signals of each wavelength and color signals project to the middle layers of V1. SIGNIFICANCE STATEMENT: In natural environments, color information is useful for guiding behavior. How small terrestrial mammals such as mice use graded expression of cone opsins to extract visual information from their environments is not clear, even as the use of mice for studying visually guided behavior grows. In this study, we examined the color signals that the retina sends to the visual cortex via the lateral geniculate nucleus of the thalamus. We found that green dominated responses in the lower and nasal visual field and ultraviolet dominated responses in the upper visual field. We describe a subset of cells that exhibit color opponent responses.

A Comparison of Visual Response Properties in the Lateral Geniculate Nucleus and Primary Visual Cortex of Awake and Anesthetized Mice.

The cerebral cortex of the mouse has become one of the most important systems for studying information processing and the neural correlates of behavior. Multiple studies have examined the first stages of visual cortical processing: primary visual cortex (V1) and its thalamic inputs from the dorsal lateral geniculate nucleus (dLGN), but more rarely in the lateral posterior nucleus (LP) in mice. Multiple single-unit surveys of dLGN and V1, both with electrophysiology and two-photon calcium imaging, have described receptive fields in anesthetized animals. Increasingly, awake animals are being used in physiological studies, so it is important to compare neuronal responses between awake and anesthetized state. We have performed a comprehensive survey of spatial and temporal response properties in V1, dLGN, and lateral posterior nucleus of both anesthetized and awake animals, using a common set of stimuli: drifting sine-wave gratings spanning a broad range of spatial and temporal parameters, and sparse noise stimuli consisting of flashed light and dark squares. Most qualitative receptive field parameters were found to be unchanged between the two states, such as most aspects of spatial processing, but there were significant differences in several parameters, most notably in temporal processing. Compared with anesthetized animals, the temporal frequency that evoked the peak response was shifted toward higher values in the dLGN of awake mice and responses were more sustained. Further, the peak response to a flashed stimulus was earlier in all three areas. Overall, however, receptive field properties in the anesthetized animal remain a good model for those in the awake animal. SIGNIFICANCE STATEMENT: The primary visual cortex (V1) of the mouse and its inputs from visual thalamus (dLGN), have become a dominant model for studying information processing in the brain. Early surveys of visual response properties (receptive fields) were performed in anesthetized animals. Although most recent studies of V1 have been performed in awake animals to examine links between vision and behavior, there have been few comprehensive studies of receptive field properties in the awake mouse, especially in dLGN and lateral posterior nucleus. We have performed a comparative survey of receptive fields in dLGN, lateral posterior nucleus, and V1 in anesthetized and awake mice. We found multiple differences in processing of time-varying stimuli, whereas the spatial aspects of receptive fields remain comparatively unchanged.

Network anatomy and in vivo physiology of visual cortical neurons.

In the cerebral cortex, local circuits consist of tens of thousands of neurons, each of which makes thousands of synaptic connections. Perhaps the biggest impediment to understanding these networks is that we have no wiring diagrams of their interconnections. Even if we had a partial or complete wiring diagram, however, understanding the network would also require information about each neuron's function. Here we show that the relationship between structure and function can be studied in the cortex with a combination of in vivo physiology and network anatomy. We used two-photon calcium imaging to characterize a functional property--the preferred stimulus orientation--of a group of neurons in the mouse primary visual cortex. Large-scale electron microscopy of serial thin sections was then used to trace a portion of these neurons' local network. Consistent with a prediction from recent physiological experiments, inhibitory interneurons received convergent anatomical input from nearby excitatory neurons with a broad range of preferred orientations, although weak biases could not be rejected.

A scalable and modular computational pipeline for axonal connectomics: automated tracing and assembly of axons across serial sections.

Progress in histological methods and in microscope technology has enabled dense staining and imaging of axons over large brain volumes, but tracing axons over such volumes requires new computational tools for 3D reconstruction of data acquired from serial sections. We have developed a computational pipeline for automated tracing and volume assembly of densely stained axons imaged over serial sections, which leverages machine learning-based segmentation to enable stitching and alignment with the axon traces themselves. We validated this segmentation-driven approach to volume assembly and alignment of individual axons over centimeter-scale serial sections and show the application of the output traces for analysis of local orientation and for proofreading over aligned volumes. The pipeline is scalable, and combined with recent advances in experimental approaches, should enable new studies of mesoscale connectivity and function over the whole human brain.

Cell-type-specific inhibitory circuitry from a connectomic census of mouse visual cortex.

Mammalian cortex features a vast diversity of neuronal cell types, each with characteristic anatomical, molecular and functional properties. Synaptic connectivity powerfully shapes how each cell type participates in the cortical circuit, but mapping connectivity rules at the resolution of distinct cell types remains difficult. Here, we used millimeter-scale volumetric electron microscopy1 to investigate the connectivity of all inhibitory neurons across a densely-segmented neuronal population of 1352 cells spanning all layers of mouse visual cortex, producing a wiring diagram of inhibitory connections with more than 70,000 synapses. Taking a data-driven approach inspired by classical neuroanatomy, we classified inhibitory neurons based on the relative targeting of dendritic compartments and other inhibitory cells and developed a novel classification of excitatory neurons based on the morphological and synaptic input properties. The synaptic connectivity between inhibitory cells revealed a novel class of disinhibitory specialist targeting basket cells, in addition to familiar subclasses. Analysis of the inhibitory connectivity onto excitatory neurons found widespread specificity, with many interneurons exhibiting differential targeting of certain subpopulations spatially intermingled with other potential targets. Inhibitory targeting was organized into "motif groups," diverse sets of cells that collectively target both perisomatic and dendritic compartments of the same excitatory targets. Collectively, our analysis identified new organizing principles for cortical inhibition and will serve as a foundation for linking modern multimodal neuronal atlases with the cortical wiring diagram.

Synaptic plasticity defect following visual deprivation in Alzheimer's disease model transgenic mice.

Amyloid-ß (Aß)-induced changes in synaptic function in experimental models of Alzheimer's disease (AD) suggest that Aß generation and accumulation may affect fundamental mechanisms of synaptic plasticity. To test this hypothesis, we examined the effect of APP overexpression on a well characterized, in vivo, developmental model of systems-level plasticity, ocular dominance plasticity. Following monocular visual deprivation during the critical period, mice that express mutant alleles of amyloid precursor protein (APPswe) and Presenilin1 (PS1dE9), as well as mice that express APPswe alone, lack ocular dominance plasticity in visual cortex. Defects in the spatial extent and magnitude of the plastic response are evident using two complementary approaches, Arc induction and optical imaging of intrinsic signals in awake mice. This defect in a classic paradigm of systems level synaptic plasticity shows that Aß overexpression, even early in postnatal life, can perturb plasticity in cerebral cortex, and supports the idea that decreased synaptic plasticity due to elevated Aß exposure contributes to cognitive impairment in AD.

Expansion-assisted selective plane illumination microscopy for nanoscale imaging of centimeter-scale tissues.

Recent advances in tissue processing, labeling, and fluorescence microscopy are providing unprecedented views of the structure of cells and tissues at sub-diffraction resolutions and near single molecule sensitivity, driving discoveries in diverse fields of biology, including neuroscience. Biological tissue is organized over scales of nanometers to centimeters. Harnessing molecular imaging across three-dimensional samples on this scale requires new types of microscopes with larger fields of view and working distance, as well as higher imaging throughput. We present a new expansion-assisted selective plane illumination microscope (ExA-SPIM) with diffraction-limited and aberration-free performance over a large field of view (85 mm 2 ) and working distance (35 mm). Combined with new tissue clearing and expansion methods, the microscope allows nanoscale imaging of centimeter-scale samples, including entire mouse brains, with diffraction-limited resolutions and high contrast without sectioning. We illustrate ExA-SPIM by reconstructing individual neurons across the mouse brain, imaging cortico-spinal neurons in the macaque motor cortex, and tracing axons in human white matter.

CAVE: Connectome Annotation Versioning Engine.

Advances in Electron Microscopy, image segmentation and computational infrastructure have given rise to large-scale and richly annotated connectomic datasets which are increasingly shared across communities. To enable collaboration, users need to be able to concurrently create new annotations and correct errors in the automated segmentation by proofreading. In large datasets, every proofreading edit relabels cell identities of millions of voxels and thousands of annotations like synapses. For analysis, users require immediate and reproducible access to this constantly changing and expanding data landscape. Here, we present the Connectome Annotation Versioning Engine (CAVE), a computational infrastructure for immediate and reproducible connectome analysis in up-to petascale datasets (~1mm3) while proofreading and annotating is ongoing. For segmentation, CAVE provides a distributed proofreading infrastructure for continuous versioning of large reconstructions. Annotations in CAVE are defined by locations such that they can be quickly assigned to the underlying segment which enables fast analysis queries of CAVE's data for arbitrary time points. CAVE supports schematized, extensible annotations, so that researchers can readily design novel annotation types. CAVE is already used for many connectomics datasets, including the largest datasets available to date.

Local diversity and fine-scale organization of receptive fields in mouse visual cortex.

Many thousands of cortical neurons are activated by any single sensory stimulus, but the organization of these populations is poorly understood. For example, are neurons in mouse visual cortex--whose preferred orientations are arranged randomly--organized with respect to other response properties? Using high-speed in vivo two-photon calcium imaging, we characterized the receptive fields of up to 100 excitatory and inhibitory neurons in a 200 µm imaged plane. Inhibitory neurons had nonlinearly summating, complex-like receptive fields and were weakly tuned for orientation. Excitatory neurons had linear, simple receptive fields that can be studied with noise stimuli and system identification methods. We developed a wavelet stimulus that evoked rich population responses and yielded the detailed spatial receptive fields of most excitatory neurons in a plane. Receptive fields and visual responses were locally highly diverse, with nearby neurons having largely dissimilar receptive fields and response time courses. Receptive-field diversity was consistent with a nearly random sampling of orientation, spatial phase, and retinotopic position. Retinotopic positions varied locally on average by approximately half the receptive-field size. Nonetheless, the retinotopic progression across the cortex could be demonstrated at the scale of 100 µm, with a magnification of ≈ 10 µm/°. Receptive-field and response similarity were in register, decreasing by 50% over a distance of 200 µm. Together, the results indicate considerable randomness in local populations of mouse visual cortical neurons, with retinotopy as the principal source of organization at the scale of hundreds of micrometers.

Large-scale automated histology in the pursuit of connectomes.

How does the brain compute? Answering this question necessitates neuronal connectomes, annotated graphs of all synaptic connections within defined brain areas. Further, understanding the energetics of the brain's computations requires vascular graphs. The assembly of a connectome requires sensitive hardware tools to measure neuronal and neurovascular features in all three dimensions, as well as software and machine learning for data analysis and visualization. We present the state of the art on the reconstruction of circuits and vasculature that link brain anatomy and function. Analysis at the scale of tens of nanometers yields connections between identified neurons, while analysis at the micrometer scale yields probabilistic rules of connection between neurons and exact vascular connectivity.

Highly ordered arrangement of single neurons in orientation pinwheels.

In the visual cortex of higher mammals, neurons are arranged across the cortical surface in an orderly map of preferred stimulus orientations. This map contains 'orientation pinwheels', structures that are arranged like the spokes of a wheel such that orientation changes continuously around a centre. Conventional optical imaging first demonstrated these pinwheels, but the technique lacked the spatial resolution to determine the response properties and arrangement of cells near pinwheel centres. Electrophysiological recordings later demonstrated sharply selective neurons near pinwheel centres, but it remained unclear whether they were arranged randomly or in an orderly fashion. Here we use two-photon calcium imaging in vivo to determine the microstructure of pinwheel centres in cat visual cortex with single-cell resolution. We find that pinwheel centres are highly ordered: neurons selective to different orientations are clearly segregated even in the very centre. Thus, pinwheel centres truly represent singularities in the cortical map. This highly ordered arrangement at the level of single cells suggests great precision in the development of cortical circuits underlying orientation selectivity.

A scalable and modular automated pipeline for stitching of large electron microscopy datasets.

Serial-section electron microscopy (ssEM) is the method of choice for studying macroscopic biological samples at extremely high resolution in three dimensions. In the nervous system, nanometer-scale images are necessary to reconstruct dense neural wiring diagrams in the brain, so -called connectomes. The data that can comprise of up to 108 individual EM images must be assembled into a volume, requiring seamless 2D registration from physical section followed by 3D alignment of the stitched sections. The high throughput of ssEM necessitates 2D stitching to be done at the pace of imaging, which currently produces tens of terabytes per day. To achieve this, we present a modular volume assembly software pipeline ASAP (Assembly Stitching and Alignment Pipeline) that is scalable to datasets containing petabytes of data and parallelized to work in a distributed computational environment. The pipeline is built on top of the Render Trautman and Saalfeld (2019) services used in the volume assembly of the brain of adult Drosophila melanogaster (Zheng et al. 2018). It achieves high throughput by operating only on image meta-data and transformations. ASAP is modular, allowing for easy incorporation of new algorithms without significant changes in the workflow. The entire software pipeline includes a complete set of tools for stitching, automated quality control, 3D section alignment, and final rendering of the assembled volume to disk. ASAP has been deployed for continuous stitching of several large-scale datasets of the mouse visual cortex and human brain samples including one cubic millimeter of mouse visual cortex (Yin et al. 2020); Microns Consortium et al. (2021) at speeds that exceed imaging. The pipeline also has multi-channel processing capabilities and can be applied to fluorescence and multi-modal datasets like array tomography.