Cell-type-specific inhibitory circuitry from a connectomic census of mouse visual cortex.

Mammalian cortex features a vast diversity of neuronal cell types, each with characteristic anatomical, molecular and functional properties. Synaptic connectivity powerfully shapes how each cell type participates in the cortical circuit, but mapping connectivity rules at the resolution of distinct cell types remains difficult. Here, we used millimeter-scale volumetric electron microscopy1 to investigate the connectivity of all inhibitory neurons across a densely-segmented neuronal population of 1352 cells spanning all layers of mouse visual cortex, producing a wiring diagram of inhibitory connections with more than 70,000 synapses. Taking a data-driven approach inspired by classical neuroanatomy, we classified inhibitory neurons based on the relative targeting of dendritic compartments and other inhibitory cells and developed a novel classification of excitatory neurons based on the morphological and synaptic input properties. The synaptic connectivity between inhibitory cells revealed a novel class of disinhibitory specialist targeting basket cells, in addition to familiar subclasses. Analysis of the inhibitory connectivity onto excitatory neurons found widespread specificity, with many interneurons exhibiting differential targeting of certain subpopulations spatially intermingled with other potential targets. Inhibitory targeting was organized into "motif groups," diverse sets of cells that collectively target both perisomatic and dendritic compartments of the same excitatory targets. Collectively, our analysis identified new organizing principles for cortical inhibition and will serve as a foundation for linking modern multimodal neuronal atlases with the cortical wiring diagram.

CAVE: Connectome Annotation Versioning Engine.

Advances in Electron Microscopy, image segmentation and computational infrastructure have given rise to large-scale and richly annotated connectomic datasets which are increasingly shared across communities. To enable collaboration, users need to be able to concurrently create new annotations and correct errors in the automated segmentation by proofreading. In large datasets, every proofreading edit relabels cell identities of millions of voxels and thousands of annotations like synapses. For analysis, users require immediate and reproducible access to this constantly changing and expanding data landscape. Here, we present the Connectome Annotation Versioning Engine (CAVE), a computational infrastructure for immediate and reproducible connectome analysis in up-to petascale datasets (~1mm3) while proofreading and annotating is ongoing. For segmentation, CAVE provides a distributed proofreading infrastructure for continuous versioning of large reconstructions. Annotations in CAVE are defined by locations such that they can be quickly assigned to the underlying segment which enables fast analysis queries of CAVE's data for arbitrary time points. CAVE supports schematized, extensible annotations, so that researchers can readily design novel annotation types. CAVE is already used for many connectomics datasets, including the largest datasets available to date.

Expansion-assisted selective plane illumination microscopy for nanoscale imaging of centimeter-scale tissues.

Recent advances in tissue processing, labeling, and fluorescence microscopy are providing unprecedented views of the structure of cells and tissues at sub-diffraction resolutions and near single molecule sensitivity, driving discoveries in diverse fields of biology, including neuroscience. Biological tissue is organized over scales of nanometers to centimeters. Harnessing molecular imaging across three-dimensional samples on this scale requires new types of microscopes with larger fields of view and working distance, as well as higher imaging throughput. We present a new expansion-assisted selective plane illumination microscope (ExA-SPIM) with diffraction-limited and aberration-free performance over a large field of view (85 mm 2 ) and working distance (35 mm). Combined with new tissue clearing and expansion methods, the microscope allows nanoscale imaging of centimeter-scale samples, including entire mouse brains, with diffraction-limited resolutions and high contrast without sectioning. We illustrate ExA-SPIM by reconstructing individual neurons across the mouse brain, imaging cortico-spinal neurons in the macaque motor cortex, and tracing axons in human white matter.

Oligodendrocyte precursor cells ingest axons in the mouse neocortex.

Neurons in the developing brain undergo extensive structural refinement as nascent circuits adopt their mature form. This physical transformation of neurons is facilitated by the engulfment and degradation of axonal branches and synapses by surrounding glial cells, including microglia and astrocytes. However, the small size of phagocytic organelles and the complex, highly ramified morphology of glia have made it difficult to define the contribution of these and other glial cell types to this crucial process. Here, we used large-scale, serial section transmission electron microscopy (TEM) with computational volume segmentation to reconstruct the complete 3D morphologies of distinct glial types in the mouse visual cortex, providing unprecedented resolution of their morphology and composition. Unexpectedly, we discovered that the fine processes of oligodendrocyte precursor cells (OPCs), a population of abundant, highly dynamic glial progenitors, frequently surrounded small branches of axons. Numerous phagosomes and phagolysosomes (PLs) containing fragments of axons and vesicular structures were present inside their processes, suggesting that OPCs engage in axon pruning. Single-nucleus RNA sequencing from the developing mouse cortex revealed that OPCs express key phagocytic genes at this stage, as well as neuronal transcripts, consistent with active axon engulfment. Although microglia are thought to be responsible for the majority of synaptic pruning and structural refinement, PLs were ten times more abundant in OPCs than in microglia at this stage, and these structures were markedly less abundant in newly generated oligodendrocytes, suggesting that OPCs contribute substantially to the refinement of neuronal circuits during cortical development.

Binary and analog variation of synapses between cortical pyramidal neurons.

Learning from experience depends at least in part on changes in neuronal connections. We present the largest map of connectivity to date between cortical neurons of a defined type (layer 2/3 [L2/3] pyramidal cells in mouse primary visual cortex), which was enabled by automated analysis of serial section electron microscopy images with improved handling of image defects (250 × 140 × 90 µm3 volume). We used the map to identify constraints on the learning algorithms employed by the cortex. Previous cortical studies modeled a continuum of synapse sizes by a log-normal distribution. A continuum is consistent with most neural network models of learning, in which synaptic strength is a continuously graded analog variable. Here, we show that synapse size, when restricted to synapses between L2/3 pyramidal cells, is well modeled by the sum of a binary variable and an analog variable drawn from a log-normal distribution. Two synapses sharing the same presynaptic and postsynaptic cells are known to be correlated in size. We show that the binary variables of the two synapses are highly correlated, while the analog variables are not. Binary variation could be the outcome of a Hebbian or other synaptic plasticity rule depending on activity signals that are relatively uniform across neuronal arbors, while analog variation may be dominated by other influences such as spontaneous dynamical fluctuations. We discuss the implications for the longstanding hypothesis that activity-dependent plasticity switches synapses between bistable states.

A scalable and modular automated pipeline for stitching of large electron microscopy datasets.

Serial-section electron microscopy (ssEM) is the method of choice for studying macroscopic biological samples at extremely high resolution in three dimensions. In the nervous system, nanometer-scale images are necessary to reconstruct dense neural wiring diagrams in the brain, so -called connectomes. The data that can comprise of up to 108 individual EM images must be assembled into a volume, requiring seamless 2D registration from physical section followed by 3D alignment of the stitched sections. The high throughput of ssEM necessitates 2D stitching to be done at the pace of imaging, which currently produces tens of terabytes per day. To achieve this, we present a modular volume assembly software pipeline ASAP (Assembly Stitching and Alignment Pipeline) that is scalable to datasets containing petabytes of data and parallelized to work in a distributed computational environment. The pipeline is built on top of the Render Trautman and Saalfeld (2019) services used in the volume assembly of the brain of adult Drosophila melanogaster (Zheng et al. 2018). It achieves high throughput by operating only on image meta-data and transformations. ASAP is modular, allowing for easy incorporation of new algorithms without significant changes in the workflow. The entire software pipeline includes a complete set of tools for stitching, automated quality control, 3D section alignment, and final rendering of the assembled volume to disk. ASAP has been deployed for continuous stitching of several large-scale datasets of the mouse visual cortex and human brain samples including one cubic millimeter of mouse visual cortex (Yin et al. 2020); Microns Consortium et al. (2021) at speeds that exceed imaging. The pipeline also has multi-channel processing capabilities and can be applied to fluorescence and multi-modal datasets like array tomography.

A hybrid open-top light-sheet microscope for versatile multi-scale imaging of cleared tissues.

Light-sheet microscopy has emerged as the preferred means for high-throughput volumetric imaging of cleared tissues. However, there is a need for a flexible system that can address imaging applications with varied requirements in terms of resolution, sample size, tissue-clearing protocol, and transparent sample-holder material. Here, we present a 'hybrid' system that combines a unique non-orthogonal dual-objective and conventional (orthogonal) open-top light-sheet (OTLS) architecture for versatile multi-scale volumetric imaging. We demonstrate efficient screening and targeted sub-micrometer imaging of sparse axons within an intact, cleared mouse brain. The same system enables high-throughput automated imaging of multiple specimens, as spotlighted by a quantitative multi-scale analysis of brain metastases. Compared with existing academic and commercial light-sheet microscopy systems, our hybrid OTLS system provides a unique combination of versatility and performance necessary to satisfy the diverse requirements of a growing number of cleared-tissue imaging applications.

Reconstruction of neocortex: Organelles, compartments, cells, circuits, and activity.

We assembled a semi-automated reconstruction of L2/3 mouse primary visual cortex from ∼250 × 140 × 90 µm3 of electron microscopic images, including pyramidal and non-pyramidal neurons, astrocytes, microglia, oligodendrocytes and precursors, pericytes, vasculature, nuclei, mitochondria, and synapses. Visual responses of a subset of pyramidal cells are included. The data are publicly available, along with tools for programmatic and three-dimensional interactive access. Brief vignettes illustrate the breadth of potential applications relating structure to function in cortical circuits and neuronal cell biology. Mitochondria and synapse organization are characterized as a function of path length from the soma. Pyramidal connectivity motif frequencies are predicted accurately using a configuration model of random graphs. Pyramidal cells receiving more connections from nearby cells exhibit stronger and more reliable visual responses. Sample code shows data access and analysis.

Structure and function of axo-axonic inhibition.

Inhibitory neurons in mammalian cortex exhibit diverse physiological, morphological, molecular, and connectivity signatures. While considerable work has measured the average connectivity of several interneuron classes, there remains a fundamental lack of understanding of the connectivity distribution of distinct inhibitory cell types with synaptic resolution, how it relates to properties of target cells, and how it affects function. Here, we used large-scale electron microscopy and functional imaging to address these questions for chandelier cells in layer 2/3 of the mouse visual cortex. With dense reconstructions from electron microscopy, we mapped the complete chandelier input onto 153 pyramidal neurons. We found that synapse number is highly variable across the population and is correlated with several structural features of the target neuron. This variability in the number of axo-axonic ChC synapses is higher than the variability seen in perisomatic inhibition. Biophysical simulations show that the observed pattern of axo-axonic inhibition is particularly effective in controlling excitatory output when excitation and inhibition are co-active. Finally, we measured chandelier cell activity in awake animals using a cell-type-specific calcium imaging approach and saw highly correlated activity across chandelier cells. In the same experiments, in vivo chandelier population activity correlated with pupil dilation, a proxy for arousal. Together, these results suggest that chandelier cells provide a circuit-wide signal whose strength is adjusted relative to the properties of target neurons.

Laminar distribution and arbor density of two functional classes of thalamic inputs to primary visual cortex.

Motion/direction-sensitive and location-sensitive neurons are the two major functional types in mouse visual thalamus that project to the primary visual cortex (V1). It is under debate whether motion/direction-sensitive inputs preferentially target the superficial layers in V1, as opposed to the location-sensitive inputs, which preferentially target the middle layers. Here, by using calcium imaging to measure the activity of motion/direction-sensitive and location-sensitive axons in V1, we find evidence against these cell-type-specific laminar biases at the population level. Furthermore, using an approach to reconstruct axon arbors with identified in vivo response types, we show that, at the single-axon level, the motion/direction-sensitive axons project more densely to the middle layers than the location-sensitive axons. Overall, our results demonstrate that motion/direction-sensitive thalamic neurons project extensively to the middle layers of V1 at both the population and single-cell levels, providing further insight into the organization of thalamocortical projection in the mouse visual system.

Autoencoder networks extract latent variables and encode these variables in their connectomes.

Advances in electron microscopy and data processing techniques are leading to increasingly large and complete microscale connectomes. At the same time, advances in artificial neural networks have produced model systems that perform comparably rich computations with perfectly specified connectivity. This raises an exciting scientific opportunity for the study of both biological and artificial neural networks: to infer the underlying circuit function from the structure of its connectivity. A potential roadblock, however, is that - even with well constrained neural dynamics - there are in principle many different connectomes that could support a given computation. Here, we define a tractable setting in which the problem of inferring circuit function from circuit connectivity can be analyzed in detail: the function of input compression and reconstruction, in an autoencoder network with a single hidden layer. Here, in general there is substantial ambiguity in the weights that can produce the same circuit function, because largely arbitrary changes to input weights can be undone by applying the inverse modifications to the output weights. However, we use mathematical arguments and simulations to show that adding simple, biologically motivated regularization of connectivity resolves this ambiguity in an interesting way: weights are constrained such that the latent variable structure underlying the inputs can be extracted from the weights by using nonlinear dimensionality reduction methods.

Chromatic micromaps in primary visual cortex.

The clustering of neurons with similar response properties is a conspicuous feature of neocortex. In primary visual cortex (V1), maps of several properties like orientation preference are well described, but the functional architecture of color, central to visual perception in trichromatic primates, is not. Here we used two-photon calcium imaging in macaques to examine the fine structure of chromatic representation and found that neurons responsive to spatially uniform, chromatic stimuli form unambiguous clusters that coincide with blobs. Further, these responsive groups have marked substructure, segregating into smaller ensembles or micromaps with distinct chromatic signatures that appear columnar in upper layer 2/3. Spatially structured chromatic stimuli revealed maps built on the same micromap framework but with larger subdomains that go well beyond blobs. We conclude that V1 has an architecture for color representation that switches between blobs and a combined blob/interblob system based on the spatial content of the visual scene.

Relationship between simultaneously recorded spiking activity and fluorescence signal in GCaMP6 transgenic mice.

Fluorescent calcium indicators are often used to investigate neural dynamics, but the relationship between fluorescence and action potentials (APs) remains unclear. Most APs can be detected when the soma almost fills the microscope's field of view, but calcium indicators are used to image populations of neurons, necessitating a large field of view, generating fewer photons per neuron, and compromising AP detection. Here, we characterized the AP-fluorescence transfer function in vivo for 48 layer 2/3 pyramidal neurons in primary visual cortex, with simultaneous calcium imaging and cell-attached recordings from transgenic mice expressing GCaMP6s or GCaMP6f. While most APs were detected under optimal conditions, under conditions typical of population imaging studies, only a minority of 1 AP and 2 AP events were detected (often <10% and ~20-30%, respectively), emphasizing the limits of AP detection under more realistic imaging conditions.

Neurons, the cells that make up the nervous system, transmit information using electrical signals known as action potentials or spikes. Studying the spiking patterns of neurons in the brain is essential to understand perception, memory, thought, and behaviour. One way to do that is by recording electrical activity with microelectrodes. Another way to study neuronal activity is by using molecules that change how they interact with light when calcium binds to them, since changes in calcium concentration can be indicative of neuronal spiking. That change can be observed with specialized microscopes know as two-photon fluorescence microscopes. Using calcium indicators, it is possible to simultaneously record hundreds or even thousands of neurons. However, calcium fluorescence and spikes do not translate one-to-one. In order to interpret fluorescence data, it is important to understand the relationship between the fluorescence signals and the spikes associated with individual neurons. The only way to directly measure this relationship is by using calcium imaging and electrical recording simultaneously to record activity from the same neuron. However, this is extremely challenging experimentally, so this type of data is rare. To shed some light on this, Huang, Ledochowitsch et al. used mice that had been genetically modified to produce a calcium indicator in neurons of the visual cortex and simultaneously obtained both fluorescence measurements and electrical recordings from these neurons. These experiments revealed that, while the majority of time periods containing multi-spike neural activity could be identified using calcium imaging microscopy, on average, less than 10% of isolated single spikes were detectable. This is an important caveat that researchers need to take into consideration when interpreting calcium imaging results. These findings are intended to serve as a guide for interpreting calcium imaging studies that look at neurons in the mammalian brain at the population level. In addition, the data provided will be useful as a reference for the development of activity sensors, and to benchmark and improve computational approaches for detecting and predicting spikes.

A petascale automated imaging pipeline for mapping neuronal circuits with high-throughput transmission electron microscopy.

Electron microscopy (EM) is widely used for studying cellular structure and network connectivity in the brain. We have built a parallel imaging pipeline using transmission electron microscopes that scales this technology, implements 24/7 continuous autonomous imaging, and enables the acquisition of petascale datasets. The suitability of this architecture for large-scale imaging was demonstrated by acquiring a volume of more than 1 mm3 of mouse neocortex, spanning four different visual areas at synaptic resolution, in less than 6 months. Over 26,500 ultrathin tissue sections from the same block were imaged, yielding a dataset of more than 2 petabytes. The combined burst acquisition rate of the pipeline is 3 Gpixel per sec and the net rate is 600 Mpixel per sec with six microscopes running in parallel. This work demonstrates the feasibility of acquiring EM datasets at the scale of cortical microcircuits in multiple brain regions and species.

The Mind of a Mouse.

Large scientific projects in genomics and astronomy are influential not because they answer any single question but because they enable investigation of continuously arising new questions from the same data-rich sources. Advances in automated mapping of the brain's synaptic connections (connectomics) suggest that the complicated circuits underlying brain function are ripe for analysis. We discuss benefits of mapping a mouse brain at the level of synapses.

Capillary-Based and Stokes-Based Trapping of Serial Sections for Scalable 3D-EM Connectomics.

Serial section electron microscopy (ssEM), a technique where volumes of tissue can be anatomically reconstructed by imaging consecutive tissue slices, has proven to be a powerful tool for the investigation of brain anatomy. Between the process of cutting the slices, or "sections," and imaging them, however, handling 10°-106 delicate sections remains a bottleneck in ssEM, especially for batches in the "mesoscale" regime, i.e., 102-103 sections. We present a tissue section handling device that transports and positions sections, accurately and repeatability, for automated, robotic section pick-up and placement onto an imaging substrate. The device interfaces with a conventional ultramicrotomy diamond knife, accomplishing in-line, exact-constraint trapping of sections with 100-µm repeatability. An associated mathematical model includes capillary-based and Stokes-based forces, accurately describing observed behavior and fundamentally extends the modeling of water-air interface forces. Using the device, we demonstrate and describe the limits of reliable handling of hundreds of slices onto a variety of electron and light microscopy substrates without significant defects (n = 8 datasets composed of 126 serial sections in an automated fashion with an average loss rate and throughput of 0.50% and 63 s/section, respectively. In total, this work represents an automated mesoscale serial sectioning system for scalable 3D-EM connectomics.

Visual physiology of the layer 4 cortical circuit in silico.

Despite advances in experimental techniques and accumulation of large datasets concerning the composition and properties of the cortex, quantitative modeling of cortical circuits under in-vivo-like conditions remains challenging. Here we report and publicly release a biophysically detailed circuit model of layer 4 in the mouse primary visual cortex, receiving thalamo-cortical visual inputs. The 45,000-neuron model was subjected to a battery of visual stimuli, and results were compared to published work and new in vivo experiments. Simulations reproduced a variety of observations, including effects of optogenetic perturbations. Critical to the agreement between responses in silico and in vivo were the rules of functional synaptic connectivity between neurons. Interestingly, after extreme simplification the model still performed satisfactorily on many measurements, although quantitative agreement with experiments suffered. These results emphasize the importance of functional rules of cortical wiring and enable a next generation of data-driven models of in vivo neural activity and computations.

Large-scale neuroanatomy using LASSO: Loop-based Automated Serial Sectioning Operation.

Serial section transmission electron microscopy (ssTEM) is the most promising tool for investigating the three-dimensional anatomy of the brain with nanometer resolution. Yet as the field progresses to larger volumes of brain tissue, new methods for high-yield, low-cost, and high-throughput serial sectioning are required. Here, we introduce LASSO (Loop-based Automated Serial Sectioning Operation), in which serial sections are processed in "batches." Batches are quantized groups of individual sections that, in LASSO, are cut with a diamond knife, picked up from an attached waterboat, and placed onto microfabricated TEM substrates using rapid, accurate, and repeatable robotic tools. Additionally, we introduce mathematical models for ssTEM with respect to yield, throughput, and cost to access ssTEM scalability. To validate the method experimentally, we processed 729 serial sections of human brain tissue (~40 nm x 1 mm x 1 mm). Section yield was 727/729 (99.7%). Sections were placed accurately and repeatably (x-direction: -20 ± 110 µm (1 s.d.), y-direction: 60 ± 150 µm (1 s.d.)) with a mean cycle time of 43 s ± 12 s (1 s.d.). High-magnification (2.5 nm/px) TEM imaging was conducted to measure the image quality. We report no significant distortion, information loss, or substrate-derived artifacts in the TEM images. Quantitatively, the edge spread function across vesicle edges and image contrast were comparable, suggesting that LASSO does not negatively affect image quality. In total, LASSO compares favorably with traditional serial sectioning methods with respect to throughput, yield, and cost for large-scale experiments, and represents a flexible, scalable, and accessible technology platform to enable the next generation of neuroanatomical studies.

Transport and trapping of nanosheets via hydrodynamic forces and curvature-induced capillary quadrupolar interactions.

HYPOTHESIS: The manipulation of nanosheets on a fluid-fluid interface remains a significant challenge. At this interface, hydrodynamic forces can be used for long-range transport (>1× capillary length) but are difficult to utilize for accurate and repeatable positioning. While capillary multipole interactions have been used for particle trapping, how these interactions manifest on large but thin objects, i.e., nanosheets, remains an open question. Hence, we posit hydrodynamic forces in conjunction with capillary multipole interactions can be used for nanosheet transport and trapping. EXPERIMENTS: We designed and characterized a fluidic device for transporting and trapping nanosheets on the water-air interface. Analytical models were compared against optical measurements of the nanosheet behavior to investigate capillary multipole interactions. Energy-based modeling and dimensional analysis were used to study trapping stability. FINDINGS: Hydrodynamic forces and capillary interactions successfully transported and trapped nanosheets at a designated trapping location with a repeatability of 10% of the nanosheet's length and 12% of its width (length = 1500 µm, width = 1000 µm) and an accuracy of 20% of their length and width. Additionally, this is the first report that surface tension forces acting upon nanoscale-thick objects manifest as capillary quadrupolar interactions and can be used for precision manipulation of nanosheets.

Nontoxic, double-deletion-mutant rabies viral vectors for retrograde targeting of projection neurons.

Recombinant rabies viral vectors have proven useful for applications including retrograde targeting of projection neurons and monosynaptic tracing, but their cytotoxicity has limited their use to short-term experiments. Here we introduce a new class of double-deletion-mutant rabies viral vectors that left transduced cells alive and healthy indefinitely. Deletion of the viral polymerase gene abolished cytotoxicity and reduced transgene expression to trace levels but left vectors still able to retrogradely infect projection neurons and express recombinases, allowing downstream expression of other transgene products such as fluorophores and calcium indicators. The morphology of retrogradely targeted cells appeared unperturbed at 1 year postinjection. Whole-cell patch-clamp recordings showed no physiological abnormalities at 8 weeks. Longitudinal two-photon structural and functional imaging in vivo, tracking thousands of individual neurons for up to 4 months, showed that transduced neurons did not die but retained stable visual response properties even at the longest time points imaged.