Genetically encoded barcodes for correlative volume electron microscopy.

While genetically encoded reporters are common for fluorescence microscopy, equivalent multiplexable gene reporters for electron microscopy (EM) are still scarce. Here, by installing a variable number of fixation-stable metal-interacting moieties in the lumen of encapsulin nanocompartments of different sizes, we developed a suite of spherically symmetric and concentric barcodes (EMcapsulins) that are readable by standard EM techniques. Six classes of EMcapsulins could be automatically segmented and differentiated. The coding capacity was further increased by arranging several EMcapsulins into distinct patterns via a set of rigid spacers of variable length. Fluorescent EMcapsulins were expressed to monitor subcellular structures in light and EM. Neuronal expression in Drosophila and mouse brains enabled the automatic identification of genetically defined cells in EM. EMcapsulins are compatible with transmission EM, scanning EM and focused ion beam scanning EM. The expandable palette of genetically controlled EM-readable barcodes can augment anatomical EM images with multiplexed gene expression maps.

SyConn2: dense synaptic connectivity inference for volume electron microscopy.

The ability to acquire ever larger datasets of brain tissue using volume electron microscopy leads to an increasing demand for the automated extraction of connectomic information. We introduce SyConn2, an open-source connectome analysis toolkit, which works with both on-site high-performance compute environments and rentable cloud computing clusters. SyConn2 was tested on connectomic datasets with more than 10 million synapses, provides a web-based visualization interface and makes these data amenable to complex anatomical and neuronal connectivity queries.

Public Volume Electron Microscopy Data: An Essential Resource to Study the Brain Microvasculature.

Electron microscopy is the primary approach to study ultrastructural features of the cerebrovasculature. However, 2D snapshots of a vascular bed capture only a small fraction of its complexity. Recent efforts to synaptically map neuronal circuitry using volume electron microscopy have also sampled the brain microvasculature in 3D. Here, we perform a meta-analysis of 7 data sets spanning different species and brain regions, including two data sets from the MICrONS consortium that have made efforts to segment vasculature in addition to all parenchymal cell types in mouse visual cortex. Exploration of these data have revealed rich information for detailed investigation of the cerebrovasculature. Neurovascular unit cell types (including, but not limited to, endothelial cells, mural cells, perivascular fibroblasts, microglia, and astrocytes) could be discerned across broad microvascular zones. Image contrast was sufficient to identify subcellular details, including endothelial junctions, caveolae, peg-and-socket interactions, mitochondria, Golgi cisternae, microvilli and other cellular protrusions of potential significance to vascular signaling. Additionally, non-cellular structures including the basement membrane and perivascular spaces were visible and could be traced between arterio-venous zones along the vascular wall. These explorations revealed structural features that may be important for vascular functions, such as blood-brain barrier integrity, blood flow control, brain clearance, and bioenergetics. They also identified limitations where accuracy and consistency of segmentation could be further honed by future efforts. The purpose of this article is to introduce these valuable community resources within the framework of cerebrovascular research. We do so by providing an assessment of their vascular contents, identifying features of significance for further study, and discussing next step ideas for refining vascular segmentation and analysis.

Learning cellular morphology with neural networks.

Reconstruction and annotation of volume electron microscopy data sets of brain tissue is challenging but can reveal invaluable information about neuronal circuits. Significant progress has recently been made in automated neuron reconstruction as well as automated detection of synapses. However, methods for automating the morphological analysis of nanometer-resolution reconstructions are less established, despite the diversity of possible applications. Here, we introduce cellular morphology neural networks (CMNs), based on multi-view projections sampled from automatically reconstructed cellular fragments of arbitrary size and shape. Using unsupervised training, we infer morphology embeddings (Neuron2vec) of neuron reconstructions and train CMNs to identify glia cells in a supervised classification paradigm, which are then used to resolve neuron reconstruction errors. Finally, we demonstrate that CMNs can be used to identify subcellular compartments and the cell types of neuron reconstructions.

Automated synaptic connectivity inference for volume electron microscopy.

Teravoxel volume electron microscopy data sets from neural tissue can now be acquired in weeks, but data analysis requires years of manual labor. We developed the SyConn framework, which uses deep convolutional neural networks and random forest classifiers to infer a richly annotated synaptic connectivity matrix from manual neurite skeleton reconstructions by automatically identifying mitochondria, synapses and their types, axons, dendrites, spines, myelin, somata and cell types. We tested our approach on serial block-face electron microscopy data sets from zebrafish, mouse and zebra finch, and computed the synaptic wiring of songbird basal ganglia. We found that, for example, basal-ganglia cell types with high firing rates in vivo had higher densities of mitochondria and vesicles and that synapse sizes and quantities scaled systematically, depending on the innervated postsynaptic cell types.

Evidence for a causal inverse model in an avian cortico-basal ganglia circuit.

Learning by imitation is fundamental to both communication and social behavior and requires the conversion of complex, nonlinear sensory codes for perception into similarly complex motor codes for generating action. To understand the neural substrates underlying this conversion, we study sensorimotor transformations in songbird cortical output neurons of a basal-ganglia pathway involved in song learning. Despite the complexity of sensory and motor codes, we find a simple, temporally specific, causal correspondence between them. Sensory neural responses to song playback mirror motor-related activity recorded during singing, with a temporal offset of roughly 40 ms, in agreement with short feedback loop delays estimated using electrical and auditory stimulation. Such matching of mirroring offsets and loop delays is consistent with a recent Hebbian theory of motor learning and suggests that cortico-basal ganglia pathways could support motor control via causal inverse models that can invert the rich correspondence between motor exploration and sensory feedback.