A petavoxel fragment of human cerebral cortex reconstructed at nanoscale resolution.

To fully understand how the human brain works, knowledge of its structure at high resolution is needed. Presented here is a computationally intensive reconstruction of the ultrastructure of a cubic millimeter of human temporal cortex that was surgically removed to gain access to an underlying epileptic focus. It contains about 57,000 cells, about 230 millimeters of blood vessels, and about 150 million synapses and comprises 1.4 petabytes. Our analysis showed that glia outnumber neurons 2:1, oligodendrocytes were the most common cell, deep layer excitatory neurons could be classified on the basis of dendritic orientation, and among thousands of weak connections to each neuron, there exist rare powerful axonal inputs of up to 50 synapses. Further studies using this resource may bring valuable insights into the mysteries of the human brain.

Sample preparation methods for volume electron microscopy in mollusc Berghia stephanieae.

Creating a high-resolution brain atlas in diverse species offers crucial insights into general principles underlying brain function and development. A volume electron microscopy approach to generate such neural maps has been gaining importance due to advances in imaging, data storage capabilities, and data analysis protocols. Sample preparation remains challenging and is a crucial step to accelerate the imaging and data processing pipeline. Here, we introduce several replicable methods for processing the brains of the gastropod mollusc, Berghia stephanieae for volume electron microscopy. Although high-pressure freezing is the most reliable method, the depth of cryopreservation is a severe limitation for large tissue samples. We introduce a BROPA-based method using pyrogallol and methods to rapidly process samples that can save hours at the bench. This is the first report on sample preparation and imaging pipeline for volume electron microscopy in a gastropod mollusc, opening up the potential for connectomic analysis and comparisons with other phyla.

Mapping of neuronal and glial primary cilia contactome and connectome in the human cerebral cortex.

Primary cilia act as antenna receivers of environmental signals and enable effective neuronal or glial responses. Disruption of their function is associated with circuit disorders. To understand the signals these cilia receive, we comprehensively mapped cilia's contacts within the human cortical connectome using serial-section EM reconstruction of a 1 mm3 cortical volume, spanning the entire cortical thickness. We mapped the "contactome" of cilia emerging from neurons and astrocytes in every cortical layer. Depending on the layer and cell type, cilia make distinct patterns of contact. Primary cilia display cell-type- and layer-specific variations in size, shape, and microtubule axoneme core, which may affect their signaling competencies. Neuronal cilia are intrinsic components of a subset of cortical synapses and thus a part of the connectome. This diversity in the structure, contactome, and connectome of primary cilia endows each neuron or glial cell with a unique barcode of access to the surrounding neural circuitry.

Multi-layered maps of neuropil with segmentation-guided contrastive learning.

Maps of the nervous system that identify individual cells along with their type, subcellular components and connectivity have the potential to elucidate fundamental organizational principles of neural circuits. Nanometer-resolution imaging of brain tissue provides the necessary raw data, but inferring cellular and subcellular annotation layers is challenging. We present segmentation-guided contrastive learning of representations (SegCLR), a self-supervised machine learning technique that produces representations of cells directly from 3D imagery and segmentations. When applied to volumes of human and mouse cortex, SegCLR enables accurate classification of cellular subcompartments and achieves performance equivalent to a supervised approach while requiring 400-fold fewer labeled examples. SegCLR also enables inference of cell types from fragments as small as 10 µm, which enhances the utility of volumes in which many neurites are truncated at boundaries. Finally, SegCLR enables exploration of layer 5 pyramidal cell subtypes and automated large-scale analysis of synaptic partners in mouse visual cortex.

Probing Molecular Diversity and Ultrastructure of Brain Cells with Fluorescent Aptamers.

Detergent-free immunolabeling has been proven feasible for correlated light and electron microscopy, but its application is restricted by the availability of suitable affinity reagents. Here we introduce CAptVE, a method using slow off-rate modified aptamers for cell fluorescence labeling on ultrastructurally reconstructable electron micrographs. CAptVE provides labeling for a wide range of biomarkers, offering a pathway to integrate molecular analysis into recent approaches to delineate neural circuits via connectomics.

A Scalable Staining Strategy for Whole-Brain Connectomics.

Mapping the complete synaptic connectivity of a mammalian brain would be transformative, revealing the pathways underlying perception, behavior, and memory. Serial section electron microscopy, via membrane staining using osmium tetroxide, is ideal for visualizing cells and synaptic connections but, in whole brain samples, faces significant challenges related to chemical treatment and volume changes. These issues can adversely affect both the ultrastructural quality and macroscopic tissue integrity. By leveraging time-lapse X-ray imaging and brain proxies, we have developed a 12-step protocol, ODeCO, that effectively infiltrates osmium throughout an entire mouse brain while preserving ultrastructure without any cracks or fragmentation, a necessary prerequisite for constructing the first comprehensive mouse brain connectome.

Vimo - Visual Analysis of Neuronal Connectivity Motifs.

Recent advances in high-resolution connectomics provide researchers with access to accurate petascale reconstructions of neuronal circuits and brain networks for the first time. Neuroscientists are analyzing these networks to better understand information processing in the brain. In particular, scientists are interested in identifying specific small network motifs, i.e., repeating subgraphs of the larger brain network that are believed to be neuronal building blocks. Although such motifs are typically small (e.g., 2 - 6 neurons), the vast data sizes and intricate data complexity present significant challenges to the search and analysis process. To analyze these motifs, it is crucial to review instances of a motif in the brain network and then map the graph structure to detailed 3D reconstructions of the involved neurons and synapses. We present Vimo, an interactive visual approach to analyze neuronal motifs and motif chains in large brain networks. Experts can sketch network motifs intuitively in a visual interface and specify structural properties of the involved neurons and synapses to query large connectomics datasets. Motif instances (MIs) can be explored in high-resolution 3D renderings. To simplify the analysis of MIs, we designed a continuous focus&context metaphor inspired by visual abstractions. This allows users to transition from a highly-detailed rendering of the anatomical structure to views that emphasize the underlying motif structure and synaptic connectivity. Furthermore, Vimo supports the identification of motif chains where a motif is used repeatedly (e.g., 2 - 4 times) to form a larger network structure. We evaluate Vimo in a user study and an in-depth case study with seven domain experts on motifs in a large connectome of the fruit fly, including more than 21,000 neurons and 20 million synapses. We find that Vimo enables hypothesis generation and confirmation through fast analysis iterations and connectivity highlighting.

Preserving extracellular space for high-quality optical and ultrastructural studies of whole mammalian brains.

Analysis of brain structure, connectivity, and molecular diversity relies on effective tissue fixation. Conventional tissue fixation causes extracellular space (ECS) loss, complicating the segmentation of cellular objects from electron microscopy datasets. Previous techniques for preserving ECS in mammalian brains utilizing high-pressure perfusion can give inconsistent results owing to variations in the hydrostatic pressure within the vasculature. A more reliable fixation protocol that uniformly preserves the ECS throughout whole brains would greatly benefit a wide range of neuroscience studies. Here, we report a straightforward transcardial perfusion strategy that preserves ECS throughout the whole rodent brain. No special setup is needed besides sequential solution changes, and the protocol offers excellent reproducibility. In addition to better capturing tissue ultrastructure, preservation of ECS has many downstream advantages such as accelerating heavy-metal staining for electron microscopy, improving detergent-free immunohistochemistry for correlated light and electron microscopy, and facilitating lipid removal for tissue clearing.

mEMbrain: an interactive deep learning MATLAB tool for connectomic segmentation on commodity desktops.

Connectomics is fundamental in propelling our understanding of the nervous system's organization, unearthing cells and wiring diagrams reconstructed from volume electron microscopy (EM) datasets. Such reconstructions, on the one hand, have benefited from ever more precise automatic segmentation methods, which leverage sophisticated deep learning architectures and advanced machine learning algorithms. On the other hand, the field of neuroscience at large, and of image processing in particular, has manifested a need for user-friendly and open source tools which enable the community to carry out advanced analyses. In line with this second vein, here we propose mEMbrain, an interactive MATLAB-based software which wraps algorithms and functions that enable labeling and segmentation of electron microscopy datasets in a user-friendly user interface compatible with Linux and Windows. Through its integration as an API to the volume annotation and segmentation tool VAST, mEMbrain encompasses functions for ground truth generation, image preprocessing, training of deep neural networks, and on-the-fly predictions for proofreading and evaluation. The final goals of our tool are to expedite manual labeling efforts and to harness MATLAB users with an array of semi-automatic approaches for instance segmentation. We tested our tool on a variety of datasets that span different species at various scales, regions of the nervous system and developmental stages. To further expedite research in connectomics, we provide an EM resource of ground truth annotation from four different animals and five datasets, amounting to around 180 h of expert annotations, yielding more than 1.2 GB of annotated EM images. In addition, we provide a set of four pre-trained networks for said datasets. All tools are available from https://lichtman.rc.fas.harvard.edu/mEMbrain/. With our software, our hope is to provide a solution for lab-based neural reconstructions which does not require coding by the user, thus paving the way to affordable connectomics.

Multiplexed volumetric CLEM enabled by antibody derivatives provides new insights into the cytology of the mouse cerebellar cortex.

Mapping neuronal networks that underlie behavior has become a central focus in neuroscience. While serial section electron microscopy (ssEM) can reveal the fine structure of neuronal networks (connectomics), it does not provide the molecular information that helps identify cell types or their functional properties. Volumetric correlated light and electron microscopy (vCLEM) combines ssEM and volumetric fluorescence microscopy to incorporate molecular labeling into ssEM datasets. We developed an approach that uses small fluorescent single-chain variable fragment (scFv) immuno-probes to perform multiplexed detergent-free immuno-labeling and ssEM on the same samples. We generated eight such fluorescent scFvs that targeted useful markers for brain studies (green fluorescent protein, glial fibrillary acidic protein, calbindin, parvalbumin, voltage-gated potassium channel subfamily A member 2, vesicular glutamate transporter 1, postsynaptic density protein 95, and neuropeptide Y). To test the vCLEM approach, six different fluorescent probes were imaged in a sample of the cortex of a cerebellar lobule (Crus 1), using confocal microscopy with spectral unmixing, followed by ssEM imaging of the same sample. The results show excellent ultrastructure with superimposition of the multiple fluorescence channels. Using this approach we could document a poorly described cell type in the cerebellum, two types of mossy fiber terminals, and the subcellular localization of one type of ion channel. Because scFvs can be derived from existing monoclonal antibodies, hundreds of such probes can be generated to enable molecular overlays for connectomic studies.

Multiplexed volumetric CLEM enabled by antibody derivatives provides new insights into the cytology of the mouse cerebellar cortex.

Mapping neuronal networks that underlie behavior has become a central focus in neuroscience. While serial section electron microscopy (ssEM) can reveal the fine structure of neuronal networks (connectomics), it does not provide the molecular information that helps identify cell types or their functional properties. Volumetric correlated light and electron microscopy (vCLEM) combines ssEM and volumetric fluorescence microscopy to incorporate molecular labeling into ssEM datasets. We developed an approach that uses small fluorescent single-chain variable fragment (scFv) immuno-probes to perform multiplexed detergent-free immuno-labeling and ssEM on the same samples. We generated eight such fluorescent scFvs that targeted useful markers for brain studies (green fluorescent protein, glial fibrillary acidic protein, calbindin, parvalbumin, voltage-gated potassium channel subfamily A member 2, vesicular glutamate transporter 1, postsynaptic density protein 95, and neuropeptide Y). To test the vCLEM approach, six different fluorescent probes were imaged in a sample of the cortex of a cerebellar lobule (Crus 1), using confocal microscopy with spectral unmixing, followed by ssEM imaging of the same sample. The results show excellent ultrastructure with superimposition of the multiple fluorescence channels. Using this approach we could document a poorly described cell type in the cerebellum, two types of mossy fiber terminals, and the subcellular localization of one type of ion channel. Because scFvs can be derived from existing monoclonal antibodies, hundreds of such probes can be generated to enable molecular overlays for connectomic studies.

mEMbrain: an interactive deep learning MATLAB tool for connectomic segmentation on commodity desktops.

Connectomics is fundamental in propelling our understanding of the nervous system’s organization, unearthing cells and wiring diagrams reconstructed from volume electron microscopy (EM) datasets. Such reconstructions, on the one hand, have benefited from ever more precise automatic segmentation methods, which leverage sophisticated deep learning architectures and advanced machine learning algorithms. On the other hand, the field of neuroscience at large, and of image processing in particular, has manifested a need for user-friendly and open source tools which enable the community to carry out advanced analyses. In line with this second vein, here we propose mEMbrain, an interactive MATLAB-based software which wraps algorithms and functions that enable labeling and segmentation of electron microscopy datasets in a user-friendly user interface compatible with Linux and Windows. Through its integration as an API to the volume annotation and segmentation tool VAST, mEMbrain encompasses functions for ground truth generation, image preprocessing, training of deep neural networks, and on-the-fly predictions for proofreading and evaluation. The final goals of our tool are to expedite manual labeling efforts and to harness MATLAB users with an array of semi-automatic approaches for instance segmentation. We tested our tool on a variety of datasets that span different species at various scales, regions of the nervous system and developmental stages. To further expedite research in connectomics, we provide an EM resource of ground truth annotation from 4 different animals and 5 datasets, amounting to around 180 hours of expert annotations, yielding more than 1.2 GB of annotated EM images. In addition, we provide a set of 4 pre-trained networks for said datasets. All tools are available from https://lichtman.rc.fas.harvard.edu/mEMbrain/ . With our software, our hope is to provide a solution for lab-based neural reconstructions which does not require coding by the user, thus paving the way to affordable connectomics.

Immersion Fixation and Staining of Multicubic Millimeter Volumes for Electron Microscopy-Based Connectomics of Human Brain Biopsies.

Connectomics allows mapping of cells and their circuits at the nanometer scale in volumes of approximately 1 mm3. Given that the human cerebral cortex can be 3 mm in thickness, larger volumes are required. Larger-volume circuit reconstructions of human brain are limited by 1) the availability of fresh biopsies; 2) the need for excellent preservation of ultrastructure, including extracellular space; and 3) the requirement of uniform staining throughout the sample, among other technical challenges. Cerebral cortical samples from neurosurgical patients are available owing to lead placement for deep brain stimulation. Described here is an immersion fixation, heavy metal staining, and tissue processing method that consistently provides excellent ultrastructure throughout human and rodent surgical brain samples of volumes 2 × 2 × 2 mm3 and up to 37 mm3 with one dimension ≤2 mm. This method should allow synapse-level circuit analysis in samples from patients with psychiatric and neurologic disorders.

Post-embryonic remodeling of the C. elegans motor circuit.

During development, animals can maintain behavioral output even as underlying circuitry structurally remodels. After hatching, C. elegans undergoes substantial motor neuron expansion and synapse rewiring while the animal continuously moves with an undulatory pattern. To understand how the circuit transitions from its juvenile to mature configuration without interrupting functional output, we reconstructed the C. elegans motor circuit by electron microscopy across larval development. We observed the following: First, embryonic motor neurons transiently interact with the developing post-embryonic motor neurons prior to remodeling of their juvenile wiring. Second, post-embryonic neurons initiate synapse development with their future partners as their neurites navigate through the juvenile nerve cords. Third, embryonic and post-embryonic neurons sequentially build structural machinery needed for the adult circuit before the embryonic neurons relinquish their roles to post-embryonic neurons. Fourth, this transition is repeated region by region along the body in an anterior-to-posterior sequence, following the birth order of neurons. Through this orchestrated and programmed rewiring, the motor circuit gradually transforms from asymmetric to symmetric wiring. These maturation strategies support the continuous maintenance of motor patterns as the juvenile circuit develops into the adult configuration.

Axonal Regeneration Through Autologous Grafts: Does the Axonal Load Influence Regeneration?

INTRODUCTION: Two-stage free functional muscle transfers for long-standing facial palsy can yield unpredictable results. Earlier studies have demonstrated incomplete regeneration across neurorrhaphies in native nerve and higher donor axonal counts correlating with improved outcomes but axonal count in nerve grafts have not been as thoroughly reviewed. To investigate the impact of varying axonal counts in autologous grafts on functional outcomes of repair. MATERIALS AND METHODS: Animals were allocated into three groups: Direct Nerve Repair (DNR, n = 50), Small Nerve Graft (SNG, n = 50), and Large Nerve Graft (LNG, n = 50). All grafts were inset into the Posterior Auricular Nerve with ear movement recovery (EMR) monitored as functional outcome. At various postoperative weeks (POWs), excised specimens were imaged with electron microscopy. Axonal counts were measured proximal to, distal (DAC) to, and within grafts. Total Success Ratio (TSR) was calculated. RESULTS: In DNR, DAC was significantly lower than proximal axonal counts at all POWs, with maximum TSR of 80%. TSR for LNG and SNG were significantly lower at all POWs when compared to DNR, with maximums of 56% and 38%, respectively. LNG had a significantly larger DAC than SNG at POW12 and beyond. A direct relationship was present between DAC and EMR for all values. CONCLUSIONS: Higher native axonal count of autologous nerve grafts resulted in higher percentage of regeneration across neurorrhaphies.

Connectomics Annotation Metadata Standardization for Increased Accessibility and Queryability.

Neuroscientists can leverage technological advances to image neural tissue across a range of different scales, potentially forming the basis for the next generation of brain atlases and circuit reconstructions at submicron resolution, using Electron Microscopy and X-ray Microtomography modalities. However, there is variability in data collection, annotation, and storage approaches, which limits effective comparative and secondary analysis. There has been great progress in standardizing interfaces for large-scale spatial image data, but more work is needed to standardize annotations, especially metadata associated with neuroanatomical entities. Standardization will enable validation, sharing, and replication, greatly amplifying investment throughout the connectomics community. We share key design considerations and a usecase developed for metadata for a recent large-scale dataset.

Scalable Biologically-Aware Skeleton Generation for Connectomic Volumes.

As connectomic datasets exceed hundreds of terabytes in size, accurate and efficient skeleton generation of the label volumes has evolved into a critical component of the computation pipeline used for analysis, evaluation, visualization, and error correction. We propose a novel topological thinning strategy that uses biological-constraints to produce accurate centerlines from segmented neuronal volumes while still maintaining biologically relevant properties. Current methods are either agnostic to the underlying biology, have non-linear running times as a function of the number of input voxels, or both. First, we eliminate from the input segmentation biologically-infeasible bubbles, pockets of voxels incorrectly labeled within a neuron, to improve segmentation accuracy, allow for more accurate centerlines, and increase processing speed. Next, a Convolutional Neural Network (CNN) detects cell bodies from the input segmentation, allowing us to anchor our skeletons to the somata. Lastly, a synapse-aware topological thinning approach produces expressive skeletons for each neuron with a nearly one-to-one correspondence between endpoints and synapses. We simultaneously estimate geometric properties of neurite width and geodesic distance between synapse and cell body, improving accuracy by 47.5% and 62.8% over baseline methods. We separate the skeletonization process into a series of computation steps, leveraging data-parallel strategies to increase throughput significantly. We demonstrate our results on over 1250 neurons and neuron fragments from three different species, processing over one million voxels per second per CPU with linear scalability.

Functional and ultrastructural analysis of reafferent mechanosensation in larval zebrafish.

All animals need to differentiate between exafferent stimuli, which are caused by the environment, and reafferent stimuli, which are caused by their own movement. In the case of mechanosensation in aquatic animals, the exafferent inputs are water vibrations in the animal's proximity, which need to be distinguishable from the reafferent inputs arising from fluid drag due to locomotion. Both of these inputs are detected by the lateral line, a collection of mechanosensory organs distributed along the surface of the body. In this study, we characterize in detail how hair cells-the receptor cells of the lateral line-in zebrafish larvae discriminate between such reafferent and exafferent signals. Using dye labeling of the lateral line nerve, we visualize two parallel descending inputs that can influence lateral line sensitivity. We combine functional imaging with ultra-structural EM circuit reconstruction to show that cholinergic signals originating from the hindbrain transmit efference copies (copies of the motor command that cancel out self-generated reafferent stimulation during locomotion) and that dopaminergic signals from the hypothalamus may have a role in threshold modulation, both in response to locomotion and salient stimuli. We further gain direct mechanistic insight into the core components of this circuit by loss-of-function perturbations using targeted ablations and gene knockouts. We propose that this simple circuit is the core implementation of mechanosensory reafferent suppression in these young animals and that it might form the first instantiation of state-dependent modulation found at later stages in development.

Connectomes across development reveal principles of brain maturation.

An animal's nervous system changes as its body grows from birth to adulthood and its behaviours mature1-8. The form and extent of circuit remodelling across the connectome is unknown3,9-15. Here we used serial-section electron microscopy to reconstruct the full brain of eight isogenic Caenorhabditis elegans individuals across postnatal stages to investigate how it changes with age. The overall geometry of the brain is preserved from birth to adulthood, but substantial changes in chemical synaptic connectivity emerge on this consistent scaffold. Comparing connectomes between individuals reveals substantial differences in connectivity that make each brain partly unique. Comparing connectomes across maturation reveals consistent wiring changes between different neurons. These changes alter the strength of existing connections and create new connections. Collective changes in the network alter information processing. During development, the central decision-making circuitry is maintained, whereas sensory and motor pathways substantially remodel. With age, the brain becomes progressively more feedforward and discernibly modular. Thus developmental connectomics reveals principles that underlie brain maturation.

Ultrastructural analysis of dendritic spine necks reveals a continuum of spine morphologies.

Dendritic spines are membranous protrusions that receive essentially all excitatory inputs in most mammalian neurons. Spines, with a bulbous head connected to the dendrite by a thin neck, have a variety of morphologies that likely impact their functional properties. Nevertheless, the question of whether spines belong to distinct morphological subtypes is still open. Addressing this quantitatively requires clear identification and measurements of spine necks. Recent advances in electron microscopy enable large-scale systematic reconstructions of spines with nanometer precision in 3D. Analyzing ultrastructural reconstructions from mouse neocortical neurons with computer vision algorithms, we demonstrate that the vast majority of spine structures can be rigorously separated into heads and necks, enabling morphological measurements of spine necks. We then used a database of spine morphological parameters to explore the potential existence of different spine classes. Without exception, our analysis revealed unimodal distributions of individual morphological parameters of spine heads and necks, without evidence for subtypes of spines. The postsynaptic density size was strongly correlated with the spine head volume. The spine neck diameter, but not the neck length, was also correlated with the head volume. Spines with larger head volumes often had a spine apparatus and pairs of spines in a post-synaptic cell contacted by the same axon had similar head volumes. Our data reveal a lack of morphological subtypes of spines and indicate that the spine neck length and head volume must be independently regulated. These results have repercussions for our understanding of the function of dendritic spines in neuronal circuits.