NEURD: automated proofreading and feature extraction for connectomics.

We are now in the era of millimeter-scale electron microscopy (EM) volumes collected at nanometer resolution (Shapson-Coe et al., 2021; Consortium et al., 2021). Dense reconstruction of cellular compartments in these EM volumes has been enabled by recent advances in Machine Learning (ML) (Lee et al., 2017; Wu et al., 2021; Lu et al., 2021; Macrina et al., 2021). Automated segmentation methods can now yield exceptionally accurate reconstructions of cells, but despite this accuracy, laborious post-hoc proofreading is still required to generate large connectomes free of merge and split errors. The elaborate 3-D meshes of neurons produced by these segmentations contain detailed morphological information, from the diameter, shape, and branching patterns of axons and dendrites, down to the fine-scale structure of dendritic spines. However, extracting information about these features can require substantial effort to piece together existing tools into custom workflows. Building on existing open-source software for mesh manipulation, here we present "NEURD", a software package that decomposes each meshed neuron into a compact and extensively-annotated graph representation. With these feature-rich graphs, we implement workflows for state of the art automated post-hoc proofreading of merge errors, cell classification, spine detection, axon-dendritic proximities, and other features that can enable many downstream analyses of neural morphology and connectivity. NEURD can make these new massive and complex datasets more accessible to neuroscience researchers focused on a variety of scientific questions.

Functional connectomics reveals general wiring rule in mouse visual cortex.

To understand how the brain computes, it is important to unravel the relationship between circuit connectivity and function. Previous research has shown that excitatory neurons in layer 2/3 of the primary visual cortex of mice with similar response properties are more likely to form connections. However, technical challenges of combining synaptic connectivity and functional measurements have limited these studies to few, highly local connections. Utilizing the millimeter scale and nanometer resolution of the MICrONS dataset, we studied the connectivity-function relationship in excitatory neurons of the mouse visual cortex across interlaminar and interarea projections, assessing connection selectivity at the coarse axon trajectory and fine synaptic formation levels. A digital twin model of this mouse, that accurately predicted responses to arbitrary video stimuli, enabled a comprehensive characterization of the function of neurons. We found that neurons with highly correlated responses to natural videos tended to be connected with each other, not only within the same cortical area but also across multiple layers and visual areas, including feedforward and feedback connections, whereas we did not find that orientation preference predicted connectivity. The digital twin model separated each neuron's tuning into a feature component (what the neuron responds to) and a spatial component (where the neuron's receptive field is located). We show that the feature, but not the spatial component, predicted which neurons were connected at the fine synaptic scale. Together, our results demonstrate the "like-to-like" connectivity rule generalizes to multiple connection types, and the rich MICrONS dataset is suitable to further refine a mechanistic understanding of circuit structure and function.

Binary and analog variation of synapses between cortical pyramidal neurons.

Learning from experience depends at least in part on changes in neuronal connections. We present the largest map of connectivity to date between cortical neurons of a defined type (layer 2/3 [L2/3] pyramidal cells in mouse primary visual cortex), which was enabled by automated analysis of serial section electron microscopy images with improved handling of image defects (250 × 140 × 90 µm3 volume). We used the map to identify constraints on the learning algorithms employed by the cortex. Previous cortical studies modeled a continuum of synapse sizes by a log-normal distribution. A continuum is consistent with most neural network models of learning, in which synaptic strength is a continuously graded analog variable. Here, we show that synapse size, when restricted to synapses between L2/3 pyramidal cells, is well modeled by the sum of a binary variable and an analog variable drawn from a log-normal distribution. Two synapses sharing the same presynaptic and postsynaptic cells are known to be correlated in size. We show that the binary variables of the two synapses are highly correlated, while the analog variables are not. Binary variation could be the outcome of a Hebbian or other synaptic plasticity rule depending on activity signals that are relatively uniform across neuronal arbors, while analog variation may be dominated by other influences such as spontaneous dynamical fluctuations. We discuss the implications for the longstanding hypothesis that activity-dependent plasticity switches synapses between bistable states.

State-dependent pupil dilation rapidly shifts visual feature selectivity.

To increase computational flexibility, the processing of sensory inputs changes with behavioural context. In the visual system, active behavioural states characterized by motor activity and pupil dilation1,2 enhance sensory responses, but typically leave the preferred stimuli of neurons unchanged2-9. Here we find that behavioural state also modulates stimulus selectivity in the mouse visual cortex in the context of coloured natural scenes. Using population imaging in behaving mice, pharmacology and deep neural network modelling, we identified a rapid shift in colour selectivity towards ultraviolet stimuli during an active behavioural state. This was exclusively caused by state-dependent pupil dilation, which resulted in a dynamic switch from rod to cone photoreceptors, thereby extending their role beyond night and day vision. The change in tuning facilitated the decoding of ethological stimuli, such as aerial predators against the twilight sky10. For decades, studies in neuroscience and cognitive science have used pupil dilation as an indirect measure of brain state. Our data suggest that, in addition, state-dependent pupil dilation itself tunes visual representations to behavioural demands by differentially recruiting rods and cones on fast timescales.

Sustained deep-tissue voltage recording using a fast indicator evolved for two-photon microscopy.

Genetically encoded voltage indicators are emerging tools for monitoring voltage dynamics with cell-type specificity. However, current indicators enable a narrow range of applications due to poor performance under two-photon microscopy, a method of choice for deep-tissue recording. To improve indicators, we developed a multiparameter high-throughput platform to optimize voltage indicators for two-photon microscopy. Using this system, we identified JEDI-2P, an indicator that is faster, brighter, and more sensitive and photostable than its predecessors. We demonstrate that JEDI-2P can report light-evoked responses in axonal termini of Drosophila interneurons and the dendrites and somata of amacrine cells of isolated mouse retina. JEDI-2P can also optically record the voltage dynamics of individual cortical neurons in awake behaving mice for more than 30 min using both resonant-scanning and ULoVE random-access microscopy. Finally, ULoVE recording of JEDI-2P can robustly detect spikes at depths exceeding 400 µm and report voltage correlations in pairs of neurons.

Increased Reliability of Visually-Evoked Activity in Area V1 of the MECP2-Duplication Mouse Model of Autism.

Atypical sensory processing is now thought to be a core feature of the autism spectrum. Influential theories have proposed that both increased and decreased neural response reliability within sensory systems could underlie altered sensory processing in autism. Here, we report evidence for abnormally increased reliability of visual-evoked responses in layer 2/3 neurons of adult male and female primary visual cortex in the MECP2-duplication syndrome animal model of autism. Increased response reliability was due in part to decreased response amplitude, decreased fluctuations in endogenous activity, and an abnormal decoupling of visual-evoked activity from endogenous activity. Similar to what was observed neuronally, the optokinetic reflex occurred more reliably at low contrasts in mutant mice compared with controls. Retinal responses did not explain our observations. These data suggest that the circuit mechanisms for combining sensory-evoked and endogenous signal and noise processes may be altered in this form of syndromic autism.SIGNIFICANCE STATEMENT Atypical sensory processing is now thought to be a core feature of the autism spectrum. Influential theories have proposed that both increased and decreased neural response reliability within sensory systems could underlie altered sensory processing in autism. Here, we report evidence for abnormally increased reliability of visual-evoked responses in primary visual cortex of the animal model for MECP2-duplication syndrome, a high-penetrance single-gene cause of autism. Visual-evoked activity was abnormally decoupled from endogenous activity in mutant mice, suggesting in line with the influential "hypo-priors" theory of autism that sensory priors embedded in endogenous activity may have less influence on perception in autism.

Reconstruction of neocortex: Organelles, compartments, cells, circuits, and activity.

We assembled a semi-automated reconstruction of L2/3 mouse primary visual cortex from ∼250 × 140 × 90 µm3 of electron microscopic images, including pyramidal and non-pyramidal neurons, astrocytes, microglia, oligodendrocytes and precursors, pericytes, vasculature, nuclei, mitochondria, and synapses. Visual responses of a subset of pyramidal cells are included. The data are publicly available, along with tools for programmatic and three-dimensional interactive access. Brief vignettes illustrate the breadth of potential applications relating structure to function in cortical circuits and neuronal cell biology. Mitochondria and synapse organization are characterized as a function of path length from the soma. Pyramidal connectivity motif frequencies are predicted accurately using a configuration model of random graphs. Pyramidal cells receiving more connections from nearby cells exhibit stronger and more reliable visual responses. Sample code shows data access and analysis.

Structure and function of axo-axonic inhibition.

Inhibitory neurons in mammalian cortex exhibit diverse physiological, morphological, molecular, and connectivity signatures. While considerable work has measured the average connectivity of several interneuron classes, there remains a fundamental lack of understanding of the connectivity distribution of distinct inhibitory cell types with synaptic resolution, how it relates to properties of target cells, and how it affects function. Here, we used large-scale electron microscopy and functional imaging to address these questions for chandelier cells in layer 2/3 of the mouse visual cortex. With dense reconstructions from electron microscopy, we mapped the complete chandelier input onto 153 pyramidal neurons. We found that synapse number is highly variable across the population and is correlated with several structural features of the target neuron. This variability in the number of axo-axonic ChC synapses is higher than the variability seen in perisomatic inhibition. Biophysical simulations show that the observed pattern of axo-axonic inhibition is particularly effective in controlling excitatory output when excitation and inhibition are co-active. Finally, we measured chandelier cell activity in awake animals using a cell-type-specific calcium imaging approach and saw highly correlated activity across chandelier cells. In the same experiments, in vivo chandelier population activity correlated with pupil dilation, a proxy for arousal. Together, these results suggest that chandelier cells provide a circuit-wide signal whose strength is adjusted relative to the properties of target neurons.

The Rac-GEF Tiam1 Promotes Dendrite and Synapse Stabilization of Dentate Granule Cells and Restricts Hippocampal-Dependent Memory Functions.

The dentate gyrus (DG) controls information flow into the hippocampus and is critical for learning, memory, pattern separation, and spatial coding, while DG dysfunction is associated with neuropsychiatric disorders. Despite its importance, the molecular mechanisms regulating DG neural circuit assembly and function remain unclear. Here, we identify the Rac-GEF Tiam1 as an important regulator of DG development and associated memory processes. In the hippocampus, Tiam1 is predominantly expressed in the DG throughout life. Global deletion of Tiam1 in male mice results in DG granule cells with simplified dendritic arbors, reduced dendritic spine density, and diminished excitatory synaptic transmission. Notably, DG granule cell dendrites and synapses develop normally in Tiam1 KO mice, resembling WT mice at postnatal day 21 (P21), but fail to stabilize, leading to dendrite and synapse loss by P42. These results indicate that Tiam1 promotes DG granule cell dendrite and synapse stabilization late in development. Tiam1 loss also increases the survival, but not the production, of adult-born DG granule cells, possibly because of greater circuit integration as a result of decreased competition with mature granule cells for synaptic inputs. Strikingly, both male and female mice lacking Tiam1 exhibit enhanced contextual fear memory and context discrimination. Together, these results suggest that Tiam1 is a key regulator of DG granule cell stabilization and function within hippocampal circuits. Moreover, based on the enhanced memory phenotype of Tiam1 KO mice, Tiam1 may be a potential target for the treatment of disorders involving memory impairments.SIGNIFICANCE STATEMENT The dentate gyrus (DG) is important for learning, memory, pattern separation, and spatial navigation, and its dysfunction is associated with neuropsychiatric disorders. However, the molecular mechanisms controlling DG formation and function remain elusive. By characterizing mice lacking the Rac-GEF Tiam1, we demonstrate that Tiam1 promotes the stabilization of DG granule cell dendritic arbors, spines, and synapses, whereas it restricts the survival of adult-born DG granule cells, which compete with mature granule cells for synaptic integration. Notably, mice lacking Tiam1 also exhibit enhanced contextual fear memory and context discrimination. These findings establish Tiam1 as an essential regulator of DG granule cell development, and identify it as a possible therapeutic target for memory enhancement.

Inference of synaptic connectivity and external variability in neural microcircuits.

A major goal in neuroscience is to estimate neural connectivity from large scale extracellular recordings of neural activity in vivo. This is challenging in part because any such activity is modulated by the unmeasured external synaptic input to the network, known as the common input problem. Many different measures of functional connectivity have been proposed in the literature, but their direct relationship to synaptic connectivity is often assumed or ignored. For in vivo data, measurements of this relationship would require a knowledge of ground truth connectivity, which is nearly always unavailable. Instead, many studies use in silico simulations as benchmarks for investigation, but such approaches necessarily rely upon a variety of simplifying assumptions about the simulated network and can depend on numerous simulation parameters. We combine neuronal network simulations, mathematical analysis, and calcium imaging data to address the question of when and how functional connectivity, synaptic connectivity, and latent external input variability can be untangled. We show numerically and analytically that, even though the precision matrix of recorded spiking activity does not uniquely determine synaptic connectivity, it is in practice often closely related to synaptic connectivity. This relation becomes more pronounced when the spatial structure of neuronal variability is jointly considered.

Author Correction: Layer 4 of mouse neocortex differs in cell types and circuit organization between sensory areas.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Inception loops discover what excites neurons most using deep predictive models.

Finding sensory stimuli that drive neurons optimally is central to understanding information processing in the brain. However, optimizing sensory input is difficult due to the predominantly nonlinear nature of sensory processing and high dimensionality of the input. We developed 'inception loops', a closed-loop experimental paradigm combining in vivo recordings from thousands of neurons with in silico nonlinear response modeling. Our end-to-end trained, deep-learning-based model predicted thousands of neuronal responses to arbitrary, new natural input with high accuracy and was used to synthesize optimal stimuli-most exciting inputs (MEIs). For mouse primary visual cortex (V1), MEIs exhibited complex spatial features that occurred frequently in natural scenes but deviated strikingly from the common notion that Gabor-like stimuli are optimal for V1. When presented back to the same neurons in vivo, MEIs drove responses significantly better than control stimuli. Inception loops represent a widely applicable technique for dissecting the neural mechanisms of sensation.

Layer 4 of mouse neocortex differs in cell types and circuit organization between sensory areas.

Layer 4 (L4) of mammalian neocortex plays a crucial role in cortical information processing, yet a complete census of its cell types and connectivity remains elusive. Using whole-cell recordings with morphological recovery, we identified one major excitatory and seven inhibitory types of neurons in L4 of adult mouse visual cortex (V1). Nearly all excitatory neurons were pyramidal and all somatostatin-positive (SOM+) non-fast-spiking interneurons were Martinotti cells. In contrast, in somatosensory cortex (S1), excitatory neurons were mostly stellate and SOM+ interneurons were non-Martinotti. These morphologically distinct SOM+ interneurons corresponded to different transcriptomic cell types and were differentially integrated into the local circuit with only S1 neurons receiving local excitatory input. We propose that cell type specific circuit motifs, such as the Martinotti/pyramidal and non-Martinotti/stellate pairs, are used across the cortex as building blocks to assemble cortical circuits.

The Visual Cortex in Context.

In this article, we review the anatomical inputs and outputs to the mouse primary visual cortex, area V1. Our survey of data from the Allen Institute Mouse Connectivity project indicates that mouse V1 is highly interconnected with both cortical and subcortical brain areas. This pattern of innervation allows for computations that depend on the state of the animal and on behavioral goals, which contrasts with simple feedforward, hierarchical models of visual processing. Thus, to have an accurate description of the function of V1 during mouse behavior, its involvement with the rest of the brain circuitry has to be considered. Finally, it remains an open question whether the primary visual cortex of higher mammals displays the same degree of sensorimotor integration in the early visual system.

Target specific functions of EPL interneurons in olfactory circuits.

Inhibitory interneurons are integral to sensory processing, yet revealing their cell type-specific roles in sensory circuits remains an ongoing focus. To Investigate the mouse olfactory system, we selectively remove GABAergic transmission from a subset of olfactory bulb interneurons, EPL interneurons (EPL-INs), and assay odor responses from their downstream synaptic partners - tufted cells and mitral cells. Using a combination of in vivo electrophysiological and imaging analyses, we find that inactivating this single node of inhibition leads to differential effects in magnitude, reliability, tuning width, and temporal dynamics between the two principal neurons. Furthermore, tufted and not mitral cell responses to odor mixtures become more linearly predictable without EPL-IN inhibition. Our data suggest that olfactory bulb interneurons, through exerting distinct inhibitory functions onto their different synaptic partners, play a significant role in the processing of odor information.

Community-based benchmarking improves spike rate inference from two-photon calcium imaging data.

In recent years, two-photon calcium imaging has become a standard tool to probe the function of neural circuits and to study computations in neuronal populations. However, the acquired signal is only an indirect measurement of neural activity due to the comparatively slow dynamics of fluorescent calcium indicators. Different algorithms for estimating spike rates from noisy calcium measurements have been proposed in the past, but it is an open question how far performance can be improved. Here, we report the results of the spikefinder challenge, launched to catalyze the development of new spike rate inference algorithms through crowd-sourcing. We present ten of the submitted algorithms which show improved performance compared to previously evaluated methods. Interestingly, the top-performing algorithms are based on a wide range of principles from deep neural networks to generative models, yet provide highly correlated estimates of the neural activity. The competition shows that benchmark challenges can drive algorithmic developments in neuroscience.

Developmental broadening of inhibitory sensory maps.

Sensory maps are created by networks of neuronal responses that vary with their anatomical position, such that representations of the external world are systematically and topographically organized in the brain. Current understanding from studying excitatory maps is that maps are sculpted and refined throughout development and/or through sensory experience. Investigating the mouse olfactory bulb, where ongoing neurogenesis continually supplies new inhibitory granule cells into existing circuitry, we isolated the development of sensory maps formed by inhibitory networks. Using in vivo calcium imaging of odor responses, we compared functional responses of both maturing and established granule cells. We found that, in contrast to the refinement observed for excitatory maps, inhibitory sensory maps became broader with maturation. However, like excitatory maps, inhibitory sensory maps are sensitive to experience. These data describe the development of an inhibitory sensory map as a network, highlighting the differences from previously described excitatory maps.

Response to Comment on "Principles of connectivity among morphologically defined cell types in adult neocortex".

The critique of Barth et al centers on three points: (i) the completeness of our study is overstated; (ii) the connectivity matrix we describe is biased by technical limitations of our brain-slicing and multipatching methods; and (iii) our cell classification scheme is arbitrary and we have simply renamed previously identified interneuron types. We address these criticisms in our Response.

Benchmarking Spike Rate Inference in Population Calcium Imaging.

A fundamental challenge in calcium imaging has been to infer spike rates of neurons from the measured noisy fluorescence traces. We systematically evaluate different spike inference algorithms on a large benchmark dataset (>100,000 spikes) recorded from varying neural tissue (V1 and retina) using different calcium indicators (OGB-1 and GCaMP6). In addition, we introduce a new algorithm based on supervised learning in flexible probabilistic models and find that it performs better than other published techniques. Importantly, it outperforms other algorithms even when applied to entirely new datasets for which no simultaneously recorded data is available. Future data acquired in new experimental conditions can be used to further improve the spike prediction accuracy and generalization performance of the model. Finally, we show that comparing algorithms on artificial data is not informative about performance on real data, suggesting that benchmarking different methods with real-world datasets may greatly facilitate future algorithmic developments in neuroscience.

Improved estimation and interpretation of correlations in neural circuits.

Ambitious projects aim to record the activity of ever larger and denser neuronal populations in vivo. Correlations in neural activity measured in such recordings can reveal important aspects of neural circuit organization. However, estimating and interpreting large correlation matrices is statistically challenging. Estimation can be improved by regularization, i.e. by imposing a structure on the estimate. The amount of improvement depends on how closely the assumed structure represents dependencies in the data. Therefore, the selection of the most efficient correlation matrix estimator for a given neural circuit must be determined empirically. Importantly, the identity and structure of the most efficient estimator informs about the types of dominant dependencies governing the system. We sought statistically efficient estimators of neural correlation matrices in recordings from large, dense groups of cortical neurons. Using fast 3D random-access laser scanning microscopy of calcium signals, we recorded the activity of nearly every neuron in volumes 200 µm wide and 100 µm deep (150-350 cells) in mouse visual cortex. We hypothesized that in these densely sampled recordings, the correlation matrix should be best modeled as the combination of a sparse graph of pairwise partial correlations representing local interactions and a low-rank component representing common fluctuations and external inputs. Indeed, in cross-validation tests, the covariance matrix estimator with this structure consistently outperformed other regularized estimators. The sparse component of the estimate defined a graph of interactions. These interactions reflected the physical distances and orientation tuning properties of cells: The density of positive 'excitatory' interactions decreased rapidly with geometric distances and with differences in orientation preference whereas negative 'inhibitory' interactions were less selective. Because of its superior performance, this 'sparse+latent' estimator likely provides a more physiologically relevant representation of the functional connectivity in densely sampled recordings than the sample correlation matrix.