Semi-automatic stitching of filamentous structures in image stacks from serial-section electron tomography.

We present a software-assisted workflow for the alignment and matching of filamentous structures across a three-dimensional (3D) stack of serial images. This is achieved by combining automatic methods, visual validation, and interactive correction. After the computation of an initial automatic matching, the user can continuously improve the result by interactively correcting landmarks or matches of filaments. Supported by a visual quality assessment of regions that have been already inspected, this allows a trade-off between quality and manual labour. The software tool was developed in an interdisciplinary collaboration between computer scientists and cell biologists to investigate cell division by quantitative 3D analysis of microtubules (MTs) in both mitotic and meiotic spindles. For this, each spindle is cut into a series of semi-thick physical sections, of which electron tomograms are acquired. The serial tomograms are then stitched and non-rigidly aligned to allow tracing and connecting of MTs across tomogram boundaries. In practice, automatic stitching alone provides only an incomplete solution, because large physical distortions and a low signal-to-noise ratio often cause experimental difficulties. To derive 3D models of spindles despite dealing with imperfect data related to sample preparation and subsequent data collection, semi-automatic validation and correction is required to remove stitching mistakes. However, due to the large number of MTs in spindles (up to 30k) and their resulting dense spatial arrangement, a naive inspection of each MT is too time-consuming. Furthermore, an interactive visualisation of the full image stack is hampered by the size of the data (up to 100 GB). Here, we present a specialised, interactive, semi-automatic solution that considers all requirements for large-scale stitching of filamentous structures in serial-section image stacks. To the best of our knowledge, it is the only currently available tool which is able to process data of the type and size presented here. The key to our solution is a careful design of the visualisation and interaction tools for each processing step to guarantee real-time response, and an optimised workflow that efficiently guides the user through datasets. The final solution presented here is the result of an iterative process with tight feedback loops between the involved computer scientists and cell biologists. LAY DESCRIPTION: Electron tomography of biological samples is used for a three-dimensional (3D) reconstruction of filamentous structures, such as microtubules (MTs) in mitotic and meiotic spindles. Large-scale electron tomography can be applied to increase the reconstructed volume for the visualisation of full spindles. For this, each spindle is cut into a series of semi-thick physical sections, from which electron tomograms are acquired. The serial tomograms are then stitched and non-rigidly aligned to allow tracing and connecting of MTs across tomogram boundaries. Previously, we presented fully automatic approaches for this 3D reconstruction pipeline. However, large volumes often suffer from imperfections (ie physical distortions) caused by the image acquisition process, making it difficult to apply fully automatic approaches for matching and stitching of numerous tomograms. Therefore, we developed an interactive, semi-automatic solution that considers all requirements for large-scale stitching of microtubules in image stacks of consecutive sections. We achieved this by combining automatic methods, visual validation and interactive error correction, thus allowing the user to continuously improve the result by interactively correcting landmarks or matches of filaments. We present large-scale reconstructions of spindles in which the automatic workflow failed and where different steps of manual corrections were needed. Our approach is also applicable to other biological samples showing 3D distributions of MTs in a number of different cellular contexts.

Serial Synapse Formation through Filopodial Competition for Synaptic Seeding Factors.

Following axon pathfinding, growth cones transition from stochastic filopodial exploration to the formation of a limited number of synapses. How the interplay of filopodia and synapse assembly ensures robust connectivity in the brain has remained a challenging problem. Here, we developed a new 4D analysis method for filopodial dynamics and a data-driven computational model of synapse formation for R7 photoreceptor axons in developing Drosophila brains. Our live data support a "serial synapse formation" model, where at any time point only 1-2 "synaptogenic" filopodia suppress the synaptic competence of other filopodia through competition for synaptic seeding factors. Loss of the synaptic seeding factors Syd-1 and Liprin-α leads to a loss of this suppression, filopodial destabilization, and reduced synapse formation. The failure to form synapses can cause the destabilization and secondary retraction of axon terminals. Our model provides a filopodial "winner-takes-all" mechanism that ensures the formation of an appropriate number of synapses.

The Impact of Structural Heterogeneity on Excitation-Inhibition Balance in Cortical Networks.

Models of cortical dynamics often assume a homogeneous connectivity structure. However, we show that heterogeneous input connectivity can prevent the dynamic balance between excitation and inhibition, a hallmark of cortical dynamics, and yield unrealistically sparse and temporally regular firing. Anatomically based estimates of the connectivity of layer 4 (L4) rat barrel cortex and numerical simulations of this circuit indicate that the local network possesses substantial heterogeneity in input connectivity, sufficient to disrupt excitation-inhibition balance. We show that homeostatic plasticity in inhibitory synapses can align the functional connectivity to compensate for structural heterogeneity. Alternatively, spike-frequency adaptation can give rise to a novel state in which local firing rates adjust dynamically so that adaptation currents and synaptic inputs are balanced. This theory is supported by simulations of L4 barrel cortex during spontaneous and stimulus-evoked conditions. Our study shows how synaptic and cellular mechanisms yield fluctuation-driven dynamics despite structural heterogeneity in cortical circuits.

Generation of dense statistical connectomes from sparse morphological data.

Sensory-evoked signal flow, at cellular and network levels, is primarily determined by the synaptic wiring of the underlying neuronal circuitry. Measurements of synaptic innervation, connection probabilities and subcellular organization of synaptic inputs are thus among the most active fields of research in contemporary neuroscience. Methods to measure these quantities range from electrophysiological recordings over reconstructions of dendrite-axon overlap at light-microscopic levels to dense circuit reconstructions of small volumes at electron-microscopic resolution. However, quantitative and complete measurements at subcellular resolution and mesoscopic scales to obtain all local and long-range synaptic in/outputs for any neuron within an entire brain region are beyond present methodological limits. Here, we present a novel concept, implemented within an interactive software environment called NeuroNet, which allows (i) integration of sparsely sampled (sub)cellular morphological data into an accurate anatomical reference frame of the brain region(s) of interest, (ii) up-scaling to generate an average dense model of the neuronal circuitry within the respective brain region(s) and (iii) statistical measurements of synaptic innervation between all neurons within the model. We illustrate our approach by generating a dense average model of the entire rat vibrissal cortex, providing the required anatomical data, and illustrate how to measure synaptic innervation statistically. Comparing our results with data from paired recordings in vitro and in vivo, as well as with reconstructions of synaptic contact sites at light- and electron-microscopic levels, we find that our in silico measurements are in line with previous results.

The Filament Editor: an interactive software environment for visualization, proof-editing and analysis of 3D neuron morphology.

Neuroanatomical analysis, such as classification of cell types, depends on reliable reconstruction of large numbers of complete 3D dendrite and axon morphologies. At present, the majority of neuron reconstructions are obtained from preparations in a single tissue slice in vitro, thus suffering from cut off dendrites and, more dramatically, cut off axons. In general, axons can innervate volumes of several cubic millimeters and may reach path lengths of tens of centimeters. Thus, their complete reconstruction requires in vivo labeling, histological sectioning and imaging of large fields of view. Unfortunately, anisotropic background conditions across such large tissue volumes, as well as faintly labeled thin neurites, result in incomplete or erroneous automated tracings and even lead experts to make annotation errors during manual reconstructions. Consequently, tracing reliability renders the major bottleneck for reconstructing complete 3D neuron morphologies. Here, we present a novel set of tools, integrated into a software environment named 'Filament Editor', for creating reliable neuron tracings from sparsely labeled in vivo datasets. The Filament Editor allows for simultaneous visualization of complex neuronal tracings and image data in a 3D viewer, proof-editing of neuronal tracings, alignment and interconnection across sections, and morphometric analysis in relation to 3D anatomical reference structures. We illustrate the functionality of the Filament Editor on the example of in vivo labeled axons and demonstrate that for the exemplary dataset the final tracing results after proof-editing are independent of the expertise of the human operator.

Cell type-specific three-dimensional structure of thalamocortical circuits in a column of rat vibrissal cortex.

Soma location, dendrite morphology, and synaptic innervation may represent key determinants of functional responses of individual neurons, such as sensory-evoked spiking. Here, we reconstruct the 3D circuits formed by thalamocortical afferents from the lemniscal pathway and excitatory neurons of an anatomically defined cortical column in rat vibrissal cortex. We objectively classify 9 cortical cell types and estimate the number and distribution of their somata, dendrites, and thalamocortical synapses. Somata and dendrites of most cell types intermingle, while thalamocortical connectivity depends strongly upon the cell type and the 3D soma location of the postsynaptic neuron. Correlating dendrite morphology and thalamocortical connectivity to functional responses revealed that the lemniscal afferents can account for some of the cell type- and location-specific subthreshold and spiking responses after passive whisker touch (e.g., in layer 4, but not for other cell types, e.g., in layer 5). Our data provides a quantitative 3D prediction of the cell type-specific lemniscal synaptic wiring diagram and elucidates structure-function relationships of this physiologically relevant pathway at single-cell resolution.

Simulation of signal flow in 3D reconstructions of an anatomically realistic neural network in rat vibrissal cortex.

The three-dimensional (3D) structure of neural circuits represents an essential constraint for information flow in the brain. Methods to directly monitor streams of excitation, at subcellular and millisecond resolution, are at present lacking. Here, we describe a pipeline of tools that allow investigating information flow by simulating electrical signals that propagate through anatomically realistic models of average neural networks. The pipeline comprises three blocks. First, we review tools that allow fast and automated acquisition of 3D anatomical data, such as neuron soma distributions or reconstructions of dendrites and axons from in vivo labeled cells. Second, we introduce NeuroNet, a tool for assembling the 3D structure and wiring of average neural networks. Finally, we introduce a simulation framework, NeuroDUNE, to investigate structure-function relationships within networks of full-compartmental neuron models at subcellular, cellular and network levels. We illustrate the pipeline by simulations of a reconstructed excitatory network formed between the thalamus and spiny stellate neurons in layer 4 (L4ss) of a cortical barrel column in rat vibrissal cortex. Exciting the ensemble of L4ss neurons with realistic input from an ensemble of thalamic neurons revealed that the location-specific thalamocortical connectivity may result in location-specific spiking of cortical cells. Specifically, a radial decay in spiking probability toward the column borders could be a general feature of signal flow in a barrel column. Our simulations provide insights of how anatomical parameters, such as the subcellular organization of synapses, may constrain spiking responses at the cellular and network levels.

Automated three-dimensional detection and counting of neuron somata.

We present a novel approach for automated detection of neuron somata. A three-step processing pipeline is described on the example of confocal image stacks of NeuN-stained neurons from rat somato-sensory cortex. It results in a set of position landmarks, representing the midpoints of all neuron somata. In the first step, foreground and background pixels are identified, resulting in a binary image. It is based on local thresholding and compensates for imaging and staining artifacts. Once this pre-processing guarantees a standard image quality, clusters of touching neurons are separated in the second step, using a marker-based watershed approach. A model-based algorithm completes the pipeline. It assumes a dominant neuron population with Gaussian distributed volumes within one microscopic field of view. Remaining larger objects are hence split or treated as a second neuron type. A variation of the processing pipeline is presented, showing that our method can also be used for co-localization of neurons in multi-channel images. As an example, we process 2-channel stacks of NeuN-stained somata, labeling all neurons, counterstained with GAD67, labeling GABAergic interneurons, using an adapted pre-processing step for the second channel. The automatically generated landmark sets are compared to manually placed counterparts. A comparison yields that the deviation in landmark position is negligible and that the difference between the numbers of manually and automatically counted neurons is less than 4%. In consequence, this novel approach for neuron counting is a reliable and objective alternative to manual detection.

Analysis of barley (Hordeum vulgare) grain development using three-dimensional digital models.

Analysis of gene expression in the developing barley caryopsis requires effective instruments for visualization of the grain and the 3D expression patterns. Digital models of developing barley (Hordeum vulgare) grains were reconstructed from serial sections to visualize the complex three-dimensional (3D) grain anatomy, to generate and analyse 3D expression patterns, and to quantify tissues during growth. The models provide detailed spatial descriptions of developing grains at anthesis, at the syncytial stage of endosperm development and at the onset of starch accumulation, visualizing and quantifying 18 tissues or tissue complexes. Total caryopsis volumes and volume changes of specific tissues between the stages were determined, and proportions of ovule- and non-ovule-tissues and ratios of filial to maternal tissues were calculated from the model data. To generate and analyse 3D expression patterns, data from mRNA localization by in situ hybridizations were integrated into the models. At the onset of starch accumulation, cell-wall invertase (HvCWINV1) mRNA is mainly localized in the transfer cells and to a lesser degree in zones of the starchy endosperm. Using the model, an expression gradient across the grain was visualized. The expression pattern in the upper region of the caryopsis resembles that found in the median region at an earlier stage, indicating the presence of a developmental gradient. At anthesis, mRNA of the protease nucellin was visualized in a distinct zone of the nucellus near the antipodal cells.