Integrated platform for multiscale molecular imaging and phenotyping of the human brain.

Understanding cellular architectures and their connectivity is essential for interrogating system function and dysfunction. However, we lack technologies for mapping the multiscale details of individual cells and their connectivity in the human organ-scale system. We developed a platform that simultaneously extracts spatial, molecular, morphological, and connectivity information of individual cells from the same human brain. The platform includes three core elements: a vibrating microtome for ultraprecision slicing of large-scale tissues without losing cellular connectivity (MEGAtome), a polymer hydrogel-based tissue processing technology for multiplexed multiscale imaging of human organ-scale tissues (mELAST), and a computational pipeline for reconstructing three-dimensional connectivity across multiple brain slabs (UNSLICE). We applied this platform for analyzing human Alzheimer's disease pathology at multiple scales and demonstrating scalable neural connectivity mapping in the human brain.

Axon Tracing and Centerline Detection using Topologically-Aware 3D U-Nets.

As advances in microscopy imaging provide an ever clearer window into the human brain, accurate reconstruction of neural connectivity can yield valuable insight into the relationship between brain structure and function. However, human manual tracing is a slow and laborious task, and requires domain expertise. Automated methods are thus needed to enable rapid and accurate analysis at scale. In this paper, we explored deep neural networks for dense axon tracing and incorporated axon topological information into the loss function with a goal to improve the performance on both voxel-based segmentation and axon centerline detection. We evaluated three approaches using a modified 3D U-Net architecture trained on a mouse brain dataset imaged with light sheet microscopy and achieved a 10% increase in axon tracing accuracy over previous methods. Furthermore, the addition of centerline awareness in the loss function outperformed the baseline approach across all metrics, including a boost in Rand Index by 8%.

Microscopy-BIDS: An Extension to the Brain Imaging Data Structure for Microscopy Data.

The Brain Imaging Data Structure (BIDS) is a specification for organizing, sharing, and archiving neuroimaging data and metadata in a reusable way. First developed for magnetic resonance imaging (MRI) datasets, the community-led specification evolved rapidly to include other modalities such as magnetoencephalography, positron emission tomography, and quantitative MRI (qMRI). In this work, we present an extension to BIDS for microscopy imaging data, along with example datasets. Microscopy-BIDS supports common imaging methods, including 2D/3D, ex/in vivo, micro-CT, and optical and electron microscopy. Microscopy-BIDS also includes comprehensible metadata definitions for hardware, image acquisition, and sample properties. This extension will facilitate future harmonization efforts in the context of multi-modal, multi-scale imaging such as the characterization of tissue microstructure with qMRI.

Brain-wide mapping reveals that engrams for a single memory are distributed across multiple brain regions.

Neuronal ensembles that hold specific memory (memory engrams) have been identified in the hippocampus, amygdala, or cortex. However, it has been hypothesized that engrams of a specific memory are distributed among multiple brain regions that are functionally connected, referred to as a unified engram complex. Here, we report a partial map of the engram complex for contextual fear conditioning memory by characterizing encoding activated neuronal ensembles in 247 regions using tissue phenotyping in mice. The mapping was aided by an engram index, which identified 117 cFos+ brain regions holding engrams with high probability, and brain-wide reactivation of these neuronal ensembles by recall. Optogenetic manipulation experiments revealed engram ensembles, many of which were functionally connected to hippocampal or amygdala engrams. Simultaneous chemogenetic reactivation of multiple engram ensembles conferred a greater level of memory recall than reactivation of a single engram ensemble, reflecting the natural memory recall process. Overall, our study supports the unified engram complex hypothesis for memory storage.

Two Stream Active Query Suggestion for Active Learning in Connectomics.

For large-scale vision tasks in biomedical images, the labeled data is often limited to train effective deep models. Active learning is a common solution, where a query suggestion method selects representative unlabeled samples for annotation, and the new labels are used to improve the base model. However, most query suggestion models optimize their learnable parameters only on the limited labeled data and consequently become less effective for the more challenging unlabeled data. To tackle this, we propose a two-stream active query suggestion approach. In addition to the supervised feature extractor, we introduce an unsupervised one optimized on all raw images to capture diverse image features, which can later be improved by fine-tuning on new labels. As a use case, we build an end-to-end active learning framework with our query suggestion method for 3D synapse detection and mitochondria segmentation in connectomics. With the framework, we curate, to our best knowledge, the largest connectomics dataset with dense synapses and mitochondria annotation. On this new dataset, our method outperforms previous state-of-the-art methods by 3.1% for synapse and 3.8% for mitochondria in terms of region-of-interest proposal accuracy. We also apply our method to image classification, where it outperforms previous approaches on CIFAR-10 under the same limited annotation budget. The project page is https://zudi-lin.github.io/projects/#two_stream_active.

CellProfiler 3.0: Next-generation image processing for biology.

CellProfiler has enabled the scientific research community to create flexible, modular image analysis pipelines since its release in 2005. Here, we describe CellProfiler 3.0, a new version of the software supporting both whole-volume and plane-wise analysis of three-dimensional (3D) image stacks, increasingly common in biomedical research. CellProfiler's infrastructure is greatly improved, and we provide a protocol for cloud-based, large-scale image processing. New plugins enable running pretrained deep learning models on images. Designed by and for biologists, CellProfiler equips researchers with powerful computational tools via a well-documented user interface, empowering biologists in all fields to create quantitative, reproducible image analysis workflows.

An open-source solution for advanced imaging flow cytometry data analysis using machine learning.

Imaging flow cytometry (IFC) enables the high throughput collection of morphological and spatial information from hundreds of thousands of single cells. This high content, information rich image data can in theory resolve important biological differences among complex, often heterogeneous biological samples. However, data analysis is often performed in a highly manual and subjective manner using very limited image analysis techniques in combination with conventional flow cytometry gating strategies. This approach is not scalable to the hundreds of available image-based features per cell and thus makes use of only a fraction of the spatial and morphometric information. As a result, the quality, reproducibility and rigour of results are limited by the skill, experience and ingenuity of the data analyst. Here, we describe a pipeline using open-source software that leverages the rich information in digital imagery using machine learning algorithms. Compensated and corrected raw image files (.rif) data files from an imaging flow cytometer (the proprietary .cif file format) are imported into the open-source software CellProfiler, where an image processing pipeline identifies cells and subcellular compartments allowing hundreds of morphological features to be measured. This high-dimensional data can then be analysed using cutting-edge machine learning and clustering approaches using "user-friendly" platforms such as CellProfiler Analyst. Researchers can train an automated cell classifier to recognize different cell types, cell cycle phases, drug treatment/control conditions, etc., using supervised machine learning. This workflow should enable the scientific community to leverage the full analytical power of IFC-derived data sets. It will help to reveal otherwise unappreciated populations of cells based on features that may be hidden to the human eye that include subtle measured differences in label free detection channels such as bright-field and dark-field imagery.

Discovery of New Anti-Schistosomal Hits by Integration of QSAR-Based Virtual Screening and High Content Screening.

Schistosomiasis is a debilitating neglected tropical disease, caused by flatworms of Schistosoma genus. The treatment relies on a single drug, praziquantel (PZQ), making the discovery of new compounds extremely urgent. In this work, we integrated QSAR-based virtual screening (VS) of Schistosoma mansoni thioredoxin glutathione reductase (SmTGR) inhibitors and high content screening (HCS) aiming to discover new antischistosomal agents. Initially, binary QSAR models for inhibition of SmTGR were developed and validated using the Organization for Economic Co-operation and Development (OECD) guidance. Using these models, we prioritized 29 compounds for further testing in two HCS platforms based on image analysis of assay plates. Among them, 2-[2-(3-methyl-4-nitro-5-isoxazolyl)vinyl]pyridine and 2-(benzylsulfonyl)-1,3-benzothiazole, two compounds representing new chemical scaffolds have activity against schistosomula and adult worms at low micromolar concentrations and therefore represent promising antischistosomal hits for further hit-to-lead optimization.

QSAR-Driven Discovery of Novel Chemical Scaffolds Active against Schistosoma mansoni.

Schistosomiasis is a neglected tropical disease that affects millions of people worldwide. Thioredoxin glutathione reductase of Schistosoma mansoni (SmTGR) is a validated drug target that plays a crucial role in the redox homeostasis of the parasite. We report the discovery of new chemical scaffolds against S. mansoni using a combi-QSAR approach followed by virtual screening of a commercial database and confirmation of top ranking compounds by in vitro experimental evaluation with automated imaging of schistosomula and adult worms. We constructed 2D and 3D quantitative structure-activity relationship (QSAR) models using a series of oxadiazoles-2-oxides reported in the literature as SmTGR inhibitors and combined the best models in a consensus QSAR model. This model was used for a virtual screening of Hit2Lead set of ChemBridge database and allowed the identification of ten new potential SmTGR inhibitors. Further experimental testing on both shistosomula and adult worms showed that 4-nitro-3,5-bis(1-nitro-1H-pyrazol-4-yl)-1H-pyrazole (LabMol-17) and 3-nitro-4-{[(4-nitro-1,2,5-oxadiazol-3-yl)oxy]methyl}-1,2,5-oxadiazole (LabMol-19), two compounds representing new chemical scaffolds, have high activity in both systems. These compounds will be the subjects for additional testing and, if necessary, modification to serve as new schistosomicidal agents.

Crowdsourcing the creation of image segmentation algorithms for connectomics.

To stimulate progress in automating the reconstruction of neural circuits, we organized the first international challenge on 2D segmentation of electron microscopic (EM) images of the brain. Participants submitted boundary maps predicted for a test set of images, and were scored based on their agreement with a consensus of human expert annotations. The winning team had no prior experience with EM images, and employed a convolutional network. This "deep learning" approach has since become accepted as a standard for segmentation of EM images. The challenge has continued to accept submissions, and the best so far has resulted from cooperation between two teams. The challenge has probably saturated, as algorithms cannot progress beyond limits set by ambiguities inherent in 2D scoring and the size of the test dataset. Retrospective evaluation of the challenge scoring system reveals that it was not sufficiently robust to variations in the widths of neurite borders. We propose a solution to this problem, which should be useful for a future 3D segmentation challenge.

Pharmacological HIF2α inhibition improves VHL disease-associated phenotypes in zebrafish model.

Patients with a germline mutation in von Hippel-Lindau (VHL) develop renal cell cancers and hypervascular tumors of the brain, adrenal glands, and pancreas as well as erythrocytosis. These phenotypes are driven by aberrant expression of HIF2α, which induces expression of genes involved in cell proliferation, angiogenesis, and red blood cell production. Currently, there are no effective treatments available for VHL disease. Here, using an animal model of VHL, we report a marked improvement of VHL-associated phenotypes following treatment with HIF2α inhibitors. Inactivation of vhl in zebrafish led to constitutive activation of HIF2α orthologs and modeled several aspects of the human disease, including erythrocytosis, pathologic angiogenesis in the brain and retina, and aberrant kidney and liver proliferation. Treatment of vhl(-/-) mutant embryos with HIF2α-specific inhibitors downregulated Hif target gene expression in a dose-dependent manner, improved abnormal hematopoiesis, and substantially suppressed erythrocytosis and angiogenic sprouting. Moreover, pharmacologic inhibition of HIF2α reversed the compromised cardiac contractility of vhl(-/-) embryos and partially rescued early lethality. This study demonstrates that small-molecule targeting of HIF2α improves VHL-related phenotypes in a vertebrate animal model and supports further exploration of this strategy for treating VHL disease.

High- and low-throughput scoring of fat mass and body fat distribution in C. elegans.

Fat accumulation is a complex phenotype affected by factors such as neuroendocrine signaling, feeding, activity, and reproductive output. Accordingly, the most informative screens for genes and compounds affecting fat accumulation would be those carried out in whole living animals. Caenorhabditis elegans is a well-established and effective model organism, especially for biological processes that involve organ systems and multicellular interactions, such as metabolism. Every cell in the transparent body of C. elegans is visible under a light microscope. Consequently, an accessible and reliable method to visualize worm lipid-droplet fat depots would make C. elegans the only metazoan in which genes affecting not only fat mass but also body fat distribution could be assessed at a genome-wide scale. Here we present a radical improvement in oil red O worm staining together with high-throughput image-based phenotyping. The three-step sample preparation method is robust, formaldehyde-free, and inexpensive, and requires only 15min of hands-on time to process a 96-well plate. Together with our free and user-friendly automated image analysis package, this method enables C. elegans sample preparation and phenotype scoring at a scale that is compatible with genome-wide screens. Thus we present a feasible approach to small-scale phenotyping and large-scale screening for genetic and/or chemical perturbations that lead to alterations in fat quantity and distribution in whole animals.

A call for bioimaging software usability.

Bioimaging software developed in a research setting often is not widely used by the scientific community. We suggest that, to maximize both the public's and researchers' investments, usability should be a more highly valued goal. We describe specific characteristics of usability toward which bioimaging software projects should aim.

An image analysis toolbox for high-throughput C. elegans assays.

We present a toolbox for high-throughput screening of image-based Caenorhabditis elegans phenotypes. The image analysis algorithms measure morphological phenotypes in individual worms and are effective for a variety of assays and imaging systems. This WormToolbox is available through the open-source CellProfiler project and enables objective scoring of whole-worm high-throughput image-based assays of C. elegans for the study of diverse biological pathways that are relevant to human disease.

Improved structure, function and compatibility for CellProfiler: modular high-throughput image analysis software.

UNLABELLED: There is a strong and growing need in the biology research community for accurate, automated image analysis. Here, we describe CellProfiler 2.0, which has been engineered to meet the needs of its growing user base. It is more robust and user friendly, with new algorithms and features to facilitate high-throughput work. ImageJ plugins can now be run within a CellProfiler pipeline. AVAILABILITY AND IMPLEMENTATION: CellProfiler 2.0 is free and open source, available at http://www.cellprofiler.org under the GPL v. 2 license. It is available as a packaged application for Macintosh OS X and Microsoft Windows and can be compiled for Linux. CONTACT: anne@broadinstitute.org SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.