Deep learning-based method for segmenting epithelial layer of tubules in histopathological images of testicular tissue.

Purpose: There is growing concern that male reproduction is affected by environmental chemicals. One way to determine the adverse effect of environmental pollutants is to use wild animals as monitors and evaluate testicular toxicity using histopathology. We propose an automated method to process histology images of testicular tissue. Approach: Testicular tissue consists of seminiferous tubules. Segmenting the epithelial layer of the seminiferous tubule is a prerequisite for developing automated methods to detect abnormalities in tissue. We suggest an encoder-decoder fully connected convolutional neural network model to segment the epithelial layer of the seminiferous tubules in histological images. The ResNet-34 is used in the feature encoder module, and the squeeze and excitation attention block is integrated into the encoding module improving the segmentation and localization of epithelium. Results: We applied the proposed method for the two-class problem, where the epithelial layer of the tubule is the target class. The F -score and Intersection over Union of the proposed method are 0.85 and 0.92. Although the proposed method is trained on a limited training set, it performs well on an independent dataset and outperforms other state-of-the-art methods. Conclusion: The pretrained ResNet-34 in the encoder and attention block suggested in the decoder result in better segmentation and generalization. The proposed method can be applied to testicular tissue images from any mammalian species and can be used as the first part of a fully automated testicular tissue processing pipeline. The dataset and codes are publicly available on GitHub.

Deep learning-based method for segmenting epithelial layer of tubules in histopathological images of testicular tissue.

Purpose: There is growing concern that male reproduction is affected by environmental chemicals. One way to determine the adverse effect of environmental pollutants is to use wild animals as monitors and evaluate testicular toxicity using histopathology. We propose an automated method to process histology images of testicular tissue. Approach: Testicular tissue consists of seminiferous tubules. Segmenting the epithelial layer of the seminiferous tubule is a prerequisite for developing automated methods to detect abnormalities in tissue. We suggest an encoder-decoder fully connected convolutional neural network model to segment the epithelial layer of the seminiferous tubules in histological images. The ResNet-34 is used in the feature encoder module, and the squeeze and excitation attention block is integrated into the encoding module improving the segmentation and localization of epithelium. Results: We applied the proposed method for the two-class problem, where the epithelial layer of the tubule is the target class. The F-score and Intersection over Union of the proposed method are 0.85 and 0.92. Although the proposed method is trained on a limited training set, it performs well on an independent dataset and outperforms other state-of-the-art methods. Conclusion: The pretrained ResNet-34 in the encoder and attention block suggested in the decoder result in better segmentation and generalization. The proposed method can be applied to testicular tissue images from any mammalian species and can be used as the first part of a fully automated testicular tissue processing pipeline. The dataset and codes are publicly available on GitHub.

Erratum: Publisher's note: Deep learning-based method for segmenting epithelial layer of tubules in histopathological images of testicular tissue.

[This corrects the article DOI: 10.1117/1.JMI.10.3.037501.].

New computerized staging method to analyze mink testicular tissue in environmental research.

Histopathology of testicular tissue is considered to be the most sensitive tool to detect adverse effects on male reproduction. When assessing tissue damage, seminiferous epithelium needs to be classified into different stages to detect certain cell damages; but stage identification is a demanding task. The authors present a method to identify the 12 stages in mink testicular tissue. The staging system uses Gata-4 immunohistochemistry to visualize acrosome development and proved to be both intraobserver-reproducible and interobserver-reproducible with a substantial agreement of 83.6% (kappa = 0.81) and 70.5% (kappa = 0.67), respectively. To further advance and objectify this method, they present a computerized staging system that identifies these 12 stages. This program has an agreement of 52.8% (kappa 0.47) with the consensus staging by 2 investigators. The authors propose a pooling of the stages into 5 groups based on morphology, stage transition, and toxicologically important endpoints. The computerized program then reached a substantial agreement of 76.7% (kappa = 0.69). The computerized staging tool uses local ternary patterns to describe the texture of the tubules and a support vector machine classifier to learn which textures correspond to which stages. The results have the potential to modernize the tedious staging process required in toxicological evaluation of testicular tissue, especially if combined with whole-slide imaging and automated tubular segmentation. Environ Toxicol Chem 2017;36:156-164. © 2016 The Authors. Environmental Toxicology and Chemistry Published by Wiley Periodicals, Inc. on behalf of SETAC.

A Faster, Unbiased Path Opening by Upper Skeletonization and Weighted Adjacency Graphs.

The path opening is a filter that preserves bright regions in the image in which a path of a certain length L fits. A path is a (not necessarily straight) line defined by a specific adjacency relation. The most efficient implementation known scales as O(min(L, d, Q) N) with the length of the path, L , the maximum possible path length, d , the number of graylevels, Q , and the image size, N . An approximation exists (parsimonious path opening) that has an execution time independent of path length. This is achieved by preselecting paths, and applying 1D openings along these paths. However, the preselected paths can miss important structures, as described by its authors. Here, we propose a different approximation, in which we preselect paths using a grayvalue skeleton. The skeleton follows all ridges in the image, meaning that no important line structures will be missed. An H-minima transform simplifies the image to reduce the number of branches in the skeleton. A graph-based version of the traditional path opening operates only on the pixels in the skeleton, yielding speedups up to one order of magnitude, depending on image size and filter parameters. The edges of the graph are weighted in order to minimize bias. Experiments show that the proposed algorithm scales linearly with image size, and that it is often slightly faster for longer paths than for shorter paths. The algorithm also yields the most accurate results-as compared with a number of path opening variants-when measuring length distributions.

Preconditioning 2D Integer Data for Fast Convex Hull Computations.

In order to accelerate computing the convex hull on a set of n points, a heuristic procedure is often applied to reduce the number of points to a set of s points, s ≤ n, which also contains the same hull. We present an algorithm to precondition 2D data with integer coordinates bounded by a box of size p × q before building a 2D convex hull, with three distinct advantages. First, we prove that under the condition min(p, q) ≤ n the algorithm executes in time within O(n); second, no explicit sorting of data is required; and third, the reduced set of s points forms a simple polygonal chain and thus can be directly pipelined into an O(n) time convex hull algorithm. This paper empirically evaluates and quantifies the speed up gained by preconditioning a set of points by a method based on the proposed algorithm before using common convex hull algorithms to build the final hull. A speedup factor of at least four is consistently found from experiments on various datasets when the condition min(p, q) ≤ n holds; the smaller the ratio min(p, q)/n is in the dataset, the greater the speedup factor achieved.

Precision Automation of Cell Type Classification and Sub-Cellular Fluorescence Quantification from Laser Scanning Confocal Images.

While novel whole-plant phenotyping technologies have been successfully implemented into functional genomics and breeding programs, the potential of automated phenotyping with cellular resolution is largely unexploited. Laser scanning confocal microscopy has the potential to close this gap by providing spatially highly resolved images containing anatomic as well as chemical information on a subcellular basis. However, in the absence of automated methods, the assessment of the spatial patterns and abundance of fluorescent markers with subcellular resolution is still largely qualitative and time-consuming. Recent advances in image acquisition and analysis, coupled with improvements in microprocessor performance, have brought such automated methods within reach, so that information from thousands of cells per image for hundreds of images may be derived in an experimentally convenient time-frame. Here, we present a MATLAB-based analytical pipeline to (1) segment radial plant organs into individual cells, (2) classify cells into cell type categories based upon Random Forest classification, (3) divide each cell into sub-regions, and (4) quantify fluorescence intensity to a subcellular degree of precision for a separate fluorescence channel. In this research advance, we demonstrate the precision of this analytical process for the relatively complex tissues of Arabidopsis hypocotyls at various stages of development. High speed and robustness make our approach suitable for phenotyping of large collections of stem-like material and other tissue types.

Effect of pre-fixation delay and freezing on mink testicular endpoints for environmental research.

There is growing interest in using wild animals to monitor the real-life cocktail effect of environmental chemicals on male reproduction. However, practical difficulties, such as long distances to the laboratory, generally prolong the time between euthanisation and specimen handling. For instance, tissue fixation is often performed on frozen material or on material where deterioration has started, which may affect tissue morphology. This study examined the effect of pre-fixation delay and freezing on mink testicular endpoints in order to determine robust endpoints in suboptimally handled specimens. Sexually mature farmed mink (n=30) selected at culling were divided into six groups and subjected to different time intervals between euthanisation and fixation or freezing: 0 hours (fixed immediately post mortem), 6 hours, 18 hours, 30 hours, 42 hours, or frozen 6 hours post mortem and thawed overnight. Unaffected endpoints when pre-fixation storage was extended to 30 hours included: area and diameter of the seminiferous tubules, length and weight of the testes, and acrosomes marked with Gata-4. Epithelial height, Sertoli cells marked with Gata-4 and cell morphology were affected endpoints after 6 hours of storage. Freezing the tissue prior to fixation severely altered cell morphology and reduced testicular weight, tubular diameter and area. Morphological changes seen after 6 hours included shredded germ cells and excess cytoplasm in seminiferous tubular lumen, chromatin rearrangements and increased germ cell death. Extended delay before fixation and freezing affected many endpoints in the mink testicular tissue. Some of these endpoints may mimic chemically induced effects, which is important to consider when evaluating specimens from wild animals for environmental toxicity.

Fully automatic evaluation of the corneal endothelium from in vivo confocal microscopy.

BACKGROUND: Manual and semi-automatic analyses of images, acquired in vivo by confocal microscopy, are often used to determine the quality of corneal endothelium in the human eye. These procedures are highly time consuming. Here, we present two fully automatic methods to analyze and quantify corneal endothelium imaged by in vivo white light slit-scanning confocal microscopy. METHODS: In the first approach, endothelial cell density is estimated with the help of spatial frequency analysis. We evaluate published methods, and propose a new, parameter-free method. In the second approach, based on the stochastic watershed, cells are automatically segmented and the result is used to estimate cell density, polymegathism (cell size variability) and pleomorphism (cell shape variation). We show how to determine optimal values for the three parameters of this algorithm, and compare its results to a semi-automatic delineation by a trained observer. RESULTS: The frequency analysis method proposed here is more precise than any published method. The segmentation method outperforms the fully automatic method in the NAVIS software (Nidek Technologies Srl, Padova, Italy), which significantly overestimates the number of cells for cell densities below approximately 1200 mm(-2), as well as previously published methods. CONCLUSIONS: The methods presented here provide a significant improvement over the state of the art, and make in vivo, automated assessment of corneal endothelium more accessible. The segmentation method proposed paves the way to many possible new morphometric parameters, which can quickly and precisely be determined from the segmented image.

Postprocessing method for reducing phase effects in reconstructed microcomputed-tomography data.

With increased resolution in x-ray computed tomography, refraction adds increasingly to the attenuation signal. Though potentially beneficial, the artifacts caused by refraction often need to be removed from the image. In this paper, we propose a postprocessing method, based on deconvolution, that is able to remove these artifacts after conventional reconstruction. This method poses two advantages over existing projection-based (preprocessing) phase-retrieval or phase-removal algorithms. First, evaluation of the parameters can be done very quickly, improving the overall speed of the method. Second, postprocessing methods can be applied when projection data is not available, which occurs in several commercial systems with closed software or when projection data has been deleted. It is shown that the proposed method performs comparably to state-of-the-art methods in terms of image quality.

A conserved developmental patterning network produces quantitatively different output in multiple species of Drosophila.

Differences in the level, timing, or location of gene expression can contribute to alternative phenotypes at the molecular and organismal level. Understanding the origins of expression differences is complicated by the fact that organismal morphology and gene regulatory networks could potentially vary even between closely related species. To assess the scope of such changes, we used high-resolution imaging methods to measure mRNA expression in blastoderm embryos of Drosophila yakuba and Drosophila pseudoobscura and assembled these data into cellular resolution atlases, where expression levels for 13 genes in the segmentation network are averaged into species-specific, cellular resolution morphological frameworks. We demonstrate that the blastoderm embryos of these species differ in their morphology in terms of size, shape, and number of nuclei. We present an approach to compare cellular gene expression patterns between species, while accounting for varying embryo morphology, and apply it to our data and an equivalent dataset for Drosophila melanogaster. Our analysis reveals that all individual genes differ quantitatively in their spatio-temporal expression patterns between these species, primarily in terms of their relative position and dynamics. Despite many small quantitative differences, cellular gene expression profiles for the whole set of genes examined are largely similar. This suggests that cell types at this stage of development are conserved, though they can differ in their relative position by up to 3-4 cell widths and in their relative proportion between species by as much as 5-fold. Quantitative differences in the dynamics and relative level of a subset of genes between corresponding cell types may reflect altered regulatory functions between species. Our results emphasize that transcriptional networks can diverge over short evolutionary timescales and that even small changes can lead to distinct output in terms of the placement and number of equivalent cells.

Integrating data clustering and visualization for the analysis of 3D gene expression data.

The recent development of methods for extracting precise measurements of spatial gene expression patterns from three-dimensional (3D) image data opens the way for new analyses of the complex gene regulatory networks controlling animal development. We present an integrated visualization and analysis framework that supports user-guided data clustering to aid exploration of these new complex data sets. The interplay of data visualization and clustering-based data classification leads to improved visualization and enables a more detailed analysis than previously possible. We discuss 1) the integration of data clustering and visualization into one framework, 2) the application of data clustering to 3D gene expression data, 3) the evaluation of the number of clusters k in the context of 3D gene expression clustering, and 4) the improvement of overall analysis quality via dedicated postprocessing of clustering results based on visualization. We discuss the use of this framework to objectively define spatial pattern boundaries and temporal profiles of genes and to analyze how mRNA patterns are controlled by their regulatory transcription factors.

Visual exploration of three-dimensional gene expression using physical views and linked abstract views.

During animal development, complex patterns of gene expression provide positional information within the embryo. To better understand the underlying gene regulatory networks, the Berkeley Drosophila Transcription Network Project (BDTNP) has developed methods that support quantitative computational analysis of three-dimensional (3D) gene expression in early Drosophila embryos at cellular resolution. We introduce PointCloudXplore (PCX), an interactive visualization tool that supports visual exploration of relationships between different genes' expression using a combination of established visualization techniques. Two aspects of gene expression are of particular interest: 1) gene expression patterns defined by the spatial locations of cells expressing a gene and 2) relationships between the expression levels of multiple genes. PCX provides users with two corresponding classes of data views: 1) Physical Views based on the spatial relationships of cells in the embryo and 2) Abstract Views that discard spatial information and plot expression levels of multiple genes with respect to each other. Cell Selectors highlight data associated with subsets of embryo cells within a View. Using linking, these selected cells can be viewed in multiple representations. We describe PCX as a 3D gene expression visualization tool and provide examples of how it has been used by BDTNP biologists to generate new hypotheses.

Transcription factors bind thousands of active and inactive regions in the Drosophila blastoderm.

Identifying the genomic regions bound by sequence-specific regulatory factors is central both to deciphering the complex DNA cis-regulatory code that controls transcription in metazoans and to determining the range of genes that shape animal morphogenesis. We used whole-genome tiling arrays to map sequences bound in Drosophila melanogaster embryos by the six maternal and gap transcription factors that initiate anterior-posterior patterning. We find that these sequence-specific DNA binding proteins bind with quantitatively different specificities to highly overlapping sets of several thousand genomic regions in blastoderm embryos. Specific high- and moderate-affinity in vitro recognition sequences for each factor are enriched in bound regions. This enrichment, however, is not sufficient to explain the pattern of binding in vivo and varies in a context-dependent manner, demonstrating that higher-order rules must govern targeting of transcription factors. The more highly bound regions include all of the over 40 well-characterized enhancers known to respond to these factors as well as several hundred putative new cis-regulatory modules clustered near developmental regulators and other genes with patterned expression at this stage of embryogenesis. The new targets include most of the microRNAs (miRNAs) transcribed in the blastoderm, as well as all major zygotically transcribed dorsal-ventral patterning genes, whose expression we show to be quantitatively modulated by anterior-posterior factors. In addition to these highly bound regions, there are several thousand regions that are reproducibly bound at lower levels. However, these poorly bound regions are, collectively, far more distant from genes transcribed in the blastoderm than highly bound regions; are preferentially found in protein-coding sequences; and are less conserved than highly bound regions. Together these observations suggest that many of these poorly bound regions are not involved in early-embryonic transcriptional regulation, and a significant proportion may be nonfunctional. Surprisingly, for five of the six factors, their recognition sites are not unambiguously more constrained evolutionarily than the immediate flanking DNA, even in more highly bound and presumably functional regions, indicating that comparative DNA sequence analysis is limited in its ability to identify functional transcription factor targets.

Automatic channel unmixing for high-throughput quantitative analysis of fluorescence images.

Laser-scanning microscopy allows rapid acquisition of multi-channel data, paving the way for high-throughput, high-content analysis of large numbers of images. An inherent problem of using multiple fluorescent dyes is overlapping emission spectra, which results in channel cross-talk and reduces the ability to extract quantitative measurements. Traditional unmixing methods rely on measuring channel cross-talk and using fixed acquisition parameters, but these requirements are not suited to high-throughput processing. Here we present a simple automatic method to correct for channel cross-talk in multi-channel images using image data only. The method is independent of the acquisition parameters but requires some spatial separation between different dyes in the image. We evaluate the method by comparing the cross-talk levels it estimates to those measured directly from a standard fluorescent slide. The method is then applied to a high-throughput analysis pipeline that measures nuclear volumes and relative expression of gene products from three-dimensional, multi-channel fluorescence images of whole Drosophila embryos. Analysis of images before unmixing revealed an aberrant spatial correlation between measured nuclear volumes and the gene expression pattern in the shorter wavelength channel. Applying the unmixing algorithm before performing these analyses removed this correlation.

Three-dimensional morphology and gene expression in the Drosophila blastoderm at cellular resolution I: data acquisition pipeline.

BACKGROUND: To model and thoroughly understand animal transcription networks, it is essential to derive accurate spatial and temporal descriptions of developing gene expression patterns with cellular resolution. RESULTS: Here we describe a suite of methods that provide the first quantitative three-dimensional description of gene expression and morphology at cellular resolution in whole embryos. A database containing information derived from 1,282 embryos is released that describes the mRNA expression of 22 genes at multiple time points in the Drosophila blastoderm. We demonstrate that our methods are sufficiently accurate to detect previously undescribed features of morphology and gene expression. The cellular blastoderm is shown to have an intricate morphology of nuclear density patterns and apical/basal displacements that correlate with later well-known morphological features. Pair rule gene expression stripes, generally considered to specify patterning only along the anterior/posterior body axis, are shown to have complex changes in stripe location, stripe curvature, and expression level along the dorsal/ventral axis. Pair rule genes are also found to not always maintain the same register to each other. CONCLUSION: The application of these quantitative methods to other developmental systems will likely reveal many other previously unknown features and provide a more rigorous understanding of developmental regulatory networks.

Three-dimensional morphology and gene expression in the Drosophila blastoderm at cellular resolution II: dynamics.

BACKGROUND: To accurately describe gene expression and computationally model animal transcriptional networks, it is essential to determine the changing locations of cells in developing embryos. RESULTS: Using automated image analysis methods, we provide the first quantitative description of temporal changes in morphology and gene expression at cellular resolution in whole embryos, using the Drosophila blastoderm as a model. Analyses based on both fixed and live embryos reveal complex, previously undetected three-dimensional changes in nuclear density patterns caused by nuclear movements prior to gastrulation. Gene expression patterns move, in part, with these changes in morphology, but additional spatial shifts in expression patterns are also seen, supporting a previously proposed model of pattern dynamics based on the induction and inhibition of gene expression. We show that mutations that disrupt either the anterior/posterior (a/p) or the dorsal/ventral (d/v) transcriptional cascades alter morphology and gene expression along both the a/p and d/v axes in a way suggesting that these two patterning systems interact via both transcriptional and morphological mechanisms. CONCLUSION: Our work establishes a new strategy for measuring temporal changes in the locations of cells and gene expression patterns that uses fixed cell material and computational modeling. It also provides a coordinate framework for the blastoderm embryo that will allow increasingly accurate spatio-temporal modeling of both the transcriptional control network and morphogenesis.