An automatic approach for cell detection and segmentation of corneal endothelium in specular microscope.

PURPOSE: Specular microscopy is an indispensable tool for clinicians seeking to monitor the corneal endothelium. Automated methods of determining endothelial cell density (ECD) are limited in their ability to analyze images of poor quality. We describe and assess an image processing algorithm to analyze corneal endothelial images. METHODS: A set of corneal endothelial images acquired with a Konan CellChek specular microscope was analyzed using three methods: flex-center, Konan Auto Tracer, and the proposed method. In this technique, the algorithm determines the region of interest, filters the image to differentiate cell boundaries from their interiors, and utilizes stochastic watershed segmentation to draw cell boundaries and assess ECD based on the masked region. We compared ECD measured by the algorithm with manual and automated results from the specular microscope. RESULTS: We analyzed a total of 303 images manually, using the Auto Tracer, and with the proposed image processing method. Relative to manual analysis across all images, the mean error was 0.04% in the proposed method (p = 0.23 for difference) whereas Auto Tracer demonstrated a bias towards overestimation, with a mean error of 5.7% (p = 2.06× 10-8). The relative mean absolute errors were 6.9% and 7.9%, respectively, for the proposed and Auto Tracer. The average time for analysis of each image using the proposed method was 2.5 s. CONCLUSION: We demonstrate a computationally efficient algorithm to analyze corneal endothelial cell density that can be implemented on devices for clinical and research use.

Automatic three-dimensional segmentation of mouse embryonic stem cell nuclei by utilising multiple channels of confocal fluorescence images.

Time-lapse confocal fluorescence microscopy images from mouse embryonic stem cells (ESCs) carrying reporter genes, histone H2B-mCherry and Mvh-Venus, have been used to monitor dynamic changes in cellular/differentiation characteristics of live ESCs. Accurate cell nucleus segmentation is required to analyse the ESC dynamics and differentiation at a single cell resolution. Several methods used concavities on nucleus contours to segment overlapping cell nuclei. Our proposed method evaluates not only the concavities but also the size and shape of every 2D nucleus region to determine if any of the strait, extrusion, convexity and large diameter criteria is satisfied to segment overlapping nuclei inside the region. We then use a 3D segmentation method to reconstruct simple, convex, and reasonably sized 3D nuclei along the image stacking direction using the radius and centre of every segmented region in respective microscopy images. To avoid false concavities on nucleus boundaries, fluorescence images of the H2B-mCherry reporter are used for localisation of cell nuclei and Venus fluorescence images are used for determining the cell colony ranges. We use a series of image preprocessing procedures to remove noise outside and inside cell colonies, and in respective nuclei, and to smooth nucleus boundaries based on the colony ranges.  We propose dynamic data structures to record every segmented nucleus region and solid in sets (volumes) of 3D confocal images. The experimental results show that the proposed image preprocessing method preserves the areas of mouse ESC nuclei on microscopy images and that the segmentation method effectively segment out every nucleus with a reasonable size and shape. All 3D nuclei in a set (volume) of confocal microscopy images can be accessed by the dynamic data structures for 3D reconstruction. The 3D nuclei in time-lapse confocal microscopy images can be tracked to calculate cell movement and proliferation in consecutive volumes for understanding the dynamics of the differentiation characteristics about ESCs. LAY DESCRIPTION: Embryonic stem cells (ESCs) are considered as an ideal source for basic cell biology study and producing medically useful cells in vitro. This study uses time-lapse confocal fluorescence microscopy images from mouse ESCs carrying reporter gene to monitor dynamic changes in cellular/differentiation characteristics of live ESCs. To automate analyses of ESC differentiation behaviours, accurate cell nucleus segmentation to distinguish respective cells are required. A series of image preprocessing procedures are implemented to remove noise in live-cell fluorescence images but yield overlapping cell nuclei. A segmentation method that evaluates boundary concavities and the size and shape of every nucleus is then used to determine if any of the strait, extrusion, convexity, large and local minimum diameter criteria satisfied to segment overlapping nuclei. We propose a dynamic data structure to record every newly segmented nucleus. The experimental results show that the proposed image preprocessing method preserves the areas of mouse ESC nuclei and that the segmentation method effectively detects overlapping nuclei. All segmented nuclei in confocal images can be accessed using the dynamic data structures to be visualised and manipulated for quantitative analyses of the ESC differentiation behaviours. The manipulation can be tracking of segmented 3D cell nuclei in time-lapse images to calculate their dynamics of differentiation characteristics.

Automatic detection and analysis of cell motility in phase-contrast time-lapse images using a combination of maximally stable extremal regions and Kalman filter approaches.

Phase-contrast illumination is simple and most commonly used microscopic method to observe nonstained living cells. Automatic cell segmentation and motion analysis provide tools to analyze single cell motility in large cell populations. However, the challenge is to find a sophisticated method that is sufficiently accurate to generate reliable results, robust to function under the wide range of illumination conditions encountered in phase-contrast microscopy, and also computationally light for efficient analysis of large number of cells and image frames. To develop better automatic tools for analysis of low magnification phase-contrast images in time-lapse cell migration movies, we investigated the performance of cell segmentation method that is based on the intrinsic properties of maximally stable extremal regions (MSER). MSER was found to be reliable and effective in a wide range of experimental conditions. When compared to the commonly used segmentation approaches, MSER required negligible preoptimization steps thus dramatically reducing the computation time. To analyze cell migration characteristics in time-lapse movies, the MSER-based automatic cell detection was accompanied by a Kalman filter multiobject tracker that efficiently tracked individual cells even in confluent cell populations. This allowed quantitative cell motion analysis resulting in accurate measurements of the migration magnitude and direction of individual cells, as well as characteristics of collective migration of cell groups. Our results demonstrate that MSER accompanied by temporal data association is a powerful tool for accurate and reliable analysis of the dynamic behaviour of cells in phase-contrast image sequences. These techniques tolerate varying and nonoptimal imaging conditions and due to their relatively light computational requirements they should help to resolve problems in computationally demanding and often time-consuming large-scale dynamical analysis of cultured cells.

U-RISC: An Annotated Ultra-High-Resolution Electron Microscopy Dataset Challenging the Existing Deep Learning Algorithms.

Connectomics is a developing field aiming at reconstructing the connection of the neural system at the nanometer scale. Computer vision technology, especially deep learning methods used in image processing, has promoted connectomic data analysis to a new era. However, the performance of the state-of-the-art (SOTA) methods still falls behind the demand of scientific research. Inspired by the success of ImageNet, we present an annotated ultra-high resolution image segmentation dataset for cell membrane (U-RISC), which is the largest cell membrane-annotated electron microscopy (EM) dataset with a resolution of 2.18 nm/pixel. Multiple iterative annotations ensured the quality of the dataset. Through an open competition, we reveal that the performance of current deep learning methods still has a considerable gap from the human level, different from ISBI 2012, on which the performance of deep learning is closer to the human level. To explore the causes of this discrepancy, we analyze the neural networks with a visualization method, which is an attribution analysis. We find that the U-RISC requires a larger area around a pixel to predict whether the pixel belongs to the cell membrane or not. Finally, we integrate the currently available methods to provide a new benchmark (0.67, 10% higher than the leader of the competition, 0.61) for cell membrane segmentation on the U-RISC and propose some suggestions in developing deep learning algorithms. The U-RISC dataset and the deep learning codes used in this study are publicly available.

A fast open-source Fiji-macro to quantify virus infection and transfection on single-cell level by fluorescence microscopy.

The ability to automatically analyze large quantities of image data is a valuable tool for many biochemical assays, as it rapidly provides reliable data. Here, we describe a fast and robust Fiji macro for the analysis of cellular fluorescence microscopy images with single-cell resolution. The macro presented here was validated by successful reconstruction of fluorescent and non-fluorescent cell mixing ratios (for fluorescence fractions ranging between 0 and 100%) and applied to quantify the efficiency of transfection and virus infection inhibition. It performed well compared with manually obtained image quantification data. Its use is not limited to the cases shown here but is applicable for most monolayered cellular assays with nuclei staining. We provide a detailed description of how the macro works and how it is applied to image data. It can be downloaded free of charge and may be used by and modified according to the needs of the user. • Rapid, simple, and reproducible segmentation of eukaryotic cells in confluent cellular assays • Open-source software for use without technical or computational expertise • Single-cell analysis allows identification and quantification of virus infected cell populations and infection inhibition.

Morphological characterization of the human corneal epithelium by in vivo confocal laser scanning microscopy.

BACKGROUND: Regarding the growing interest and importance of understanding the cellular changes of the cornea in diseases, a quantitative cellular characterization of the epithelium is becoming increasingly important. Towards this, the latest research offers considerable improvements in imaging of the cornea by confocal laser scanning microscopy (CLSM). This study presents a pipeline to generate normative morphological data of epithelial cell layers of healthy human corneas. METHODS: 3D in vivo CLSM was performed on the eyes of volunteers (n=25) with a Heidelberg Retina Tomograph II equipped with an in-house modified version of the Rostock Cornea Module implementing two dedicated piezo actuators and a concave contact cap. Image data were acquired with nearly isotropic voxel resolution. After image registration, stacks of en-face sections were used to generate full-thickness volume data sets of the epithelium. Beyond that, an image analysis algorithm quantified en-face sections of epithelial cells regarding the depth-dependent mean of cell density, area, diameter, aggregation (Clark and Evans index of aggregation), neighbor count and polygonality. RESULTS: Imaging and cell segmentation were successfully performed in all subjects. Thereby intermediated cells were efficiently recognized by the segmentation algorithm while efficiency for superficial and basal cells was reduced. Morphological parameters showed an increased mean cell density, decreased mean cell area and mean diameter from anterior to posterior (5,197.02 to 8,190.39 cells/mm2; 160.51 to 90.29 µm2; 15.9 to 12.3 µm respectively). Aggregation gradually increased from anterior to posterior ranging from 1.45 to 1.53. Average neighbor count increased from 5.50 to a maximum of 5.66 followed by a gradual decrease to 5.45 within the normalized depth from anterior to posterior. Polygonality gradually decreased ranging from 4.93 to 4.64 sides of cells. The neighbor count and polygonality parameters exhibited profound depth-dependent changes. CONCLUSIONS: This in vivo study demonstrates the successful implementation of a CLSM-based imaging pipeline for cellular characterization of the human corneal epithelium. The dedicated hardware in combination with an adapted image registration method to correct the remaining motion-induced image distortions followed by a dedicated algorithm to calculate characteristic quantities of different epithelial cell layers enabled the generation of normative data. Further significant effort is necessary to improve the algorithm for superficial and basal cell segmentation.

Automated segmentation of brain cells for clonal analyses in fluorescence microscopy images.

The understanding of how cell diversity within and across distinct brain regions is ontogenetically achieved is a pivotal topic in neuroscience. Clonal analyses based on multicolor cell labeling represent a powerful tool to tackle this issue and disclose lineage relationships, but produce enormous sets of fluorescence images, leading to time consuming analyses that may be biased by the operator's subjectivity. Thus, time-efficient automated software are needed to analyze images easily, accurately and without subjective bias. In this paper, we present a fully automated method, named FAST ('Fluorescent cell Analysis Segmentation Tool'), for the segmentation of neural cells labeled by multicolor combinations of fluorophores and for their classification into clones. The proposed method was tested on 77 high-magnification fluorescence images of adult mouse cerebellar tissues acquired using a confocal microscope. Automatic results were compared with manual annotations and two open-source software designed for cell detection in microscopic imaging. The algorithm showed very good performance in the cellular detection and in the assignment of the clonal identity. To the best of our knowledge, FAST is the first fully automated technique for the analysis of cellular clones based on combinatorial expression of fluorescent proteins. The proposed approach allows to perform clonal analyses easily, accurately and objectively, overcoming those biases and errors that may result from manual annotations. Moreover, it can be broadly applied to the quantification and colocalization within cells of fluorescent markers, therefore representing a versatile and powerful tool for automated quantitative analyses in fluorescence microscopy.

A fully automated cell segmentation and morphometric parameter system for quantifying corneal endothelial cell morphology.

BACKGROUND AND OBJECTIVE: Corneal endothelial cell abnormalities may be associated with a number of corneal and systemic diseases. Damage to the endothelial cells can significantly affect corneal transparency by altering hydration of the corneal stroma, which can lead to irreversible endothelial cell pathology requiring corneal transplantation. To date, quantitative analysis of endothelial cell abnormalities has been manually performed by ophthalmologists using time consuming and highly subjective semi-automatic tools, which require an operator interaction. We developed and applied a fully-automated and real-time system, termed the Corneal Endothelium Analysis System (CEAS) for the segmentation and computation of endothelial cells in images of the human cornea obtained by in vivo corneal confocal microscopy. METHODS: First, a Fast Fourier Transform (FFT) Band-pass filter is applied to reduce noise and enhance the image quality to make the cells more visible. Secondly, endothelial cell boundaries are detected using watershed transformations and Voronoi tessellations to accurately quantify the morphological parameters of the human corneal endothelial cells. The performance of the automated segmentation system was tested against manually traced ground-truth images based on a database consisting of 40 corneal confocal endothelial cell images in terms of segmentation accuracy and obtained clinical features. In addition, the robustness and efficiency of the proposed CEAS system were compared with manually obtained cell densities using a separate database of 40 images from controls (n = 11), obese subjects (n = 16) and patients with diabetes (n = 13). RESULTS: The Pearson correlation coefficient between automated and manual endothelial cell densities is 0.9 (p < 0.0001) and a Bland-Altman plot shows that 95% of the data are between the 2SD agreement lines. CONCLUSIONS: We demonstrate the effectiveness and robustness of the CEAS system, and the possibility of utilizing it in a real world clinical setting to enable rapid diagnosis and for patient follow-up, with an execution time of only 6 seconds per image.