Deep learning assisted holography microscopy for in-flow enumeration of tumor cells in blood.

Currently, detection of circulating tumor cells (CTCs) in cancer patient blood samples relies on immunostaining, which does not provide access to live CTCs, limiting the breadth of CTC-based applications. Here, we take the first steps to address this limitation, by demonstrating staining-free enumeration of tumor cells spiked into lysed blood samples using digital holographic microscopy (DHM), microfluidics and machine learning (ML). A 3D-printed module for laser assembly was developed to simplify the optical set up for holographic imaging of cells flowing through a sheath-based microfluidic device. Computational reconstruction of the holograms was performed to localize the cells in 3D and obtain the plane of best focus images to train deep learning models. We developed a custom-designed light-weight shallow Network dubbed s-Net and compared its performance against off-the-shelf CNN models including ResNet-50. The accuracy, sensitivity and specificity of the s-Net model was found to be higher than the off-the-shelf ML models. By applying an optimized decision threshold to mixed samples prepared in silico, the false positive rate was reduced from 1 × 10-2 to 2.77 × 10-4. Finally, the developed DHM-ML framework was successfully applied to enumerate spiked MCF-7 breast cancer cells and SkOV3 ovarian cancer cells from lysed blood samples containing white blood cells (WBCs) at concentrations typical of label-free enrichment techniques. We conclude by discussing the advances that need to be made to translate the DHM-ML approach to staining-free enumeration of actual CTCs in cancer patient blood samples.

Detection of live breast cancer cells in bright-field microscopy images containing white blood cells by image analysis and deep learning.

SIGNIFICANCE: Circulating tumor cells (CTCs) are important biomarkers for cancer management. Isolated CTCs from blood are stained to detect and enumerate CTCs. However, the staining process is laborious and moreover makes CTCs unsuitable for drug testing and molecular characterization. AIM: The goal is to develop and test deep learning (DL) approaches to detect unstained breast cancer cells in bright-field microscopy images that contain white blood cells (WBCs). APPROACH: We tested two convolutional neural network (CNN) approaches. The first approach allows investigation of the prominent features extracted by CNN to discriminate in vitro cancer cells from WBCs. The second approach is based on faster region-based convolutional neural network (Faster R-CNN). RESULTS: Both approaches detected cancer cells with higher than 95% sensitivity and 99% specificity with the Faster R-CNN being more efficient and suitable for deployment presenting an improvement of 4% in sensitivity. The distinctive feature that CNN uses for discrimination is cell size, however, in the absence of size difference, the CNN was found to be capable of learning other features. The Faster R-CNN was found to be robust with respect to intensity and contrast image transformations. CONCLUSIONS: CNN-based DL approaches could be potentially applied to detect patient-derived CTCs from images of blood samples.

Automated detection of apoptotic versus nonapoptotic cell death using label-free computational microscopy.

Identification of cell death mechanisms, particularly distinguishing between apoptotic versus nonapoptotic pathways, is of paramount importance for a wide range of applications related to cell signaling, interaction with pathogens, therapeutic processes, drug discovery, drug resistance, and even pathogenesis of diseases like cancers and neurogenerative disease among others. Here, we present a novel high-throughput method of identifying apoptotic versus necrotic versus other nonapoptotic cell death processes, based on lensless digital holography. This method relies on identification of the temporal changes in the morphological features of mammalian cells, which are unique to each cell death processes. Different cell death processes were induced by known cytotoxic agents. A deep learning-based approach was used to automatically classify the cell death mechanism (apoptotic vs necrotic vs nonapoptotic) with more than 93% accuracy. This label free approach can provide a low cost (<$250) alternative to some of the currently available high content imaging-based screening tools.

On the creation of a segmentation library for digitized cervical and lumbar spine radiographs.

In this paper, we address the issue of computer-assisted indexing in one specific case, i.e., for the 17,000 digitized images of the spine acquired during the National Health and Nutrition Examination Survey (NHANES). The crucial step in this process is to accurately segment the cervical and lumbar spine in the radiographic images. To that end, we have implemented a unique segmentation system that consists of a suite of spine-customized automatic and semi-automatic statistical shape segmentation algorithms. Using the aforementioned system, we have developed experiments to optimally generate a library of spine segmentations, which currently include 2000 cervical and 2000 lumbar spines. This work is expected to contribute toward the creation of a biomedical Content-Based Image Retrieval system that will allow retrieval of vertebral shapes by using query by image example or query by shape example.

Double-edge detection of radiographic lumbar vertebrae images using pressurized open DGVF snakes.

The detection of double edges in X-ray images of lumbar vertebrae is of prime importance in the assessment of vertebral injury or collapse that may be caused by osteoporosis and other spine pathology. In addition, if the above double-edge detection process is conducted within an automatic framework, it would not only facilitate inexpensive and fast means of obtaining objective morphometric measurements on the spine, but also remove the human subjectivity involved in the morphometric analysis. This paper proposes a novel force-formulation scheme, termed as pressurized open directional gradient vector flow snakes, to discriminate and detect the superior and inferior double edges present in the radiographic images of the lumbar vertebrae. As part of the validation process, this algorithm is applied to a set of 100 lumbar images and the detection results are quantified using analyst-generated ground truth. The promising nature of the detection results bears testimony to the efficacy of the proposed approach.