Machine-learning-based diagnosis of thyroid fine-needle aspiration biopsy synergistically by Papanicolaou staining and refractive index distribution.

We developed a machine learning algorithm (MLA) that can classify human thyroid cell clusters by exploiting both Papanicolaou staining and intrinsic refractive index (RI) as correlative imaging contrasts and evaluated the effects of this combination on diagnostic performance. Thyroid fine-needle aspiration biopsy (FNAB) specimens were analyzed using correlative optical diffraction tomography, which can simultaneously measure both, the color brightfield of Papanicolaou staining and three-dimensional RI distribution. The MLA was designed to classify benign and malignant cell clusters using color images, RI images, or both. We included 1535 thyroid cell clusters (benign: malignancy = 1128:407) from 124 patients. Accuracies of MLA classifiers using color images, RI images, and both were 98.0%, 98.0%, and 100%, respectively. As information for classification, the nucleus size was mainly used in the color image; however, detailed morphological information of the nucleus was also used in the RI image. We demonstrate that the present MLA and correlative FNAB imaging approach has the potential for diagnosing thyroid cancer, and complementary information from color and RI images can improve the performance of the MLA.

Label-free multiplexed microtomography of endogenous subcellular dynamics using generalizable deep learning.

Simultaneous imaging of various facets of intact biological systems across multiple spatiotemporal scales is a long-standing goal in biology and medicine, for which progress is hindered by limits of conventional imaging modalities. Here we propose using the refractive index (RI), an intrinsic quantity governing light-matter interaction, as a means for such measurement. We show that major endogenous subcellular structures, which are conventionally accessed via exogenous fluorescence labelling, are encoded in three-dimensional (3D) RI tomograms. We decode this information in a data-driven manner, with a deep learning-based model that infers multiple 3D fluorescence tomograms from RI measurements of the corresponding subcellular targets, thereby achieving multiplexed microtomography. This approach, called RI2FL for refractive index to fluorescence, inherits the advantages of both high-specificity fluorescence imaging and label-free RI imaging. Importantly, full 3D modelling of absolute and unbiased RI improves generalization, such that the approach is applicable to a broad range of new samples without retraining to facilitate immediate applicability. The performance, reliability and scalability of this technology are extensively characterized, and its various applications within single-cell profiling at unprecedented scales (which can generate new experimentally testable hypotheses) are demonstrated.

Label-Free White Blood Cell Classification Using Refractive Index Tomography and Deep Learning.

Objective and Impact Statement. We propose a rapid and accurate blood cell identification method exploiting deep learning and label-free refractive index (RI) tomography. Our computational approach that fully utilizes tomographic information of bone marrow (BM) white blood cell (WBC) enables us to not only classify the blood cells with deep learning but also quantitatively study their morphological and biochemical properties for hematology research. Introduction. Conventional methods for examining blood cells, such as blood smear analysis by medical professionals and fluorescence-activated cell sorting, require significant time, costs, and domain knowledge that could affect test results. While label-free imaging techniques that use a specimen's intrinsic contrast (e.g., multiphoton and Raman microscopy) have been used to characterize blood cells, their imaging procedures and instrumentations are relatively time-consuming and complex. Methods. The RI tomograms of the BM WBCs are acquired via Mach-Zehnder interferometer-based tomographic microscope and classified by a 3D convolutional neural network. We test our deep learning classifier for the four types of bone marrow WBC collected from healthy donors (n=10): monocyte, myelocyte, B lymphocyte, and T lymphocyte. The quantitative parameters of WBC are directly obtained from the tomograms. Results. Our results show >99% accuracy for the binary classification of myeloids and lymphoids and >96% accuracy for the four-type classification of B and T lymphocytes, monocyte, and myelocytes. The feature learning capability of our approach is visualized via an unsupervised dimension reduction technique. Conclusion. We envision that the proposed cell classification framework can be easily integrated into existing blood cell investigation workflows, providing cost-effective and rapid diagnosis for hematologic malignancy.

Expert-level segmentation using deep learning for volumetry of polycystic kidney and liver.

PURPOSE: Volumetry is used in polycystic kidney and liver diseases (PKLDs), including autosomal dominant polycystic kidney disease (ADPKD), to assess disease progression and drug efficiency. However, since no rapid and accurate method for volumetry has been developed, volumetry has not yet been established in clinical practice, hindering the development of therapies for PKLD. This study presents an artificial intelligence (AI)-based volumetry method for PKLD. MATERIALS AND METHODS: The performance of AI was first evaluated in comparison with ground-truth (GT). We trained a V-net-based convolutional neural network on 175 ADPKD computed tomography (CT) segmentations, which served as the GT and were agreed upon by 3 experts using images from 214 patients analyzed with volumetry. The dice similarity coefficient (DSC), interobserver correlation coefficient (ICC), and Bland-Altman plots of 39 GT and AI segmentations in the validation set were compared. Next, the performance of AI on the segmentation of 50 random CT images was compared with that of 11 PKLD specialists based on the resulting DSC and ICC. RESULTS: The DSC and ICC of the AI were 0.961 and 0.999729, respectively. The error rate was within 3% for approximately 95% of the CT scans (error<1%, 46.2%; 1%≤error<3%, 48.7%). Compared with the specialists, AI showed moderate performance. Furthermore, an outlier in our results confirmed that even PKLD specialists can make mistakes in volumetry. CONCLUSIONS: PKLD volumetry using AI was fast and accurate. AI performed comparably to human specialists, suggesting its use may be practical in clinical settings.