The spectrum of intestinal mature T- and NK-cell neoplasms in a tertiary center in Taiwan with a high frequency of perforation.

Primary intestinal T-cell lymphomas (PITLs) comprise enteropathy-associated T-cell lymphoma (EATL), monomorphic epitheliotropic intestinal T-cell lymphoma (MEITL), extranodal NK/T-cell lymphoma (ENKTL), anaplastic large cell lymphoma (ALCL), and intestinal T cell lymphoma, NOS (ITCL-NOS). MEITL is composed of monomorphic medium cells expressing CD8 and CD56, with a cytotoxic phenotype. We retrospectively analyzed 77 cases of intestinal T-cell lymphomas, 71 primary and six secondary, at a tertiary center in Taiwan from 2001 to 2021. Perforation occurred in 57 (74%) patients, including 56 (73%) at presentation and one after chemotherapy. The primary cases included MEITL (68%), ENKTL (14%), ITCL-NOS (13%), ALCL (4%), and EATL (1%). The perforation rate was 90%, 70%, and 22% in MEITL, ENKTL, and ITCL-NOS cases, respectively (p < 0.0001, Fisher's exact test). Most (75%; n = 36) MEITL cases were typical; while seven (15%) had atypical morphology and five (10%) exhibited atypical immunophenotype. The tumor cells of ITCL-NOS were pleomorphic, with various expression of CD8 or CD56. All METIL, ITCL-NOS and ALCL cases were negative for EBER; while all ENKTL cases, either primary or secondary, were positive for cytotoxic granules and EBER. The prognosis of PITL was poor, with a medium survival of 7.0, 3.3, and 3.7 months among patients with MEITL, ENKTL, and ITCL-NOS, respectively. Of the six secondary cases, the primary tumors orginated from nasal ENKTL (n = 5) and cutaneous PTCL-NOS (n = 1). We showed a wide spectrum of intestinal T-cell lymphomas in Taiwan, with MEITL as the most common PITL, a high rate of perforation, and a wider morphological and immunophenotypic spectrum.

Deep Learning-Based Nuclear Morphometry Reveals an Independent Prognostic Factor in Mantle Cell Lymphoma.

Blastoid/pleomorphic morphology is associated with short survival in mantle cell lymphoma (MCL), but its prognostic value is overridden by Ki-67 in multivariate analysis. Herein, a nuclear segmentation model was developed using deep learning, and nuclei of tumor cells in 103 MCL cases were automatically delineated. Eight nuclear morphometric attributes were extracted from each nucleus. The mean, variance, skewness, and kurtosis of each attribute were calculated for each case, resulting in 32 morphometric parameters. Compared with those in classic MCL, 17 morphometric parameters were significantly different in blastoid/pleomorphic MCL. Using univariate analysis, 16 morphometric parameters (including 14 significantly different between classic and blastoid/pleomorphic MCL) emerged as significant prognostic factors. Using multivariate analysis, Biologic MCL International Prognostic Index (bMIPI) risk group (P = 0.025), low skewness of nuclear irregularity (P = 0.020), and high mean of nuclear irregularity (P = 0.047) emerged as independent adverse prognostic factors. Additionally, a morphometric score calculated from the skewness and mean of nuclear irregularity (P = 0.0038) was an independent prognostic factor in addition to bMIPI risk group (P = 0.025), and a summed morphometric bMIPI score was useful for risk stratification of patients with MCL (P = 0.000001). These results demonstrate, for the first time, that a nuclear morphometric score is an independent prognostic factor in MCL. It is more robust than blastoid/pleomorphic morphology and can be objectively measured.

Machine Learning Based on Morphological Features Enables Classification of Primary Intestinal T-Cell Lymphomas.

The aim of this study was to investigate the feasibility of using machine learning techniques based on morphological features in classifying two subtypes of primary intestinal T-cell lymphomas (PITLs) defined according to the WHO criteria: monomorphic epitheliotropic intestinal T-cell lymphoma (MEITL) versus intestinal T-cell lymphoma, not otherwise specified (ITCL-NOS), which is considered a major challenge for pathological diagnosis. A total of 40 histopathological whole-slide images (WSIs) from 40 surgically resected PITL cases were used as the dataset for model training and testing. A deep neural network was trained to detect and segment the nuclei of lymphocytes. Quantitative nuclear morphometrics were further computed from these predicted contours. A decision-tree-based machine learning algorithm, XGBoost, was then trained to classify PITL cases into two disease subtypes using these nuclear morphometric features. The deep neural network achieved an average precision of 0.881 in the cell segmentation work. In terms of classifying MEITL versus ITCL-NOS, the XGBoost model achieved an area under receiver operating characteristic curve (AUC) of 0.966. Our research demonstrated an accurate, human-interpretable approach to using machine learning algorithms for reducing the high dimensionality of image features and classifying T cell lymphomas that present challenges in morphologic diagnosis. The quantitative nuclear morphometric features may lead to further discoveries concerning the relationship between cellular phenotype and disease status.

Identification of nodal micrometastasis in colorectal cancer using deep learning on annotation-free whole-slide images.

Detection of nodal micrometastasis (tumor size: 0.2-2.0 mm) is challenging for pathologists due to the small size of metastatic foci. Since lymph nodes with micrometastasis are counted as positive nodes, detecting micrometastasis is crucial for accurate pathologic staging of colorectal cancer. Previously, deep learning algorithms developed with manually annotated images performed well in identifying micrometastasis of breast cancer in sentinel lymph nodes. However, the process of manual annotation is labor intensive and time consuming. Multiple instance learning was later used to identify metastatic breast cancer without manual annotation, but its performance appears worse in detecting micrometastasis. Here, we developed a deep learning model using whole-slide images of regional lymph nodes of colorectal cancer with only a slide-level label (either a positive or negative slide). The training, validation, and testing sets included 1963, 219, and 1000 slides, respectively. A supercomputer TAIWANIA 2 was used to train a deep learning model to identify metastasis. At slide level, our algorithm performed well in identifying both macrometastasis (tumor size > 2.0 mm) and micrometastasis with an area under the receiver operating characteristics curve (AUC) of 0.9993 and 0.9956, respectively. Since most of our slides had more than one lymph node, we then tested the performance of our algorithm on 538 single-lymph node images randomly cropped from the testing set. At single-lymph node level, our algorithm maintained good performance in identifying macrometastasis and micrometastasis with an AUC of 0.9944 and 0.9476, respectively. Visualization using class activation mapping confirmed that our model identified nodal metastasis based on areas of tumor cells. Our results demonstrate for the first time that micrometastasis could be detected by deep learning on whole-slide images without manual annotation.

Predicting aggressive histopathological features in esophageal cancer with positron emission tomography using a deep convolutional neural network.

BACKGROUND: The presence of lymphovascular invasion (LVI) and perineural invasion (PNI) are of great prognostic importance in esophageal squamous cell carcinoma. Currently, positron emission tomography (PET) scans are the only means of functional assessment prior to treatment. We aimed to predict the presence of LVI and PNI in esophageal squamous cell carcinoma using PET imaging data by training a three-dimensional convolution neural network (3D-CNN). METHODS: Seven hundred and ninety-eight PET scans of patients with esophageal squamous cell carcinoma and 309 PET scans of patients with stage I lung cancer were collected. In the first part of this study, we built a 3D-CNN based on a residual network, ResNet, for a task to classify the scans into esophageal cancer or lung cancer. In the second stage, we collected the PET scans of 278 patients undergoing esophagectomy for a task to classify and predict the presence of LVI/PNI. RESULTS: In the first part, the model performance attained an area under the receiver operating characteristic curve (AUC) of 0.860. In the second part, we randomly split 80%, 10%, and 10% of our dataset into training set, validation set and testing set, respectively, for a task to classify the scans into the presence of LVI/PNI and evaluated the model performance on the testing set. Our 3D-CNN model attained an AUC of 0.668 in the testing set, which shows a better discriminative ability than random guessing. CONCLUSIONS: A 3D-CNN can be trained, using PET imaging datasets, to predict LNV/PNI in esophageal cancer with acceptable accuracy.

An annotation-free whole-slide training approach to pathological classification of lung cancer types using deep learning.

Deep learning for digital pathology is hindered by the extremely high spatial resolution of whole-slide images (WSIs). Most studies have employed patch-based methods, which often require detailed annotation of image patches. This typically involves laborious free-hand contouring on WSIs. To alleviate the burden of such contouring and obtain benefits from scaling up training with numerous WSIs, we develop a method for training neural networks on entire WSIs using only slide-level diagnoses. Our method leverages the unified memory mechanism to overcome the memory constraint of compute accelerators. Experiments conducted on a data set of 9662 lung cancer WSIs reveal that the proposed method achieves areas under the receiver operating characteristic curve of 0.9594 and 0.9414 for adenocarcinoma and squamous cell carcinoma classification on the testing set, respectively. Furthermore, the method demonstrates higher classification performance than multiple-instance learning as well as strong localization results for small lesions through class activation mapping.

Successful Identification of Nasopharyngeal Carcinoma in Nasopharyngeal Biopsies Using Deep Learning.

Pathologic diagnosis of nasopharyngeal carcinoma (NPC) can be challenging since most cases are nonkeratinizing carcinoma with little differentiation and many admixed lymphocytes. Our aim was to evaluate the possibility to identify NPC in nasopharyngeal biopsies using deep learning. A total of 726 nasopharyngeal biopsies were included. Among them, 100 cases were randomly selected as the testing set, 20 cases as the validation set, and all other 606 cases as the training set. All three datasets had equal numbers of NPC cases and benign cases. Manual annotation was performed. Cropped square image patches of 256 × 256 pixels were used for patch-level training, validation, and testing. The final patch-level algorithm effectively identified NPC patches, with an area under the receiver operator characteristic curve (AUC) of 0.9900. Using gradient-weighted class activation mapping, we demonstrated that the identification of NPC patches was based on morphologic features of tumor cells. At the second stage, whole-slide images were sequentially cropped into patches, inferred with the patch-level algorithm, and reconstructed into images with a smaller size for training, validation, and testing. Finally, the AUC was 0.9848 for slide-level identification of NPC. Our result shows for the first time that deep learning algorithms can identify NPC.

A Multi-Organ Nucleus Segmentation Challenge.

Generalized nucleus segmentation techniques can contribute greatly to reducing the time to develop and validate visual biomarkers for new digital pathology datasets. We summarize the results of MoNuSeg 2018 Challenge whose objective was to develop generalizable nuclei segmentation techniques in digital pathology. The challenge was an official satellite event of the MICCAI 2018 conference in which 32 teams with more than 80 participants from geographically diverse institutes participated. Contestants were given a training set with 30 images from seven organs with annotations of 21,623 individual nuclei. A test dataset with 14 images taken from seven organs, including two organs that did not appear in the training set was released without annotations. Entries were evaluated based on average aggregated Jaccard index (AJI) on the test set to prioritize accurate instance segmentation as opposed to mere semantic segmentation. More than half the teams that completed the challenge outperformed a previous baseline. Among the trends observed that contributed to increased accuracy were the use of color normalization as well as heavy data augmentation. Additionally, fully convolutional networks inspired by variants of U-Net, FCN, and Mask-RCNN were popularly used, typically based on ResNet or VGG base architectures. Watershed segmentation on predicted semantic segmentation maps was a popular post-processing strategy. Several of the top techniques compared favorably to an individual human annotator and can be used with confidence for nuclear morphometrics.

Deep Convolutional Neural Network-Based Positron Emission Tomography Analysis Predicts Esophageal Cancer Outcome.

In esophageal cancer, few prediction tools can be confidently used in current clinical practice. We developed a deep convolutional neural network (CNN) with 798 positron emission tomography (PET) scans of esophageal squamous cell carcinoma and 309 PET scans of stage I lung cancer. In the first stage, we pretrained a 3D-CNN with all PET scans for a task to classify the scans into esophageal cancer or lung cancer. Overall, 548 of 798 PET scans of esophageal cancer patients were included in the second stage with an aim to classify patients who expired within or survived more than one year after diagnosis. The area under the receiver operating characteristic curve (AUC) was used to evaluate model performance. In the pretrain model, the deep CNN attained an AUC of 0.738 in identifying patients who expired within one year after diagnosis. In the survival analysis, patients who were predicted to be expired but were alive at one year after diagnosis had a 5-year survival rate of 32.6%, which was significantly worse than the 5-year survival rate of the patients who were predicted to survive and were alive at one year after diagnosis (50.5%, p < 0.001). These results suggest that the prediction model could identify tumors with more aggressive behavior. In the multivariable analysis, the prediction result remained an independent prognostic factor (hazard ratio: 2.830; 95% confidence interval: 2.252-3.555, p < 0.001). We conclude that a 3D-CNN can be trained with PET image datasets to predict esophageal cancer outcome with acceptable accuracy.