Deep learning to automatically evaluate HER2 gene amplification status from fluorescence in situ hybridization images.

Human epidermal growth factor receptor 2 (HER2) gene amplification helps identify breast cancer patients who may respond to targeted anti-HER2 therapy. This study aims to develop an automated method for quantifying HER2 fluorescence in situ hybridization (FISH) signals and improve the working efficiency of pathologists. An Aitrox artificial intelligence (AI) model based on deep learning was constructed, and a comparison between the AI model and traditional manual counting was performed. In total, 918 FISH images from 320 consecutive invasive breast cancers were analysed and automatically classified into 5 groups according to the 2018 ASCO/CAP guidelines. The overall classification accuracy was 85.33% (157/184) with a mean average precision of 0.735. In Group 5, the most common group, the consistency was as high as 95.90% (117/122), while the consistency was low in the other groups due to the limited number of cases. The causes of this inconsistency, including clustered HER2 signals, coarse CEP17 signals and some section quality problems, were analysed. The developed AI model is a reliable tool for evaluating HER2 amplification statuses, especially for breast cancer in Group 5; additional cases from multiple centres could further improve the accuracy achieved for other groups.

Generalizability and Diagnostic Performance of AI Models for Thyroid US.

Background Artificial intelligence (AI) models have improved US assessment of thyroid nodules; however, the lack of generalizability limits the application of these models. Purpose To develop AI models for segmentation and classification of thyroid nodules in US using diverse data sets from nationwide hospitals and multiple vendors, and to measure the impact of the AI models on diagnostic performance. Materials and Methods This retrospective study included consecutive patients with pathologically confirmed thyroid nodules who underwent US using equipment from 12 vendors at 208 hospitals across China from November 2017 to January 2019. The detection, segmentation, and classification models were developed based on the subset or complete set of images. Model performance was evaluated by precision and recall, Dice coefficient, and area under the receiver operating characteristic curve (AUC) analyses. Three scenarios (diagnosis without AI assistance, with freestyle AI assistance, and with rule-based AI assistance) were compared with three senior and three junior radiologists to optimize incorporation of AI into clinical practice. Results A total of 10 023 patients (median age, 46 years [IQR 37-55 years]; 7669 female) were included. The detection, segmentation, and classification models had an average precision, Dice coefficient, and AUC of 0.98 (95% CI: 0.96, 0.99), 0.86 (95% CI: 0.86, 0.87), and 0.90 (95% CI: 0.88, 0.92), respectively. The segmentation model trained on the nationwide data and classification model trained on the mixed vendor data exhibited the best performance, with a Dice coefficient of 0.91 (95% CI: 0.90, 0.91) and AUC of 0.98 (95% CI: 0.97, 1.00), respectively. The AI model outperformed all senior and junior radiologists (P < .05 for all comparisons), and the diagnostic accuracies of all radiologists were improved (P < .05 for all comparisons) with rule-based AI assistance. Conclusion Thyroid US AI models developed from diverse data sets had high diagnostic performance among the Chinese population. Rule-based AI assistance improved the performance of radiologists in thyroid cancer diagnosis. © RSNA, 2023 Supplemental material is available for this article.

Radiologists with assistance of deep learning can achieve overall accuracy of benign-malignant differentiation of musculoskeletal tumors comparable with that of pre-surgical biopsies in the literature.

PURPOSE: The purpose of this study was to assess if radiologists assisted by deep learning (DL) algorithms can achieve diagnostic accuracy comparable to that of pre-surgical biopsies in benign-malignant differentiation of musculoskeletal tumors (MST). METHODS: We first conducted a systematic review of literature to get the respective overall diagnostic accuracies of fine-needle aspiration biopsy (FNAB) and core needle biopsy (CNB) in differentiating between benign and malignant MST, by synthesizing data from the articles meeting our inclusion criteria. To compared against the accuracies reported in literature, we then invited 4 radiologists, respectively with 2 (A), 6 (B), 7 (C), and 33 (D) years of experience in interpreting musculoskeletal MRI to perform diagnostic tests on our own dataset (n = 62), with and without assistance of a previously developed DL algorithm. The gold standard for benign-malignant differentiation was histopathologic confirmation or clinical/radiographic follow-up. RESULTS: For FNAB, a meta-analysis containing 4604 samples met the inclusion criteria, with the overall diagnostic accuracy reported to be 0.77. For CNB, an overall accuracy of 0.86 was derived by synthesizing results from 7 original research articles containing a total of 587 samples. On our internal MST dataset, the invited radiologists, respectively, achieved diagnostic accuracies of 0.84 (A), 0.89 (B), 0.87 (C), and 0.90 (D), with the assistance of DL. CONCLUSION: Use of DL algorithms on musculoskeletal dynamic contrast-enhanced MRI improved the benign-malignant differentiation accuracy of radiologists to a level comparable to that of pre-surgical biopsies. The developed DL algorithms have a potential to lower the risk of miss-diagnosing malignancy in radiological practice.

A new AI-assisted scoring system for PD-L1 expression in NSCLC.

BACKGROUND: Artificial intelligence (AI) analysis may serve as a scoring tool for programmed cell death ligand-1 (PD-L1) expression. In this study, a new AI-assisted scoring system for pathologists was tested for PD-L1 expression assessment in non-small cell lung cancer (NSCLC). METHODS: PD-L1 expression was evaluated using the tumor proportion score (TPS) categorized into three levels: negative (TPS < 1%), low expression (TPS 1-49%), and high expression (TPS ≥ 50%). In order to train, validate, and test the Aitrox AI segmentation model at the whole slide image (WSI) level, 54, 53, and 115 cases were used as training, validation, and test datasets, respectively. TPS reading results from five experienced pathologists, six inexperienced and the Aitrox AI model were analyzed on 115 PD-L1 stained WSIs. The Gold Standard for TPS was derived from the review of three expert pathologists. Spearman's correlation coefficient was calculated and compared between the results. RESULTS: Aitrox AI Model correlated strongly with the TPS Gold Standard and was comparable with the results of three of the five experienced pathologists. In contrast, the results of four of the six inexperienced pathologists correlated only moderately with the TPS Gold Standard. Aitrox AI Model performed better than the inexperienced pathologists and was comparable to experienced pathologists in both negative and low TPS groups. Despite the fact that the low TPS group showed 5.09% of cases with large fluctuations, the Aitrox AI Model still showed a higher correlation than the inexperienced pathologists. However, the AI model showed unsatisfactory performance in the high TPS groups, especially lower values than the Gold Standard in images with large regions of false-positive cells. CONCLUSION: The Aitrox AI Model demonstrates potential in assisting routine diagnosis of NSCLC by pathologists through scoring of PD-L1 expression.

Deep convolutional neural network-based classification of cancer cells on cytological pleural effusion images.

Lung cancer is one of the leading causes of cancer-related death worldwide. Cytology plays an important role in the initial evaluation and diagnosis of patients with lung cancer. However, due to the subjectivity of cytopathologists and the region-dependent diagnostic levels, the low consistency of liquid-based cytological diagnosis results in certain proportions of misdiagnoses and missed diagnoses. In this study, we performed a weakly supervised deep learning method for the classification of benign and malignant cells in lung cytological images through a deep convolutional neural network (DCNN). A total of 404 cases of lung cancer cells in effusion cytology specimens from Shanghai Pulmonary Hospital were investigated, in which 266, 78, and 60 cases were used as the training, validation and test sets, respectively. The proposed method was evaluated on 60 whole-slide images (WSIs) of lung cancer pleural effusion specimens. This study showed that the method had an accuracy, sensitivity, and specificity respectively of 91.67%, 87.50% and 94.44% in classifying malignant and benign lesions (or normal). The area under the receiver operating characteristic (ROC) curve (AUC) was 0.9526 (95% confidence interval (CI): 0.9019-9.9909). In contrast, the average accuracies of senior and junior cytopathologists were 98.34% and 83.34%, respectively. The proposed deep learning method will be useful and may assist pathologists with different levels of experience in the diagnosis of cancer cells on cytological pleural effusion images in the future.

Deep Learning Assisted Diagnosis of Musculoskeletal Tumors Based on Contrast-Enhanced Magnetic Resonance Imaging.

BACKGROUND: Misdiagnosis of malignant musculoskeletal tumors may lead to the delay of intervention, resulting in amputation or death. PURPOSE: To improve the diagnostic efficacy of musculoskeletal tumors by developing deep learning (DL) models based on contrast-enhanced magnetic resonance imaging and to quantify the improvement in diagnostic performance obtained by using these models. STUDY TYPE: Retrospective. POPULATION: Three hundreds and four musculoskeletal tumors, including 212 malignant and 92 benign lesions, were randomized into the training (n = 180), validation (n = 62) and testing cohort (n = 62). FIELD STRENGTH/SEQUENCE: A 3 T/T1 -weighted (T1 -w), T2 -weighted (T2 -w), diffusion-weighted imaging (DWI), and contrast-enhanced T1-weighted (CET1 -w) images. ASSESSMENT: Three DL models based, respectively, on the sagittal, coronal, and axial MR images were constructed to predict the malignancy of tumors. Blinded to the prediction results, a group of specialists made independent initial diagnoses for each patient by reading all image sequences. One month after the initial diagnoses, the same group of doctors made another round of diagnoses knowing the malignancy of each tumor predicted by the three models. The reference standard was the pathological diagnosis of malignancy. STATISTICAL TESTS: Sensitivity, specificity, and accuracy (all with 95% confidential intervals [CI]) corresponding to each diagnostic test were computed. Chi-square tests were used to assess the differences in those parameters with and without DL models. A P value < 0.05 was considered statistically significant. RESULTS: The developed models significantly improved the diagnostic sensitivities of two oncologists by 0.15 (95% CI: 0.06-0.24) and 0.36 (95% CI: 0.24-0.28), one radiologist by 0.12 (95% CI: 0.04-0.20), and three of the four orthopedists, respectively, by 0.12 (95% CI: 0.04-0.20), 0.29 (95% CI: 0.18-0.40), and 0.23 (95% CI: 0.13-0.33), without impairing any of their diagnostic specificities (all P > 0.128). DATA CONCLUSION: The DL models developed can significantly improve the performance of doctors with different training and experience in diagnosing musculoskeletal tumors. EVIDENCE LEVEL: 3 TECHNICAL EFFICACY: Stage 2.

Histological Subtypes Classification of Lung Cancers on CT Images Using 3D Deep Learning and Radiomics.

RATIONALE AND OBJECTIVES: Histological subtypes of lung cancers are critical for clinical treatment decision. In this study, we attempt to use 3D deep learning and radiomics methods to automatically distinguish lung adenocarcinomas (ADC), squamous cell carcinomas (SCC), and small cell lung cancers (SCLC) respectively on Computed Tomography images, and then compare their performance. MATERIALS AND METHODS: 920 patients (mean age 61.2, range, 17-87; 340 Female and 580 Male) with lung cancer, including 554 patients with ADC, 175 patients with lung SCC and 191 patients with SCLC, were included in this retrospective study from January 2013 to August 2018. Histopathologic analysis was available for every patient. The classification models based on 3D deep learning (named the ProNet) and radiomics (named com_radNet) were designed to classify lung cancers into the three types mentioned above according to histopathologic results. The training, validation and testing cohorts counted 0.70, 0.15, and 0.15 of the whole datasets respectively. RESULTS: The ProNet model used to classify the three types of lung cancers achieved the F1-scores of 90.0%, 72.4%, 83.7% in ADC, SCC, and SCLC respectively, and the weighted average F1-score of 73.2%. For com_radNet, the F1-scores achieved 83.1%, 75.4%, 85.1% in ADC, SCC, and SCLC, and the weighted average F1-score was 72.2%. The area under the receiver operating characteristic curve of the ProNet model and com_radNet were 0.840 and 0.789, and the accuracy were 71.6% and 74.7% respectively. CONCLUSION: The ProNet and com_radNet models we developed can achieve high performance in distinguishing ADC, SCC, and SCLC and may be promising approaches for non-invasive predicting histological subtypes of lung cancers.

Predicting the invasiveness of lung adenocarcinomas appearing as ground-glass nodule on CT scan using multi-task learning and deep radiomics.

BACKGROUND: Due to different treatment method and prognosis of different subtypes of lung adenocarcinomas appearing as ground-glass nodules (GGNs) on computed tomography (CT) scan, it is important to classify invasive adenocarcinomas from non-invasive adenocarcinomas. The purpose of this paper is to build and evaluate the performance of deep learning networks on the differentiation the invasiveness of lung adenocarcinoma appearing as GGNs. METHODS: This retrospective study included 886 GGNs from 794 pathological confirmed patients with lung adenocarcinoma for training and testing the proposed networks. Three deep learning networks, namely XimaNet (deep learning-based classification model), XimaSharp (classification and nodule segmentation model), and Deep-RadNet (deep learning and radiomics combined classification model, i.e., deep radiomics) were built. Three classification tasks, namely task 1: classification of AAH/AIS and MIA, task 2: classification of MIA and IAC, and task 3: classification of non-invasive adenocarcinomas and invasive adenocarcinomas (AAH/AIS&MIA and IAC) were conducted to evaluate the model performance. The Z-test was used to compare the model performance. RESULTS: The AUC for classification of AAH/AIS with MIA were 0.891, 0.841 and 0.779 for Deep-RadNet, XimaNet and XimaSharp respectively. The AUC for classification of MIA with IAC were 0.889, 0.785 and 0.778 for three networks and AUC for classification of AAH/AIS&MIA with IAC were 0.941, 0.892 and 0.827 respectively. The performance of deep_RadNet was better than the other two models with the Z-test (P<0.05). CONCLUSIONS: Deep-RadNet with the visual heat map could evaluate the invasiveness of GGNs accurately and intuitively, providing a theoretical basis for individualized and accurate medical treatment of patients with GGNs.

Molecular characterization of the bla(KPC-2) gene in clinical isolates of carbapenem-resistant Klebsiella pneumoniae from the pediatric wards of a Chinese hospital.

The present study was conducted to confirm the presence of Klebsiella pneumoniae carbapenemase (KPC)-producing K. pneumoniae associated with a nosocomial outbreak in a Chinese pediatric hospital. From July 2009 to January 2011, 124 nonduplicated K. pneumoniae isolates were collected from specimens from patients of pediatric units in the hospital. Twelve of the 124 isolates possessed the bla(KPC-2) gene and showed 7 different pulsed-field gel electrophoresis (PFGE) patterns. Meanwhile, 16S rRNA methylase, acc(6')-Ib-cr, and several types of ß-lactamases were also produced by the majority of the KPC-producing isolates. Class 1 integron-encoded intI1 integrase gene was subsequently found in all strains, and amplification, sequencing, and comparison of DNA between 5' conserved segment and 3' conserved segment region showed the presence of several known antibiotic resistance gene cassettes of various sizes. The conjugation and plasmid-curing experiments indicated some KPC-2-encoding genes were transmissible. In addition, conjugal cotransfer of multidrug-resistant phenotypes with KPC-positive phenotypes was observed in KPC-producing strains. Restriction endonuclease analysis and DNA hybridization with a KPC-specific probe showed that the bla(KPC-2) gene was carried by plasmid DNA from K. pneumoniae of PFGE pattern B. The overall results indicate that the emergence and outbreak of KPC-producing K. pneumoniae in our pediatric wards occurred in conjunction with plasmids coharboring 16S rRNA methylase and extended-spectrum ß-lactamases.