Deep learning system for malignancy risk prediction in cystic renal lesions: a multicenter study.

OBJECTIVES: To develop an interactive, non-invasive artificial intelligence (AI) system for malignancy risk prediction in cystic renal lesions (CRLs). METHODS: In this retrospective, multicenter diagnostic study, we evaluated 715 patients. An interactive geodesic-based 3D segmentation model was created for CRLs segmentation. A CRLs classification model was developed using spatial encoder temporal decoder (SETD) architecture. The classification model combines a 3D-ResNet50 network for extracting spatial features and a gated recurrent unit (GRU) network for decoding temporal features from multi-phase CT images. We assessed the segmentation model using sensitivity (SEN), specificity (SPE), intersection over union (IOU), and dice similarity (Dice) metrics. The classification model's performance was evaluated using the area under the receiver operator characteristic curve (AUC), accuracy score (ACC), and decision curve analysis (DCA). RESULTS: From 2012 to 2023, we included 477 CRLs (median age, 57 [IQR: 48-65]; 173 men) in the training cohort, 226 CRLs (median age, 60 [IQR: 52-69]; 77 men) in the validation cohort, and 239 CRLs (median age, 59 [IQR: 53-69]; 95 men) in the testing cohort (external validation cohort 1, cohort 2, and cohort 3). The segmentation model and SETD classifier exhibited excellent performance in both validation (AUC = 0.973, ACC = 0.916, Dice = 0.847, IOU = 0.743, SEN = 0.840, SPE = 1.000) and testing datasets (AUC = 0.998, ACC = 0.988, Dice = 0.861, IOU = 0.762, SEN = 0.876, SPE = 1.000). CONCLUSION: The AI system demonstrated excellent benign-malignant discriminatory ability across both validation and testing datasets and illustrated improved clinical decision-making utility. CRITICAL RELEVANCE STATEMENT: In this era when incidental CRLs are prevalent, this interactive, non-invasive AI system will facilitate accurate diagnosis of CRLs, reducing excessive follow-up and overtreatment. KEY POINTS: The rising prevalence of CRLs necessitates better malignancy prediction strategies. The AI system demonstrated excellent diagnostic performance in identifying malignant CRL. The AI system illustrated improved clinical decision-making utility.

An artificial intelligence model for detecting pathological lymph node metastasis in prostate cancer using whole slide images: a retrospective, multicentre, diagnostic study.

Background: The pathological examination of lymph node metastasis (LNM) is crucial for treating prostate cancer (PCa). However, the limitations with naked-eye detection and pathologist workload contribute to a high missed-diagnosis rate for nodal micrometastasis. We aimed to develop an artificial intelligence (AI)-based, time-efficient, and high-precision PCa LNM detector (ProCaLNMD) and evaluate its clinical application value. Methods: In this multicentre, retrospective, diagnostic study, consecutive patients with PCa who underwent radical prostatectomy and pelvic lymph node dissection at five centres between Sep 2, 2013 and Apr 28, 2023 were included, and histopathological slides of resected lymph nodes were collected and digitised as whole-slide images for model development and validation. ProCaLNMD was trained at a dataset from a single centre (the Sun Yat-sen Memorial Hospital of Sun Yat-sen University [SYSMH]), and externally validated in the other four centres. A bladder cancer dataset from SYSMH was used to further validate ProCaLNMD, and an additional validation (human-AI comparison and collaboration study) containing consecutive patients with PCa from SYSMH was implemented to evaluate the application value of integrating ProCaLNMD into the clinical workflow. The primary endpoint was the area under the receiver operating characteristic curve (AUROC) of ProCaLNMD. In addition, the performance measures for pathologists with ProCaLNMD assistance was also assessed. Findings: In total, 8225 slides from 1297 patients with PCa were collected and digitised. Overall, 8158 slides (18,761 lymph nodes) from 1297 patients with PCa (median age 68 years [interquartile range 64-73]; 331 [26%] with LNM) were used to train and validate ProCaLNMD. The AUROC of ProCaLNMD ranged from 0.975 (95% confidence interval 0.953-0.998) to 0.992 (0.982-1.000) in the training and validation datasets, with sensitivities > 0.955 and specificities > 0.921. ProCaLNMD also demonstrated an AUROC of 0.979 in the cross-cancer dataset. ProCaLNMD use triggered true reclassification in 43 (4.3%) slides in which micrometastatic tumour regions were initially missed by pathologists, thereby correcting 28 (8.5%) missed-diagnosed cases of previous routine pathological reports. In the human-AI comparison and collaboration study, the sensitivity of ProCaLNMD (0.983 [0.908-1.000]) surpassed that of two junior pathologists (0.862 [0.746-0.939], P = 0.023; 0.879 [0.767-0.950], P = 0.041) by 10-12% and showed no difference to that of two senior pathologists (both 0.983 [0.908-1.000], both P > 0.99). Furthermore, ProCaLNMD significantly boosted the diagnostic sensitivity of two junior pathologists (both P = 0.041) to the level of senior pathologists (both P > 0.99), and substantially reduced the four pathologists' slide reviewing time (-31%, P < 0.0001; -34%, P < 0.0001; -29%, P < 0.0001; and -27%, P = 0.00031). Interpretation: ProCaLNMD demonstrated high diagnostic capabilities for identifying LNM in prostate cancer, reducing the likelihood of missed diagnoses by pathologists and decreasing the slide reviewing time, highlighting its potential for clinical application. Funding: National Natural Science Foundation of China, the Science and Technology Planning Project of Guangdong Province, the National Key Research and Development Programme of China, the Guangdong Provincial Clinical Research Centre for Urological Diseases, and the Science and Technology Projects in Guangzhou.

Development and validation of a CT-based deep learning radiomics nomogram to predict muscle invasion in bladder cancer.

Objective: This study aimed to develop a nomogram combining CT-based handcrafted radiomics and deep learning (DL) features to preoperatively predict muscle invasion in bladder cancer (BCa) with multi-center validation. Methods: In this retrospective study, 323 patients underwent radical cystectomy with pathologically confirmed BCa were enrolled and randomly divided into the training cohort (n = 226) and internal validation cohort (n = 97). And fifty-two patients from another independent medical center were enrolled as an independent external validation cohort. Handcrafted radiomics and DL features were constructed from preoperative nephrographic phase CT images. Least absolute shrinkage and selection operator (LASSO) regression was used to identify the most discriminative features in train cohort. Multivariate logistic regression was used to develop the predictive model and a deep learning radiomics nomogram (DLRN) was constructed. The predictive performance of models was evaluated by area under the curves (AUC) in the three cohorts. The calibration and clinical usefulness of DLRN were estimated by calibration curve and decision curve analysis. Results: The nomogram that incorporated radiomics signature and DL signature demonstrated satisfactory predictive performance for differentiating non-muscle invasive bladder cancer (NMIBC) from muscle invasive bladder cancer (MIBC), with an AUC of 0.884 (95 % CI: 0.813-0.953) in internal validation cohort and 0.862 (95 % CI: 0.756-0.968) in external validation cohort, respectively. Decision curve analysis confirmed the clinical usefulness of the nomogram. Conclusions: A CT-based deep learning radiomics nomogram exhibited a promising performance for preoperative prediction of muscle invasion in bladder cancer, and may be helpful in the clinical decision-making process.

Deep learning and radiomic feature-based blending ensemble classifier for malignancy risk prediction in cystic renal lesions.

BACKGROUND: The rising prevalence of cystic renal lesions (CRLs) detected by computed tomography necessitates better identification of the malignant cystic renal neoplasms since a significant majority of CRLs are benign renal cysts. Using arterial phase CT scans combined with pathology diagnosis results, a fusion feature-based blending ensemble machine learning model was created to identify malignant renal neoplasms from cystic renal lesions (CRLs). Histopathology results were adopted as diagnosis standard. Pretrained 3D-ResNet50 network was selected for non-handcrafted features extraction and pyradiomics toolbox was selected for handcrafted features extraction. Tenfold cross validated least absolute shrinkage and selection operator regression methods were selected to identify the most discriminative candidate features in the development cohort. Feature's reproducibility was evaluated by intra-class correlation coefficients and inter-class correlation coefficients. Pearson correlation coefficients for normal distribution and Spearman's rank correlation coefficients for non-normal distribution were utilized to remove redundant features. After that, a blending ensemble machine learning model were developed in training cohort. Area under the receiver operator characteristic curve (AUC), accuracy score (ACC), and decision curve analysis (DCA) were employed to evaluate the performance of the final model in testing cohort. RESULTS: The fusion feature-based machine learning algorithm demonstrated excellent diagnostic performance in external validation dataset (AUC = 0.934, ACC = 0.905). Net benefits presented by DCA are higher than Bosniak-2019 version classification for stratifying patients with CRL to the appropriate surgery procedure. CONCLUSIONS: Fusion feature-based classifier accurately distinguished malignant and benign CRLs which outperformed the Bosniak-2019 version classification and illustrated improved clinical decision-making utility.

Stratification of malignant renal neoplasms from cystic renal lesions using deep learning and radiomics features based on a stacking ensemble CT machine learning algorithm.

Using nephrographic phase CT images combined with pathology diagnosis, we aim to develop and validate a fusion feature-based stacking ensemble machine learning model to distinguish malignant renal neoplasms from cystic renal lesions (CRLs). This retrospective research includes 166 individuals with CRLs for model training and 47 individuals with CRLs in another institution for model testing. Histopathology results are adopted as diagnosis criterion. Nephrographic phase CT scans are selected to build the fusion feature-based machine learning algorithms. The pretrained 3D-ResNet50 CNN model and radiomics methods are selected to extract deep features and radiomics features, respectively. Fivefold cross-validated least absolute shrinkage and selection operator (LASSO) regression methods are adopted to identify the most discriminative candidate features in the development cohort. Intraclass correlation coefficients and interclass correlation coefficients are employed to evaluate feature's reproducibility. Pearson correlation coefficients for normal distribution features and Spearman's rank correlation coefficients for non-normal distribution features are used to eliminate redundant features. After that, stacking ensemble machine learning models are developed in the training cohort. The area under the receiver operator characteristic curve (ROC), calibration curve, and decision curve analysis (DCA) are adopted in the testing cohort to evaluate the performance of each model. The stacking ensemble machine learning algorithm reached excellent diagnostic performance in the testing dataset. The calibration plot shows good stability when using the stacking ensemble model. Net benefits presented by DCA are higher than the Bosniak 2019 version classification when employing any machine learning algorithm. The fusion feature-based machine learning algorithm accurately distinguishes malignant renal neoplasms from CRLs, which outperformed the Bosniak 2019 version classification, and proves to be more applicable for clinical decision-making.