Multimodal Deep Learning Improves Recurrence Risk Prediction in Pediatric Low-Grade Gliomas.

BACKGROUND: Postoperative recurrence risk for pediatric low-grade gliomas (pLGGs) is challenging to predict by conventional clinical, radiographic, and genomic factors. We investigated if deep learning of MRI tumor features could improve postoperative pLGG risk stratification. METHODS: We used pre-trained deep learning (DL) tool designed for pLGG segmentation to extract pLGG imaging features from preoperative T2-weighted MRI from patients who underwent surgery (DL-MRI features). Patients were pooled from two institutions: Dana Farber/Boston Children's Hospital (DF/BCH) and the Children's Brain Tumor Network (CBTN). We trained three DL logistic hazard models to predict postoperative event-free survival (EFS) probabilities with 1) clinical features, 2) DL-MRI features, and 3) multimodal (clinical and DL-MRI features). We evaluated the models with a time-dependent Concordance Index (Ctd) and risk group stratification with Kaplan Meier plots and log-rank tests. We developed an automated pipeline integrating pLGG segmentation and EFS prediction with the best model. RESULTS: Of the 396 patients analyzed (median follow-up: 85 months, range: 1.5-329 months), 214 (54%) underwent gross total resection and 110 (28%) recurred. The multimodal model improved EFS prediction compared to the DL-MRI and clinical models (Ctd: 0.85 (95% CI: 0.81-0.93), 0.79 (95% CI: 0.70-0.88), and 0.72 (95% CI: 0.57-0.77), respectively). The multimodal model improved risk-group stratification (3-year EFS for predicted high-risk: 31% versus low-risk: 92%, p<0.0001). CONCLUSIONS: DL extracts imaging features that can inform postoperative recurrence prediction for pLGG. Multimodal DL improves postoperative risk stratification for pLGG and may guide postoperative decision-making. Larger, multicenter training data may be needed to improve model generalizability.

Deep learning-assisted survival prognosis in renal cancer: A CT scan-based personalized approach.

This paper presents a deep learning (DL) approach for predicting survival probabilities of renal cancer patients based solely on preoperative CT imaging. The proposed approach consists of two networks: a classifier- and a survival- network. The classifier attempts to extract features from 3D CT scans to predict the ISUP grade of Renal cell carcinoma (RCC) tumors, as defined by the International Society of Urological Pathology (ISUP). Our classifier is a 3D convolutional neural network to avoid losing crucial information on the interconnection of slides in 3D images. We employ multiple procedures, including image augmentation, preprocessing, and concatenation, to improve the performance of the classifier. Given the strong correlation between ISUP grading and renal cancer prognosis in the clinical context, we use the ISUP grading features extracted by the classifier as the input to the survival network. By leveraging this clinical association and the classifier network, we are able to model our survival analysis using a simple DL-based network. We adopt a discrete LogisticHazard-based loss to extract intrinsic survival characteristics of RCC tumors from CT images. This allows us to build a completely parametric survival model that varies with patients' tumor characteristics and predicts non-proportional survival probability curves for different patients. Our results demonstrated that the proposed method could predict the future course of renal cancer with reasonable accuracy from the CT scans. The proposed method obtained an average concordance index of 0.72, an integrated Brier score of 0.15, and an area under the curve value of 0.71 on the test cohorts.

Multimodal deep learning for personalized renal cell carcinoma prognosis: Integrating CT imaging and clinical data.

BACKGROUND AND OBJECTIVE: Renal cell carcinoma represents a significant global health challenge with a low survival rate. The aim of this research was to devise a comprehensive deep-learning model capable of predicting survival probabilities in patients with renal cell carcinoma by integrating CT imaging and clinical data and addressing the limitations observed in prior studies. The aim is to facilitate the identification of patients requiring urgent treatment. METHODS: The proposed framework comprises three modules: a 3D image feature extractor, clinical variable selection, and survival prediction. Based on the 3D CNN architecture, the feature extractor module predicts the ISUP grade of renal cell carcinoma tumors linked to mortality rates from CT images. Clinical variables are systematically selected using the Spearman score and random forest importance score as criteria. A deep learning-based network, trained with discrete LogisticHazard-based loss, performs the survival prediction. Nine distinct experiments are performed, with varying numbers of clinical variables determined by different thresholds of the Spearman and importance scores. RESULTS: Our findings demonstrate that the proposed strategy surpasses the current literature on renal cancer prognosis based on CT scans and clinical factors. The best-performing experiment yielded a concordance index of 0.84 and an area under the curve value of 0.8 on the test cohort, which suggests strong predictive power. CONCLUSIONS: The multimodal deep-learning approach developed in this study shows promising results in estimating survival probabilities for renal cell carcinoma patients using CT imaging and clinical data. This may have potential implications in identifying patients who require urgent treatment, potentially improving patient outcomes. The code created for this project is available for the public on: GitHub.