Predicting microvascular invasion in hepatocellular carcinoma with a CT- and MRI-based multimodal deep learning model.

PURPOSE: To investigate the value of a multimodal deep learning (MDL) model based on computed tomography (CT) and magnetic resonance imaging (MRI) for predicting microvascular invasion (MVI) in hepatocellular carcinoma (HCC). METHODS: A total of 287 patients with HCC from our institution and 58 patients from another individual institution were included. Among these, 119 patients with only CT data and 116 patients with only MRI data were selected for single-modality deep learning model development, after which select parameters were migrated for MDL model development with transfer learning (TL). In addition, 110 patients with simultaneous CT and MRI data were divided into a training cohort (n = 66) and a validation cohort (n = 44). We input the features extracted from DenseNet121 into an extreme learning machine (ELM) classifier to construct a classification model. RESULTS: The area under the curve (AUC) of the MDL model was 0.844, which was superior to that of the single-phase CT (AUC = 0.706-0.776, P < 0.05), single-sequence MRI (AUC = 0.706-0.717, P < 0.05), single-modality DL model (AUCall-phase CT = 0.722, AUCall-sequence MRI = 0.731; P < 0.05), clinical (AUC = 0.648, P < 0.05), but not to that of the delay phase (DP) and in-phase (IP) MRI and portal venous phase (PVP) CT models. The MDL model achieved better performance than models described above (P < 0.05). When combined with clinical features, the AUC of the MDL model increased from 0.844 to 0.871. A nomogram, combining deep learning signatures (DLS) and clinical indicators for MDL models, demonstrated a greater overall net gain than the MDL models (P < 0.05). CONCLUSION: The MDL model is a valuable noninvasive technique for preoperatively predicting MVI in HCC.

Differentiating adrenal metastases from benign lesions with multiphase CT imaging: Deep learning could play an active role in assisting radiologists.

OBJECTIVES: To develop and externally validate multiphase CT-based deep learning (DL) models for differentiating adrenal metastases from benign lesions. MATERIALS AND METHODS: This retrospective two-center study included 1146 adrenal lesions from 1059 patients who underwent multiphase CT scanning between January 2008 and March 2021. The study encompassed 564 surgically confirmed adenomas, along with 135 benign lesions and 447 metastases confirmed by observation. DL models based on multiphase CT images were developed, validated and tested. The diagnostic performance of the classification models, imaging phases and radiologists with or without DL were compared using accuracy (ACC) and receiver operating characteristic (ROC) curves. Integrated discrimination improvement (IDI) analysis and the DeLong test were used to compare the area under the curve (AUC) among models. Decision curve analysis (DCA) was used to assess the clinical usefulness of the predictive models. RESULTS: The DL signature based on LASSO (DLSL) had a higher AUC than that of the other classification models (IDI > 0, P < 0.05). Furthermore, the precontrast phase (PCP)-based DLSL performed best in the independent external validation (AUC = 0.881, ACC = 82.9 %) and clinical test cohorts (AUC = 0.790, ACC = 70.4 %), outperforming DLSL based on the other single-phase or three-phase images (IDI > 0, P < 0.05). DCA demonstrated that PCP-based DLSL provided a higher net benefit (0.01-0.95). The diagnostic performance led to statistically significant improvements when radiologists incorporated the DL model, with the AUC improving by 0.056-0.159 and the ACC improving by 0.069-0.178 (P < 0.05). CONCLUSION: The DL model based on PCP CT images performed acceptably in differentiating adrenal metastases from benign lesions, and it may assist radiologists in accurate tumor staging for patients with a history of extra-adrenal malignancy.

Development and validation of a deep learning radiomics nomogram for preoperatively differentiating thymic epithelial tumor histologic subtypes.

OBJECTIVES: Using contrast-enhanced computed tomography (CECT) and deep learning technology to develop a deep learning radiomics nomogram (DLRN) to preoperative predict risk status of patients with thymic epithelial tumors (TETs). METHODS: Between October 2008 and May 2020, 257 consecutive patients with surgically and pathologically confirmed TETs were enrolled from three medical centers. We extracted deep learning features from all lesions using a transformer-based convolutional neural network and created a deep learning signature (DLS) using selector operator regression and least absolute shrinkage. The predictive capability of a DLRN incorporating clinical characteristics, subjective CT findings and DLS was evaluated by the area under the curve (AUC) of a receiver operating characteristic curve. RESULTS: To construct a DLS, 25 deep learning features with non-zero coefficients were selected from 116 low-risk TETs (subtypes A, AB, and B1) and 141 high-risk TETs (subtypes B2, B3, and C). The combination of subjective CT features such as infiltration and DLS demonstrated the best performance in differentiating TETs risk status. The AUCs in the training, internal validation, external validation 1 and 2 cohorts were 0.959 (95% confidence interval [CI]: 0.924-0.993), 0.868 (95% CI: 0.765-0.970), 0.846 (95% CI: 0.750-0.942), and 0.846 (95% CI: 0.735-0.957), respectively. The DeLong test and decision in curve analysis revealed that the DLRN was the most predictive and clinically useful model. CONCLUSIONS: The DLRN comprised of CECT-derived DLS and subjective CT findings showed a high performance in predicting risk status of patients with TETs. CLINICAL RELEVANCE STATEMENT: Accurate risk status assessment of thymic epithelial tumors (TETs) may aid in determining whether preoperative neoadjuvant treatment is necessary. A deep learning radiomics nomogram incorporating enhancement CT-based deep learning features, clinical characteristics, and subjective CT findings has the potential to predict the histologic subtypes of TETs, which can facilitate decision-making and personalized therapy in clinical practice. KEY POINTS: • A non-invasive diagnostic method that can predict the pathological risk status may be useful for pretreatment stratification and prognostic evaluation in TET patients. • DLRN demonstrated superior performance in differentiating the risk status of TETs when compared to the deep learning signature, radiomics signature, or clinical model. • The DeLong test and decision in curve analysis revealed that the DLRN was the most predictive and clinically useful in differentiating the risk status of TETs.

Distinguishing common renal cell carcinomas from benign renal tumors based on machine learning: comparing various CT imaging phases, slices, tumor sizes, and ROI segmentation strategies.

OBJECTIVES: To determine whether a CT-based machine learning (ML) can differentiate benign renal tumors from renal cell carcinomas (RCCs) and improve radiologists' diagnostic performance, and evaluate the impact of variable CT imaging phases, slices, tumor sizes, and region of interest (ROI) segmentation strategies. METHODS: Patients with pathologically proven RCCs and benign renal tumors from our institution between 2008 and 2020 were included as the training dataset for ML model development and internal validation (including 418 RCCs and 78 benign tumors), and patients from two independent institutions and a public database (TCIA) were included as the external dataset for individual testing (including 262 RCCs and 47 benign tumors). Features were extracted from three-phase CT images. CatBoost was used for feature selection and ML model establishment. The area under the receiver operating characteristic curve (AUC) was used to assess the performance of the ML model. RESULTS: The ML model based on 3D images performed better than that based on 2D images, with the highest AUC of 0.81 and accuracy (ACC) of 0.86. All three radiologists achieved better performance by referring to the classifier's decision, with accuracies increasing from 0.82 to 0.87, 0.82 to 0.88, and 0.76 to 0.87. The ML model achieved higher negative predictive values (NPV, 0.82-0.99), and the radiologists achieved higher positive predictive values (PPV, 0.91-0.95). CONCLUSIONS: A ML classifier based on whole-tumor three-phase CT images can be a useful and promising tool for differentiating RCCs from benign renal tumors. The ML model also perfectly complements radiologist interpretations. KEY POINTS: • A machine learning classifier based on CT images could be a reliable way to differentiate RCCs from benign renal tumors. • The machine learning model perfectly complemented the radiologists' interpretations. • Subtle variances in ROI delineation had little effect on the performance of the ML classifier.