AI-based classification of three common malignant tumors in neuro-oncology: A multi-institutional comparison of machine learning and deep learning methods.

PURPOSE: To determine if machine learning (ML) or deep learning (DL) pipelines perform better in AI-based three-class classification of glioblastoma (GBM), intracranial metastatic disease (IMD) and primary CNS lymphoma (PCNSL). METHODOLOGY: Retrospective analysis included 502 cases for training (208 GBM, 67 PCNSL and 227 IMD), with external validation on 86 cases (27:27:32). Multiparametric MRI images (T1W, T2W, FLAIR, DWI and T1-CE) were co-registered, resampled, denoised and intensity normalized, followed by semiautomatic 3D segmentation of the enhancing tumor (ET) and peritumoral region (PTR). Model performance was assessed using several ML pipelines and 3D-convolutional neural networks (3D-CNN) using sequence specific masks, as well as combination of masks. All pipelines were trained and evaluated with 5-fold nested cross-validation on internal data followed by external validation using multi-class AUC. RESULTS: Two ML models achieved similar performance on test set, one using T2-ET and T2-PTR masks (AUC: 0.885, 95% CI: [0.816, 0.935] and another using T1-CE-ET and FLAIR-PTR mask (AUC: 0.878, CI: [0.804, 0.930]). The best performing DL models achieved an AUC of 0.854, (CI [0.774, 0.914]) on external data using T1-CE-ET and T2-PTR masks, followed by model derived from T1-CE-ET, ADC-ET and FLAIR-PTR masks (AUC: 0.851, CI [0.772, 0.909]). CONCLUSION: Both ML and DL derived pipelines achieved similar performance. T1-CE mask was used in three of the top four overall models. Additionally, all four models had some mask derived from PTR, either T2WI or FLAIR.

Differentiation Between Glioblastoma and Metastatic Disease on Conventional MRI Imaging Using 3D-Convolutional Neural Networks: Model Development and Validation.

RATIONALE AND OBJECTIVES: Imaging-based differentiation between glioblastoma (GB) and brain metastases (BM) remains challenging. Our aim was to evaluate the performance of 3D-convolutional neural networks (CNN) to address this binary classification problem. MATERIALS AND METHODS: T1-CE, T2WI, and FLAIR 3D-segmented masks of 307 patients (157 GB and 150 BM) were generated post resampling, co-registration normalization and semi-automated 3D-segmentation and used for internal model development. Subsequent external validation was performed on 59 cases (27 GB and 32 BM) from another institution. Four different mask-sequence combinations were evaluated using area under the curve (AUC), precision, recall and F1-scores. Diagnostic performance of a neuroradiologist and a general radiologist, both without and with the model output available, was also assessed. RESULTS: 3D-model using the T1-CE tumor mask (TM) showed the highest performance [AUC 0.93 (95% CI 0.858-0.995)] on the external test set, followed closely by the model using T1-CE TM and FLAIR mask of peri-tumoral region (PTR) [AUC of 0.91 (95% CI 0.834-0.986)]. Models using T2WI masks showed robust performance on the internal dataset but lower performance on the external set. Both neuroradiologist and general radiologist showed improved performance with model output provided [AUC increased from 0.89 to 0.968 (p = 0.06) and from 0.78 to 0.965 (p = 0.007) respectively], the latter being statistically significant. CONCLUSION: 3D-CNNs showed robust performance for differentiating GB from BMs, with T1-CE TM, either alone or combined with FLAIR-PTR masks. Availability of model output significantly improved the accuracy of the general radiologist.