RimNet: A deep 3D multimodal MRI architecture for paramagnetic rim lesion assessment in multiple sclerosis.

OBJECTIVES: In multiple sclerosis (MS), the presence of a paramagnetic rim at the edge of non-gadolinium-enhancing lesions indicates perilesional chronic inflammation. Patients featuring a higher paramagnetic rim lesion burden tend to have more aggressive disease. The objective of this study was to develop and evaluate a convolutional neural network (CNN) architecture (RimNet) for automated detection of paramagnetic rim lesions in MS employing multiple magnetic resonance (MR) imaging contrasts. MATERIALS AND METHODS: Imaging data were acquired at 3 Tesla on three different scanners from two different centers, totaling 124 MS patients, and studied retrospectively. Paramagnetic rim lesion detection was independently assessed by two expert raters on T2*-phase images, yielding 462 rim-positive (rim+) and 4857 rim-negative (rim-) lesions. RimNet was designed using 3D patches centered on candidate lesions in 3D-EPI phase and 3D FLAIR as input to two network branches. The interconnection of branches at both the first network blocks and the last fully connected layers favors the extraction of low and high-level multimodal features, respectively. RimNet's performance was quantitatively evaluated against experts' evaluation from both lesion-wise and patient-wise perspectives. For the latter, patients were categorized based on a clinically relevant threshold of 4 rim+ lesions per patient. The individual prediction capabilities of the images were also explored and compared (DeLong test) by testing a CNN trained with one image as input (unimodal). RESULTS: The unimodal exploration showed the superior performance of 3D-EPI phase and 3D-EPI magnitude images in the rim+/- classification task (AUC = 0.913 and 0.901), compared to the 3D FLAIR (AUC = 0.855, Ps < 0.0001). The proposed multimodal RimNet prototype clearly outperformed the best unimodal approach (AUC = 0.943, P < 0.0001). The sensitivity and specificity achieved by RimNet (70.6% and 94.9%, respectively) are comparable to those of experts at the lesion level. In the patient-wise analysis, RimNet performed with an accuracy of 89.5% and a Dice coefficient (or F1 score) of 83.5%. CONCLUSIONS: The proposed prototype showed promising performance, supporting the usage of RimNet for speeding up and standardizing the paramagnetic rim lesions analysis in MS.

CVSnet: A machine learning approach for automated central vein sign assessment in multiple sclerosis.

The central vein sign (CVS) is an efficient imaging biomarker for multiple sclerosis (MS) diagnosis, but its application in clinical routine is limited by inter-rater variability and the expenditure of time associated with manual assessment. We describe a deep learning-based prototype for automated assessment of the CVS in white matter MS lesions using data from three different imaging centers. We retrospectively analyzed data from 3 T magnetic resonance images acquired on four scanners from two different vendors, including adults with MS (n = 42), MS mimics (n = 33, encompassing 12 distinct neurological diseases mimicking MS) and uncertain diagnosis (n = 5). Brain white matter lesions were manually segmented on FLAIR* images. Perivenular assessment was performed according to consensus guidelines and used as ground truth, yielding 539 CVS-positive (CVS+ ) and 448 CVS-negative (CVS- ) lesions. A 3D convolutional neural network ("CVSnet") was designed and trained on 47 datasets, keeping 33 for testing. FLAIR* lesion patches of CVS+ /CVS- lesions were used for training and validation (n = 375/298) and for testing (n = 164/150). Performance was evaluated lesion-wise and subject-wise and compared with a state-of-the-art vesselness filtering approach through McNemar's test. The proposed CVSnet approached human performance, with lesion-wise median balanced accuracy of 81%, and subject-wise balanced accuracy of 89% on the validation set, and 91% on the test set. The process of CVS assessment, in previously manually segmented lesions, was ~ 600-fold faster using the proposed CVSnet compared with human visual assessment (test set: 4 seconds vs. 40 minutes). On the validation and test sets, the lesion-wise performance outperformed the vesselness filter method (P < 0.001). The proposed deep learning prototype shows promising performance in differentiating MS from its mimics. Our approach was evaluated using data from different hospitals, enabling larger multicenter trials to evaluate the benefit of introducing the CVS marker into MS diagnostic criteria.

Partial volume-aware assessment of multiple sclerosis lesions.

White-matter lesion count and volume estimation are key to the diagnosis and monitoring of multiple sclerosis (MS). Automated MS lesion segmentation methods that have been proposed in the past 20 years reach their limits when applied to patients in early disease stages characterized by low lesion load and small lesions. We propose an algorithm to automatically assess MS lesion load (number and volume) while taking into account the mixing of healthy and lesional tissue in the image voxels due to partial volume effects. The proposed method works on 3D MPRAGE and 3D FLAIR images as obtained from current routine MS clinical protocols. The method was evaluated and compared with manual segmentation on a cohort of 39 early-stage MS patients with low disability, and showed higher Dice similarity coefficients (median DSC = 0.55) and higher detection rate (median DR = 61%) than two widely used methods (median DSC = 0.50, median DR < 45%) for automated MS lesion segmentation. We argue that this is due to the higher performance in segmentation of small lesions, which are inherently prone to partial volume effects.