ABSTRACT
BACKGROUND: The central vein sign (CVS) is a proposed magnetic resonance imaging (MRI) biomarker for multiple sclerosis (MS); the optimal method for abbreviated CVS scoring is not yet established. OBJECTIVE: The aim of this study was to evaluate the performance of a simplified approach to CVS assessment in a multicenter study of patients being evaluated for suspected MS. METHODS: Adults referred for possible MS to 10 sites were recruited. A post-Gd 3D T2*-weighted MRI sequence (FLAIR*) was obtained in each subject. Trained raters at each site identified up to six CVS-positive lesions per FLAIR* scan. Diagnostic performance of CVS was evaluated for a diagnosis of MS which had been confirmed using the 2017 McDonald criteria at thresholds including three positive lesions (Select-3*) and six positive lesions (Select-6*). Inter-rater reliability assessments were performed. RESULTS: Overall, 78 participants were analyzed; 37 (47%) were diagnosed with MS, and 41 (53%) were not. The mean age of participants was 45 (range: 19-64) years, and most were female (n = 55, 71%). The area under the receiver operating characteristic curve (AUROC) for the simplified counting method was 0.83 (95% CI: 0.73-0.93). Select-3* and Select-6* had sensitivity of 81% and 65% and specificity of 68% and 98%, respectively. Inter-rater agreement was 78% for Select-3* and 83% for Select-6*. CONCLUSION: A simplified method for CVS assessment in patients referred for suspected MS demonstrated good diagnostic performance and inter-rater agreement.
Subject(s)
Multiple Sclerosis , Adult , Humans , Female , Young Adult , Middle Aged , Male , Multiple Sclerosis/diagnostic imaging , Multiple Sclerosis/pathology , Pilot Projects , Reproducibility of Results , Veins , Magnetic Resonance Imaging/methods , Brain/pathologyABSTRACT
Diffusion MRI (dMRI) has become an invaluable tool to assess the microstructural organization of brain tissue. Depending on the specific acquisition settings, the dMRI signal encodes specific properties of the underlying diffusion process. In the last two decades, several signal representations have been proposed to fit the dMRI signal and decode such properties. Most methods, however, are tested and developed on a limited amount of data, and their applicability to other acquisition schemes remains unknown. With this work, we aimed to shed light on the generalizability of existing dMRI signal representations to different diffusion encoding parameters and brain tissue types. To this end, we organized a community challenge - named MEMENTO, making available the same datasets for fair comparisons across algorithms and techniques. We considered two state-of-the-art diffusion datasets, including single-diffusion-encoding (SDE) spin-echo data from a human brain with over 3820 unique diffusion weightings (the MASSIVE dataset), and double (oscillating) diffusion encoding data (DDE/DODE) of a mouse brain including over 2520 unique data points. A subset of the data sampled in 5 different voxels was openly distributed, and the challenge participants were asked to predict the remaining part of the data. After one year, eight participant teams submitted a total of 80 signal fits. For each submission, we evaluated the mean squared error, the variance of the prediction error and the Bayesian information criteria. The received submissions predicted either multi-shell SDE data (37%) or DODE data (22%), followed by cartesian SDE data (19%) and DDE (18%). Most submissions predicted the signals measured with SDE remarkably well, with the exception of low and very strong diffusion weightings. The prediction of DDE and DODE data seemed more challenging, likely because none of the submissions explicitly accounted for diffusion time and frequency. Next to the choice of the model, decisions on fit procedure and hyperparameters play a major role in the prediction performance, highlighting the importance of optimizing and reporting such choices. This work is a community effort to highlight strength and limitations of the field at representing dMRI acquired with trending encoding schemes, gaining insights into how different models generalize to different tissue types and fiber configurations over a large range of diffusion encodings.
Subject(s)
Brain/diagnostic imaging , Databases, Factual , Diffusion Magnetic Resonance Imaging/methods , Image Processing, Computer-Assisted/methods , Neural Networks, Computer , Animals , Brain/physiology , Humans , MiceABSTRACT
Composite MRI scales of central nervous system tissue destruction correlate stronger with clinical outcomes than their individual components in multiple sclerosis (MS) patients. Using machine learning (ML), we previously developed Combinatorial MRI scale (COMRISv1) solely from semi-quantitative (semi-qMRI) biomarkers. Here, we asked how much better COMRISv2 might become with the inclusion of quantitative (qMRI) volumetric features and employment of more powerful ML algorithm. The prospectively acquired MS patients, divided into training (n = 172) and validation (n = 83) cohorts underwent brain MRI imaging and clinical evaluation. Neurological examination was transcribed to NeurEx™ App that automatically computes disability scales. qMRI features were computed by lesion-TOADS algorithm. Modified random forest pipeline selected biomarkers for optimal model(s) in the training cohort. COMRISv2 models validated moderate correlation with cognitive disability [Spearman Rho = 0.674; Lin's concordance coefficient (CCC) = 0.458; p < 0.001] and strong correlations with physical disability (Spearman Rho = 0.830-0.852; CCC = 0.789-0.823; p < 0.001). The NeurEx led to the strongest COMRISv2 model. Addition of qMRI features enhanced performance only of cognitive disability model, likely because semi-qMRI biomarkers measure infratentorial injury with greater accuracy. COMRISv2 models predict most granular clinical scales in MS with remarkable criterion validity, expanding scientific utilization of cohorts with missing clinical data.