Reliability of brain atrophy measurements in multiple sclerosis using MRI: an assessment of six freely available software packages for cross-sectional analyses.

PURPOSE: Volume measurement using MRI is important to assess brain atrophy in multiple sclerosis (MS). However, differences between scanners, acquisition protocols, and analysis software introduce unwanted variability of volumes. To quantify theses effects, we compared within-scanner repeatability and between-scanner reproducibility of three different MR scanners for six brain segmentation methods. METHODS: Twenty-one people with MS underwent scanning and rescanning on three 3 T MR scanners (GE MR750, Philips Ingenuity, Toshiba Vantage Titan) to obtain 3D T1-weighted images. FreeSurfer, FSL, SAMSEG, FastSurfer, CAT-12, and SynthSeg were used to quantify brain, white matter and (deep) gray matter volumes both from lesion-filled and non-lesion-filled 3D T1-weighted images. We used intra-class correlation coefficient (ICC) to quantify agreement; repeated-measures ANOVA to analyze systematic differences; and variance component analysis to quantify the standard error of measurement (SEM) and smallest detectable change (SDC). RESULTS: For all six software, both between-scanner agreement (ICCs ranging 0.4-1) and within-scanner agreement (ICC range: 0.6-1) were typically good, and good to excellent (ICC > 0.7) for large structures. No clear differences were found between filled and non-filled images. However, gray and white matter volumes did differ systematically between scanners for all software (p < 0.05). Variance component analysis yielded within-scanner SDC ranging from 1.02% (SAMSEG, whole-brain) to 14.55% (FreeSurfer, CSF); and between-scanner SDC ranging from 4.83% (SynthSeg, thalamus) to 29.25% (CAT12, thalamus). CONCLUSION: Volume measurements of brain, GM and WM showed high repeatability, and high reproducibility despite substantial differences between scanners. Smallest detectable change was high, especially between different scanners, which hampers the clinical implementation of atrophy measurements.

Longitudinal Assessment of Multiple Sclerosis with the Brain-Age Paradigm.

OBJECTIVE: During the natural course of multiple sclerosis (MS), the brain is exposed to aging as well as disease effects. Brain aging can be modeled statistically; the so-called "brain-age" paradigm. Here, we evaluated whether brain-predicted age difference (brain-PAD) was sensitive to the presence of MS, clinical progression, and future outcomes. METHODS: In a longitudinal, multicenter sample of 3,565 magnetic resonance imaging (MRI) scans, in 1,204 patients with MS and clinically isolated syndrome (CIS) and 150 healthy controls (mean follow-up time: patients 3.41 years, healthy controls 1.97 years), we measured "brain-predicted age" using T1-weighted MRI. We compared brain-PAD among patients with MS and patients with CIS and healthy controls, and between disease subtypes. Relationships between brain-PAD and Expanded Disability Status Scale (EDSS) were explored. RESULTS: Patients with MS had markedly higher brain-PAD than healthy controls (mean brain-PAD +10.3 years; 95% confidence interval [CI] = 8.5-12.1] versus 4.3 years; 95% CI = 2.1 to 6.4; p < 0.001). The highest brain-PADs were in secondary-progressive MS (+13.3 years; 95% CI = 11.3-15.3). Brain-PAD at study entry predicted time-to-disability progression (hazard ratio 1.02; 95% CI = 1.01-1.03; p < 0.001); although normalized brain volume was a stronger predictor. Greater annualized brain-PAD increases were associated with greater annualized EDSS score (r = 0.26; p < 0.001). INTERPRETATION: The brain-age paradigm is sensitive to MS-related atrophy and clinical progression. A higher brain-PAD at baseline was associated with more rapid disability progression and the rate of change in brain-PAD related to worsening disability. Potentially, "brain-age" could be used as a prognostic biomarker in early-stage MS, to track disease progression or stratify patients for clinical trial enrollment. ANN NEUROL 2020 ANN NEUROL 2020;88:93-105.

Joint assessment of white matter integrity, cortical and subcortical atrophy to distinguish AD from behavioral variant FTD: A two-center study.

We investigated the ability of cortical and subcortical gray matter (GM) atrophy in combination with white matter (WM) integrity to distinguish behavioral variant frontotemporal dementia (bvFTD) from Alzheimer's disease (AD) and from controls using voxel-based morphometry, subcortical structure segmentation, and tract-based spatial statistics. To determine which combination of MR markers differentiated the three groups with the highest accuracy, we conducted discriminant function analyses. Adjusted for age, sex and center, both types of dementia had more GM atrophy, lower fractional anisotropy (FA) and higher mean (MD), axial (L1) and radial diffusivity (L23) values than controls. BvFTD patients had more GM atrophy in orbitofrontal and inferior frontal areas than AD patients. In addition, caudate nucleus and nucleus accumbens were smaller in bvFTD than in AD. FA values were lower; MD, L1 and L23 values were higher, especially in frontal areas of the brain for bvFTD compared to AD patients. The combination of cortical GM, hippocampal volume and WM integrity measurements, classified 97-100% of controls, 81-100% of AD and 67-75% of bvFTD patients correctly. Our results suggest that WM integrity measures add complementary information to measures of GM atrophy, thereby improving the classification between AD and bvFTD.

Hippocampal volume change measurement: quantitative assessment of the reproducibility of expert manual outlining and the automated methods FreeSurfer and FIRST.

BACKGROUND: To measure hippocampal volume change in Alzheimer's disease (AD) or mild cognitive impairment (MCI), expert manual delineation is often used because of its supposed accuracy. It has been suggested that expert outlining yields poorer reproducibility as compared to automated methods, but this has not been investigated. AIM: To determine the reproducibilities of expert manual outlining and two common automated methods for measuring hippocampal atrophy rates in healthy aging, MCI and AD. METHODS: From the Alzheimer's Disease Neuroimaging Initiative (ADNI), 80 subjects were selected: 20 patients with AD, 40 patients with mild cognitive impairment (MCI) and 20 healthy controls (HCs). Left and right hippocampal volume change between baseline and month-12 visit was assessed by using expert manual delineation, and by the automated software packages FreeSurfer (longitudinal processing stream) and FIRST. To assess reproducibility of the measured hippocampal volume change, both back-to-back (BTB) MPRAGE scans available for each visit were analyzed. Hippocampal volume change was expressed in µL, and as a percentage of baseline volume. Reproducibility of the 1-year hippocampal volume change was estimated from the BTB measurements by using linear mixed model to calculate the limits of agreement (LoA) of each method, reflecting its measurement uncertainty. Using the delta method, approximate p-values were calculated for the pairwise comparisons between methods. Statistical analyses were performed both with inclusion and exclusion of visibly incorrect segmentations. RESULTS: Visibly incorrect automated segmentation in either one or both scans of a longitudinal scan pair occurred in 7.5% of the hippocampi for FreeSurfer and in 6.9% of the hippocampi for FIRST. After excluding these failed cases, reproducibility analysis for 1-year percentage volume change yielded LoA of ±7.2% for FreeSurfer, ±9.7% for expert manual delineation, and ±10.0% for FIRST. Methods ranked the same for reproducibility of 1-year µL volume change, with LoA of ±218 µL for FreeSurfer, ±319 µL for expert manual delineation, and ±333 µL for FIRST. Approximate p-values indicated that reproducibility was better for FreeSurfer than for manual or FIRST, and that manual and FIRST did not differ. Inclusion of failed automated segmentations led to worsening of reproducibility of both automated methods for 1-year raw and percentage volume change. CONCLUSION: Quantitative reproducibility values of 1-year microliter and percentage hippocampal volume change were roughly similar between expert manual outlining, FIRST and FreeSurfer, but FreeSurfer reproducibility was statistically significantly superior to both manual outlining and FIRST after exclusion of failed segmentations.