Accuracy and reproducibility of automated white matter hyperintensities segmentation with lesion segmentation tool: A European multi-site 3T study.

Brain vascular damage accumulate in aging and often manifest as white matter hyperintensities (WMHs) on MRI. Despite increased interest in automated methods to segment WMHs, a gold standard has not been achieved and their longitudinal reproducibility has been poorly investigated. The aim of present work is to evaluate accuracy and reproducibility of two freely available segmentation algorithms. A harmonized MRI protocol was implemented in 3T-scanners across 13 European sites, each scanning five volunteers twice (test-retest) using 2D-FLAIR. Automated segmentation was performed using Lesion segmentation tool algorithms (LST): the Lesion growth algorithm (LGA) in SPM8 and 12 and the Lesion prediction algorithm (LPA). To assess reproducibility, we applied the LST longitudinal pipeline to the LGA and LPA outputs for both the test and retest scans. We evaluated volumetric and spatial accuracy comparing LGA and LPA with manual tracing, and for reproducibility the test versus retest. Median volume difference between automated WMH and manual segmentations (mL) was -0.22[IQR = 0.50] for LGA-SPM8, -0.12[0.57] for LGA-SPM12, -0.09[0.53] for LPA, while the spatial accuracy (Dice Coefficient) was 0.29[0.31], 0.33[0.26] and 0.41[0.23], respectively. The reproducibility analysis showed a median reproducibility error of 20%[IQR = 41] for LGA-SPM8, 14% [31] for LGA-SPM12 and 10% [27] with the LPA cross-sectional pipeline. Applying the LST longitudinal pipeline, the reproducibility errors were considerably reduced (LGA: 0%[IQR = 0], p < 0.001; LPA: 0% [3], p < 0.001) compared to those derived using the cross-sectional algorithms. The DC using the longitudinal pipeline was excellent (median = 1) for LGA [IQR = 0] and LPA [0.02]. LST algorithms showed moderate accuracy and good reproducibility. Therefore, it can be used as a reliable cross-sectional and longitudinal tool in multi-site studies.

Amygdalar nuclei and hippocampal subfields on MRI: Test-retest reliability of automated volumetry across different MRI sites and vendors.

BACKGROUND: The amygdala and the hippocampus are two limbic structures that play a critical role in cognition and behavior, however their manual segmentation and that of their smaller nuclei/subfields in multicenter datasets is time consuming and difficult due to the low contrast of standard MRI. Here, we assessed the reliability of the automated segmentation of amygdalar nuclei and hippocampal subfields across sites and vendors using FreeSurfer in two independent cohorts of older and younger healthy adults. METHODS: Sixty-five healthy older (cohort 1) and 68 younger subjects (cohort 2), from the PharmaCog and CoRR consortia, underwent repeated 3D-T1 MRI (interval 1-90 days). Segmentation was performed using FreeSurfer v6.0. Reliability was assessed using volume reproducibility error (ε) and spatial overlapping coefficient (DICE) between test and retest session. RESULTS: Significant MRI site and vendor effects (p â€‹< â€‹.05) were found in a few subfields/nuclei for the ε, while extensive effects were found for the DICE score of most subfields/nuclei. Reliability was strongly influenced by volume, as ε correlated negatively and DICE correlated positively with volume size of structures (absolute value of Spearman's r correlations >0.43, p â€‹< â€‹1.39E-36). In particular, volumes larger than 200 â€‹mm3 (for amygdalar nuclei) and 300 â€‹mm3 (for hippocampal subfields, except for molecular layer) had the best test-retest reproducibility (ε â€‹< â€‹5% and DICE â€‹> â€‹0.80). CONCLUSION: Our results support the use of volumetric measures of larger amygdalar nuclei and hippocampal subfields in multisite MRI studies. These measures could be useful for disease tracking and assessment of efficacy in drug trials.

Two-Year Longitudinal Monitoring of Amnestic Mild Cognitive Impairment Patients with Prodromal Alzheimer's Disease Using Topographical Biomarkers Derived from Functional Magnetic Resonance Imaging and Electroencephalographic Activity.

Auditory "oddball" event-related potentials (aoERPs), resting state functional magnetic resonance imaging (rsfMRI) connectivity, and electroencephalographic (rsEEG) rhythms were tested as longitudinal functional biomarkers of prodromal Alzheimer's disease (AD). Data were collected at baseline and four follow-ups at 6, 12, 18, and 24 months in amnesic mild cognitive impairment (aMCI) patients classified in two groups: "positive" (i.e., "prodromal AD"; n = 81) or "negative" (n = 63) based on a diagnostic marker of AD derived from cerebrospinal samples (Aß42/P-tau ratio). A linear mixed model design was used to test functional biomarkers for Group, Time, and Group×Time effects adjusted by nuisance covariates (only data until conversion to dementia was used). Functional biomarkers that showed significant Group effects ("positive" versus "negative", p < 0.05) regardless of Time were 1) reduced rsfMRI connectivity in both the default mode network (DMN) and the posterior cingulate cortex (PCC), both also giving significant Time effects (connectivity decay regardless of Group); 2) increased rsEEG source activity at delta (<4 Hz) and theta (4-8 Hz) rhythms and decreased source activity at low-frequency alpha (8-10.5 Hz) rhythms; and 3) reduced parietal and posterior cingulate source activities of aoERPs. Time×Group effects showed differential functional biomarker progression between groups: 1) increased rsfMRI connectivity in the left parietal cortex of the DMN nodes, consistent with compensatory effects and 2) increased limbic source activity at theta rhythms. These findings represent the first longitudinal characterization of functional biomarkers of prodromal AD relative to "negative" aMCI patients based on 5 serial recording sessions over 2 years.

Free water elimination improves test-retest reproducibility of diffusion tensor imaging indices in the brain: A longitudinal multisite study of healthy elderly subjects.

Free water elimination (FWE) in brain diffusion MRI has been shown to improve tissue specificity in human white matter characterization both in health and in disease. Relative to the classical diffusion tensor imaging (DTI) model, FWE is also expected to increase sensitivity to microstructural changes in longitudinal studies. However, it is not clear if these two models differ in their test-retest reproducibility. This study compares a bi-tensor model for FWE with DTI by extending a previous longitudinal-reproducibility 3T multisite study (10 sites, 7 different scanner models) of 50 healthy elderly participants (55-80 years old) scanned in two sessions at least 1 week apart. We computed the reproducibility of commonly used DTI metrics (FA: fractional anisotropy, MD: mean diffusivity, RD: radial diffusivity, and AXD: axial diffusivity), derived either using a DTI model or a FWE model. The DTI metrics were evaluated over 48 white-matter regions of the JHU-ICBM-DTI-81 white-matter labels atlas, and reproducibility errors were assessed. We found that relative to the DTI model, FWE significantly reduced reproducibility errors in most areas tested. In particular, for the FA and MD metrics, there was an average reduction of approximately 1% in the reproducibility error. The reproducibility scores did not significantly differ across sites. This study shows that FWE improves sensitivity and is thus promising for clinical applications, with the potential to identify more subtle changes. The increased reproducibility allows for smaller sample size or shorter trials in studies evaluating biomarkers of disease progression or treatment effects. Hum Brain Mapp 38:12-26, 2017. © 2016 Wiley Periodicals, Inc.

Test-retest reliability of the default mode network in a multi-centric fMRI study of healthy elderly: Effects of data-driven physiological noise correction techniques.

Understanding how to reduce the influence of physiological noise in resting state fMRI data is important for the interpretation of functional brain connectivity. Limited data is currently available to assess the performance of physiological noise correction techniques, in particular when evaluating longitudinal changes in the default mode network (DMN) of healthy elderly participants. In this 3T harmonized multisite fMRI study, we investigated how different retrospective physiological noise correction (rPNC) methods influence the within-site test-retest reliability and the across-site reproducibility consistency of DMN-derived measurements across 13 MRI sites. Elderly participants were scanned twice at least a week apart (five participants per site). The rPNC methods were: none (NPC), Tissue-based regression, PESTICA and FSL-FIX. The DMN at the single subject level was robustly identified using ICA methods in all rPNC conditions. The methods significantly affected the mean z-scores and, albeit less markedly, the cluster-size in the DMN; in particular, FSL-FIX tended to increase the DMN z-scores compared to others. Within-site test-retest reliability was consistent across sites, with no differences across rPNC methods. The absolute percent errors were in the range of 5-11% for DMN z-scores and cluster-size reliability. DMN pattern overlap was in the range 60-65%. In particular, no rPNC method showed a significant reliability improvement relative to NPC. However, FSL-FIX and Tissue-based physiological correction methods showed both similar and significant improvements of reproducibility consistency across the consortium (ICC = 0.67) for the DMN z-scores relative to NPC. Overall these findings support the use of rPNC methods like tissue-based or FSL-FIX to characterize multisite longitudinal changes of intrinsic functional connectivity. Hum Brain Mapp 37:2114-2132, 2016. © 2016 Wiley Periodicals, Inc.

Longitudinal reproducibility of default-mode network connectivity in healthy elderly participants: A multicentric resting-state fMRI study.

To date, limited data are available regarding the inter-site consistency of test-retest reproducibility of functional connectivity measurements, in particular with regard to integrity of the Default Mode Network (DMN) in elderly participants. We implemented a harmonized resting-state fMRI protocol on 13 clinical scanners at 3.0T using vendor-provided sequences. Each site scanned a group of 5 healthy elderly participants twice, at least a week apart. We evaluated inter-site differences and test-retest reproducibility of both temporal signal-to-noise ratio (tSNR) and functional connectivity measurements derived from: i) seed-based analysis (SBA) with seed in the posterior cingulate cortex (PCC), ii) group independent component analysis (ICA) separately for each site (site ICA), and iii) consortium ICA, with group ICA across the whole consortium. Despite protocol harmonization, significant and quantitatively important inter-site differences remained in the tSNR of resting-state fMRI data; these were plausibly driven by hardware and pulse sequence differences across scanners which could not be harmonized. Nevertheless, the tSNR test-retest reproducibility in the consortium was high (ICC=0.81). The DMN was consistently extracted across all sites and analysis methods. While significant inter-site differences in connectivity scores were found, there were no differences in the associated test-retest error. Overall, ICA measurements were more reliable than PCC-SBA, with site ICA showing higher reproducibility than consortium ICA. Across the DMN nodes, the PCC yielded the most reliable measurements (≈4% test-retest error, ICC=0.85), the medial frontal cortex the least reliable (≈12%, ICC=0.82) and the lateral parietal cortices were in between (site ICA). Altogether these findings support usage of harmonized multisite studies of resting-state functional connectivity to characterize longitudinal effects in studies that assess disease progression and treatment response.

Longitudinal reproducibility of automatically segmented hippocampal subfields: A multisite European 3T study on healthy elderly.

Recently, there has been an increased interest in the use of automatically segmented subfields of the human hippocampal formation derived from magnetic resonance imaging (MRI). However, little is known about the test-retest reproducibility of such measures, particularly in the context of multisite studies. Here, we report the reproducibility of automated Freesurfer hippocampal subfields segmentations in 65 healthy elderly enrolled in a consortium of 13 3T MRI sites (five subjects per site). Participants were scanned in two sessions (test and retest) at least one week apart. Each session included two anatomical 3D T1 MRI acquisitions harmonized in the consortium. We evaluated the test-retest reproducibility of subfields segmentation (i) to assess the effects of averaging two within-session T1 images and (ii) to compare subfields with whole hippocampus volume and spatial reliability. We found that within-session averaging of two T1 images significantly improved the reproducibility of all hippocampal subfields but not that of the whole hippocampus. Volumetric and spatial reproducibility across MRI sites were very good for the whole hippocampus, CA2-3, CA4-dentate gyrus (DG), subiculum (reproducibility error∼2% and DICE > 0.90), good for CA1 and presubiculum (reproducibility error ∼ 5% and DICE ∼ 0.90), and poorer for fimbria and hippocampal fissure (reproducibility error ∼ 15% and DICE < 0.80). Spearman's correlations confirmed that test-retest reproducibility improved with volume size. Despite considerable differences of MRI scanner configurations, we found consistent hippocampal subfields volumes estimation. CA2-3, CA4-DG, and sub-CA1 (subiculum, presubiculum, and CA1 pooled together) gave test-retest reproducibility similar to the whole hippocampus. Our findings suggest that the larger hippocampal subfields volume may be reliable longitudinal markers in multisite studies.