Multiple sclerosis lesions segmentation from multiple experts: The MICCAI 2016 challenge dataset.

MRI plays a crucial role in multiple sclerosis diagnostic and patient follow-up. In particular, the delineation of T2-FLAIR hyperintense lesions is crucial although mostly performed manually - a tedious task. Many methods have thus been proposed to automate this task. However, sufficiently large datasets with a thorough expert manual segmentation are still lacking to evaluate these methods. We present a unique dataset for MS lesions segmentation evaluation. It consists of 53 patients acquired on 4 different scanners with a harmonized protocol. Hyperintense lesions on FLAIR were manually delineated on each patient by 7 experts with control on T2 sequence, and gathered in a consensus segmentation for evaluation. We provide raw and preprocessed data and a split of the dataset into training and testing data, the latter including data from a scanner not present in the training dataset. We strongly believe that this dataset will become a reference in MS lesions segmentation evaluation, allowing to evaluate many aspects: evaluation of performance on unseen scanner, comparison to individual experts performance, comparison to other challengers who already used this dataset, etc.

USPIO-positive MS lesions are associated with greater tissue damage than gadolinium-positive-only lesions during 3-year follow-up.

BACKGROUND: Identifying in vivo the processes that determine lesion severity in multiple sclerosis (MS) remains a challenge. OBJECTIVES: To describe the dynamics of ultrasmall superparamagnetic iron oxide (USPIO) enhancement in MS lesions and the relationship between USPIO enhancement and microstructural changes over 3 years. METHODS: Lesion development was assessed at baseline, Months 3, 6, and 9, using magnetic resonance imaging (MRI) with gadolinium and USPIO. Microstructural changes were assessed at baseline, Months 3, 6, 9, 12, 18, 24, and 36, using relaxometry, magnetization transfer, and diffusion-weighted imaging. RESULTS: We included 15 patients with clinically isolated syndrome. In the 52 MRI scans acquired with USPIO, 22 lesions were USPIO and gadolinium positive, and 44 were USPIO negative but gadolinium positive. Lesions no longer exhibited sustained USPIO enhancement 3 months later. At baseline, lesions that were both USPIO and gadolinium positive had lower magnetization transfer ratio values (common language effect size = 0.84, p = 0.0005) and lower fractional anisotropy values (0.83, p = 0.001) than gadolinium-positive-only lesions. USPIO-positive lesions remained associated with greater damage than gadolinium-positive-only lesions throughout the 3-year follow-up. CONCLUSION: USPIO enhancement, mainly reflecting monocyte infiltration, is transient and is associated with persistent tissue damage after 3 years.

Longitudinal multiple sclerosis lesion segmentation: Resource and challenge.

In conjunction with the ISBI 2015 conference, we organized a longitudinal lesion segmentation challenge providing training and test data to registered participants. The training data consisted of five subjects with a mean of 4.4 time-points, and test data of fourteen subjects with a mean of 4.4 time-points. All 82 data sets had the white matter lesions associated with multiple sclerosis delineated by two human expert raters. Eleven teams submitted results using state-of-the-art lesion segmentation algorithms to the challenge, with ten teams presenting their results at the conference. We present a quantitative evaluation comparing the consistency of the two raters as well as exploring the performance of the eleven submitted results in addition to three other lesion segmentation algorithms. The challenge presented three unique opportunities: (1) the sharing of a rich data set; (2) collaboration and comparison of the various avenues of research being pursued in the community; and (3) a review and refinement of the evaluation metrics currently in use. We report on the performance of the challenge participants, as well as the construction and evaluation of a consensus delineation. The image data and manual delineations will continue to be available for download, through an evaluation website2 as a resource for future researchers in the area. This data resource provides a platform to compare existing methods in a fair and consistent manner to each other and multiple manual raters.

Automated delineation of white matter fiber tracts with a multiple region-of-interest approach.

White matter fiber bundles of the brain can be delineated by tractography utilizing multiple regions-of-interest (MROI) defined by anatomical landmarks. These MROI can be used to specify regions in which to seed, select, or reject tractography fibers. Manual identification of anatomical MROI enables the delineation of white matter fiber bundles, but requires considerable training to develop expertise, considerable time to carry out and suffers from unwanted inter- and intra-rater variability. In a study of 20 healthy volunteers, we compared three methodologies for automated delineation of the white matter fiber bundles. Using these methodologies, fiber bundle MROI for each volunteer were automatically generated. We assessed three strategies for inferring the automatic MROI utilizing nonrigid alignment of reference images and projection of template MROI. We assessed the bundle delineation error associated with alignment utilizing T1-weighted MRI, fractional anisotropy images, and full tensor images. We confirmed the smallest delineation error was achieved using the full tensor images. We then assessed three projection strategies for automatic determination of MROI in each volunteer. Quantitative comparisons were made using the root-mean-squared error observed between streamline density images constructed from fiber bundles identified automatically and by manually drawn MROI in the same subjects. We demonstrate that a multiple template consensus label fusion algorithm generated fiber bundles most consistent with the manual reference standard.

An Iterative Centroid Approach for Diffeomorphic Online Atlasing.

Online atlasing, i.e., incrementing an atlas with new images as they are acquired, is key when performing studies on very large, or still being gathered, databases. Regular approaches to atlasing however do not focus on this aspect and impose a complete reconstruction of the atlas when adding images. We propose instead a diffeomorphic online atlasing method that allows gradual updates to an atlas. In this iterative centroid approach, we integrate new subjects in the atlas in an iterative manner, gradually moving the centroid of the images towards its final position. This leads to a computationally cheap approach since it only necessitates one additional registration per new subject added. We validate our approach on several experiments with three main goals: 1- to evaluate atlas image quality of the obtained atlases with sharpness and overlap measures, 2- to assess the deviation in terms of transformations with respect to a conventional atlasing method and 3- to compare its computational time with regular approaches of the literature. We demonstrate that the transformations divergence with respect to a state-of-the-art atlas construction method is small and reaches a plateau, that the two construction methods have the same ability to map subject homologous regions onto a common space and produce images of equivalent quality. The computational time of our approach is also drastically reduced for regular updates. Finally, we also present a direct extension of our method to update spatio-temporal atlases, especially useful for developmental studies.

Interpolation and Averaging of Diffusion MRI Multi-Compartment Models.

Multi-compartment models (MCM) are increasingly used to characterize the brain white matter microstructure from diffusion-weighted imaging (DWI). Their use in clinical studies is however limited by the inability to resample an MCM image towards a common reference frame, or to construct atlases from such brain microstructure models. We propose to solve this problem by first identifying that these two tasks amount to the same problem. We propose to tackle it by viewing it as a simplification problem, solved thanks to spectral clustering and the definition of semi-metrics between several usual compartments encountered in the MCM literature. This generic framework is evaluated for two models: the multi-tensor model where individual fibers are modeled as individual tensors and the diffusion direction imaging (DDI) model that differentiates intra- and extra-axonal components of each fiber. Results on simulated data, simulated transformations and real data show the ability of our method to well interpolate MCM images of these types. We finally present as an application an MCM template of normal controls constructed using our approach.

Multiparametric Analysis of Cerebral Development in Preterm Infants Using Magnetic Resonance Imaging.

OBJECTIVES: The severity of neurocognitive impairment increases with prematurity. However, its mechanisms remain poorly understood. Our aim was firstly to identify multiparametric magnetic resonance imaging (MRI) markers that differ according to the degree of prematurity, and secondly to evaluate the impact of clinical complications on these markers. MATERIALS AND METHODS: We prospectively enrolled preterm infants who were divided into two groups according to their degree of prematurity: extremely preterm (<28 weeks' gestational age) and very preterm (28-32 weeks' gestational age). They underwent a multiparametric brain MRI scan at term-equivalent age including morphological, diffusion tensor and arterial spin labeling (ASL) perfusion sequences. We quantified overall and regional volumes, diffusion parameters, and cerebral blood flow (CBF). We then compared the parameters for the two groups. We also assessed the effects of clinical data and potential MRI morphological abnormalities on those parameters. RESULTS: Thirty-four preterm infants were included. Extremely preterm infants (n = 13) had significantly higher frontal relative volumes (p = 0.04), frontal GM relative volumes (p = 0.03), and regional CBF than very preterm infants, but they had lower brainstem and insular relative volumes (respectively p = 0.008 and 0.04). Preterm infants with WM lesions on MRI had significantly lower overall GM CBF (13.3 ± 2 ml/100 g/min versus 17.7 ± 2.5, < ml/100 g/min p = 0.03). CONCLUSION: Magnetic resonance imaging brain scans performed at term-equivalent age in preterm infants provide quantitative imaging parameters that differ with respect to the degree of prematurity, related to brain maturation.

A Clinically-Compatible Workflow for Computer-Aided Assessment of Brain Disease Activity in Multiple Sclerosis Patients.

Over the last 10 years, the number of approved disease modifying drugs acting on the focal inflammatory process in Multiple Sclerosis (MS) has increased from 3 to 10. This wide choice offers the opportunity of a personalized medicine with the objective of no clinical and radiological activity for each patient. This new paradigm requires the optimization of the detection of new FLAIR lesions on longitudinal MRI. In this paper, we describe a complete workflow-that we developed, implemented, deployed, and evaluated-to facilitate the monitoring of new FLAIR lesions on longitudinal MRI of MS patients. This workflow has been designed to be usable by both hospital and private neurologists and radiologists in France. It consists of three main components: (i) a software component that allows for automated and secured anonymization and transfer of MRI data from the clinical Picture Archive and Communication System (PACS) to a processing server (and vice-versa); (ii) a fully automated segmentation core that enables detection of focal longitudinal changes in patients from T1-weighted, T2-weighted and FLAIR brain MRI scans, and (iii) a dedicated web viewer that provides an intuitive visualization of new lesions to radiologists and neurologists. We first present these different components. Then, we evaluate the workflow on 54 pairs of longitudinal MRI scans that were analyzed by 3 experts (1 neuroradiologist, 1 radiologist, and 1 neurologist) with and without the proposed workflow. We show that our workflow provided a valuable aid to clinicians in detecting new MS lesions both in terms of accuracy (mean number of detected lesions per patient and per expert 1.8 without the workflow vs. 2.3 with the workflow, p = 5.10-4) and of time dedicated by the experts (mean time difference 2'45″, p = 10-4). This increase in the number of detected lesions has implications in the classification of MS patients as stable or active, even for the most experienced neuroradiologist (mean sensitivity was 0.74 without the workflow and 0.90 with the workflow, p-value for no difference = 0.003). It therefore has potential consequences on the therapeutic management of MS patients.

Regional brain development analysis through registration using anisotropic similarity, a constrained affine transformation.

We propose a novel method to quantify brain growth in 3 arbitrary orthogonal directions of the brain or its sub-regions through linear registration. This is achieved by introducing a 9 degrees of freedom (dof) transformation called anisotropic similarity which is an affine transformation with constrained scaling directions along arbitrarily chosen orthogonal vectors. This gives the opportunity to extract scaling factors describing brain growth along those directions by registering a database of subjects onto a common reference. This information about directional growth brings insights that are not usually available in longitudinal volumetric analysis. The interest of this method is illustrated by studying the anisotropic regional and global brain development of 308 healthy subjects betwen 0 and 19 years old. A gender comparison of those scaling factors is also performed for four age-intervals. We demonstrate through these applications the stability of the method to the chosen reference and its ability to highlight growth differences accros regions and gender.

Unsupervised Domain Adaptation With Optimal Transport in Multi-Site Segmentation of Multiple Sclerosis Lesions From MRI Data.

Automatic segmentation of Multiple Sclerosis (MS) lesions from Magnetic Resonance Imaging (MRI) images is essential for clinical assessment and treatment planning of MS. Recent years have seen an increasing use of Convolutional Neural Networks (CNNs) for this task. Although these methods provide accurate segmentation, their applicability in clinical settings remains limited due to a reproducibility issue across different image domains. MS images can have highly variable characteristics across patients, MRI scanners and imaging protocols; retraining a supervised model with data from each new domain is not a feasible solution because it requires manual annotation from expert radiologists. In this work, we explore an unsupervised solution to the problem of domain shift. We present a framework, Seg-JDOT, which adapts a deep model so that samples from a source domain and samples from a target domain sharing similar representations will be similarly segmented. We evaluated the framework on a multi-site dataset, MICCAI 2016, and showed that the adaptation toward a target site can bring remarkable improvements in a model performance over standard training.

White matter abnormalities in depression: A categorical and phenotypic diffusion MRI study.

Mood depressive disorder is one of the most disabling chronic diseases with a high rate of everyday life disability that affects 350 million people around the world. Recent advances in neuroimaging have reported widespread structural abnormalities, suggesting a dysfunctional frontal-limbic circuit involved in the pathophysiological mechanisms of depression. However, a variety of different white matter regions has been implicated and is sought to suffer from lack of reproducibility of such categorical-based biomarkers. These inconsistent results might be attributed to various factors: actual categorical definition of depression as well as clinical phenotype variability. In this study, we 1/ examined WM changes in a large cohort (114 patients) compared to a healthy control group and 2/ sought to identify specific WM alterations in relation to specific depressive phenotypes such as anhedonia (i.e. lack of pleasure), anxiety and psychomotor retardation -three core symptoms involved in depression. Consistent with previous studies, reduced white matter was observed in the genu of the corpus callosum extending to the inferior fasciculus and posterior thalamic radiation, confirming a frontal-limbic circuit abnormality. Our analysis also reported other patterns of increased fractional anisotropy and axial diffusivity as well as decreased apparent diffusion coefficient and radial diffusivity in the splenium of the corpus callosum and posterior limb of the internal capsule. Moreover, a positive correlation between FA and anhedonia was found in the superior longitudinal fasciculus as well as a negative correlation in the cingulum. Then, the analysis of the anxiety and diffusion metric revealed that increased anxiety was associated with greater FA values in genu and splenium of corpus callosum, anterior corona radiata and posterior thalamic radiation. Finally, the motor retardation analysis showed a correlation between increased Widlöcher depressive retardation scale scores and reduced FA in the body and genu of the corpus callosum, fornix, and superior striatum. Through this twofold approach (categorical and phenotypic), this study has underlined the need to move forward to a symptom-based research area of biomarkers, which help to understand the pathophysiology of mood depressive disorders and to stratify precise phenotypes of depression with targeted therapeutic strategies.

Atlas-based delineation of lymph node levels in head and neck computed tomography images.

PURPOSE: Radiotherapy planning requires accurate delineations of the tumor and of the critical structures. Atlas-based segmentation has been shown to be very efficient to automatically delineate brain critical structures. We therefore propose to construct an anatomical atlas of the head and neck region. METHODS AND MATERIALS: Due to the high anatomical variability of this region, an atlas built from a single image as for the brain is not adequate. We address this issue by building a symmetric atlas from a database of manually segmented images. First, we develop an atlas construction method and apply it to a database of 45 Computed Tomography (CT) images from patients with node-negative pharyngo-laryngeal squamous cell carcinoma manually delineated for radiotherapy. Then, we qualitatively and quantitatively evaluate the results generated by the built atlas based on Leave-One-Out framework on the database. RESULTS: We present qualitative and quantitative results using this atlas construction method. The evaluation was performed on a subset of 12 patients among the original CT database of 45 patients. Qualitative results depict visually well delineated structures. The quantitative results are also good, with an error with respect to the best achievable results ranging from 0.196 to 0.404 with a mean of 0.253. CONCLUSIONS: These results show the feasibility of using such an atlas for radiotherapy planning. Many perspectives are raised from this work ranging from extensive validation to the construction of several atlases representing sub-populations, to account for large inter-patient variabilities, and populations with node-positive tumors.

Evaluation of an atlas-based automatic segmentation software for the delineation of brain organs at risk in a radiation therapy clinical context.

BACKGROUND AND PURPOSE: Conformal radiation therapy techniques require the delineation of volumes of interest, a time-consuming and operator-dependent task. In this work, we aimed to evaluate the potential interest of an atlas-based automatic segmentation software (ABAS) of brain organs at risk (OAR), when used under our clinical conditions. MATERIALS AND METHODS: Automatic and manual segmentations of the eyes, optic nerves, optic chiasm, pituitary gland, brain stem and cerebellum of 11 patients on T1-weighted magnetic resonance, 3-mm thick slice images were compared using the Dice similarity coefficient (DSC). The sensitivity and specificity of the ABAS were also computed and analysed from a radiotherapy point of view by splitting the ROC (Receiver Operating Characteristic) space into four sub-regions. RESULTS: Automatic segmentation of OAR was achieved in 7-8 min. Excellent agreement was obtained between automatic and manual delineations for organs exceeding 7 cm3: the DSC was greater than 0.8. For smaller structures, the DSC was lower than 0.41. CONCLUSIONS: These tests demonstrated that this ABAS is a robust and reliable tool for automatic delineation of large structures under clinical conditions in our daily practice, even though the small structures must continue to be delineated manually by an expert.

Measurement of pediatric regional cerebral blood flow from 6 months to 15 years of age in a clinical population.

OBJECTIVES: To investigate changes in cerebral blood flow (CBF) in gray matter (GM) between 6 months and 15 years of age and to provide CBF values for the brain, GM, white matter (WM), hemispheres and lobes. METHODS: Between 2013 and 2016, we retrospectively included all clinical MRI examinations with arterial spin labeling (ASL). We excluded subjects with a condition potentially affecting brain perfusion. For each subject, mean values of CBF in the brain, GM, WM, hemispheres and lobes were calculated. GM CBF was fitted using linear, quadratic and cubic polynomial regression against age. Regression models were compared with Akaike's information criterion (AIC), and Likelihood Ratio tests. RESULTS: 84 children were included (44 females/40 males). Mean CBF values were 64.2 ±â€¯13.8 mL/100 g/min in GM, and 29.3 ±â€¯10.0 mL/100 g/min in WM. The best-fit model of brain perfusion was the cubic polynomial function (AIC = 672.7, versus respectively AIC = 673.9 and AIC = 674.1 with the linear negative function and the quadratic polynomial function). A statistically significant difference between the tested models demonstrating the superiority of the quadratic (p = 0.18) or cubic polynomial model (p = 0.06), over the negative linear regression model was not found. No effect of general anesthesia (p = 0.34) or of gender (p = 0.16) was found. CONCLUSION: we provided values for ASL CBF in the brain, GM, WM, hemispheres, and lobes over a wide pediatric age range, approximately showing inverted U-shaped changes in GM perfusion over the course of childhood.

Objective Evaluation of Multiple Sclerosis Lesion Segmentation using a Data Management and Processing Infrastructure.

We present a study of multiple sclerosis segmentation algorithms conducted at the international MICCAI 2016 challenge. This challenge was operated using a new open-science computing infrastructure. This allowed for the automatic and independent evaluation of a large range of algorithms in a fair and completely automatic manner. This computing infrastructure was used to evaluate thirteen methods of MS lesions segmentation, exploring a broad range of state-of-theart algorithms, against a high-quality database of 53 MS cases coming from four centers following a common definition of the acquisition protocol. Each case was annotated manually by an unprecedented number of seven different experts. Results of the challenge highlighted that automatic algorithms, including the recent machine learning methods (random forests, deep learning, …), are still trailing human expertise on both detection and delineation criteria. In addition, we demonstrate that computing a statistically robust consensus of the algorithms performs closer to human expertise on one score (segmentation) although still trailing on detection scores.

Block-Matching Distortion Correction of Echo-Planar Images With Opposite Phase Encoding Directions.

By shortening the acquisition time of MRI, Echo Planar Imaging (EPI) enables the acquisition of a large number of images in a short time, compatible with clinical constraints as required for diffusion or functional MRI. However such images are subject to large, local distortions disrupting their correspondence with the underlying anatomy. The correction of those distortions is an open problem, especially in regions where large deformations occur. We propose a new block-matching registration method to perform EPI distortion correction based on the acquisition of two EPI with opposite phase encoding directions (PED). It relies on new transformations between blocks adapted to the EPI distortion model, and on an adapted optimization scheme to ensure an opposite symmetric transformation. We present qualitative and quantitative results of the block-matching correction using different metrics on a phantom dataset and on in-vivo data. We show the ability of the block-matching to robustly correct EPI distortion even in strongly affected areas.

Imaging biomarkers in multiple Sclerosis: From image analysis to population imaging.

The production of imaging data in medicine increases more rapidly than the capacity of computing models to extract information from it. The grand challenges of better understanding the brain, offering better care for neurological disorders, and stimulating new drug design will not be achieved without significant advances in computational neuroscience. The road to success is to develop a new, generic, computational methodology and to confront and validate this methodology on relevant diseases with adapted computational infrastructures. This new concept sustains the need to build new research paradigms to better understand the natural history of the pathology at the early phase; to better aggregate data that will provide the most complete representation of the pathology in order to better correlate imaging with other relevant features such as clinical, biological or genetic data. In this context, one of the major challenges of neuroimaging in clinical neurosciences is to detect quantitative signs of pathological evolution as early as possible to prevent disease progression, evaluate therapeutic protocols or even better understand and model the natural history of a given neurological pathology. Many diseases encompass brain alterations often not visible on conventional MRI sequences, especially in normal appearing brain tissues (NABT). MRI has often a low specificity for differentiating between possible pathological changes which could help in discriminating between the different pathological stages or grades. The objective of medical image analysis procedures is to define new quantitative neuroimaging biomarkers to track the evolution of the pathology at different levels. This paper illustrates this issue in one acute neuro-inflammatory pathology: Multiple Sclerosis (MS). It exhibits the current medical image analysis approaches and explains how this field of research will evolve in the next decade to integrate larger scale of information at the temporal, cellular, structural and morphological levels.

Atlas-based automatic segmentation of MR images: validation study on the brainstem in radiotherapy context.

PURPOSE: Brain tumor radiotherapy requires the volume measurements and the localization of several individual brain structures. Any tool that can assist the physician to perform the delineation would then be of great help. Among segmentation methods, those that are atlas-based are appealing because they are able to segment several structures simultaneously, while preserving the anatomy topology. This study aims to evaluate such a method in a clinical context. METHODS AND MATERIALS: The brain atlas is made of two three-dimensional (3D) volumes: the first is an artificial 3D magnetic resonance imaging (MRI); the second consists of the segmented structures in this artificial MRI. The elastic registration of the artificial 3D MRI against a patient 3D MRI dataset yields an elastic transformation that can be applied to the labeled image. The elastic transformation is obtained by minimizing the sum of the square differences of the image intensities and derived from the optical flow principle. This automatic delineation (AD) enables the mapping of the segmented structures onto the patient MRI. Parameters of the AD have been optimized on a set of 20 patients. Results are obtained on a series of 6 patients' MRI. A comprehensive validation of the AD has been conducted on performance of atlas-based segmentation in a clinical context with volume, position, sensitivity, and specificity that are compared by a panel of seven experimented physicians for the brain tumor treatments. RESULTS: Expert interobserver volume variability ranged from 16.70 cm(3) to 41.26 cm(3). For patients, the ratio of minimal to maximal volume ranged from 48% to 70%. Median volume varied from 19.47 cm(3) to 27.66 cm(3) and volume of the brainstem calculated by AD varied from 17.75 cm(3) to 24.54 cm(3). Medians of experts ranged, respectively, for sensitivity and specificity, from 0.75 to 0.98 and from 0.85 to 0.99. Median of AD were, respectively, 0.77 and 0.97. Mean of experts ranged, respectively, from 0.78 to 0.97 and from 0.86 to 0.99. Mean of AD were, respectively, 0.76 and 0.97. CONCLUSIONS: Results demonstrate that the method is repeatable, provides a good trade-off between accuracy and robustness, and leads to reproducible segmentation and labeling. These results can be improved by enriching the atlas with the rough information of tumor or by using different laws of deformation for the different structures. Qualitative results also suggest that this method can be used for automatic segmentation of other organs such as neck, thorax, abdomen, pelvis, and limbs.

Diffusion MRI abnormalities detection with orientation distribution functions: a multiple sclerosis longitudinal study.

We propose a new algorithm for the voxelwise analysis of orientation distribution functions between one image and a group of reference images. It relies on a generic framework for the comparison of diffusion probabilities on the sphere, sampled from the underlying models. We demonstrate that this method, combined to dimensionality reduction through a principal component analysis, allows for more robust detection of lesions on simulated data when compared to classical tensor-based analysis. We then demonstrate the efficiency of this pipeline on the longitudinal comparison of multiple sclerosis patients at an early stage of the disease: right after their first clinically isolated syndrome (CIS) and three months later. We demonstrate the predictive value of ODF-based scores for the early detection of lesions that will appear or heal.