Retinal small vessel pathology is associated with disease burden in multiple sclerosis.

BACKGROUND: Alterations of the superficial retinal vasculature are commonly observed in multiple sclerosis (MS) and can be visualized through optical coherence tomography angiography (OCTA). OBJECTIVES: This study aimed to examine changes in the retinal vasculature during MS and to integrate findings into current concepts of the underlying pathology. METHODS: In this cross-sectional study, including 259 relapsing-remitting MS patients and 78 healthy controls, we analyzed OCTAs using deep-learning-based segmentation algorithm tools. RESULTS: We identified a loss of small-sized vessels (diameter < 10 µm) in the superficial vascular complex in all MS eyes, irrespective of their optic neuritis (ON) history. This alteration was associated with MS disease burden and appears independent of retinal ganglion cell loss. In contrast, an observed reduction of medium-sized vessels (diameter 10-20 µm) was specific to eyes with a history of ON and was closely linked to ganglion cell atrophy. CONCLUSION: These findings suggest distinct atrophy patterns in retinal vessels in patients with MS. Further studies are necessary to investigate retinal vessel alterations and their underlying pathology in MS.

Limited One-time Sampling Irregularity Map (LOTS-IM) for Automatic Unsupervised Assessment of White Matter Hyperintensities and Multiple Sclerosis Lesions in Structural Brain Magnetic Resonance Images.

We present the application of limited one-time sampling irregularity map (LOTS-IM): a fully automatic unsupervised approach to extract brain tissue irregularities in magnetic resonance images (MRI), for quantitatively assessing white matter hyperintensities (WMH) of presumed vascular origin, and multiple sclerosis (MS) lesions and their progression. LOTS-IM generates an irregularity map (IM) that represents all voxels as irregularity values with respect to the ones considered "normal". Unlike probability values, IM represents both regular and irregular regions in the brain based on the original MRI's texture information. We evaluated and compared the use of IM for WMH and MS lesions segmentation on T2-FLAIR MRI with the state-of-the-art unsupervised lesions' segmentation method, Lesion Growth Algorithm from the public toolbox Lesion Segmentation Toolbox (LST-LGA), with several well established conventional supervised machine learning schemes and with state-of-the-art supervised deep learning methods for WMH segmentation. In our experiments, LOTS-IM outperformed unsupervised method LST-LGA on WMH segmentation, both in performance and processing speed, thanks to the limited one-time sampling scheme and its implementation on GPU. Our method also outperformed supervised conventional machine learning algorithms (i.e., support vector machine (SVM) and random forest (RF)) and deep learning algorithms (i.e., deep Boltzmann machine (DBM) and convolutional encoder network (CEN)), while yielding comparable results to the convolutional neural network schemes that rank top of the algorithms developed up to date for this purpose (i.e., UResNet and UNet). LOTS-IM also performed well on MS lesions segmentation, performing similar to LST-LGA. On the other hand, the high sensitivity of IM on depicting signal change deems suitable for assessing MS progression, although care must be taken with signal changes not reflective of a true pathology.

Global Burden of Small Vessel Disease-Related Brain Changes on MRI Predicts Cognitive and Functional Decline.

Background and Purpose- Cerebral small vessel disease is characterized by a wide range of focal and global brain changes. We used a magnetic resonance imaging segmentation tool to quantify multiple types of small vessel disease-related brain changes and examined their individual and combined predictive value on cognitive and functional abilities. Methods- Magnetic resonance imaging scans of 560 older individuals from LADIS (Leukoaraiosis and Disability Study) were analyzed using automated atlas- and convolutional neural network-based segmentation methods yielding volumetric measures of white matter hyperintensities, lacunes, enlarged perivascular spaces, chronic cortical infarcts, and global and regional brain atrophy. The subjects were followed up with annual neuropsychological examinations for 3 years and evaluation of instrumental activities of daily living for 7 years. Results- The strongest predictors of cognitive performance and functional outcome over time were the total volumes of white matter hyperintensities, gray matter, and hippocampi (P<0.001 for global cognitive function, processing speed, executive functions, and memory and P<0.001 for poor functional outcome). Volumes of lacunes, enlarged perivascular spaces, and cortical infarcts were significantly associated with part of the outcome measures, but their contribution was weaker. In a multivariable linear mixed model, volumes of white matter hyperintensities, lacunes, gray matter, and hippocampi remained as independent predictors of cognitive impairment. A combined measure of these markers based on Z scores strongly predicted cognitive and functional outcomes (P<0.001) even above the contribution of the individual brain changes. Conclusions- Global burden of small vessel disease-related brain changes as quantified by an image segmentation tool is a powerful predictor of long-term cognitive decline and functional disability. A combined measure of white matter hyperintensities, lacunar, gray matter, and hippocampal volumes could be used as an imaging marker associated with vascular cognitive impairment.

DeepCut: Object Segmentation From Bounding Box Annotations Using Convolutional Neural Networks.

In this paper, we propose DeepCut, a method to obtain pixelwise object segmentations given an image dataset labelled weak annotations, in our case bounding boxes. It extends the approach of the well-known GrabCut [1] method to include machine learning by training a neural network classifier from bounding box annotations. We formulate the problem as an energy minimisation problem over a densely-connected conditional random field and iteratively update the training targets to obtain pixelwise object segmentations. Additionally, we propose variants of the DeepCut method and compare those to a naïve approach to CNN training under weak supervision. We test its applicability to solve brain and lung segmentation problems on a challenging fetal magnetic resonance dataset and obtain encouraging results in terms of accuracy.

Generalised overlap measures for assessment of pairwise and groupwise image registration and segmentation.

Effective validation techniques are an essential pre-requisite for segmentation and non-rigid registration techniques to enter clinical use. These algorithms can be evaluated by calculating the overlap of corresponding test and gold-standard regions. Common overlap measures compare pairs of binary labels but it is now common for multiple labels to exist and for fractional (partial volume) labels to be used to describe multiple tissue types contributing to a single voxel. Evaluation studies may involve multiple image pairs. In this paper we use results from fuzzy set theory and fuzzy morphology to extend the definitions of existing overlap measures to accommodate multiple fractional labels. Simple formulas are provided which define single figures of merit to quantify the total overlap for ensembles of pairwise or groupwise label comparisons. A quantitative link between overlap and registration error is established by defining the overlap tolerance. Experiments are performed on publicly available labeled brain data to demonstrate the new measures in a comparison of pairwise and groupwise registration.

Segmentation of 4D cardiac MR images using a probabilistic atlas and the EM algorithm.

In this paper an automatic atlas-based segmentation algorithm for 4D cardiac MR images is proposed. The algorithm is based on the 4D extension of the expectation maximisation (EM) algorithm. The EM algorithm uses a 4D probabilistic cardiac atlas to estimate the initial model parameters and to integrate a priori information into the classification process. The probabilistic cardiac atlas has been constructed from the manual segmentations of 3D cardiac image sequences of 14 healthy volunteers. It provides space and time-varying probability maps for the left and right ventricles, the myocardium, and background structures such as the liver, stomach, lungs and skin. In addition to using the probabilistic cardiac atlas as a priori information, the segmentation algorithm incorporates spatial and temporal contextual information by using 4D Markov Random Fields. After the classification, the largest connected component of each structure is extracted using a global connectivity filter which improves the results significantly, especially for the myocardium. Validation against manual segmentations and computation of the correlation between manual and automatic segmentation on 249 3D volumes were calculated. We used the 'leave one out' test where the image set to be segmented was not used in the construction of its corresponding atlas. Results show that the procedure can successfully segment the left ventricle (LV) (r = 0.96), myocardium (r = 0.92) and right ventricle (r = 0.92). In addition, 4D images from 10 patients with hypertrophic cardiomyopathy were also manually and automatically segmented yielding a good correlation in the volumes of the LV (r = 0.93) and myocardium (0.94) when the atlas constructed with volunteers is blurred.