Multiscale networks in multiple sclerosis.

Complex diseases such as Multiple Sclerosis (MS) cover a wide range of biological scales, from genes and proteins to cells and tissues, up to the full organism. In fact, any phenotype for an organism is dictated by the interplay among these scales. We conducted a multilayer network analysis and deep phenotyping with multi-omics data (genomics, phosphoproteomics and cytomics), brain and retinal imaging, and clinical data, obtained from a multicenter prospective cohort of 328 patients and 90 healthy controls. Multilayer networks were constructed using mutual information for topological analysis, and Boolean simulations were constructed using Pearson correlation to identified paths within and among all layers. The path more commonly found from the Boolean simulations connects protein MK03, with total T cells, the thickness of the retinal nerve fiber layer (RNFL), and the walking speed. This path contains nodes involved in protein phosphorylation, glial cell differentiation, and regulation of stress-activated MAPK cascade, among others. Specific paths identified were subsequently analyzed by flow cytometry at the single-cell level. Combinations of several proteins (GSK3AB, HSBP1 or RS6) and immune cells (Th17, Th1 non-classic, CD8, CD8 Treg, CD56 neg, and B memory) were part of the paths explaining the clinical phenotype. The advantage of the path identified from the Boolean simulations is that it connects information about these known biological pathways with the layers at higher scales (retina damage and disability). Overall, the identified paths provide a means to connect the molecular aspects of MS with the overall phenotype.

Predicting disease severity in multiple sclerosis using multimodal data and machine learning.

BACKGROUND: Multiple sclerosis patients would benefit from machine learning algorithms that integrates clinical, imaging and multimodal biomarkers to define the risk of disease activity. METHODS: We have analysed a prospective multi-centric cohort of 322 MS patients and 98 healthy controls from four MS centres, collecting disability scales at baseline and 2 years later. Imaging data included brain MRI and optical coherence tomography, and omics included genotyping, cytomics and phosphoproteomic data from peripheral blood mononuclear cells. Predictors of clinical outcomes were searched using Random Forest algorithms. Assessment of the algorithm performance was conducted in an independent prospective cohort of 271 MS patients from a single centre. RESULTS: We found algorithms for predicting confirmed disability accumulation for the different scales, no evidence of disease activity (NEDA), onset of immunotherapy and the escalation from low- to high-efficacy therapy with intermediate to high-accuracy. This accuracy was achieved for most of the predictors using clinical data alone or in combination with imaging data. Still, in some cases, the addition of omics data slightly increased algorithm performance. Accuracies were comparable in both cohorts. CONCLUSION: Combining clinical, imaging and omics data with machine learning helps identify MS patients at risk of disability worsening.

Intraretinal Layer Segmentation Using Cascaded Compressed U-Nets.

Reliable biomarkers quantifying neurodegeneration and neuroinflammation in central nervous system disorders such as Multiple Sclerosis, Alzheimer's dementia or Parkinson's disease are an unmet clinical need. Intraretinal layer thicknesses on macular optical coherence tomography (OCT) images are promising noninvasive biomarkers querying neuroretinal structures with near cellular resolution. However, changes are typically subtle, while tissue gradients can be weak, making intraretinal segmentation a challenging task. A robust and efficient method that requires no or minimal manual correction is an unmet need to foster reliable and reproducible research as well as clinical application. Here, we propose and validate a cascaded two-stage network for intraretinal layer segmentation, with both networks being compressed versions of U-Net (CCU-INSEG). The first network is responsible for retinal tissue segmentation from OCT B-scans. The second network segments eight intraretinal layers with high fidelity. At the post-processing stage, we introduce Laplacian-based outlier detection with layer surface hole filling by adaptive non-linear interpolation. Additionally, we propose a weighted version of focal loss to minimize the foreground-background pixel imbalance in the training data. We train our method using 17,458 B-scans from patients with autoimmune optic neuropathies, i.e., multiple sclerosis, and healthy controls. Voxel-wise comparison against manual segmentation produces a mean absolute error of 2.3 µm, outperforming current state-of-the-art methods on the same data set. Voxel-wise comparison against external glaucoma data leads to a mean absolute error of 2.6 µm when using the same gold standard segmentation approach, and 3.7 µm mean absolute error in an externally segmented data set. In scans from patients with severe optic atrophy, 3.5% of B-scan segmentation results were rejected by an experienced grader, whereas this was the case in 41.4% of B-scans segmented with a graph-based reference method. The validation results suggest that the proposed method can robustly segment macular scans from eyes with even severe neuroretinal changes.

Prior optic neuritis detection on peripapillary ring scans using deep learning.

BACKGROUND: The diagnosis of multiple sclerosis (MS) requires demyelinating events that are disseminated in time and space. Peripapillary retinal nerve fiber layer (pRNFL) thickness as measured by optical coherence tomography (OCT) distinguishes eyes with a prior history of acute optic neuritis (ON) and may provide evidence to support a demyelinating attack. OBJECTIVE: To investigate whether a deep learning (DL)-based network can distinguish between eyes with prior ON and healthy control (HC) eyes using peripapillary ring scans. METHODS: We included 1033 OCT scans from 415 healthy eyes (213 HC subjects) and 510 peripapillary ring scans from 164 eyes with prior acute ON (140 patients with MS). Data were split into 70% training, 15% validation, and 15% test data. We included 102 OCT scans from 80 healthy eyes (40 HC) and 61 scans from 40 ON eyes (31 MS patients) from an independent second center. Receiver operating characteristic curve analyses with area under the curve (AUC) were used to investigate performance. RESULTS: We used a dilated residual convolutional neural network for the classification. The final network had an accuracy of 0.85 and an AUC of 0.86, whereas pRNFL only had an AUC of 0.77 in recognizing ON eyes. Using data from a second center, the network achieved an accuracy of 0.77 and an AUC of 0.90 compared to pRNFL, which had an AUC of 0.84. INTERPRETATION: DL-based disease classification of prior ON is feasible and has the potential to outperform thickness-based classification of eyes with and without history of prior ON.

Modular deep neural networks for automatic quality control of retinal optical coherence tomography scans.

Retinal optical coherence tomography (OCT) with intraretinal layer segmentation is increasingly used not only in ophthalmology but also for neurological diseases such as multiple sclerosis (MS). Signal quality influences segmentation results, and high-quality OCT images are needed for accurate segmentation and quantification of subtle intraretinal layer changes. Among others, OCT image quality depends on the ability to focus, patient compliance and operator skills. Current criteria for OCT quality define acceptable image quality, but depend on manual rating by experienced graders and are time consuming and subjective. In this paper, we propose and validate a standardized, grader-independent, real-time feedback system for automatic quality assessment of retinal OCT images. We defined image quality criteria for scan centering, signal quality and image completeness based on published quality criteria and typical artifacts identified by experienced graders when inspecting OCT images. We then trained modular neural networks on OCT data with manual quality grading to analyze image quality features. Quality analysis by a combination of these trained networks generates a comprehensive quality report containing quantitative results. We validated the approach against quality assessment according to the OSCAR-IB criteria by an experienced grader. Here, 100 OCT files with volume, circular and radial scans, centered on optic nerve head and macula, were analyzed and classified. A specificity of 0.96, a sensitivity of 0.97 and an accuracy of 0.97 as well as a Matthews correlation coefficient of 0.93 indicate a high rate of correct classification. Our method shows promising results in comparison to manual OCT grading and may be useful for real-time image quality analysis or analysis of large data sets, supporting standardized application of image quality criteria.