Cross-Cohort Automatic Knee MRI Segmentation With Multi-Planar U-Nets.

BACKGROUND: Segmentation of medical image volumes is a time-consuming manual task. Automatic tools are often tailored toward specific patient cohorts, and it is unclear how they behave in other clinical settings. PURPOSE: To evaluate the performance of the open-source Multi-Planar U-Net (MPUnet), the validated Knee Imaging Quantification (KIQ) framework, and a state-of-the-art two-dimensional (2D) U-Net architecture on three clinical cohorts without extensive adaptation of the algorithms. STUDY TYPE: Retrospective cohort study. SUBJECTS: A total of 253 subjects (146 females, 107 males, ages 57 ± 12 years) from three knee osteoarthritis (OA) studies (Center for Clinical and Basic Research [CCBR], Osteoarthritis Initiative [OAI], and Prevention of OA in Overweight Females [PROOF]) with varying demographics and OA severity (64/37/24/53/2 scans of Kellgren and Lawrence [KL] grades 0-4). FIELD STRENGTH/SEQUENCE: 0.18 T, 1.0 T/1.5 T, and 3 T sagittal three-dimensional fast-spin echo T1w and dual-echo steady-state sequences. ASSESSMENT: All models were fit without tuning to knee magnetic resonance imaging (MRI) scans with manual segmentations from three clinical cohorts. All models were evaluated across KL grades. STATISTICAL TESTS: Segmentation performance differences as measured by Dice coefficients were tested with paired, two-sided Wilcoxon signed-rank statistics with significance threshold α = 0.05. RESULTS: The MPUnet performed superior or equal to KIQ and 2D U-Net on all compartments across three cohorts. Mean Dice overlap was significantly higher for MPUnet compared to KIQ and U-Net on CCBR ( 0.83±0.04 vs. 0.81±0.06 and 0.82±0.05 ), significantly higher than KIQ and U-Net OAI ( 0.86±0.03 vs. 0.84±0.04 and 0.85±0.03) , and not significantly different from KIQ while significantly higher than 2D U-Net on PROOF ( 0.78±0.07 vs. 0.77±0.07 , P=0.10 , and 0.73±0.07) . The MPUnet performed significantly better on N=22 KL grade 3 CCBR scans with 0.78±0.06 vs. 0.75±0.08 for KIQ and 0.76±0.06 for 2D U-Net. DATA CONCLUSION: The MPUnet matched or exceeded the performance of state-of-the-art knee MRI segmentation models across cohorts of variable sequences and patient demographics. The MPUnet required no manual tuning making it both accurate and easy-to-use. LEVEL OF EVIDENCE: 3 TECHNICAL EFFICACY: Stage 2.

Robust parametric modeling of Alzheimer's disease progression.

Quantitative characterization of disease progression using longitudinal data can provide long-term predictions for the pathological stages of individuals. This work studies the robust modeling of Alzheimer's disease progression using parametric methods. The proposed method linearly maps the individual's age to a disease progression score (DPS) and jointly fits constrained generalized logistic functions to the longitudinal dynamics of biomarkers as functions of the DPS using M-estimation. Robustness of the estimates is quantified using bootstrapping via Monte Carlo resampling, and the estimated inflection points of the fitted functions are used to temporally order the modeled biomarkers in the disease course. Kernel density estimation is applied to the obtained DPSs for clinical status classification using a Bayesian classifier. Different M-estimators and logistic functions, including a novel type proposed in this study, called modified Stannard, are evaluated on the data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) for robust modeling of volumetric magnetic resonance imaging (MRI) and positron emission tomography (PET) biomarkers, cerebrospinal fluid (CSF) measurements, as well as cognitive tests. The results show that the modified Stannard function fitted using the logistic loss achieves the best modeling performance with an average normalized mean absolute error (NMAE) of 0.991 across all biomarkers and bootstraps. Applied to the ADNI test set, this model achieves a multiclass area under the ROC curve (AUC) of 0.934 in clinical status classification. The obtained results for the proposed model outperform almost all state-of-the-art results in predicting biomarker values and classifying clinical status. Finally, the experiments show that the proposed model, trained using abundant ADNI data, generalizes well to data from the National Alzheimer's Coordinating Center (NACC) with an average NMAE of 1.182 and a multiclass AUC of 0.929.

Brain region's relative proximity as marker for Alzheimer's disease based on structural MRI.

BACKGROUND: Alzheimer's disease (AD) is a progressive, incurable neurodegenerative disease and the most common type of dementia. It cannot be prevented, cured or drastically slowed, even though AD research has increased in the past 5-10 years. Instead of focusing on the brain volume or on the single brain structures like hippocampus, this paper investigates the relationship and proximity between regions in the brain and uses this information as a novel way of classifying normal control (NC), mild cognitive impaired (MCI), and AD subjects. METHODS: A longitudinal cohort of 528 subjects (170 NC, 240 MCI, and 114 AD) from ADNI at baseline and month 12 was studied. We investigated a marker based on Procrustes aligned center of masses and the percentile surface connectivity between regions. These markers were classified using a linear discriminant analysis in a cross validation setting and compared to whole brain and hippocampus volume. RESULTS: We found that both our markers was able to significantly classify the subjects. The surface connectivity marker showed the best results with an area under the curve (AUC) at 0.877 (p<0.001), 0.784 (p<0.001), 0,766 (p<0.001) for NC-AD, NC-MCI, and MCI-AD, respectively, for the functional regions in the brain. The surface connectivity marker was able to classify MCI-converters with an AUC of 0.599 (p<0.05) for the 1-year period. CONCLUSION: Our results show that our relative proximity markers include more information than whole brain and hippocampus volume. Our results demonstrate that our proximity markers have the potential to assist in early diagnosis of AD.

Artificial Intelligence for Automated DWI/FLAIR Mismatch Assessment on Magnetic Resonance Imaging in Stroke: A Systematic Review.

We conducted this Systematic Review to create an overview of the currently existing Artificial Intelligence (AI) methods for Magnetic Resonance Diffusion-Weighted Imaging (DWI)/Fluid-Attenuated Inversion Recovery (FLAIR)-mismatch assessment and to determine how well DWI/FLAIR mismatch algorithms perform compared to domain experts. We searched PubMed Medline, Ovid Embase, Scopus, Web of Science, Cochrane, and IEEE Xplore literature databases for relevant studies published between 1 January 2017 and 20 November 2022, following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. We assessed the included studies using the Quality Assessment of Diagnostic Accuracy Studies 2 tool. Five studies fit the scope of this review. The area under the curve ranged from 0.74 to 0.90. The sensitivity and specificity ranged from 0.70 to 0.85 and 0.74 to 0.84, respectively. Negative predictive value, positive predictive value, and accuracy ranged from 0.55 to 0.82, 0.74 to 0.91, and 0.73 to 0.83, respectively. In a binary classification of ±4.5 h from stroke onset, the surveyed AI methods performed equivalent to or even better than domain experts. However, using the relation between time since stroke onset (TSS) and increasing visibility of FLAIR hyperintensity lesions is not recommended for the determination of TSS within the first 4.5 h. An AI algorithm on DWI/FLAIR mismatch assessment focused on treatment eligibility, outcome prediction, and consideration of patient-specific data could potentially increase the proportion of stroke patients with unknown onset who could be treated with thrombolysis.

An Automatic DWI/FLAIR Mismatch Assessment of Stroke Patients.

DWI/FLAIR mismatch assessment for ischemic stroke patients shows promising results in determining if patients are eligible for recombinant tissue-type plasminogen activator (r-tPA) treatment. However, the mismatch criteria suffer from two major issues: binary classification of a non-binary problem and the subjectiveness of the assessor. In this article, we present a simple automatic method for segmenting stroke-related parenchymal hyperintensities on FLAIR, allowing for an automatic and continuous DWI/FLAIR mismatch assessment. We further show that our method's segmentations have comparable inter-rater agreement (DICE 0.820, SD 0.12) compared to that of two neuro-radiologists (DICE 0.856, SD 0.07), that our method appears robust to hyper-parameter choices (suggesting good generalizability), and lastly, that our methods continuous DWI/FLAIR mismatch assessment correlates to mismatch assessments made for a cohort of wake-up stroke patients at hospital submission. The proposed method shows promising results in automating the segmentation of parenchymal hyperintensity within ischemic stroke lesions and could help reduce inter-observer variability of DWI/FLAIR mismatch assessment performed in clinical environments as well as offer a continuous assessment instead of the current binary one.

Automated Identification of Multiple Findings on Brain MRI for Improving Scan Acquisition and Interpretation Workflows: A Systematic Review.

We conducted a systematic review of the current status of machine learning (ML) algorithms' ability to identify multiple brain diseases, and we evaluated their applicability for improving existing scan acquisition and interpretation workflows. PubMed Medline, Ovid Embase, Scopus, Web of Science, and IEEE Xplore literature databases were searched for relevant studies published between January 2017 and February 2022. The quality of the included studies was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 tool. The applicability of ML algorithms for successful workflow improvement was qualitatively assessed based on the satisfaction of three clinical requirements. A total of 19 studies were included for qualitative synthesis. The included studies performed classification tasks (n = 12) and segmentation tasks (n = 7). For classification algorithms, the area under the receiver operating characteristic curve (AUC) ranged from 0.765 to 0.997, while accuracy, sensitivity, and specificity ranged from 80% to 100%, 72% to 100%, and 65% to 100%, respectively. For segmentation algorithms, the Dice coefficient ranged from 0.300 to 0.912. No studies satisfied all clinical requirements for successful workflow improvements due to key limitations pertaining to the study's design, study data, reference standards, and performance reporting. Standardized reporting guidelines tailored for ML in radiology, prospective study designs, and multi-site testing could help alleviate this.

The Medical Segmentation Decathlon.

International challenges have become the de facto standard for comparative assessment of image analysis algorithms. Although segmentation is the most widely investigated medical image processing task, the various challenges have been organized to focus only on specific clinical tasks. We organized the Medical Segmentation Decathlon (MSD)-a biomedical image analysis challenge, in which algorithms compete in a multitude of both tasks and modalities to investigate the hypothesis that a method capable of performing well on multiple tasks will generalize well to a previously unseen task and potentially outperform a custom-designed solution. MSD results confirmed this hypothesis, moreover, MSD winner continued generalizing well to a wide range of other clinical problems for the next two years. Three main conclusions can be drawn from this study: (1) state-of-the-art image segmentation algorithms generalize well when retrained on unseen tasks; (2) consistent algorithmic performance across multiple tasks is a strong surrogate of algorithmic generalizability; (3) the training of accurate AI segmentation models is now commoditized to scientists that are not versed in AI model training.

Developing and validating COVID-19 adverse outcome risk prediction models from a bi-national European cohort of 5594 patients.

Patients with severe COVID-19 have overwhelmed healthcare systems worldwide. We hypothesized that machine learning (ML) models could be used to predict risks at different stages of management and thereby provide insights into drivers and prognostic markers of disease progression and death. From a cohort of approx. 2.6 million citizens in Denmark, SARS-CoV-2 PCR tests were performed on subjects suspected for COVID-19 disease; 3944 cases had at least one positive test and were subjected to further analysis. SARS-CoV-2 positive cases from the United Kingdom Biobank was used for external validation. The ML models predicted the risk of death (Receiver Operation Characteristics-Area Under the Curve, ROC-AUC) of 0.906 at diagnosis, 0.818, at hospital admission and 0.721 at Intensive Care Unit (ICU) admission. Similar metrics were achieved for predicted risks of hospital and ICU admission and use of mechanical ventilation. Common risk factors, included age, body mass index and hypertension, although the top risk features shifted towards markers of shock and organ dysfunction in ICU patients. The external validation indicated fair predictive performance for mortality prediction, but suboptimal performance for predicting ICU admission. ML may be used to identify drivers of progression to more severe disease and for prognostication patients in patients with COVID-19. We provide access to an online risk calculator based on these findings.

Efficacy of a collagen hydrolysate and antioxidants-containing nutraceutical on metrics of skin health in Indian women.

BACKGROUND: The skin's aging process involves a decreased biosynthesis of extracellular matrix proteins (predominantly collagen) compounded by damage from environmental and intrinsic stressors. The Indian population is susceptible to skin damage given its geography and increasing urbanization or a genetic disposition. Previous studies have investigated nutrients such as collagen peptides, vitamins and phytonutrient-rich botanical extracts for their individual benefits on skin. AIMS: This study examined the collective effect of a proprietary blend of these nutrients (in Nutrova Collagen+Antioxidants; NCA) on skin parameters, which has not been previously studied, especially in an Indian context. PATIENTS/METHODS: 34 healthy, Indian women (mean age = 39.5 years) were given a placebo daily for 30 days to establish a baseline, followed by NCA for two intervals of 30 days. 3D image reconstruction allowed the analysis of skin topography and blemishes. Instrumental measurements also included skin firmness, elasticity, hydration, and transepidermal water loss. Clinical evaluation was used to grade blemishes, wrinkles and periorbital hyperpigmentation. RESULTS: Based on instrumental evaluation, NCA significantly reduced wrinkle width, open pores, skin roughness, and the colour of hyperpigmented blemishes, while improving skin hydration, firmness and barrier function from baseline to Day 30 and Day 60. NCA also increased elasticity at Day 30. Clinical evaluation showed that periorbital hyperpigmentation and wrinkles reduced significantly. CONCLUSION: NCA is effective for improving overall skin health in Indian women. These results show that targeted nutrient supplementation can improve skin health and further research over extended durations is merited.

Inflammatory pathway analytes predicting rapid cognitive decline in MCI stage of Alzheimer's disease.

OBJECTIVE: To determine the inflammatory analytes that predict clinical progression and evaluate their performance against biomarkers of neurodegeneration. METHODS: A longitudinal study of MCI-AD patients in a Discovery cohort over 15 months, with replication in the Alzheimer's Disease Neuroimaging Initiative (ADNI) MCI cohort over 36 months. Fifty-three inflammatory analytes were measured in the CSF and plasma with a RBM multiplex analyte platform. Inflammatory analytes that predict clinical progression on Clinical Dementia Rating Scale-Sum of Boxes (CDR-SB) and Mini Mental State Exam scores were assessed in multivariate regression models. To provide context, key analyte results in ADNI were compared against biomarkers of neurodegeneration, hippocampal volume, and CSF neurofilament light (NfL), in receiver operating characteristic (ROC) analyses evaluating highest quartile of CDR-SB change over two years (≥3 points). RESULTS: Cerebrospinal fluid inflammatory analytes in relation to cognitive decline were best described by gene ontology terms, natural killer cell chemotaxis, and endothelial cell apoptotic process and in plasma, extracellular matrix organization, blood coagulation, and fibrin clot formation described the analytes. CSF CCL2 was most robust in predicting rate of cognitive change and analytes that correlated to CCL2 suggest IL-10 pathway dysregulation. The ROC curves for ≥3 points change in CDR-SB over 2 years when comparing baseline hippocampal volume, CSF NfL, and CCL2 were not significantly different. INTERPRETATION: Baseline levels of immune cell chemotactic cytokine CCL2 in the CSF and IL-10 pathway dysregulation impact longitudinal cognitive and functional decline in MCI-AD. CCL2's utility appears comparable to biomarkers of neurodegeneration in predicting rapid decline.

Training recurrent neural networks robust to incomplete data: Application to Alzheimer's disease progression modeling.

Disease progression modeling (DPM) using longitudinal data is a challenging machine learning task. Existing DPM algorithms neglect temporal dependencies among measurements, make parametric assumptions about biomarker trajectories, do not model multiple biomarkers jointly, and need an alignment of subjects' trajectories. In this paper, recurrent neural networks (RNNs) are utilized to address these issues. However, in many cases, longitudinal cohorts contain incomplete data, which hinders the application of standard RNNs and requires a pre-processing step such as imputation of the missing values. Instead, we propose a generalized training rule for the most widely used RNN architecture, long short-term memory (LSTM) networks, that can handle both missing predictor and target values. The proposed LSTM algorithm is applied to model the progression of Alzheimer's disease (AD) using six volumetric magnetic resonance imaging (MRI) biomarkers, i.e., volumes of ventricles, hippocampus, whole brain, fusiform, middle temporal gyrus, and entorhinal cortex, and it is compared to standard LSTM networks with data imputation and a parametric, regression-based DPM method. The results show that the proposed algorithm achieves a significantly lower mean absolute error (MAE) than the alternatives with p < 0.05 using Wilcoxon signed rank test in predicting values of almost all of the MRI biomarkers. Moreover, a linear discriminant analysis (LDA) classifier applied to the predicted biomarker values produces a significantly larger area under the receiver operating characteristic curve (AUC) of 0.90 vs. at most 0.84 with p < 0.001 using McNemar's test for clinical diagnosis of AD. Inspection of MAE curves as a function of the amount of missing data reveals that the proposed LSTM algorithm achieves the best performance up until more than 74% missing values. Finally, it is illustrated how the method can successfully be applied to data with varying time intervals. This paper shows that built-in handling of missing values in training an LSTM network benefits the application of RNNs in neurodegenerative disease progression modeling in longitudinal cohorts.

Multi-domain Adaptation in Brain MRI Through Paired Consistency and Adversarial Learning.

Supervised learning algorithms trained on medical images will often fail to generalize across changes in acquisition parameters. Recent work in domain adaptation addresses this challenge and successfully leverages labeled data in a source domain to perform well on an unlabeled target domain. Inspired by recent work in semi-supervised learning we introduce a novel method to adapt from one source domain to n target domains (as long as there is paired data covering all domains). Our multi-domain adaptation method utilises a consistency loss combined with adversarial learning. We provide results on white matter lesion hyperintensity segmentation from brain MRIs using the MICCAI 2017 challenge data as the source domain and two target domains. The proposed method significantly outperforms other domain adaptation baselines.

Collocation for Diffeomorphic Deformations in Medical Image Registration.

Diffeomorphic deformation is a popular choice in medical image registration. A fundamental property of diffeomorphisms is invertibility, implying that once the relation between two points A to B is found, then the relation B to A is given per definition. Consistency is a measure of a numerical algorithm's ability to mimic this invertibility, and achieving consistency has proven to be a challenge for many state-of-the-art algorithms. We present CDD (Collocation for Diffeomorphic Deformations), a numerical solution to diffeomorphic image registration, which solves for the Stationary Velocity Field (SVF) using an implicit A-stable collocation method. CDD guarantees the preservation of the diffeomorphic properties at all discrete points and is thereby consistent to machine precision. We compared CDD's collocation method with the following standard methods: Scaling and Squaring, Forward Euler, and Runge-Kutta 4, and found that CDD is up to 9 orders of magnitude more consistent. Finally, we evaluated CDD on a number of standard bench-mark data sets and compared the results with current state-of-the-art methods: SPM-DARTEL, Diffeomorphic Demons and SyN. We found that CDD outperforms state-of-the-art methods in consistency and delivers comparable or superior registration precision.

Differential diagnosis of mild cognitive impairment and Alzheimer's disease using structural MRI cortical thickness, hippocampal shape, hippocampal texture, and volumetry.

This paper presents a brain T1-weighted structural magnetic resonance imaging (MRI) biomarker that combines several individual MRI biomarkers (cortical thickness measurements, volumetric measurements, hippocampal shape, and hippocampal texture). The method was developed, trained, and evaluated using two publicly available reference datasets: a standardized dataset from the Alzheimer's Disease Neuroimaging Initiative (ADNI) and the imaging arm of the Australian Imaging Biomarkers and Lifestyle flagship study of ageing (AIBL). In addition, the method was evaluated by participation in the Computer-Aided Diagnosis of Dementia (CADDementia) challenge. Cross-validation using ADNI and AIBL data resulted in a multi-class classification accuracy of 62.7% for the discrimination of healthy normal controls (NC), subjects with mild cognitive impairment (MCI), and patients with Alzheimer's disease (AD). This performance generalized to the CADDementia challenge where the method, trained using the ADNI and AIBL data, achieved a classification accuracy 63.0%. The obtained classification accuracy resulted in a first place in the challenge, and the method was significantly better (McNemar's test) than the bottom 24 methods out of the total of 29 methods contributed by 15 different teams in the challenge. The method was further investigated with learning curve and feature selection experiments using ADNI and AIBL data. The learning curve experiments suggested that neither more training data nor a more complex classifier would have improved the obtained results. The feature selection experiment showed that both common and uncommon individual MRI biomarkers contributed to the performance; hippocampal volume, ventricular volume, hippocampal texture, and parietal lobe thickness were the most important. This study highlights the need for both subtle, localized measurements and global measurements in order to discriminate NC, MCI, and AD simultaneously based on a single structural MRI scan. It is likely that additional non-structural MRI features are needed to further improve the obtained performance, especially to improve the discrimination between NC and MCI.

Kernel Bundle Diffeomorphic Image Registration Using Stationary Velocity Fields and Wendland Basis Functions.

In this paper, we propose a multi-scale, multi-kernel shape, compactly supported kernel bundle framework for stationary velocity field-based image registration (Wendland kernel bundle stationary velocity field, wKB-SVF). We exploit the possibility of directly choosing kernels to construct a reproducing kernel Hilbert space (RKHS) instead of imposing it from a differential operator. The proposed framework allows us to minimize computational cost without sacrificing the theoretical foundations of SVF-based diffeomorphic registration. In order to recover deformations occurring at different scales, we use compactly supported Wendland kernels at multiple scales and orders to parameterize the velocity fields, and the framework allows simultaneous optimization over all scales. The performance of wKB-SVF is extensively compared to the 14 non-rigid registration algorithms presented in a recent comparison paper. On both MGH10 and CUMC12 datasets, the accuracy of wKB-SVF is improved when compared to other registration algorithms. In a disease-specific application for intra-subject registration, atrophy scores estimated using the proposed registration scheme separates the diagnostic groups of Alzheimer's and normal controls better than the state-of-the-art segmentation technique. Experimental results show that wKB-SVF is a robust, flexible registration framework that allows theoretically well-founded and computationally efficient multi-scale representation of deformations and is equally well-suited for both inter- and intra-subject image registration.

Deformation-based atrophy computation by surface propagation and its application to Alzheimer's disease.

Obtaining regional volume changes from a deformation field is more precise when using simplex counting (SC) compared with Jacobian integration (JI) due to the numerics involved in the latter. Although SC has been proposed before, numerical properties underpinning the method and a thorough evaluation of the method against JI is missing in the literature. The contributions of this paper are: (a) we propose surface propagation (SP)-a simplification to SC that significantly reduces its computational complexity; (b) we will derive the orders of approximation of SP which can also be extended to SC. In the experiments, we will begin by empirically showing that SP is indeed nearly identical to SC, and that both methods are more stable than JI in presence of moderate to large deformation noise. Since SC and SP are identical, we consider SP as a representative of both the methods for a practical evaluation against JI. In a real application on Alzheimer's disease neuroimaging initiative data, we show the following: (a) SP produces whole brain and medial temporal lobe atrophy numbers that are significantly better than JI at separating between normal controls and Alzheimer's disease patients; (b) SP produces disease group atrophy differences comparable to or better than those obtained using FreeSurfer, demonstrating the validity of the obtained clinical results. Finally, in a reproducibility study, we show that the voxel-wise application of SP yields significantly lower variance when compared to JI.