Development and external validation of an MRI-based neural network for brain metastasis segmentation in the AURORA multicenter study.

BACKGROUND: Stereotactic radiotherapy is a standard treatment option for patients with brain metastases. The planning target volume is based on gross tumor volume (GTV) segmentation. The aim of this work is to develop and validate a neural network for automatic GTV segmentation to accelerate clinical daily routine practice and minimize interobserver variability. METHODS: We analyzed MRIs (T1-weighted sequence ± contrast-enhancement, T2-weighted sequence, and FLAIR sequence) from 348 patients with at least one brain metastasis from different cancer primaries treated in six centers. To generate reference segmentations, all GTVs and the FLAIR hyperintense edematous regions were segmented manually. A 3D-U-Net was trained on a cohort of 260 patients from two centers to segment the GTV and the surrounding FLAIR hyperintense region. During training varying degrees of data augmentation were applied. Model validation was performed using an independent international multicenter test cohort (n = 88) including four centers. RESULTS: Our proposed U-Net reached a mean overall Dice similarity coefficient (DSC) of 0.92 ± 0.08 and a mean individual metastasis-wise DSC of 0.89 ± 0.11 in the external test cohort for GTV segmentation. Data augmentation improved the segmentation performance significantly. Detection of brain metastases was effective with a mean F1-Score of 0.93 ± 0.16. The model performance was stable independent of the center (p = 0.3). There was no correlation between metastasis volume and DSC (Pearson correlation coefficient 0.07). CONCLUSION: Reliable automated segmentation of brain metastases with neural networks is possible and may support radiotherapy planning by providing more objective GTV definitions.

Improving Automated Glioma Segmentation in Routine Clinical Use Through Artificial Intelligence-Based Replacement of Missing Sequences With Synthetic Magnetic Resonance Imaging Scans.

OBJECTIVES: Although automated glioma segmentation holds promise for objective assessment of tumor biology and response, its routine clinical use is impaired by missing sequences, for example, due to motion artifacts. The aim of our study was to develop and validate a generative adversarial network for synthesizing missing sequences to allow for a robust automated segmentation. MATERIALS AND METHODS: Our model was trained on data from The Cancer Imaging Archive (n = 238 WHO II-IV gliomas) to synthesize either missing FLAIR, T2-weighted, T1-weighted (T1w), or contrast-enhanced T1w images from available sequences, using a novel tumor-targeting loss to improve synthesis of tumor areas. We validated performance in a test set from both the REMBRANDT repository and our local institution (n = 68 WHO II-IV gliomas), using qualitative image appearance metrics, but also segmentation performance with state-of-the-art segmentation models. Segmentation of synthetic images was compared with 2 commonly used strategies for handling missing input data, entering a blank mask or copying an existing sequence. RESULTS: Across tumor areas and missing sequences, synthetic images generally outperformed both conventional approaches, in particular when FLAIR was missing. Here, for edema and whole tumor segmentation, we improved the Dice score, a common metric for evaluation of segmentation performance, by 12% and 11%, respectively, over the best conventional method. No method was able to reliably replace missing contrast-enhanced T1w images. DISCUSSION: Replacing missing nonenhanced magnetic resonance sequences via synthetic images significantly improves segmentation quality over most conventional approaches. This model is freely available and facilitates more widespread use of automated segmentation in routine clinical use, where missing sequences are common.

Uncertainty-Aware and Lesion-Specific Image Synthesis in Multiple Sclerosis Magnetic Resonance Imaging: A Multicentric Validation Study.

Generative adversarial networks (GANs) can synthesize high-contrast MRI from lower-contrast input. Targeted translation of parenchymal lesions in multiple sclerosis (MS), as well as visualization of model confidence further augment their utility, provided that the GAN generalizes reliably across different scanners. We here investigate the generalizability of a refined GAN for synthesizing high-contrast double inversion recovery (DIR) images and propose the use of uncertainty maps to further enhance its clinical utility and trustworthiness. A GAN was trained to synthesize DIR from input fluid-attenuated inversion recovery (FLAIR) and T1w of 50 MS patients (training data). In another 50 patients (test data), two blinded readers (R1 and R2) independently quantified lesions in synthetic DIR (synthDIR), acquired DIR (trueDIR) and FLAIR. Of the 50 test patients, 20 were acquired on the same scanner as training data (internal data), while 30 were scanned at different scanners with heterogeneous field strengths and protocols (external data). Lesion-to-Background ratios (LBR) for MS-lesions vs. normal appearing white matter, as well as image quality parameters were calculated. Uncertainty maps were generated to visualize model confidence. Significantly more MS-specific lesions were found in synthDIR compared to FLAIR (R1: 26.7 ± 2.6 vs. 22.5 ± 2.2 p < 0.0001; R2: 22.8 ± 2.2 vs. 19.9 ± 2.0, p = 0.0005). While trueDIR remained superior to synthDIR in R1 [28.6 ± 2.9 vs. 26.7 ± 2.6 (p = 0.0021)], both sequences showed comparable lesion conspicuity in R2 [23.3 ± 2.4 vs. 22.8 ± 2.2 (p = 0.98)]. Importantly, improvements in lesion counts were similar in internal and external data. Measurements of LBR confirmed that lesion-focused GAN training significantly improved lesion conspicuity. The use of uncertainty maps furthermore helped discriminate between MS lesions and artifacts. In conclusion, this multicentric study confirms the external validity of a lesion-focused Deep-Learning tool aimed at MS imaging. When implemented, uncertainty maps are promising to increase the trustworthiness of synthetic MRI.

ISLES 2022: A multi-center magnetic resonance imaging stroke lesion segmentation dataset.

Magnetic resonance imaging (MRI) is an important imaging modality in stroke. Computer based automated medical image processing is increasingly finding its way into clinical routine. The Ischemic Stroke Lesion Segmentation (ISLES) challenge is a continuous effort to develop and identify benchmark methods for acute and sub-acute ischemic stroke lesion segmentation. Here we introduce an expert-annotated, multicenter MRI dataset for segmentation of acute to subacute stroke lesions ( https://doi.org/10.5281/zenodo.7153326 ). This dataset comprises 400 multi-vendor MRI cases with high variability in stroke lesion size, quantity and location. It is split into a training dataset of n = 250 and a test dataset of n = 150. All training data is publicly available. The test dataset will be used for model validation only and will not be released to the public. This dataset serves as the foundation of the ISLES 2022 challenge ( https://www.isles-challenge.org/ ) with the goal of finding algorithmic methods to enable the development and benchmarking of automatic, robust and accurate segmentation methods for ischemic stroke.

High-throughput AFM analysis reveals unwrapping pathways of H3 and CENP-A nucleosomes.

Nucleosomes, the fundamental units of chromatin, regulate readout and expression of eukaryotic genomes. Single-molecule experiments have revealed force-induced nucleosome accessibility, but a high-resolution unwrapping landscape in the absence of external forces is currently lacking. Here, we introduce a high-throughput pipeline for the analysis of nucleosome conformations based on atomic force microscopy and automated, multi-parameter image analysis. Our data set of ∼10 000 nucleosomes reveals multiple unwrapping states corresponding to steps of 5 bp DNA. For canonical H3 nucleosomes, we observe that dissociation from one side impedes unwrapping from the other side, but in contrast to force-induced unwrapping, we find only a weak sequence-dependent asymmetry. Notably, centromeric CENP-A nucleosomes do not unwrap anti-cooperatively, in stark contrast to H3 nucleosomes. Finally, our results reconcile previous conflicting findings about the differences in height between H3 and CENP-A nucleosomes. We expect our approach to enable critical insights into epigenetic regulation of nucleosome structure and stability and to facilitate future high-throughput AFM studies that involve heterogeneous nucleoprotein complexes.

DeepVesselNet: Vessel Segmentation, Centerline Prediction, and Bifurcation Detection in 3-D Angiographic Volumes.

We present DeepVesselNet, an architecture tailored to the challenges faced when extracting vessel trees and networks and corresponding features in 3-D angiographic volumes using deep learning. We discuss the problems of low execution speed and high memory requirements associated with full 3-D networks, high-class imbalance arising from the low percentage (<3%) of vessel voxels, and unavailability of accurately annotated 3-D training data-and offer solutions as the building blocks of DeepVesselNet. First, we formulate 2-D orthogonal cross-hair filters which make use of 3-D context information at a reduced computational burden. Second, we introduce a class balancing cross-entropy loss function with false-positive rate correction to handle the high-class imbalance and high false positive rate problems associated with existing loss functions. Finally, we generate a synthetic dataset using a computational angiogenesis model capable of simulating vascular tree growth under physiological constraints on local network structure and topology and use these data for transfer learning. We demonstrate the performance on a range of angiographic volumes at different spatial scales including clinical MRA data of the human brain, as well as CTA microscopy scans of the rat brain. Our results show that cross-hair filters achieve over 23% improvement in speed, lower memory footprint, lower network complexity which prevents overfitting and comparable accuracy that does not differ from full 3-D filters. Our class balancing metric is crucial for training the network, and transfer learning with synthetic data is an efficient, robust, and very generalizable approach leading to a network that excels in a variety of angiography segmentation tasks. We observe that sub-sampling and max pooling layers may lead to a drop in performance in tasks that involve voxel-sized structures. To this end, the DeepVesselNet architecture does not use any form of sub-sampling layer and works well for vessel segmentation, centerline prediction, and bifurcation detection. We make our synthetic training data publicly available, fostering future research, and serving as one of the first public datasets for brain vessel tree segmentation and analysis.

CXCR4-Targeted PET Imaging of Central Nervous System B-Cell Lymphoma.

C-X-C chemokine receptor 4 (CXCR4) is a transmembrane chemokine receptor involved in growth, survival, and dissemination of cancer, including aggressive B-cell lymphoma. MRI is the standard imaging technology for central nervous system (CNS) involvement of B-cell lymphoma and provides high sensitivity but moderate specificity. Therefore, novel molecular and functional imaging strategies are urgently required. Methods: In this proof-of-concept study, 11 patients with lymphoma of the CNS (8 primary and 3 secondary involvement) were imaged with the CXCR4-directed PET tracer 68Ga-pentixafor. To evaluate the predictive value of this imaging modality, treatment response, as determined by MRI, was correlated with quantification of CXCR4 expression by 68Ga-pentixafor PET in vivo before initiation of treatment in 7 of 11 patients. Results:68Ga-pentixafor PET showed excellent contrast with the surrounding brain parenchyma in all patients with active disease. Furthermore, initial CXCR4 uptake determined by PET correlated with subsequent treatment response as assessed by MRI. Conclusion:68Ga-pentixafor PET represents a novel diagnostic tool for CNS lymphoma with potential implications for theranostic approaches as well as response and risk assessment.

c-Rel gain in B cells drives germinal center reactions and autoantibody production.

Single-nucleotide polymorphisms and locus amplification link the NF-κB transcription factor c-Rel to human autoimmune diseases and B cell lymphomas, respectively. However, the functional consequences of enhanced c-Rel levels remain enigmatic. Here, we overexpressed c-Rel specifically in mouse B cells from BAC-transgenic gene loci and demonstrate that c-Rel protein levels linearly dictated expansion of germinal center B (GCB) cells and isotype-switched plasma cells. c-Rel expression in B cells of otherwise c-Rel-deficient mice fully rescued terminal B cell differentiation, underscoring its critical B cell-intrinsic roles. Unexpectedly, in GCB cells transcription-independent regulation produced the highest c-Rel protein levels among B cell subsets. In c-Rel-overexpressing GCB cells this caused enhanced nuclear translocation, a profoundly altered transcriptional program, and increased proliferation. Finally, we provide a link between c-Rel gain and autoimmunity by showing that c-Rel overexpression in B cells caused autoantibody production and renal immune complex deposition.

Towards quantitative imaging biomarkers of tumor dissemination: A multi-scale parametric modeling of multiple myeloma.

The advent of medical imaging and automatic image analysis is bringing the full quantitative assessment of lesions and tumor burden at every clinical examination within reach. This opens avenues for the development and testing of functional disease models, as well as their use in the clinical practice for personalized medicine. In this paper, we introduce a Bayesian statistical framework, based on mixed-effects models, to quantitatively test and learn functional disease models at different scales, on population longitudinal data. We also derive an effective mathematical model for the crossover between initially detected lesions and tumor dissemination, based on the Iwata-Kawasaki-Shigesada model. We finally propose to leverage this descriptive disease progression model into model-aware biomarkers for personalized risk-assessment, taking all available examinations and relevant covariates into account. As a use case, we study Multiple Myeloma, a disseminated plasma cell cancer, in which proper diagnostics is essential, to differentiate frequent precursor state without end-organ damage from the rapidly developing disease requiring therapy. After learning the best biological models for local lesion growth and global tumor burden evolution on clinical data, and computing corresponding population priors, we use individual model parameters as biomarkers, and can study them systematically for correlation with external covariates, such as sex or location of the lesion. On our cohort of 63 patients with smoldering Multiple Myeloma, we show that they perform substantially better than other radiological criteria, to predict progression into symptomatic Multiple Myeloma. Our study paves the way for modeling disease progression patterns for Multiple Myeloma, but also for other metastatic and disseminated tumor growth processes, and for analyzing large longitudinal image data sets acquired in oncological imaging. It shows the unprecedented potential of model-based biomarkers for better and more personalized treatment decisions and deserves being validated on larger cohorts to establish its role in clinical decision making.