Virtual reality-empowered deep-learning analysis of brain cells.

Automated detection of specific cells in three-dimensional datasets such as whole-brain light-sheet image stacks is challenging. Here, we present DELiVR, a virtual reality-trained deep-learning pipeline for detecting c-Fos+ cells as markers for neuronal activity in cleared mouse brains. Virtual reality annotation substantially accelerated training data generation, enabling DELiVR to outperform state-of-the-art cell-segmenting approaches. Our pipeline is available in a user-friendly Docker container that runs with a standalone Fiji plugin. DELiVR features a comprehensive toolkit for data visualization and can be customized to other cell types of interest, as we did here for microglia somata, using Fiji for dataset-specific training. We applied DELiVR to investigate cancer-related brain activity, unveiling an activation pattern that distinguishes weight-stable cancer from cancers associated with weight loss. Overall, DELiVR is a robust deep-learning tool that does not require advanced coding skills to analyze whole-brain imaging data in health and disease.

Application of machine learning to pretherapeutically estimate dosimetry in men with advanced prostate cancer treated with 177Lu-PSMA I&T therapy.

PURPOSE: Although treatment planning and individualized dose application for emerging prostate-specific membrane antigen (PSMA)-targeted radioligand therapy (RLT) are generally recommended, it is still difficult to implement in practice at the moment. In this study, we aimed to prove the concept of pretherapeutic prediction of dosimetry based on imaging and laboratory measurements before the RLT treatment. METHODS: Twenty-three patients with metastatic castration-resistant prostate cancer (mCRPC) treated with 177Lu-PSMA I&T RLT were included retrospectively. They had available pre-therapy 68 Ga-PSMA-HEBD-CC PET/CT and at least 3 planar and 1 SPECT/CT imaging for dosimetry. Overall, 43 cycles of 177Lu-PSMA I&T RLT were applied. Organ-based standard uptake values (SUVs) were obtained from pre-therapy PET/CT scans. Patient dosimetry was calculated for the kidney, liver, spleen, and salivary glands using Hermes Hybrid Dosimetry 4.0 from the planar and SPECT/CT images. Machine learning methods were explored for dose prediction from organ SUVs and laboratory measurements. The uncertainty of these dose predictions was compared with the population-based dosimetry estimates. Mean absolute percentage error (MAPE) was used to assess the prediction uncertainty of estimated dosimetry. RESULTS: An optimal machine learning method achieved a dosimetry prediction MAPE of 15.8 ± 13.2% for the kidney, 29.6% ± 13.7% for the liver, 23.8% ± 13.1% for the salivary glands, and 32.1 ± 31.4% for the spleen. In contrast, the prediction based on literature population mean has significantly larger MAPE (p < 0.01), 25.5 ± 17.3% for the kidney, 139.1% ± 111.5% for the liver, 67.0 ± 58.3% for the salivary glands, and 54.1 ± 215.3% for the spleen. CONCLUSION: The preliminary results confirmed the feasibility of pretherapeutic estimation of treatment dosimetry and its added value to empirical population-based estimation. The exploration of dose prediction may support the implementation of treatment planning for RLT.

Accelerated 3D whole-brain T1, T2, and proton density mapping: feasibility for clinical glioma MR imaging.

PURPOSE: Advanced MRI-based biomarkers offer comprehensive and quantitative information for the evaluation and characterization of brain tumors. In this study, we report initial clinical experience in routine glioma imaging with a novel, fully 3D multiparametric quantitative transient-state imaging (QTI) method for tissue characterization based on T1 and T2 values. METHODS: To demonstrate the viability of the proposed 3D QTI technique, nine glioma patients (grade II-IV), with a variety of disease states and treatment histories, were included in this study. First, we investigated the feasibility of 3D QTI (6:25 min scan time) for its use in clinical routine imaging, focusing on image reconstruction, parameter estimation, and contrast-weighted image synthesis. Second, for an initial assessment of 3D QTI-based quantitative MR biomarkers, we performed a ROI-based analysis to characterize T1 and T2 components in tumor and peritumoral tissue. RESULTS: The 3D acquisition combined with a compressed sensing reconstruction and neural network-based parameter inference produced parametric maps with high isotropic resolution (1.125 × 1.125 × 1.125 mm3 voxel size) and whole-brain coverage (22.5 × 22.5 × 22.5 cm3 FOV), enabling the synthesis of clinically relevant T1-weighted, T2-weighted, and FLAIR contrasts without any extra scan time. Our study revealed increased T1 and T2 values in tumor and peritumoral regions compared to contralateral white matter, good agreement with healthy volunteer data, and high inter-subject consistency. CONCLUSION: 3D QTI demonstrated comprehensive tissue assessment of tumor substructures captured in T1 and T2 parameters. Aiming for fast acquisition of quantitative MR biomarkers, 3D QTI has potential to improve disease characterization in brain tumor patients under tight clinical time-constraints.

Measuring large lipid droplet sizes by probing restricted lipid diffusion effects with diffusion-weighted MRS at 3T.

PURPOSE: The in vivo probing of restricted diffusion effects in large lipid droplets on a clinical MR scanner remains a major challenge due to the need for high b-values and long diffusion times. This work proposes a methodology to probe mean lipid droplet sizes using diffusion-weighted MRS (DW-MRS) at 3T. METHODS: An analytical expression for restricted diffusion was used. Simulations were performed to evaluate the noise performance and the influence of particle size distribution. To validate the method, oil-in-water emulsions were prepared and examined using DW-MRS, laser deflection and light microscopy. The tibia bone marrow was scanned in volunteers to test the method repeatability and characterize microstructural differences at different locations. RESULTS: The simulations showed accurate and precise droplet size estimation when a sufficient SNR is reached with minor dependence on the size distribution. In phantoms, a good correlation between the measured droplet sizes by DW-MRS and by laser deflection (R2 = 0.98; P = 0.01) and microscopy (R2 = 0.99; P < 0.01) measurements was obtained. A mean coefficient of variation of 11.5 % was found for the lipid droplet diameter in vivo. The average diameter was smaller at a proximal (50.1 ± 7.3 µm) compared with a distal tibia location (61.1 ± 6.8 µm) (P < 0.01). CONCLUSION: The presented methods were able to probe restricted diffusion effects in lipid droplets using DW-MRS and to estimate lipid droplet size. The methodology was validated using phantoms and the in vivo feasibility in bone marrow was shown based on a good repeatability and findings in agreement with literature.

A diffusion model-free framework with echo time dependence for free-water elimination and brain tissue microstructure characterization.

PURPOSE: The compartmental nature of brain tissue microstructure is typically studied by diffusion MRI, MR relaxometry or their correlation. Diffusion MRI relies on signal representations or biophysical models, while MR relaxometry and correlation studies are based on regularized inverse Laplace transforms (ILTs). Here we introduce a general framework for characterizing microstructure that does not depend on diffusion modeling and replaces ill-posed ILTs with blind source separation (BSS). This framework yields proton density, relaxation times, volume fractions, and signal disentanglement, allowing for separation of the free-water component. THEORY AND METHODS: Diffusion experiments repeated for several different echo times, contain entangled diffusion and relaxation compartmental information. These can be disentangled by BSS using a physically constrained nonnegative matrix factorization. RESULTS: Computer simulations, phantom studies, together with repeatability and reproducibility experiments demonstrated that BSS is capable of estimating proton density, compartmental volume fractions and transversal relaxations. In vivo results proved its potential to correct for free-water contamination and to estimate tissue parameters. CONCLUSION: Formulation of the diffusion-relaxation dependence as a BSS problem introduces a new framework for studying microstructure compartmentalization, and a novel tool for free-water elimination.

Impact of Temporal Heterogeneity of Acute Hypoxia on the Radiation Response of Experimental Tumors.

Tumor hypoxia is a major factor inducing resistance to radiotherapy. Spatial limitation in oxygen (O2) diffusion usually leads to chronic hypoxia, whereas temporary shut-down of perfusion or fluctuations in red blood cell flux can cause acute hypoxia. Since the role of temporal heterogeneity of pO2 in acute hypoxia during radiotherapy remains unclear, this study focuses on analyzing the influence of temporal heterogeneity of tumor hypoxia upon radiotherapy by modeling the temporal variance of acute hypoxia. The computational simulation was conducted on digital 2D tumor phantoms. The O2 diffusion and consumption within the tumor tissues were calculated using the reaction-diffusion equation. A total of nine experimental tumor lines (FaDu, GL, C3H, RIF, SCCVII, KHT, MEF, MTG, HT29) were modeled according to known pO2 distributions. Each tumor line was first simulated 36 times with various temporal heterogeneities (dynamic hypoxia) and once again without temporal heterogeneity (static hypoxia). Temporal pO2 fluctuations were modeled according to known red blood cell (RBC) fluxes. All tumor phantoms were irradiated with 30 fractions of 2 Gy. Cell survival was calculated as a function of pO2 and radiation dose via linear quadratic model. The simulation results indicate that the temporal heterogeneity varies with different tumor types, and tumor line HT29 shows the most significant impact of temporal heterogeneity upon the treatment effect. The ratio between the surviving fractions without and with temporal variance ranges from 1.44 to 6.28. Given the same mean pO2, the fraction of killed tumor cells in dynamic hypoxia is higher than in static hypoxia. A temporal heterogeneity index (THI) denoting normalized average pO2 temporal variance is proposed. The results show that for similar mean tumor pO2, a strong inverse correlation between THI and the surviving fraction is observed for each tumor line. THI is highly proportional to the fraction of acute hypoxia and to the RBC flux. The proposed THI corresponds well to the fraction of acute hypoxia.

Mapping patterns of long-term settlement in Northern Mesopotamia at a large scale.

The landscapes of the Near East show both the first settlements and the longest trajectories of settlement systems. Mounding is a characteristic property of these settlement sites, resulting from millennia of continuing settlement activity at distinguished places. So far, however, this defining feature of ancient settlements has not received much attention, or even been the subject of systematic evaluation. We propose a remote sensing approach for comprehensively mapping the pattern of human settlement at large scale and establish the largest archaeological record for a landscape in Mesopotamia, mapping about 14,000 settlement sites--spanning eight millennia--at 15-m resolution in a 23,000-km(2) area in northeastern Syria. To map both low- and high-mounded places--the latter of which are often referred to as "tells"--we develop a strategy for detecting anthrosols in time series of multispectral satellite images and measure the volume of settlement sites in a digital elevation model. Using this volume as a proxy to continued occupation, we find a dependency of the long-term attractiveness of a site on local water availability, but also a strong relation to the relevance within a basin-wide exchange network that we can infer from our record and third millennium B.C. intersite routes visible on the ground until recent times. We believe it is possible to establish a nearly comprehensive map of human settlements in the fluvial plains of northern Mesopotamia and beyond, and site volume may be a key quantity to uncover long-term trends in human settlement activity from such a record.

Learning continuous shape priors from sparse data with neural implicit functions.

Statistical shape models are an essential tool for various tasks in medical image analysis, including shape generation, reconstruction and classification. Shape models are learned from a population of example shapes, which are typically obtained through segmentation of volumetric medical images. In clinical practice, highly anisotropic volumetric scans with large slice distances are prevalent, e.g., to reduce radiation exposure in CT or image acquisition time in MR imaging. For existing shape modeling approaches, the resolution of the emerging model is limited to the resolution of the training shapes. Therefore, any missing information between slices prohibits existing methods from learning a high-resolution shape prior. We propose a novel shape modeling approach that can be trained on sparse, binary segmentation masks with large slice distances. This is achieved through employing continuous shape representations based on neural implicit functions. After training, our model can reconstruct shapes from various sparse inputs at high target resolutions beyond the resolution of individual training examples. We successfully reconstruct high-resolution shapes from as few as three orthogonal slices. Furthermore, our shape model allows us to embed various sparse segmentation masks into a common, low-dimensional latent space - independent of the acquisition direction, resolution, spacing, and field of view. We show that the emerging latent representation discriminates between healthy and pathological shapes, even when provided with sparse segmentation masks. Lastly, we qualitatively demonstrate that the emerging latent space is smooth and captures characteristic modes of shape variation. We evaluate our shape model on two anatomical structures: the lumbar vertebra and the distal femur, both from publicly available datasets.

Synthetic Optical Coherence Tomography Angiographs for Detailed Retinal Vessel Segmentation Without Human Annotations.

Optical coherence tomography angiography (OCTA) is a non-invasive imaging modality that can acquire high-resolution volumes of the retinal vasculature and aid the diagnosis of ocular, neurological and cardiac diseases. Segmenting the visible blood vessels is a common first step when extracting quantitative biomarkers from these images. Classical segmentation algorithms based on thresholding are strongly affected by image artifacts and limited signal-to-noise ratio. The use of modern, deep learning-based segmentation methods has been inhibited by a lack of large datasets with detailed annotations of the blood vessels. To address this issue, recent work has employed transfer learning, where a segmentation network is trained on synthetic OCTA images and is then applied to real data. However, the previously proposed simulations fail to faithfully model the retinal vasculature and do not provide effective domain adaptation. Because of this, current methods are unable to fully segment the retinal vasculature, in particular the smallest capillaries. In this work, we present a lightweight simulation of the retinal vascular network based on space colonization for faster and more realistic OCTA synthesis. We then introduce three contrast adaptation pipelines to decrease the domain gap between real and artificial images. We demonstrate the superior segmentation performance of our approach in extensive quantitative and qualitative experiments on three public datasets that compare our method to traditional computer vision algorithms and supervised training using human annotations. Finally, we make our entire pipeline publicly available, including the source code, pretrained models, and a large dataset of synthetic OCTA images.

A deep learning approach to predict collateral flow in stroke patients using radiomic features from perfusion images.

Collateral circulation results from specialized anastomotic channels which are capable of providing oxygenated blood to regions with compromised blood flow caused by arterial obstruction. The quality of collateral circulation has been established as a key factor in determining the likelihood of a favorable clinical outcome and goes a long way to determining the choice of a stroke care model. Though many imaging and grading methods exist for quantifying collateral blood flow, the actual grading is mostly done through manual inspection. This approach is associated with a number of challenges. First, it is time-consuming. Second, there is a high tendency for bias and inconsistency in the final grade assigned to a patient depending on the experience level of the clinician. We present a multi-stage deep learning approach to predict collateral flow grading in stroke patients based on radiomic features extracted from MR perfusion data. First, we formulate a region of interest detection task as a reinforcement learning problem and train a deep learning network to automatically detect the occluded region within the 3D MR perfusion volumes. Second, we extract radiomic features from the obtained region of interest through local image descriptors and denoising auto-encoders. Finally, we apply a convolutional neural network and other machine learning classifiers to the extracted radiomic features to automatically predict the collateral flow grading of the given patient volume as one of three severity classes - no flow (0), moderate flow (1), and good flow (2). Results from our experiments show an overall accuracy of 72% in the three-class prediction task. With an inter-observer agreement of 16% and a maximum intra-observer agreement of 74% in a similar experiment, our automated deep learning approach demonstrates a performance comparable to expert grading, is faster than visual inspection, and eliminates the problem of grading bias.

Identifying core MRI sequences for reliable automatic brain metastasis segmentation.

BACKGROUND: Many automatic approaches to brain tumor segmentation employ multiple magnetic resonance imaging (MRI) sequences. The goal of this project was to compare different combinations of input sequences to determine which MRI sequences are needed for effective automated brain metastasis (BM) segmentation. METHODS: We analyzed preoperative imaging (T1-weighted sequence ± contrast-enhancement (T1/T1-CE), T2-weighted sequence (T2), and T2 fluid-attenuated inversion recovery (T2-FLAIR) sequence) from 339 patients with BMs from seven centers. A baseline 3D U-Net with all four sequences and six U-Nets with plausible sequence combinations (T1-CE, T1, T2-FLAIR, T1-CE + T2-FLAIR, T1-CE + T1 + T2-FLAIR, T1-CE + T1) were trained on 239 patients from two centers and subsequently tested on an external cohort of 100 patients from five centers. RESULTS: The model based on T1-CE alone achieved the best segmentation performance for BM segmentation with a median Dice similarity coefficient (DSC) of 0.96. Models trained without T1-CE performed worse (T1-only: DSC = 0.70 and T2-FLAIR-only: DSC = 0.73). For edema segmentation, models that included both T1-CE and T2-FLAIR performed best (DSC = 0.93), while the remaining four models without simultaneous inclusion of these both sequences reached a median DSC of 0.81-0.89. CONCLUSIONS: A T1-CE-only protocol suffices for the segmentation of BMs. The combination of T1-CE and T2-FLAIR is important for edema segmentation. Missing either T1-CE or T2-FLAIR decreases performance. These findings may improve imaging routines by omitting unnecessary sequences, thus allowing for faster procedures in daily clinical practice while enabling optimal neural network-based target definitions.

The Brain Tumor Segmentation (BraTS-METS) Challenge 2023: Brain Metastasis Segmentation on Pre-treatment MRI.

Clinical monitoring of metastatic disease to the brain can be a laborious and timeconsuming process, especially in cases involving multiple metastases when the assessment is performed manually. The Response Assessment in Neuro-Oncology Brain Metastases (RANO-BM) guideline, which utilizes the unidimensional longest diameter, is commonly used in clinical and research settings to evaluate response to therapy in patients with brain metastases. However, accurate volumetric assessment of the lesion and surrounding peri-lesional edema holds significant importance in clinical decision-making and can greatly enhance outcome prediction. The unique challenge in performing segmentations of brain metastases lies in their common occurrence as small lesions. Detection and segmentation of lesions that are smaller than 10 mm in size has not demonstrated high accuracy in prior publications. The brain metastases challenge sets itself apart from previously conducted MICCAI challenges on glioma segmentation due to the significant variability in lesion size. Unlike gliomas, which tend to be larger on presentation scans, brain metastases exhibit a wide range of sizes and tend to include small lesions. We hope that the BraTS-METS dataset and challenge will advance the field of automated brain metastasis detection and segmentation.

The Brain Tumor Segmentation (BraTS) Challenge 2023: Glioma Segmentation in Sub-Saharan Africa Patient Population (BraTS-Africa).

Gliomas are the most common type of primary brain tumors. Although gliomas are relatively rare, they are among the deadliest types of cancer, with a survival rate of less than 2 years after diagnosis. Gliomas are challenging to diagnose, hard to treat and inherently resistant to conventional therapy. Years of extensive research to improve diagnosis and treatment of gliomas have decreased mortality rates across the Global North, while chances of survival among individuals in low- and middle-income countries (LMICs) remain unchanged and are significantly worse in Sub-Saharan Africa (SSA) populations. Long-term survival with glioma is associated with the identification of appropriate pathological features on brain MRI and confirmation by histopathology. Since 2012, the Brain Tumor Segmentation (BraTS) Challenge have evaluated state-of-the-art machine learning methods to detect, characterize, and classify gliomas. However, it is unclear if the state-of-the-art methods can be widely implemented in SSA given the extensive use of lower-quality MRI technology, which produces poor image contrast and resolution and more importantly, the propensity for late presentation of disease at advanced stages as well as the unique characteristics of gliomas in SSA (i.e., suspected higher rates of gliomatosis cerebri). Thus, the BraTS-Africa Challenge provides a unique opportunity to include brain MRI glioma cases from SSA in global efforts through the BraTS Challenge to develop and evaluate computer-aided-diagnostic (CAD) methods for the detection and characterization of glioma in resource-limited settings, where the potential for CAD tools to transform healthcare are more likely.

Using spatial prior knowledge in the spectral fitting of MRS images.

We propose a Bayesian smoothness prior in the spectral fitting of MRS images which can be used in addition to commonly employed prior knowledge. By combining a frequency-domain model for the free induction decay with a Gaussian Markov random field prior, a new optimization objective is derived that encourages smooth parameter maps. Using a particular parameterization of the prior, smooth damping, frequency and phase maps can be obtained whilst preserving sharp spatial features in the amplitude map. A Monte Carlo study based on two sets of simulated data demonstrates that the variance of the estimated parameter maps can be reduced considerably, even below the Cramér-Rao lower bound, when using spatial prior knowledge. Long-TE (1)H MRSI at 1.5 T of a patient with a brain tumor shows that the use of the spatial prior resolves the overlapping peaks of choline and creatine when a single voxel method fails to do so. Improved and detailed metabolic maps can be derived from high-spatial-resolution, short-TE (1)H MRSI at 3 T. Finally, the evaluation of four series of long-TE brain MRSI data with various signal-to-noise ratios shows the general benefit of the proposed approach.

Prediction of multiple pH compartments by deep learning in magnetic resonance spectroscopy with hyperpolarized 13C-labelled zymonic acid.

BACKGROUND: Hyperpolarization enhances the sensitivity of nuclear magnetic resonance experiments by between four and five orders of magnitude. Several hyperpolarized sensor molecules have been introduced that enable high sensitivity detection of metabolism and physiological parameters. However, hyperpolarized magnetic resonance spectroscopy imaging (MRSI) often suffers from poor signal-to-noise ratio and spectral analysis is complicated by peak overlap. Here, we study measurements of extracellular pH (pHe) by hyperpolarized zymonic acid, where multiple pHe compartments, such as those observed in healthy kidney or other heterogeneous tissue, result in a cluster of spectrally overlapping peaks, which is hard to resolve with conventional spectroscopy analysis routines. METHODS: We investigate whether deep learning methods can yield improved pHe prediction in hyperpolarized zymonic acid spectra of multiple pHe compartments compared to conventional line fitting. As hyperpolarized 13C-MRSI data sets are often small, a convolutional neural network (CNN) and a multilayer perceptron (MLP) were trained with either a synthetic or a mixed (synthetic and augmented) data set of acquisitions from the kidneys of healthy mice. RESULTS: Comparing the networks' performances compartment-wise on a synthetic test data set and eight real kidney data shows superior performance of CNN compared to MLP and equal or superior performance compared to conventional line fitting. For correct prediction of real kidney pHe values, training with a mixed data set containing only 0.5% real data shows a large improvement compared to training with synthetic data only. Using a manual segmentation approach, pH maps of kidney compartments can be improved by neural network predictions for voxels including three pH compartments. CONCLUSION: The results of this study indicate that CNNs offer a reliable, accurate, fast and non-interactive method for analysis of hyperpolarized 13C MRS and MRSI data, where low amounts of acquired data can be complemented to achieve suitable network training.

SRflow: Deep learning based super-resolution of 4D-flow MRI data.

Exploiting 4D-flow magnetic resonance imaging (MRI) data to quantify hemodynamics requires an adequate spatio-temporal vector field resolution at a low noise level. To address this challenge, we provide a learned solution to super-resolve in vivo 4D-flow MRI data at a post-processing level. We propose a deep convolutional neural network (CNN) that learns the inter-scale relationship of the velocity vector map and leverages an efficient residual learning scheme to make it computationally feasible. A novel, direction-sensitive, and robust loss function is crucial to learning vector-field data. We present a detailed comparative study between the proposed super-resolution and the conventional cubic B-spline based vector-field super-resolution. Our method improves the peak-velocity to noise ratio of the flow field by 10 and 30% for in vivo cardiovascular and cerebrovascular data, respectively, for 4 × super-resolution over the state-of-the-art cubic B-spline. Significantly, our method offers 10x faster inference over the cubic B-spline. The proposed approach for super-resolution of 4D-flow data would potentially improve the subsequent calculation of hemodynamic quantities.

Self-Supervised Pretext Tasks in Model Robustness & Generalizability: A Revisit from Medical Imaging Perspective.

Self-supervised pretext tasks have been introduced as an effective strategy when learning target tasks on small annotated data sets. However, while current research focuses on exploring novel pretext tasks for meaningful and reusable representation learning for the target task, the study of its robustness and generalizability has remained relatively under-explored. Specifically, it is crucial in medical imaging to proactively investigate performance under different perturbations for reliable deployment of clinical applications. In this work, we revisit medical imaging networks pre-trained with self-supervised learnings and categorically evaluate robustness and generalizability compared to vanilla supervised learning. Our experiments on pneumonia detection in X-rays and multi-organ segmentation in CT yield conclusive results exposing the hidden benefits of self-supervision pre-training for learning robust feature representations.

A Unified 3D Framework for Organs-at-Risk Localization and Segmentation for Radiation Therapy Planning.

Automatic localization and segmentation of organs-at-risk (OAR) in CT are essential pre-processing steps in medical image analysis tasks, such as radiation therapy planning. For instance, the segmentation of OAR surrounding tumors enables the maximization of radiation to the tumor area without compromising the healthy tissues. However, the current medical workflow requires manual delineation of OAR, which is prone to errors and is annotator-dependent. In this work, we aim to introduce a unified 3D pipeline for OAR localization-segmentation rather than novel localization or segmentation architectures. To the best of our knowledge, our proposed framework fully enables the exploitation of 3D context information inherent in medical imaging. In the first step, a 3D multi-variate regression network predicts organs' centroids and bounding boxes. Secondly, 3D organ-specific segmentation networks are leveraged to generate a multi-organ segmentation map. Our method achieved an overall Dice score of 0.9260 ± 0.18% on the VISCERAL dataset containing CT scans with varying fields of view and multiple organs.

Anatomy-Aware Inference of the 3D Standing Spine Posture from 2D Radiographs.

An important factor for the development of spinal degeneration, pain and the outcome of spinal surgery is known to be the balance of the spine. It must be analyzed in an upright, standing position to ensure physiological loading conditions and visualize load-dependent deformations. Despite the complex 3D shape of the spine, this analysis is currently performed using 2D radiographs, as all frequently used 3D imaging techniques require the patient to be scanned in a prone position. To overcome this limitation, we propose a deep neural network to reconstruct the 3D spinal pose in an upright standing position, loaded naturally. Specifically, we propose a novel neural network architecture, which takes orthogonal 2D radiographs and infers the spine's 3D posture using vertebral shape priors. In this work, we define vertebral shape priors using an atlas and a spine shape prior, incorporating both into our proposed network architecture. We validate our architecture on digitally reconstructed radiographs, achieving a 3D reconstruction Dice of 0.95, indicating an almost perfect 2D-to-3D domain translation. Validating the reconstruction accuracy of a 3D standing spine on real data is infeasible due to the lack of a valid ground truth. Hence, we design a novel experiment for this purpose, using an orientation invariant distance metric, to evaluate our model's ability to synthesize full-3D, upright, and patient-specific spine models. We compare the synthesized spine shapes from clinical upright standing radiographs to the same patient's 3D spinal posture in the prone position from CT.

Quantitative evaluation of the influence of multiple MRI sequences and of pathological tissues on the registration of longitudinal data acquired during brain tumor treatment.

Registration methods facilitate the comparison of multiparametric magnetic resonance images acquired at different stages of brain tumor treatments. Image-based registration solutions are influenced by the sequences chosen to compute the distance measure, and the lack of image correspondences due to the resection cavities and pathological tissues. Nonetheless, an evaluation of the impact of these input parameters on the registration of longitudinal data is still missing. This work evaluates the influence of multiple sequences, namely T1-weighted (T1), T2-weighted (T2), contrast enhanced T1-weighted (T1-CE), and T2 Fluid Attenuated Inversion Recovery (FLAIR), and the exclusion of the pathological tissues on the non-rigid registration of pre- and post-operative images. We here investigate two types of registration methods, an iterative approach and a convolutional neural network solution based on a 3D U-Net. We employ two test sets to compute the mean target registration error (mTRE) based on corresponding landmarks. In the first set, markers are positioned exclusively in the surroundings of the pathology. The methods employing T1-CE achieves the lowest mTREs, with a improvement up to 0.8 mm for the iterative solution. The results are higher than the baseline when using the FLAIR sequence. When excluding the pathology, lower mTREs are observable for most of the methods. In the second test set, corresponding landmarks are located in the entire brain volumes. Both solutions employing T1-CE obtain the lowest mTREs, with a decrease up to 1.16 mm for the iterative method, whereas the results worsen using the FLAIR. When excluding the pathology, an improvement is observable for the CNN method using T1-CE. Both approaches utilizing the T1-CE sequence obtain the best mTREs, whereas the FLAIR is the least informative to guide the registration process. Besides, the exclusion of pathology from the distance measure computation improves the registration of the brain tissues surrounding the tumor. Thus, this work provides the first numerical evaluation of the influence of these parameters on the registration of longitudinal magnetic resonance images, and it can be helpful for developing future algorithms.