Whole-brain, gray, and white matter time-locked functional signal changes with simple tasks and model-free analysis.

Recent studies have revealed the production of time-locked blood oxygenation level-dependent (BOLD) functional MRI (fMRI) signals throughout the entire brain in response to tasks, challenging the existence of sparse and localized brain functions and highlighting the pervasiveness of potential false negative fMRI findings. "Whole-brain" actually refers to gray matter, the only tissue traditionally studied with fMRI. However, several reports have demonstrated reliable detection of BOLD signals in white matter, which have previously been largely ignored. Using simple tasks and analyses, we demonstrate BOLD signal changes across the whole brain, in both white and gray matters, in similar manner to previous reports of whole brain studies. We investigated whether white matter displays time-locked BOLD signals across multiple structural pathways in response to a stimulus in a similar manner to the cortex. We find that both white and gray matter show time-locked activations across the whole brain, with a majority of both tissue types showing statistically significant signal changes for all task stimuli investigated. We observed a wide range of signal responses to tasks, with different regions showing different BOLD signal changes to the same task. Moreover, we find that each region may display different BOLD responses to different stimuli. Overall, we present compelling evidence that, just like all gray matter, essentially all white matter in the brain shows time-locked BOLD signal changes in response to multiple stimuli, challenging the idea of sparse functional localization and the prevailing wisdom of treating white matter BOLD signals as artifacts to be removed.

The Interictal Suppression Hypothesis in focal epilepsy: network-level supporting evidence.

Why are people with focal epilepsy not continuously having seizures? Previous neuronal signalling work has implicated gamma-aminobutyric acid balance as integral to seizure generation and termination, but is a high-level distributed brain network involved in suppressing seizures? Recent intracranial electrographic evidence has suggested that seizure-onset zones have increased inward connectivity that could be associated with interictal suppression of seizure activity. Accordingly, we hypothesize that seizure-onset zones are actively suppressed by the rest of the brain network during interictal states. Full testing of this hypothesis would require collaboration across multiple domains of neuroscience. We focused on partially testing this hypothesis at the electrographic network level within 81 individuals with drug-resistant focal epilepsy undergoing presurgical evaluation. We used intracranial electrographic resting-state and neurostimulation recordings to evaluate the network connectivity of seizure onset, early propagation and non-involved zones. We then used diffusion imaging to acquire estimates of white-matter connectivity to evaluate structure-function coupling effects on connectivity findings. Finally, we generated a resting-state classification model to assist clinicians in detecting seizure-onset and propagation zones without the need for multiple ictal recordings. Our findings indicate that seizure onset and early propagation zones demonstrate markedly increased inwards connectivity and decreased outwards connectivity using both resting-state (one-way ANOVA, P-value = 3.13 × 10-13) and neurostimulation analyses to evaluate evoked responses (one-way ANOVA, P-value = 2.5 × 10-3). When controlling for the distance between regions, the difference between inwards and outwards connectivity remained stable up to 80 mm between brain connections (two-way repeated measures ANOVA, group effect P-value of 2.6 × 10-12). Structure-function coupling analyses revealed that seizure-onset zones exhibit abnormally enhanced coupling (hypercoupling) of surrounding regions compared to presumably healthy tissue (two-way repeated measures ANOVA, interaction effect P-value of 9.76 × 10-21). Using these observations, our support vector classification models achieved a maximum held-out testing set accuracy of 92.0 ± 2.2% to classify early propagation and seizure-onset zones. These results suggest that seizure-onset zones are actively segregated and suppressed by a widespread brain network. Furthermore, this electrographically observed functional suppression is disproportionate to any observed structural connectivity alterations of the seizure-onset zones. These findings have implications for the identification of seizure-onset zones using only brief electrographic recordings to reduce patient morbidity and augment the presurgical evaluation of drug-resistant epilepsy. Further testing of the interictal suppression hypothesis can provide insight into potential new resective, ablative and neuromodulation approaches to improve surgical success rates in those suffering from drug-resistant focal epilepsy.

Tractostorm 2: Optimizing tractography dissection reproducibility with segmentation protocol dissemination.

The segmentation of brain structures is a key component of many neuroimaging studies. Consistent anatomical definitions are crucial to ensure consensus on the position and shape of brain structures, but segmentations are prone to variation in their interpretation and execution. White-matter (WM) pathways are global structures of the brain defined by local landmarks, which leads to anatomical definitions being difficult to convey, learn, or teach. Moreover, the complex shape of WM pathways and their representation using tractography (streamlines) make the design and evaluation of dissection protocols difficult and time-consuming. The first iteration of Tractostorm quantified the variability of a pyramidal tract dissection protocol and compared results between experts in neuroanatomy and nonexperts. Despite virtual dissection being used for decades, in-depth investigations of how learning or practicing such protocols impact dissection results are nonexistent. To begin to fill the gap, we evaluate an online educational tractography course and investigate the impact learning and practicing a dissection protocol has on interrater (groupwise) reproducibility. To generate the required data to quantify reproducibility across raters and time, 20 independent raters performed dissections of three bundles of interest on five Human Connectome Project subjects, each with four timepoints. Our investigation shows that the dissection protocol in conjunction with an online course achieves a high level of reproducibility (between 0.85 and 0.90 for the voxel-based Dice score) for the three bundles of interest and remains stable over time (repetition of the protocol). Suggesting that once raters are familiar with the software and tasks at hand, their interpretation and execution at the group level do not drastically vary. When compared to previous work that used a different method of communication for the protocol, our results show that incorporating a virtual educational session increased reproducibility. Insights from this work may be used to improve the future design of WM pathway dissection protocols and to further inform neuroanatomical definitions.

Temporal lobe epilepsy lateralisation and surgical outcome prediction using diffusion imaging.

OBJECTIVE: We sought to augment the presurgical workup of medically refractory temporal lobe epilepsy by creating a supervised machine learning technique that uses diffusion-weighted imaging to classify patient-specific seizure onset laterality and surgical outcome. METHODS: 151 subjects were included in this analysis: 62 patients (aged 18-68 years, 36 women) and 89 healthy controls (aged 18-71 years, 47 women). We created a supervised machine learning technique that uses diffusion-weighted metrics to classify subject groups. Specifically, we sought to classify patients versus healthy controls, unilateral versus bilateral temporal lobe epilepsy, left versus right temporal lobe epilepsy and seizure-free versus not seizure-free surgical outcome. We then reduced the dimensionality of derived features with community detection for ease of interpretation. RESULTS: We classified the subject groups in withheld testing data sets with a cross-fold average testing areas under the receiver operating characteristic curve of 0.745 for patients versus healthy controls, 1.000 for unilateral versus bilateral seizure onset, 0.662 for left versus right seizure onset, 0.800 for left-sided seizure-free vsersu not seizure-free surgical outcome and 0.775 for right-sided seizure-free versus not seizure-free surgical outcome. CONCLUSIONS: This technique classifies important clinical decisions in the presurgical workup of temporal lobe epilepsy by generating discerning white-matter features. We believe that this work augments existing network connectivity findings in the field by further elucidating important white-matter pathology in temporal lobe epilepsy. We hope that this work contributes to recent efforts aimed at using diffusion imaging as an augmentation to the presurgical workup of this devastating neurological disorder.

Fiber tractography bundle segmentation depends on scanner effects, vendor effects, acquisition resolution, diffusion sampling scheme, diffusion sensitization, and bundle segmentation workflow.

When investigating connectivity and microstructure of white matter pathways of the brain using diffusion tractography bundle segmentation, it is important to understand potential confounds and sources of variation in the process. While cross-scanner and cross-protocol effects on diffusion microstructure measures are well described (in particular fractional anisotropy and mean diffusivity), it is unknown how potential sources of variation effect bundle segmentation results, which features of the bundle are most affected, where variability occurs, nor how these sources of variation depend upon the method used to reconstruct and segment bundles. In this study, we investigate six potential sources of variation, or confounds, for bundle segmentation: variation (1) across scan repeats, (2) across scanners, (3) across vendors (4) across acquisition resolution, (5) across diffusion schemes, and (6) across diffusion sensitization. We employ four different bundle segmentation workflows on two benchmark multi-subject cross-scanner and cross-protocol databases, and investigate reproducibility and biases in volume overlap, shape geometry features of fiber pathways, and microstructure features within the pathways. We find that the effects of acquisition protocol, in particular acquisition resolution, result in the lowest reproducibility of tractography and largest variation of features, followed by vendor-effects, scanner-effects, and finally diffusion scheme and b-value effects which had similar reproducibility as scan-rescan variation. However, confounds varied both across pathways and across segmentation workflows, with some bundle segmentation workflows more (or less) robust to sources of variation. Despite variability, bundle dissection is consistently able to recover the same location of pathways in the deep white matter, with variation at the gray matter/ white matter interface. Next, we show that differences due to the choice of bundle segmentation workflows are larger than any other studied confound, with low-to-moderate overlap of the same intended pathway when segmented using different methods. Finally, quantifying microstructure features within a pathway, we show that tractography adds variability over-and-above that which exists due to noise, scanner effects, and acquisition effects. Overall, these confounds need to be considered when harmonizing diffusion datasets, interpreting or combining data across sites, and when attempting to understand the successes and limitations of different methodologies in the design and development of new tractography or bundle segmentation methods.

MASiVar: Multisite, multiscanner, and multisubject acquisitions for studying variability in diffusion weighted MRI.

PURPOSE: Diffusion-weighted imaging allows investigators to identify structural, microstructural, and connectivity-based differences between subjects, but variability due to session and scanner biases is a challenge. METHODS: To investigate DWI variability, we present MASiVar, a multisite data set consisting of 319 diffusion scans acquired at 3 T from b = 1000 to 3000 s/mm2 across 14 healthy adults, 83 healthy children (5 to 8 years), three sites, and four scanners as a publicly available, preprocessed, and de-identified data set. With the adult data, we demonstrate the capacity of MASiVar to simultaneously quantify the intrasession, intersession, interscanner, and intersubject variability of four common DWI processing approaches: (1) a tensor signal representation, (2) a multi-compartment neurite orientation dispersion and density model, (3) white-matter bundle segmentation, and (4) structural connectomics. Respectively, we evaluate region-wise fractional anisotropy, mean diffusivity, and principal eigenvector; region-wise CSF volume fraction, intracellular volume fraction, and orientation dispersion index; bundle-wise shape, volume, fractional anisotropy, and length; and whole connectome correlation and maximized modularity, global efficiency, and characteristic path length. RESULTS: We plot the variability in these measures at each level and find that it consistently increases with intrasession to intersession to interscanner to intersubject effects across all processing approaches and that sometimes interscanner variability can approach intersubject variability. CONCLUSIONS: This study demonstrates the potential of MASiVar to more globally investigate DWI variability across multiple levels and processing approaches simultaneously and suggests harmonization between scanners for multisite analyses should be considered before inference of group differences on subjects.

PreQual: An automated pipeline for integrated preprocessing and quality assurance of diffusion weighted MRI images.

PURPOSE: Diffusion weighted MRI imaging (DWI) is often subject to low signal-to-noise ratios (SNRs) and artifacts. Recent work has produced software tools that can correct individual problems, but these tools have not been combined with each other and with quality assurance (QA). A single integrated pipeline is proposed to perform DWI preprocessing with a spectrum of tools and produce an intuitive QA document. METHODS: The proposed pipeline, built around the FSL, MRTrix3, and ANTs software packages, performs DWI denoising; inter-scan intensity normalization; susceptibility-, eddy current-, and motion-induced artifact correction; and slice-wise signal drop-out imputation. To perform QA on the raw and preprocessed data and each preprocessing operation, the pipeline documents qualitative visualizations, quantitative plots, gradient verifications, and tensor goodness-of-fit and fractional anisotropy analyses. RESULTS: Raw DWI data were preprocessed and quality checked with the proposed pipeline and demonstrated improved SNRs; physiologic intensity ratios; corrected susceptibility-, eddy current-, and motion-induced artifacts; imputed signal-lost slices; and improved tensor fits. The pipeline identified incorrect gradient configurations and file-type conversion errors and was shown to be effective on externally available datasets. CONCLUSIONS: The proposed pipeline is a single integrated pipeline that combines established diffusion preprocessing tools from major MRI-focused software packages with intuitive QA.

Nonlinear Gradient Field Estimation in Diffusion MRI Tensor Simulation.

Gradient nonlinearities not only induce spatial distortion in magnetic resonance imaging (MRI), but also introduce discrepancies between intended and acquired diffusion sensitization in diffusion weighted (DW) MRI. Advances in scanner performance have increased the importance of correcting gradient nonlinearities. The most common approaches for gradient nonlinear field estimations rely on phantom calibration field maps which are not always feasible, especially on retrospective data. Here, we derive a quadratic minimization problem for the complete gradient nonlinear field (L(r)). This approach starts with corrupt diffusion signal and estimates the L(r) in two scenarios: (1) the true diffusion tensor known and (2) the true diffusion tensor unknown (i.e., diffusion tensor is estimated). We show the validity of this mathematical approach, both theoretically and through tensor simulation. The estimated field is assessed through diffusion tensor metrics: mean diffusivity (MD), fractional anisotropy (FA), and principal eigenvector (V1). In simulation with 300 diffusion tensors, the study shows the mathematical model is not ill-posed and remains stable. We find when the true diffusion tensor is known (1) the change in determinant of the estimated L(r) field and the true field is near zero and (2) the median difference in estimated L(r) corrected diffusion metrics to true values is near zero. We find the results of L(r) estimation are dependent on the level of L(r) corruption. This work provides an approach to estimate gradient field without the need for additional calibration scans. To the best of our knowledge, the mathematical derivation presented here is novel.

Deep conditional generative model for longitudinal single-slice abdominal computed tomography harmonization.

Purpose: Two-dimensional single-slice abdominal computed tomography (CT) provides a detailed tissue map with high resolution allowing quantitative characterization of relationships between health conditions and aging. However, longitudinal analysis of body composition changes using these scans is difficult due to positional variation between slices acquired in different years, which leads to different organs/tissues being captured. Approach: To address this issue, we propose C-SliceGen, which takes an arbitrary axial slice in the abdominal region as a condition and generates a pre-defined vertebral level slice by estimating structural changes in the latent space. Results: Our experiments on 2608 volumetric CT data from two in-house datasets and 50 subjects from the 2015 Multi-Atlas Abdomen Labeling Challenge Beyond the Cranial Vault (BTCV) dataset demonstrate that our model can generate high-quality images that are realistic and similar. We further evaluate our method's capability to harmonize longitudinal positional variation on 1033 subjects from the Baltimore longitudinal study of aging dataset, which contains longitudinal single abdominal slices, and confirmed that our method can harmonize the slice positional variance in terms of visceral fat area. Conclusion: This approach provides a promising direction for mapping slices from different vertebral levels to a target slice and reducing positional variance for single-slice longitudinal analysis. The source code is available at: https://github.com/MASILab/C-SliceGen.

Spatiospectral image processing workflow considerations for advanced MR spectroscopy of the brain.

Magnetic resonance spectroscopy (MRS) is one of the few non-invasive imaging modalities capable of making neurochemical and metabolic measurements in vivo. Traditionally, the clinical utility of MRS has been narrow. The most common use has been the "single-voxel spectroscopy" variant to discern the presence of a lactate peak in the spectra in one location in the brain, typically to evaluate for ischemia in neonates. Thus, the reduction of rich spectral data to a binary variable has not classically necessitated much signal processing. However, scanners have become more powerful and MRS sequences more advanced, increasing data complexity and adding 2 to 3 spatial dimensions in addition to the spectral one. The result is a spatially- and spectrally-variant MRS image ripe for image processing innovation. Despite this potential, the logistics for robustly accessing and manipulating MRS data across different scanners, data formats, and software standards remain unclear. Thus, as research into MRS advances, there is a clear need to better characterize its image processing considerations to facilitate innovation from scientists and engineers. Building on established neuroimaging standards, we describe a framework for manipulating these images that generalizes to the voxel, spectral, and metabolite level across space and multiple imaging sites while integrating with LCModel, a widely used quantitative MRS peak-fitting platform. In doing so, we provide examples to demonstrate the advantages of such a workflow in relation to recent publications and with new data. Overall, we hope our characterizations will lower the barrier of entry to MRS processing for neuroimaging researchers.

Tractography with T1-weighted MRI and associated anatomical constraints on clinical quality diffusion MRI.

Diffusion MRI (dMRI) streamline tractography, the gold-standard for in vivo estimation of white matter (WM) pathways in the brain, has long been considered as a product of WM microstructure. However, recent advances in tractography demonstrated that convolutional recurrent neural networks (CoRNN) trained with a teacher-student framework have the ability to learn to propagate streamlines directly from T1 and anatomical context. Training for this network has previously relied on high resolution dMRI. In this paper, we generalize the training mechanism to traditional clinical resolution data, which allows generalizability across sensitive and susceptible study populations. We train CoRNN on a small subset of the Baltimore Longitudinal Study of Aging (BLSA), which better resembles clinical scans. We define a metric, termed the epsilon ball seeding method, to compare T1 tractography and traditional diffusion tractography at the streamline level. We show that under this metric T1 tractography generated by CoRNN reproduces diffusion tractography with approximately three millimeters of error.

Robust fiber orientation distribution function estimation using deep constrained spherical deconvolution for diffusion-weighted magnetic resonance imaging.

Purpose: Diffusion-weighted magnetic resonance imaging (DW-MRI) is a critical imaging method for capturing and modeling tissue microarchitecture at a millimeter scale. A common practice to model the measured DW-MRI signal is via fiber orientation distribution function (fODF). This function is the essential first step for the downstream tractography and connectivity analyses. With recent advantages in data sharing, large-scale multisite DW-MRI datasets are being made available for multisite studies. However, measurement variabilities (e.g., inter- and intrasite variability, hardware performance, and sequence design) are inevitable during the acquisition of DW-MRI. Most existing model-based methods [e.g., constrained spherical deconvolution (CSD)] and learning-based methods (e.g., deep learning) do not explicitly consider such variabilities in fODF modeling, which consequently leads to inferior performance on multisite and/or longitudinal diffusion studies. Approach: In this paper, we propose a data-driven deep CSD method to explicitly constrain the scan-rescan variabilities for a more reproducible and robust estimation of brain microstructure from repeated DW-MRI scans. Specifically, the proposed method introduces a three-dimensional volumetric scanner-invariant regularization scheme during the fODF estimation. We study the Human Connectome Project (HCP) young adults test-retest group as well as the MASiVar dataset (with inter- and intrasite scan/rescan data). The Baltimore Longitudinal Study of Aging dataset is employed for external validation. Results: From the experimental results, the proposed data-driven framework outperforms the existing benchmarks in repeated fODF estimation. By introducing the contrastive loss with scan/rescan data, the proposed method achieved a higher consistency while maintaining higher angular correlation coefficients with the CSD modeling. The proposed method is assessing the downstream connectivity analysis and shows increased performance in distinguishing subjects with different biomarkers. Conclusion: We propose a deep CSD method to explicitly reduce the scan-rescan variabilities, so as to model a more reproducible and robust brain microstructure from repeated DW-MRI scans. The plug-and-play design of the proposed approach is potentially applicable to a wider range of data harmonization problems in neuroimaging.

Characterizing patterns of DTI variance in aging brains.

Background: As large analyses merge data across sites, a deeper understanding of variance in statistical assessment across the sources of data becomes critical for valid analyses. Diffusion tensor imaging (DTI) exhibits spatially varying and correlated noise, so care must be taken with distributional assumptions. Purpose: We characterize the role of physiology, subject compliance, and the interaction of subject with the scanner in the understanding of DTI variability, as modeled in spatial variance of derived metrics in homogeneous regions. Methods: We analyze DTI data from 1035 subjects in the Baltimore Longitudinal Study of Aging (BLSA), with ages ranging from 22.4 to 103 years old. For each subject, up to 12 longitudinal sessions were conducted. We assess variance of DTI scalars within regions of interest (ROIs) defined by four segmentation methods and investigate the relationships between the variance and covariates, including baseline age, time from the baseline (referred to as "interval"), motion, sex, and whether it is the first scan or the second scan in the session. Results: Covariate effects are heterogeneous and bilaterally symmetric across ROIs. Inter-session interval is positively related (p ≪ 0.001) to FA variance in the cuneus and occipital gyrus, but negatively (p ≪ 0.001) in the caudate nucleus. Males show significantly (p ≪ 0.001) higher FA variance in the right putamen, thalamus, body of the corpus callosum, and cingulate gyrus. In 62 out of 176 ROIs defined by the Eve type-1 atlas, an increase in motion is associated (p < 0.05) with a decrease in FA variance. Head motion increases during the rescan of DTI (Δµ = 0.045 millimeters per volume). Conclusions: The effects of each covariate on DTI variance, and their relationships across ROIs are complex. Ultimately, we encourage researchers to include estimates of variance when sharing data and consider models of heteroscedasticity in analysis. This work provides a foundation for study planning to account for regional variations in metric variance.

Empirical assessment of the assumptions of ComBat with diffusion tensor imaging.

Purpose: Diffusion tensor imaging (DTI) is a magnetic resonance imaging technique that provides unique information about white matter microstructure in the brain but is susceptible to confounding effects introduced by scanner or acquisition differences. ComBat is a leading approach for addressing these site biases. However, despite its frequent use for harmonization, ComBat's robustness toward site dissimilarities and overall cohort size have not yet been evaluated in terms of DTI. Approach: As a baseline, we match N=358 participants from two sites to create a "silver standard" that simulates a cohort for multi-site harmonization. Across sites, we harmonize mean fractional anisotropy and mean diffusivity, calculated using participant DTI data, for the regions of interest defined by the JHU EVE-Type III atlas. We bootstrap 10 iterations at 19 levels of total sample size, 10 levels of sample size imbalance between sites, and 6 levels of mean age difference between sites to quantify (i) ßAGE, the linear regression coefficient of the relationship between FA and age; (ii) Î³/f*, the ComBat-estimated site-shift; and (iii) Î´/f*, the ComBat-estimated site-scaling. We characterize the reliability of ComBat by evaluating the root mean squared error in these three metrics and examine if there is a correlation between the reliability of ComBat and a violation of assumptions. Results: ComBat remains well behaved for ßAGE when N>162 and when the mean age difference is less than 4 years. The assumptions of the ComBat model regarding the normality of residual distributions are not violated as the model becomes unstable. Conclusion: Prior to harmonization of DTI data with ComBat, the input cohort should be examined for size and covariate distributions of each site. Direct assessment of residual distributions is less informative on stability than bootstrap analysis. We caution use ComBat of in situations that do not conform to the above thresholds.

Alleviating tiling effect by random walk sliding window in high-resolution histological whole slide image synthesis.

Multiplex immunofluorescence (MxIF) is an advanced molecular imaging technique that can simultaneously provide biologists with multiple (i.e., more than 20) molecular markers on a single histological tissue section. Unfortunately, due to imaging restrictions, the more routinely used hematoxylin and eosin (H&E) stain is typically unavailable with MxIF on the same tissue section. As biological H&E staining is not feasible, previous efforts have been made to obtain H&E whole slide image (WSI) from MxIF via deep learning empowered virtual staining. However, the tiling effect is a long-lasting problem in high-resolution WSI-wise synthesis. The MxIF to H&E synthesis is no exception. Limited by computational resources, the cross-stain image synthesis is typically performed at the patch-level. Thus, discontinuous intensities might be visually identified along with the patch boundaries assembling all individual patches back to a WSI. In this work, we propose a deep learning based unpaired high-resolution image synthesis method to obtain virtual H&E WSIs from MxIF WSIs (each with 27 markers/stains) with reduced tiling effects. Briefly, we first extend the CycleGAN framework by adding simultaneous nuclei and mucin segmentation supervision as spatial constraints. Then, we introduce a random walk sliding window shifting strategy during the optimized inference stage, to alleviate the tiling effects. The validation results show that our spatially constrained synthesis method achieves a 56% performance gain for the downstream cell segmentation task. The proposed inference method reduces the tiling effects by using 50% fewer computation resources without compromising performance. The proposed random sliding window inference method is a plug-and-play module, which can be generalized for other high-resolution WSI image synthesis applications. The source code with our proposed model are available at https://github.com/MASILab/RandomWalkSlidingWindow.git.

Nucleus subtype classification using inter-modality learning.

Understanding the way cells communicate, co-locate, and interrelate is essential to understanding human physiology. Hematoxylin and eosin (H&E) staining is ubiquitously available both for clinical studies and research. The Colon Nucleus Identification and Classification (CoNIC) Challenge has recently innovated on robust artificial intelligence labeling of six cell types on H&E stains of the colon. However, this is a very small fraction of the number of potential cell classification types. Specifically, the CoNIC Challenge is unable to classify epithelial subtypes (progenitor, endocrine, goblet), lymphocyte subtypes (B, helper T, cytotoxic T), or connective subtypes (fibroblasts, stromal). In this paper, we propose to use inter-modality learning to label previously un-labelable cell types on virtual H&E. We leveraged multiplexed immunofluorescence (MxIF) histology imaging to identify 14 subclasses of cell types. We performed style transfer to synthesize virtual H&E from MxIF and transferred the higher density labels from MxIF to these virtual H&E images. We then evaluated the efficacy of learning in this approach. We identified helper T and progenitor nuclei with positive predictive values of 0.34 ± 0.15 (prevalence 0.03 ± 0.01) and 0.47 ± 0.1 (prevalence 0.07 ± 0.02) respectively on virtual H&E. This approach represents a promising step towards automating annotation in digital pathology.

Characterizing patterns of diffusion tensor imaging variance in aging brains.

Purpose: As large analyses merge data across sites, a deeper understanding of variance in statistical assessment across the sources of data becomes critical for valid analyses. Diffusion tensor imaging (DTI) exhibits spatially varying and correlated noise, so care must be taken with distributional assumptions. Here, we characterize the role of physiology, subject compliance, and the interaction of the subject with the scanner in the understanding of DTI variability, as modeled in the spatial variance of derived metrics in homogeneous regions. Approach: We analyze DTI data from 1035 subjects in the Baltimore Longitudinal Study of Aging, with ages ranging from 22.4 to 103 years old. For each subject, up to 12 longitudinal sessions were conducted. We assess the variance of DTI scalars within regions of interest (ROIs) defined by four segmentation methods and investigate the relationships between the variance and covariates, including baseline age, time from the baseline (referred to as "interval"), motion, sex, and whether it is the first scan or the second scan in the session. Results: Covariate effects are heterogeneous and bilaterally symmetric across ROIs. Inter-session interval is positively related ( p ≪ 0.001 ) to FA variance in the cuneus and occipital gyrus, but negatively ( p ≪ 0.001 ) in the caudate nucleus. Males show significantly ( p ≪ 0.001 ) higher FA variance in the right putamen, thalamus, body of the corpus callosum, and cingulate gyrus. In 62 out of 176 ROIs defined by the Eve type-1 atlas, an increase in motion is associated ( p < 0.05 ) with a decrease in FA variance. Head motion increases during the rescan of DTI ( Δ µ = 0.045 mm per volume). Conclusions: The effects of each covariate on DTI variance and their relationships across ROIs are complex. Ultimately, we encourage researchers to include estimates of variance when sharing data and consider models of heteroscedasticity in analysis. This work provides a foundation for study planning to account for regional variations in metric variance.

DeepN4: Learning N4ITK Bias Field Correction for T1-weighted Images.

T1-weighted (T1w) MRI has low frequency intensity artifacts due to magnetic field inhomogeneities. Removal of these biases in T1w MRI images is a critical preprocessing step to ensure spatially consistent image interpretation. N4ITK bias field correction, the current state-of-the-art, is implemented in such a way that makes it difficult to port between different pipelines and workflows, thus making it hard to reimplement and reproduce results across local, cloud, and edge platforms. Moreover, N4ITK is opaque to optimization before and after its application, meaning that methodological development must work around the inhomogeneity correction step. Given the importance of bias fields correction in structural preprocessing and flexible implementation, we pursue a deep learning approximation / reinterpretation of the N4ITK bias fields correction to create a method which is portable, flexible, and fully differentiable. In this paper, we trained a deep learning network "DeepN4" on eight independent cohorts from 72 different scanners and age ranges with N4ITK-corrected T1w MRI and bias field for supervision in log space. We found that we can closely approximate N4ITK bias fields correction with naïve networks. We evaluate the peak signal to noise ratio (PSNR) in test dataset against the N4ITK corrected images. The median PSNR of corrected images between N4ITK and DeepN4 was 47.96 dB. In addition, we assess the DeepN4 model on eight additional external datasets and show the generalizability of the approach. This study establishes that incompatible N4ITK preprocessing steps can be closely approximated by naïve deep neural networks, facilitating more flexibility. All code and models are released at https://github.com/MASILab/DeepN4 .

Semantic-Aware Contrastive Learning for Multi-Object Medical Image Segmentation.

Medical image segmentation, or computing voxel-wise semantic masks, is a fundamental yet challenging task in medical imaging domain. To increase the ability of encoder-decoder neural networks to perform this task across large clinical cohorts, contrastive learning provides an opportunity to stabilize model initialization and enhances downstream tasks performance without ground-truth voxel-wise labels. However, multiple target objects with different semantic meanings and contrast level may exist in a single image, which poses a problem for adapting traditional contrastive learning methods from prevalent "image-level classification" to "pixel-level segmentation". In this article, we propose a simple semantic-aware contrastive learning approach leveraging attention masks and image-wise labels to advance multi-object semantic segmentation. Briefly, we embed different semantic objects to different clusters rather than the traditional image-level embeddings. We evaluate our proposed method on a multi-organ medical image segmentation task with both in-house data and MICCAI Challenge 2015 BTCV datasets. Compared with current state-of-the-art training strategies, our proposed pipeline yields a substantial improvement of 5.53% and 6.09% on Dice score for both medical image segmentation cohorts respectively (p-value 0.01). The performance of the proposed method is further assessed on external medical image cohort via MICCAI Challenge FLARE 2021 dataset, and achieves a substantial improvement from Dice 0.922 to 0.933 (p-value 0.01).

SynBOLD-DisCo: Synthetic BOLD images for distortion correction of fMRI without additional calibration scans.

The blood oxygen level dependent (BOLD) signal from functional magnetic resonance imaging (fMRI) is a noninvasive technique that has been widely used in research to study brain function. However, fMRI suffers from susceptibility-induced off resonance fields which may cause geometric distortions and mismatches with anatomical images. State-of-the-art correction methods require acquiring reverse phase encoded images or additional field maps to enable distortion correction. However, not all imaging protocols include these additional scans and thus cannot take advantage of these susceptibility correction capabilities. As such, in this study we aim to enable state-of-the-art distortion correction with FSL's topup algorithm of historical and/or limited fMRI data that include only a structural image and single phase encoded fMRI. To do this, we use 3D U-net models to synthesize undistorted fMRI BOLD contrast images from the structural image and use this undistorted synthetic image as an anatomical target for distortion correction with topup. We evaluate the efficacy of this approach, named SynBOLD-DisCo (synthetic BOLD images for distortion correction), and show that BOLD images corrected using our approach are geometrically more similar to structural images than the distorted BOLD data and are practically equivalent to state-of-the-art correction methods which require reverse phase encoded data. Future directions include additional validation studies, integration with other preprocessing operations, retraining with broader pathologies, and investigating the effects of spin echo versus gradient echo images for training and distortion correction. In summary, we demonstrate SynBOLD-DisCo corrects distortion of fMRI when reverse phase encoding scans or field maps are not available.