Automatic geometry-based estimation of the locus coeruleus region on T1-weighted magnetic resonance images.

The locus coeruleus (LC) is a key brain structure implicated in cognitive function and neurodegenerative disease. Automatic segmentation of the LC is a crucial step in quantitative non-invasive analysis of the LC in large MRI cohorts. Most publicly available imaging databases for training automatic LC segmentation models take advantage of specialized contrast-enhancing (e.g., neuromelanin-sensitive) MRI. Segmentation models developed with such image contrasts, however, are not readily applicable to existing datasets with conventional MRI sequences. In this work, we evaluate the feasibility of using non-contrast neuroanatomical information to geometrically approximate the LC region from standard 3-Tesla T1-weighted images of 20 subjects from the Human Connectome Project (HCP). We employ this dataset to train and internally/externally evaluate two automatic localization methods, the Expected Label Value and the U-Net. For out-of-sample segmentation, we compare the results with atlas-based segmentation, as well as test the hypothesis that using the phase image as input can improve the robustness. We then apply our trained models to a larger subset of HCP, while exploratorily correlating LC imaging variables and structural connectivity with demographic and clinical data. This report provides an evaluation of computational methods estimating neural structure.

Multimodal MRI reveals brainstem connections that sustain wakefulness in human consciousness.

Consciousness is composed of arousal (i.e., wakefulness) and awareness. Substantial progress has been made in mapping the cortical networks that underlie awareness in the human brain, but knowledge about the subcortical networks that sustain arousal in humans is incomplete. Here, we aimed to map the connectivity of a proposed subcortical arousal network that sustains wakefulness in the human brain, analogous to the cortical default mode network (DMN) that has been shown to contribute to awareness. We integrated data from ex vivo diffusion magnetic resonance imaging (MRI) of three human brains, obtained at autopsy from neurologically normal individuals, with immunohistochemical staining of subcortical brain sections. We identified nodes of the proposed default ascending arousal network (dAAN) in the brainstem, hypothalamus, thalamus, and basal forebrain. Deterministic and probabilistic tractography analyses of the ex vivo diffusion MRI data revealed projection, association, and commissural pathways linking dAAN nodes with one another and with DMN nodes. Complementary analyses of in vivo 7-tesla resting-state functional MRI data from the Human Connectome Project identified the dopaminergic ventral tegmental area in the midbrain as a widely connected hub node at the nexus of the subcortical arousal and cortical awareness networks. Our network-based autopsy methods and connectivity data provide a putative neuroanatomic architecture for the integration of arousal and awareness in human consciousness.

Multi-Head Graph Convolutional Network for Structural Connectome Classification.

We tackle classification based on brain connectivity derived from diffusion magnetic resonance images. We propose a machine-learning model inspired by graph convolutional networks (GCNs), which takes a brain-connectivity input graph and processes the data separately through a parallel GCN mechanism with multiple heads. The proposed network is a simple design that employs different heads involving graph convolutions focused on edges and nodes, thoroughly capturing representations from the input data. To test the ability of our model to extract complementary and representative features from brain connectivity data, we chose the task of sex classification. This quantifies the degree to which the connectome varies depending on the sex, which is important for improving our understanding of health and disease in both sexes. We show experiments on two publicly available datasets: PREVENT-AD (347 subjects) and OASIS3 (771 subjects). The proposed model demonstrates the highest performance compared to the existing machine-learning algorithms we tested, including classical methods and (graph and non-graph) deep learning. We provide a detailed analysis of each component of our model.

Impact of repeated blast exposure on active-duty United States Special Operations Forces.

United States (US) Special Operations Forces (SOF) are frequently exposed to explosive blasts in training and combat, but the effects of repeated blast exposure (RBE) on SOF brain health are incompletely understood. Furthermore, there is no diagnostic test to detect brain injury from RBE. As a result, SOF personnel may experience cognitive, physical, and psychological symptoms for which the cause is never identified, and they may return to training or combat during a period of brain vulnerability. In 30 active-duty US SOF, we assessed the relationship between cumulative blast exposure and cognitive performance, psychological health, physical symptoms, blood proteomics, and neuroimaging measures (Connectome structural and diffusion MRI, 7 Tesla functional MRI, [11C]PBR28 translocator protein [TSPO] positron emission tomography [PET]-MRI, and [18F]MK6240 tau PET-MRI), adjusting for age, combat exposure, and blunt head trauma. Higher blast exposure was associated with increased cortical thickness in the left rostral anterior cingulate cortex (rACC), a finding that remained significant after multiple comparison correction. In uncorrected analyses, higher blast exposure was associated with worse health-related quality of life, decreased functional connectivity in the executive control network, decreased TSPO signal in the right rACC, and increased cortical thickness in the right rACC, right insula, and right medial orbitofrontal cortex-nodes of the executive control, salience, and default mode networks. These observations suggest that the rACC may be susceptible to blast overpressure and that a multimodal, network-based diagnostic approach has the potential to detect brain injury associated with RBE in active-duty SOF.

BOOSTING SKULL-STRIPPING PERFORMANCE FOR PEDIATRIC BRAIN IMAGES.

Skull-stripping is the removal of background and non-brain anatomical features from brain images. While many skull-stripping tools exist, few target pediatric populations. With the emergence of multi-institutional pediatric data acquisition efforts to broaden the understanding of perinatal brain development, it is essential to develop robust and well-tested tools ready for the relevant data processing. However, the broad range of neuroanatomical variation in the developing brain, combined with additional challenges such as high motion levels, as well as shoulder and chest signal in the images, leaves many adult-specific tools ill-suited for pediatric skull-stripping. Building on an existing framework for robust and accurate skull-stripping, we propose developmental SynthStrip (d-SynthStrip), a skull-stripping model tailored to pediatric images. This framework exposes networks to highly variable images synthesized from label maps. Our model substantially outperforms pediatric baselines across scan types and age cohorts. In addition, the <1-minute runtime of our tool compares favorably to the fastest baselines. We distribute our model at https://w3id.org/synthstrip.

Automatic Geometry-based Estimation of the Locus Coeruleus Region on T1-Weighted Magnetic Resonance Images.

The locus coeruleus (LC) is a key brain structure implicated in cognitive function and neurodegenerative disease. Automatic segmentation of the LC is a crucial step in quantitative non-invasive analysis of the LC in large MRI cohorts. Most publicly available imaging databases for training automatic LC segmentation models take advantage of specialized contrast-enhancing (e.g., neuromelanin-sensitive) MRI. Segmentation models developed with such image contrasts, however, are not readily applicable to existing datasets with conventional MRI sequences. In this work, we evaluate the feasibility of using non-contrast neuroanatomical information to geometrically approximate the LC region from standard 3-Tesla T1-weighted images of 20 subjects from the Human Connectome Project (HCP). We employ this dataset to train and internally/externally evaluate two automatic localization methods, the Expected Label Value and the U-Net. We also test the hypothesis that using the phase image as input can improve the robustness of out-of-sample segmentation. We then apply our trained models to a larger subset of HCP, while exploratorily correlating LC imaging variables and structural connectivity with demographic and clinical data. This report contributes and provides an evaluation of two computational methods estimating neural structure.

Machine learning of dissection photographs and surface scanning for quantitative 3D neuropathology.

We present open-source tools for 3D analysis of photographs of dissected slices of human brains, which are routinely acquired in brain banks but seldom used for quantitative analysis. Our tools can: (i) 3D reconstruct a volume from the photographs and, optionally, a surface scan; and (ii) produce a high-resolution 3D segmentation into 11 brain regions per hemisphere (22 in total), independently of the slice thickness. Our tools can be used as a substitute for ex vivo magnetic resonance imaging (MRI), which requires access to an MRI scanner, ex vivo scanning expertise, and considerable financial resources. We tested our tools on synthetic and real data from two NIH Alzheimer's Disease Research Centers. The results show that our methodology yields accurate 3D reconstructions, segmentations, and volumetric measurements that are highly correlated to those from MRI. Our method also detects expected differences between post mortem confirmed Alzheimer's disease cases and controls. The tools are available in our widespread neuroimaging suite "FreeSurfer" ( https://surfer.nmr.mgh.harvard.edu/fswiki/PhotoTools ).

Segmentation of supragranular and infragranular layers in ultra-high resolution 7T ex vivo MRI of the human cerebral cortex.

Accurate labeling of specific layers in the human cerebral cortex is crucial for advancing our understanding of neurodevelopmental and neurodegenerative disorders. Leveraging recent advancements in ultra-high resolution ex vivo MRI, we present a novel semi-supervised segmentation model capable of identifying supragranular and infragranular layers in ex vivo MRI with unprecedented precision. On a dataset consisting of 17 whole-hemisphere ex vivo scans at 120 µm, we propose a multi-resolution U-Nets framework (MUS) that integrates global and local structural information, achieving reliable segmentation maps of the entire hemisphere, with Dice scores over 0.8 for supra- and infragranular layers. This enables surface modeling, atlas construction, anomaly detection in disease states, and cross-modality validation, while also paving the way for finer layer segmentation. Our approach offers a powerful tool for comprehensive neuroanatomical investigations and holds promise for advancing our mechanistic understanding of progression of neurodegenerative diseases.

Exploratory correlation of the human structural connectome with non-MRI variables in Alzheimer's disease.

Introduction: Discovery of the associations between brain structural connectivity and clinical and demographic variables can help to better understand the vulnerability and resilience of the brain architecture to neurodegenerative diseases and to discover biomarkers. Methods: We used four diffusion-MRI databases, three related to Alzheimer's disease (AD), to exploratorily correlate structural connections between 85 brain regions with non-MRI variables, while stringently correcting the significance values for multiple testing and ruling out spurious correlations via careful visual inspection. We repeated the analysis with brain connectivity augmented with multi-synaptic neural pathways. Results: We found 85 and 101 significant relationships with direct and augmented connectivity, respectively, which were generally stronger for the latter. Age was consistently linked to decreased connectivity, and healthier clinical scores were generally linked to increased connectivity. Discussion: Our findings help to elucidate which structural brain networks are affected in AD and aging and highlight the importance of including indirect connections.

Quantitative imaging of three-dimensional fiber orientation in the human brain via two illumination angles using polarization-sensitive optical coherence tomography.

The accurate measurement of three-dimensional (3D) fiber orientation in the brain is crucial for reconstructing fiber pathways and studying their involvement in neurological diseases. Optical imaging methods such as polarization-sensitive optical coherence tomography (PS-OCT) provide important tools to directly quantify fiber orientation at micrometer resolution. However, brain imaging based on the optic axis by PS-OCT so far has been limited to two-dimensional in-plane orientation, preventing the comprehensive study of connectivity in 3D. In this work, we present a novel method to obtain the 3D fiber orientation in full angular space with only two illumination angles. We measure the optic axis orientation and the apparent birefringence by PS-OCT from a normal and a 15 deg tilted illumination, and then apply a computational method yielding the 3D optic axis orientation and true birefringence. We verify that our method accurately recovers a large range of through-plane orientations from -85 deg to 85 deg with a high angular precision. We further present 3D fiber orientation maps of entire coronal sections of human cerebrum and brainstem with 10 µm in-plane resolution, revealing unprecedented details of fiber configurations. We envision that further development of our method will open a promising avenue towards large-scale 3D fiber axis mapping in the human brain and other complex fibrous tissues at microscopic level.

Optimizing Brain Health of United States Special Operations Forces.

United States Special Operations Forces (SOF) personnel are frequently exposed to explosive blasts in training and combat. However, the effects of repeated blast exposure on the human brain are incompletely understood. Moreover, there is currently no diagnostic test to detect repeated blast brain injury (rBBI). In this "Human Performance Optimization" article, we discuss how the development and implementation of a reliable diagnostic test for rBBI has the potential to promote SOF brain health, combat readiness, and quality of life.

Multi-Scale Label-Free Human Brain Imaging with Integrated Serial Sectioning Polarization Sensitive Optical Coherence Tomography and Two-Photon Microscopy.

The study of aging and neurodegenerative processes in the human brain requires a comprehensive understanding of cytoarchitectonic, myeloarchitectonic, and vascular structures. Recent computational advances have enabled volumetric reconstruction of the human brain using thousands of stained slices, however, tissue distortions and loss resulting from standard histological processing have hindered deformation-free reconstruction. Here, the authors describe an integrated serial sectioning polarization-sensitive optical coherence tomography (PSOCT) and two photon microscopy (2PM) system to provide label-free multi-contrast imaging of intact brain structures, including scattering, birefringence, and autofluorescence of human brain tissue. The authors demonstrate high-throughput reconstruction of 4 × 4 × 2cm3 sample blocks and simple registration between PSOCT and 2PM images that enable comprehensive analysis of myelin content, vascular structure, and cellular information. The high-resolution 2PM images provide microscopic validation and enrichment of the cellular information provided by the PSOCT optical properties on the same sample, revealing the densely packed fibers, capillaries, and lipofuscin-filled cell bodies in the cortex and white matter. It is  shown that the imaging system enables quantitative characterization of various pathological features in aging process, including myelin degradation, lipofuscin accumulation, and microvascular changes, which opens up numerous opportunities in the study of neurodegenerative diseases in the future.

A cellular resolution atlas of Broca's area.

Brain cells are arranged in laminar, nuclear, or columnar structures, spanning a range of scales. Here, we construct a reliable cell census in the frontal lobe of human cerebral cortex at micrometer resolution in a magnetic resonance imaging (MRI)-referenced system using innovative imaging and analysis methodologies. MRI establishes a macroscopic reference coordinate system of laminar and cytoarchitectural boundaries. Cell counting is obtained with a digital stereological approach on the 3D reconstruction at cellular resolution from a custom-made inverted confocal light-sheet fluorescence microscope (LSFM). Mesoscale optical coherence tomography enables the registration of the distorted histological cell typing obtained with LSFM to the MRI-based atlas coordinate system. The outcome is an integrated high-resolution cellular census of Broca's area in a human postmortem specimen, within a whole-brain reference space atlas.

Joint cortical registration of geometry and function using semi-supervised learning.

Brain surface-based image registration, an important component of brain image analysis, establishes spatial correspondence between cortical surfaces. Existing iterative and learning-based approaches focus on accurate registration of folding patterns of the cerebral cortex, and assume that geometry predicts function and thus functional areas will also be well aligned. However, structure/functional variability of anatomically corresponding areas across subjects has been widely reported. In this work, we introduce a learning-based cortical registration framework, JOSA, which jointly aligns folding patterns and functional maps while simultaneously learning an optimal atlas. We demonstrate that JOSA can substantially improve registration performance in both anatomical and functional domains over existing methods. By employing a semi-supervised training strategy, the proposed framework obviates the need for functional data during inference, enabling its use in broad neuroscientific domains where functional data may not be observed. The source code of JOSA will be released to the public at https://voxelmorph.net.

Intermediate Deformable Image Registration via Windowed Cross-Correlation.

In population and longitudinal imaging studies that employ deformable image registration, more accurate results can be achieved by initializing deformable registration with the results of affine registration where global misalignments have been considerably reduced. Such affine registration, however, is limited to linear transformations and it cannot account for large nonlinear anatomical variations, such as those between pre- and post-operative images or across different subject anatomies. In this work, we introduce a new intermediate deformable image registration (IDIR) technique that recovers large deformations via windowed cross-correlation, and provide an efficient implementation based on the fast Fourier transform. We evaluate our method on 2D X-ray and 3D magnetic resonance images, demonstrating its ability to align substantial nonlinear anatomical variations within a few iterations.

Can we predict motion artifacts in clinical MRI before the scan completes?

Subject motion can cause artifacts in clinical MRI, frequently necessitating repeat scans. We propose to alleviate this inefficiency by predicting artifact scores from partial multi-shot multi-slice acquisitions, which may guide the operator in aborting corrupted scans early.

Clinical evaluation of k-space correlation informed motion artifact detection in segmented multi-slice MRI.

Motion artifacts can negatively impact diagnosis, patient experience, and radiology workflow especially when a patient recall is required. Detecting motion artifacts while the patient is still in the scanner could potentially improve workflow and reduce costs by enabling immediate corrective action. We demonstrate in a clinical k-space dataset that using cross-correlation between adjacent phase-encoding lines can detect motion artifacts directly from raw k-space in multi-shot multi-slice scans. We train a split-attention residual network to examine the performance in predicting motion artifact severity. The network is trained on simulated data and tested on real clinical data.

Estimation of the Spatial Gradient of the MR Image from the Diffusion Profile.

In the course of diffusion, water molecules experience varying values for the relaxation-time property of the underlying tissue, a factor that has not been accounted for in diffusion MRI (dMRI) modeling. Accordingly, we derive a relationship between the diffusion profile measured by dMRI and the spatial gradient of the image, and subsequently estimate the latter from the former. We test our hypothesized relationship via dMRI of the human brain (a public in vivo image and an acquired ex vivo stimulated-echo image), showing statistically significant results that may be due to our model and/or the confounding factor of "fiber continuity".

Sustaining wakefulness: Brainstem connectivity in human consciousness.

Consciousness is comprised of arousal (i.e., wakefulness) and awareness. Substantial progress has been made in mapping the cortical networks that modulate awareness in the human brain, but knowledge about the subcortical networks that sustain arousal is lacking. We integrated data from ex vivo diffusion MRI, immunohistochemistry, and in vivo 7 Tesla functional MRI to map the connectivity of a subcortical arousal network that we postulate sustains wakefulness in the resting, conscious human brain, analogous to the cortical default mode network (DMN) that is believed to sustain self-awareness. We identified nodes of the proposed default ascending arousal network (dAAN) in the brainstem, hypothalamus, thalamus, and basal forebrain by correlating ex vivo diffusion MRI with immunohistochemistry in three human brain specimens from neurologically normal individuals scanned at 600-750 µm resolution. We performed deterministic and probabilistic tractography analyses of the diffusion MRI data to map dAAN intra-network connections and dAAN-DMN internetwork connections. Using a newly developed network-based autopsy of the human brain that integrates ex vivo MRI and histopathology, we identified projection, association, and commissural pathways linking dAAN nodes with one another and with cortical DMN nodes, providing a structural architecture for the integration of arousal and awareness in human consciousness. We release the ex vivo diffusion MRI data, corresponding immunohistochemistry data, network-based autopsy methods, and a new brainstem dAAN atlas to support efforts to map the connectivity of human consciousness.

Supervision by Denoising.

Learning-based image reconstruction models, such as those based on the U-Net, require a large set of labeled images if good generalization is to be guaranteed. In some imaging domains, however, labeled data with pixel- or voxel-level label accuracy are scarce due to the cost of acquiring them. This problem is exacerbated further in domains like medical imaging, where there is no single ground truth label, resulting in large amounts of repeat variability in the labels. Therefore, training reconstruction networks to generalize better by learning from both labeled and unlabeled examples (called semi-supervised learning) is problem of practical and theoretical interest. However, traditional semi-supervised learning methods for image reconstruction often necessitate handcrafting a differentiable regularizer specific to some given imaging problem, which can be extremely time-consuming. In this work, we propose "supervision by denoising" (SUD), a framework to supervise reconstruction models using their own denoised output as labels. SUD unifies stochastic averaging and spatial denoising techniques under a spatio-temporal denoising framework and alternates denoising and model weight update steps in an optimization framework for semi-supervision. As example applications, we apply SUD to two problems from biomedical imaging-anatomical brain reconstruction (3D) and cortical parcellation (2D)-to demonstrate a significant improvement in reconstruction over supervised-only and ensembling baselines. Our code available at https://github.com/seannz/sud.