Gray matters: ViT-GAN framework for identifying schizophrenia biomarkers linking structural MRI and functional network connectivity.

Brain disorders are often associated with changes in brain structure and function, where functional changes may be due to underlying structural variations. Gray matter (GM) volume segmentation from 3D structural MRI offers vital structural information for brain disorders like schizophrenia, as it encompasses essential brain tissues such as neuronal cell bodies, dendrites, and synapses, which are crucial for neural signal processing and transmission; changes in GM volume can thus indicate alterations in these tissues, reflecting underlying pathological conditions. In addition, the use of the ICA algorithm to transform high-dimensional fMRI data into functional network connectivity (FNC) matrices serves as an effective carrier of functional information. In our study, we introduce a new generative deep learning architecture, the conditional efficient vision transformer generative adversarial network (cEViT-GAN), which adeptly generates FNC matrices conditioned on GM to facilitate the exploration of potential connections between brain structure and function. We developed a new, lightweight self-attention mechanism for our ViT-based generator, enhancing the generation of refined attention maps critical for identifying structural biomarkers based on GM. Our approach not only generates high quality FNC matrices with a Pearson correlation of 0.74 compared to real FNC data, but also uses attention map technology to identify potential biomarkers in GM structure that could lead to functional abnormalities in schizophrenia patients. Visualization experiments within our study have highlighted these structural biomarkers, including the medial prefrontal cortex (mPFC), dorsolateral prefrontal cortex (DL-PFC), and cerebellum. In addition, through cross-domain analysis comparing generated and real FNC matrices, we have identified functional connections with the highest correlations to structural information, further validating the structure-function connections. This comprehensive analysis helps to understand the intricate relationship between brain structure and its functional manifestations, providing a more refined insight into the neurobiological research of schizophrenia.

Searching Reproducible Brain Features using NeuroMark: Templates for Different Age Populations and Imaging Modalities.

A primary challenge to the data-driven analysis is the balance between poor generalizability of population-based research and characterizing more subject-, study- and population-specific variability. We previously introduced a fully automated spatially constrained independent component analysis (ICA) framework called NeuroMark and its functional MRI (fMRI) template. NeuroMark has been successfully applied in numerous studies, identifying brain markers reproducible across datasets and disorders. The first NeuroMark template was constructed based on young adult cohorts. We recently expanded on this initiative by creating a standardized normative multi-spatial-scale functional template using over 100,000 subjects, aiming to improve generalizability and comparability across studies involving diverse cohorts. While a unified template across the lifespan is desirable, a comprehensive investigation of the similarities and differences between components from different age populations might help systematically transform our understanding of the human brain by revealing the most well-replicated and variable network features throughout the lifespan. In this work, we introduced two significant expansions of NeuroMark templates first by generating replicable fMRI templates for infants, adolescents, and aging cohorts, and second by incorporating structural MRI (sMRI) and diffusion MRI (dMRI) modalities. Specifically, we built spatiotemporal fMRI templates based on 6,000 resting-state scans from four datasets. This is the first attempt to create robust ICA templates covering dynamic brain development across the lifespan. For the sMRI and dMRI data, we used two large publicly available datasets including more than 30,000 scans to build reliable templates. We employed a spatial similarity analysis to identify replicable templates and investigate the degree to which unique and similar patterns are reflective in different age populations. Our results suggest remarkably high similarity of the resulting adapted components, even across extreme age differences. With the new templates, the NeuroMark framework allows us to perform age-specific adaptations and to capture features adaptable to each modality, therefore facilitating biomarker identification across brain disorders. In sum, the present work demonstrates the generalizability of NeuroMark templates and suggests the potential of new templates to boost accuracy in mental health research and advance our understanding of lifespan and cross-modal alterations.

Intra-Atlas Node Size Effects on Graph Metrics in fMRI Data: Implications for Alzheimer's Disease and Cognitive Impairment.

Network neuroscience, a multidisciplinary field merging insights from neuroscience and network theory, offers a profound understanding of neural network intricacies. However, the impact of varying node sizes on computed graph metrics in neuroimaging data remains underexplored. This study addresses this gap by adopting a data-driven methodology to delineate functional nodes and assess their influence on graph metrics. Using the Neuromark framework, automated independent component analysis is applied to resting state fMRI data, capturing functional network connectivity (FNC) matrices. Global and local graph metrics reveal intricate connectivity patterns, emphasizing the need for nuanced analysis. Notably, node sizes, computed based on voxel counts, contribute to a novel metric termed 'node-metric coupling' (NMC). Correlations between graph metrics and node dimensions are consistently observed. The study extends its analysis to a dataset comprising Alzheimer's disease, mild cognitive impairment, and control subjects, showcasing the potential of NMC as a biomarker for brain disorders. The two key outcomes underscore the interplay between node sizes and resultant graph metrics within a given atlas, shedding light on an often-overlooked source of variability. Additionally, the study highlights the utility of NMC as a valuable biomarker, emphasizing the necessity of accounting for node sizes in future neuroimaging investigations. This work contributes to refining comparative studies employing diverse atlases and advocates for thoughtful consideration of intra-atlas node size in shaping graph metrics, paving the way for more robust neuroimaging research.

Developmental and aging resting functional magnetic resonance imaging brain state adaptations in adolescents and adults: A large N (>47K) study.

The brain's functional architecture and organization undergo continual development and modification throughout adolescence. While it is well known that multiple factors govern brain maturation, the constantly evolving patterns of time-resolved functional connectivity are still unclear and understudied. We systematically evaluated over 47,000 youth and adult brains to bridge this gap, highlighting replicable time-resolved developmental and aging functional brain patterns. The largest difference between the two life stages was captured in a brain state that indicated coherent strengthening and modularization of functional coupling within the auditory, visual, and motor subdomains, supplemented by anticorrelation with other subdomains in adults. This distinctive pattern, which we replicated in independent data, was consistently less modular or absent in children and presented a negative association with age in adults, thus indicating an overall inverted U-shaped trajectory. This indicates greater synchrony, strengthening, modularization, and integration of the brain's functional connections beyond adolescence, and gradual decline of this pattern during the healthy aging process. We also found evidence that the developmental changes may also bring along a departure from the canonical static functional connectivity pattern in favor of more efficient and modularized utilization of the vast brain interconnections. State-based statistical summary measures presented robust and significant group differences that also showed significant age-related associations. The findings reported in this article support the idea of gradual developmental and aging brain state adaptation processes in different phases of life and warrant future research via lifespan studies to further authenticate the projected time-resolved brain state trajectories.

A phase II study repurposing atomoxetine for neuroprotection in mild cognitive impairment.

The locus coeruleus is the initial site of Alzheimer's disease neuropathology, with hyperphosphorylated Tau appearing in early adulthood followed by neurodegeneration in dementia. Locus coeruleus dysfunction contributes to Alzheimer's pathobiology in experimental models, which can be rescued by increasing norepinephrine transmission. To test norepinephrine augmentation as a potential disease-modifying therapy, we performed a biomarker-driven phase II trial of atomoxetine, a clinically-approved norepinephrine transporter inhibitor, in subjects with mild cognitive impairment due to Alzheimer's disease. The design was a single-centre, 12-month double-blind crossover trial. Thirty-nine participants with mild cognitive impairment and biomarker evidence of Alzheimer's disease were randomized to atomoxetine or placebo treatment. Assessments were collected at baseline, 6- (crossover) and 12-months (completer). Target engagement was assessed by CSF and plasma measures of norepinephrine and metabolites. Prespecified primary outcomes were CSF levels of IL1α and TECK. Secondary/exploratory outcomes included clinical measures, CSF analyses of amyloid-ß42, Tau, and pTau181, mass spectrometry proteomics and immune-based targeted inflammation-related cytokines, as well as brain imaging with MRI and fluorodeoxyglucose-PET. Baseline demographic and clinical measures were similar across trial arms. Dropout rates were 5.1% for atomoxetine and 2.7% for placebo, with no significant differences in adverse events. Atomoxetine robustly increased plasma and CSF norepinephrine levels. IL-1α and TECK were not measurable in most samples. There were no significant treatment effects on cognition and clinical outcomes, as expected given the short trial duration. Atomoxetine was associated with a significant reduction in CSF Tau and pTau181 compared to placebo, but not associated with change in amyloid-ß42. Atomoxetine treatment also significantly altered CSF abundances of protein panels linked to brain pathophysiologies, including synaptic, metabolism and glial immunity, as well as inflammation-related CDCP1, CD244, TWEAK and osteoprotegerin proteins. Treatment was also associated with significantly increased brain-derived neurotrophic factor and reduced triglycerides in plasma. Resting state functional MRI showed significantly increased inter-network connectivity due to atomoxetine between the insula and the hippocampus. Fluorodeoxyglucose-PET showed atomoxetine-associated increased uptake in hippocampus, parahippocampal gyrus, middle temporal pole, inferior temporal gyrus and fusiform gyrus, with carry-over effects 6 months after treatment. In summary, atomoxetine treatment was safe, well tolerated and achieved target engagement in prodromal Alzheimer's disease. Atomoxetine significantly reduced CSF Tau and pTau, normalized CSF protein biomarker panels linked to synaptic function, brain metabolism and glial immunity, and increased brain activity and metabolism in key temporal lobe circuits. Further study of atomoxetine is warranted for repurposing the drug to slow Alzheimer's disease progression.

Structural Brain Architectures Match Intrinsic Functional Networks and Vary across Domains: A Study from 15 000+ Individuals.

Brain structural networks have been shown to consistently organize in functionally meaningful architectures covering the entire brain. However, to what extent brain structural architectures match the intrinsic functional networks in different functional domains remains under explored. In this study, based on independent component analysis, we revealed 45 pairs of structural-functional (S-F) component maps, distributing across nine functional domains, in both a discovery cohort (n = 6005) and a replication cohort (UK Biobank, n = 9214), providing a well-match multimodal spatial map template for public use. Further network module analysis suggested that unimodal cortical areas (e.g., somatomotor and visual networks) indicate higher S-F coherence, while heteromodal association cortices, especially the frontoparietal network (FPN), exhibit more S-F divergence. Collectively, these results suggest that the expanding and maturing brain association cortex demonstrates a higher degree of changes compared with unimodal cortex, which may lead to higher interindividual variability and lower S-F coherence.

Age-related structural and functional variations in 5,967 individuals across the adult lifespan.

Exploring brain changes across the human lifespan is becoming an important topic in neuroscience. Though there are multiple studies which investigated the relationship between age and brain imaging, the results are heterogeneous due to small sample sizes and relatively narrow age ranges. Here, based on year-wise estimation of 5,967 subjects from 13 to 72 years old, we aimed to provide a more precise description of adult lifespan variation trajectories of gray matter volume (GMV), structural network correlation (SNC), and functional network connectivity (FNC) using independent component analysis and multivariate linear regression model. Our results revealed the following relationships: (a) GMV linearly declined with age in most regions, while parahippocampus showed an inverted U-shape quadratic relationship with age; SNC presented a U-shape quadratic relationship with age within cerebellum, and inverted U-shape relationship primarily in the default mode network (DMN) and frontoparietal (FP) related correlation. (b) FNC tended to linearly decrease within resting-state networks (RSNs), especially in the visual network and DMN. Early increase was revealed between RSNs, primarily in FP and DMN, which experienced a decrease at older ages. U-shape relationship was also revealed to compensate for the cognition deficit in attention and subcortical related connectivity at late years. (c) The link between middle occipital gyrus and insula, as well as precuneus and cerebellum, exhibited similar changing trends between SNC and FNC across the adult lifespan. Collectively, these results highlight the benefit of lifespan study and provide a precise description of age-related regional variation and SNC/FNC changes based on a large dataset.

Decentralized temporal independent component analysis: Leveraging fMRI data in collaborative settings.

The field of neuroimaging has recently witnessed a strong shift towards data sharing; however, current collaborative research projects may be unable to leverage institutional architectures that collect and store data in local, centralized data centers. Additionally, though research groups are willing to grant access for collaborations, they often wish to maintain control of their data locally. These concerns may stem from research culture as well as privacy and accountability concerns. In order to leverage the potential of these aggregated larger data sets, we require tools that perform joint analyses without transmitting the data. Ideally, these tools would have similar performance and ease of use as their current centralized counterparts. In this paper, we propose and evaluate a new Algorithm, decentralized joint independent component analysis (djICA), which meets these technical requirements. djICA shares only intermediate statistics about the data, plausibly retaining privacy of the raw information to local sites, thus making it amenable to further privacy protections, for example via differential privacy. We validate our method on real functional magnetic resonance imaging (fMRI) data and show that it enables collaborative large-scale temporal ICA of fMRI, a rich vein of analysis as of yet largely unexplored, and which can benefit from the larger-N studies enabled by a decentralized approach. We show that djICA is robust to different distributions of data over sites, and that the temporal components estimated with djICA show activations similar to the temporal functional modes analyzed in previous work, thus solidifying djICA as a new, decentralized method oriented toward the frontiers of temporal independent component analysis.

An average sliding window correlation method for dynamic functional connectivity.

Sliding window correlation (SWC) is utilized in many studies to analyze the temporal characteristics of brain connectivity. However, spurious artifacts have been reported in simulated data using this technique. Several suggestions have been made through the development of the SWC technique. Recently, it has been proposed to utilize a SWC window length of 100 s given that the lowest nominal fMRI frequency is 0.01 Hz. The main pitfall is the loss of temporal resolution due to a large window length. In this work, we propose an average sliding window correlation (ASWC) approach that presents several advantages over the SWC. One advantage is the requirement for a smaller window length. This is important because shorter lengths allow for a more accurate estimation of transient dynamicity of functional connectivity. Another advantage is the behavior of ASWC as a tunable high pass filter. We demonstrate the advantages of ASWC over SWC using simulated signals with configurable functional connectivity dynamics. We present analytical models explaining the behavior of ASWC and SWC for several dynamic connectivity cases. We also include a real data example to demonstrate the application of the new method. In summary, ASWC shows lower artifacts and resolves faster transient connectivity fluctuations, resulting in a lower mean square error than in SWC.

Replicability of time-varying connectivity patterns in large resting state fMRI samples.

The past few years have seen an emergence of approaches that leverage temporal changes in whole-brain patterns of functional connectivity (the chronnectome). In this chronnectome study, we investigate the replicability of the human brain's inter-regional coupling dynamics during rest by evaluating two different dynamic functional network connectivity (dFNC) analysis frameworks using 7 500 functional magnetic resonance imaging (fMRI) datasets. To quantify the extent to which the emergent functional connectivity (FC) patterns are reproducible, we characterize the temporal dynamics by deriving several summary measures across multiple large, independent age-matched samples. Reproducibility was demonstrated through the existence of basic connectivity patterns (FC states) amidst an ensemble of inter-regional connections. Furthermore, application of the methods to conservatively configured (statistically stationary, linear and Gaussian) surrogate datasets revealed that some of the studied state summary measures were indeed statistically significant and also suggested that this class of null model did not explain the fMRI data fully. This extensive testing of reproducibility of similarity statistics also suggests that the estimated FC states are robust against variation in data quality, analysis, grouping, and decomposition methods. We conclude that future investigations probing the functional and neurophysiological relevance of time-varying connectivity assume critical importance.

Multimodal active subspace analysis for computing assessment oriented subspaces from neuroimaging data.

BACKGROUND: For successful biomarker discovery, it is essential to develop computational frameworks that summarize high-dimensional neuroimaging data in terms of involved sub-systems of the brain, while also revealing underlying heterogeneous functional and structural changes covarying with specific cognitive and biological traits. However, unsupervised decompositions do not inculcate clinical assessment information, while supervised approaches extract only individual feature importance, thereby impeding qualitative interpretation at the level of subspaces. NEW METHOD: We present a novel framework to extract robust multimodal brain subspaces associated with changes in a given cognitive or biological trait. Our approach involves active subspace learning on the gradients of a trained machine learning model followed by clustering to extract and summarize the most salient and consistent subspaces associated with the target variable. RESULTS: Through a rigorous cross-validation procedure on an Alzheimer's disease (AD) dataset, our framework successfully extracts multimodal subspaces specific to a given clinical assessment (e.g., memory and other cognitive skills), and also retains predictive performance in standard machine learning algorithms. We also show that the salient active subspace directions occur consistently across randomly sub-sampled repetitions of the analysis. COMPARISON WITH EXISTING METHOD(S): Compared to existing unsupervised decompositions based on principle component analysis, the subspace components in our framework retain higher predictive information. CONCLUSIONS: As an important step towards biomarker discovery, our framework not only uncovers AD-related brain regions in the associated brain subspaces, but also enables automated identification of multiple underlying structural and functional sub-systems of the brain that collectively characterize changes in memory and proficiency in cognitive skills related to brain disorders like AD.

A confounder controlled machine learning approach: Group analysis and classification of schizophrenia and Alzheimer's disease using resting-state functional network connectivity.

Resting-state functional magnetic resonance imaging (rs-fMRI) has increasingly been used to study both Alzheimer's disease (AD) and schizophrenia (SZ). While most rs-fMRI studies being conducted in AD and SZ compare patients to healthy controls, it is also of interest to directly compare AD and SZ patients with each other to identify potential biomarkers shared between the disorders. However, comparing patient groups collected in different studies can be challenging due to potential confounds, such as differences in the patient's age, scan protocols, etc. In this study, we compared and contrasted resting-state functional network connectivity (rs-FNC) of 162 patients with AD and late mild cognitive impairment (LMCI), 181 schizophrenia patients, and 315 cognitively normal (CN) subjects. We used confounder-controlled rs-FNC and applied machine learning algorithms (including support vector machine, logistic regression, random forest, and k-nearest neighbor) and deep learning models (i.e., fully-connected neural networks) to classify subjects in binary and three-class categories according to their diagnosis labels (e.g., AD, SZ, and CN). Our statistical analysis revealed that FNC between the following network pairs is stronger in AD compared to SZ: subcortical-cerebellum, subcortical-cognitive control, cognitive control-cerebellum, and visual-sensory motor networks. On the other hand, FNC is stronger in SZ than AD for the following network pairs: subcortical-visual, subcortical-auditory, subcortical-sensory motor, cerebellum-visual, sensory motor-cognitive control, and within the cerebellum networks. Furthermore, we observed that while AD and SZ disorders each have unique FNC abnormalities, they also share some common functional abnormalities that can be due to similar neurobiological mechanisms or genetic factors contributing to these disorders' development. Moreover, we achieved an accuracy of 85% in classifying subjects into AD and SZ where default mode, visual, and subcortical networks contributed the most to the classification and accuracy of 68% in classifying subjects into AD, SZ, and CN with the subcortical domain appearing as the most contributing features to the three-way classification. Finally, our findings indicated that for all classification tasks, except AD vs. SZ, males are more predictable than females.

Towards a multimodal neuroimaging-based risk score for mild cognitive impairment by combining clinical studies with a large (N>37000) population-based study.

Alzheimer's disease (AD) is the most common form of age-related dementia, leading to a decline in memory, reasoning, and social skills. While numerous studies have investigated the genetic risk factors associated with AD, less attention has been given to identifying a brain imaging-based measure of AD risk. This study introduces a novel approach to assess mild cognitive impairment MCI, as a stage before AD, risk using neuroimaging data, referred to as a brain-wide risk score (BRS), which incorporates multimodal brain imaging. To begin, we first categorized participants from the Open Access Series of Imaging Studies (OASIS)-3 cohort into two groups: controls (CN) and individuals with MCI. Next, we computed structure and functional imaging features from all the OASIS data as well as all the UK Biobank data. For resting functional magnetic resonance imaging (fMRI) data, we computed functional network connectivity (FNC) matrices using fully automated spatially constrained independent component analysis. For structural MRI data we computed gray matter (GM) segmentation maps. We then evaluated the similarity between each participant's neuroimaging features from the UK Biobank and the difference in the average of those features between CN individuals and those with MCI, which we refer to as the brain-wide risk score (BRS). Both GM and FNC features were utilized in determining the BRS. We first evaluated the differences in the distribution of the BRS for CN vs MCI within the OASIS-3 (using OASIS-3 as the reference group). Next, we evaluated the BRS in the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort (using OASIS-3 as the reference group), showing that the BRS can differentiate MCI from CN in an independent data set. Subsequently, using the sMRI BRS, we identified 10 distinct subgroups and similarly, we identified another set of 10 subgroups using the FNC BRS. For sMRI and FNC we observed results that mutually validate each other, with certain aspects being complementary. For the unimodal analysis, sMRI provides greater differentiation between MCI and CN individuals than the fMRI data, consistent with prior work. Additionally, by utilizing a multimodal BRS approach, which combines both GM and FNC assessments, we identified two groups of subjects using the multimodal BRS scores. One group exhibits high MCI risk with both negative GM and FNC BRS, while the other shows low MCI risk with both positive GM and FNC BRS. Moreover, in the UKBB we have 46 participants diagnosed with AD showed FNC and GM patterns similar to those in high-risk groups, defined in both unimodal and multimodal BRS. Finally, to ensure the reproducibility of our findings, we conducted a validation analysis using the ADNI as an additional reference dataset and repeated the above analysis. The results were consistently replicated across different reference groups, highlighting the potential of FNC and sMRI-based BRS in early Alzheimer's detection.

An interpretable generative multimodal neuroimaging-genomics framework for decoding Alzheimer's disease.

Alzheimer's disease (AD) is the most prevalent form of dementia, affecting millions worldwide with a progressive decline in cognitive abilities. The AD continuum encompasses a prodormal stage known as Mild Cognitive Impairment (MCI), where patients may either progress to AD (MCIc) or remain stable (MCInc). Understanding the underlying mechanisms of AD requires complementary analysis derived from different data sources, leading to the development of multimodal deep learning models. In this study, we leveraged structural and functional Magnetic Resonance Imaging (sMRI/fMRI) to investigate the disease-induced grey matter and functional network connectivity changes. Moreover, considering AD's strong genetic component, we introduce Single Nucleotide Polymorphisms (SNPs) as a third channel. Given such diverse inputs, missing one or more modalities is a typical concern of multimodal methods. We hence propose a novel deep learning based classification framework where generative module employing Cycle Generative Adversarial Networks (cGAN) was adopted to impute missing data within the latent space. Additionally, we adopted an Explainable Artificial Intelligence (XAI) method, Integrated Gradients (IG), to extract input features relevance, enhancing our understanding of the learned representations. Two critical tasks were addressed: AD detection and MCI conversion prediction. Experimental results showed that our framework was able to reach the state-of-the-art in the classification of CN vs AD reaching an average test accuracy of 0.926 ± 0.02. For the MCInc vs MCIc task, we achieved an average prediction accuracy of 0.711 ± 0.01 using the pre-trained model for CN and AD. The interpretability analysis revealed that the classification performance was led by significant grey matter modulations in cortical and subcortical brain areas well known for their association with AD. Moreover, impairments in sensory-motor and visual resting state network connectivity along the disease continuum, as well as mutations in SNPs defining biological processes linked to amyloid-beta and cholesterol formation clearance and regulation, were identified as contributors to the achieved performance. Overall, our integrative deep learning approach shows promise for AD detection and MCI prediction, while shading light on important biological insights.

Prediction of gender from longitudinal MRI data via deep learning on adolescent data reveals unique patterns associated with brain structure and change over a two-year period.

Deep learning algorithms for predicting neuroimaging data have shown considerable promise in various applications. Prior work has demonstrated that deep learning models that take advantage of the data's 3D structure can outperform standard machine learning on several learning tasks. However, most prior research in this area has focused on neuroimaging data from adults. Within the Adolescent Brain and Cognitive Development (ABCD) dataset, a large longitudinal development study, we examine structural MRI data to predict gender and identify gender-related changes in brain structure. Results demonstrate that gender prediction accuracy is exceptionally high (>97%) with training epochs > 200 and that this accuracy increases with age. Brain regions identified as the most discriminative in the task under study include predominantly frontal areas and the temporal lobe. When evaluating gender predictive changes specific to a two-year increase in age, a broader set of visual, cingulate, and insular regions are revealed. Our findings show a robust gender-related structural brain change pattern, even over a small age range. This suggests that it might be possible to study how the brain changes during adolescence by looking at how these changes are related to different behavioral and environmental factors.

Voxel-wise Fusion of Resting fMRI Networks and Gray Matter Volume for Alzheimer's Disease Classification using Deep Multimodal Learning.

Alzheimer's disease (AD) is a prevalent neurodegenerative disorder requiring accurate and early diagnosis for effective treatment. Resting-state functional magnetic resonance imaging (rs-fMRI) and gray matter volume analysis from structural MRI have emerged as valuable tools for investigating AD-related brain alterations. However, the potential benefits of integrating these modalities using deep learning techniques remain unexplored. In this study, we propose a novel framework that fuses composite images of multiple rs-fMRI networks (called voxelwise intensity projection) and gray matter segmentation images through a deep learning approach for improved AD classification. We demonstrate the superiority of fMRI networks over commonly used metrics such as amplitude of low-frequency fluctuations (ALFF) and fractional ALFF in capturing spatial maps critical for AD classification. We use a multi-channel convolutional neural network incorporating the AlexNet dropout architecture to effectively model spatial and temporal dependencies in the integrated data. Extensive experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset of AD patients and cognitively normal (CN) validate the efficacy of our approach, showcasing improved classification performance of 94.12% test accuracy and an area under the curve (AUC) score of 97.79 compared to existing methods. Our results show that the fusion results generally outperformed the unimodal results. The saliency visualizations also show significant differences in the hippocampus, amygdala, putamen, caudate nucleus, and regions of basal ganglia which are in line with the previous neurobiological literature. Our research offers a novel method to enhance our grasp of AD pathology. By integrating data from various functional networks with structural MRI insights, we significantly improve diagnostic accuracy. This accuracy is further boosted by the effective visualization of this combined information. This lays the groundwork for further studies focused on providing a more accurate and personalized approach to AD diagnosis. The proposed framework and insights gained from fMRI networks provide a promising avenue for future research in deep multimodal fusion and neuroimaging analysis.

Development of digital voice biomarkers and associations with cognition, cerebrospinal biomarkers, and neural representation in early Alzheimer's disease.

Introduction: Advances in natural language processing (NLP), speech recognition, and machine learning (ML) allow the exploration of linguistic and acoustic changes previously difficult to measure. We developed processes for deriving lexical-semantic and acoustic measures as Alzheimer's disease (AD) digital voice biomarkers. Methods: We collected connected speech, neuropsychological, neuroimaging, and cerebrospinal fluid (CSF) AD biomarker data from 92 cognitively unimpaired (40 Aß+) and 114 impaired (63 Aß+) participants. Acoustic and lexical-semantic features were derived from audio recordings using ML approaches. Results: Lexical-semantic (area under the curve [AUC] = 0.80) and acoustic (AUC = 0.77) scores demonstrated higher diagnostic performance for detecting MCI compared to Boston Naming Test (AUC = 0.66). Only lexical-semantic scores detected amyloid-ß status (p = 0.0003). Acoustic scores associated with hippocampal volume (p = 0.017) while lexical-semantic scores associated with CSF amyloid-ß (p = 0.007). Both measures were significantly associated with 2-year disease progression. Discussion: These preliminary findings suggest that derived digital biomarkers may identify cognitive impairment in preclinical and prodromal AD, and may predict disease progression. Highlights: This study derived lexical-semantic and acoustics features as Alzheimer's disease (AD) digital biomarkers.These features were derived from audio recordings using machine learning approaches.Voice biomarkers detected cognitive impairment and amyloid-ß status in early stages of AD.Voice biomarkers may predict Alzheimer's disease progression.These markers significantly mapped to functional connectivity in AD-susceptible brain regions.

MRI-based deep learning can discriminate between temporal lobe epilepsy, Alzheimer's disease, and healthy controls.

BACKGROUND: Radiological identification of temporal lobe epilepsy (TLE) is crucial for diagnosis and treatment planning. TLE neuroimaging abnormalities are pervasive at the group level, but they can be subtle and difficult to identify by visual inspection of individual scans, prompting applications of artificial intelligence (AI) assisted technologies. METHOD: We assessed the ability of a convolutional neural network (CNN) algorithm to classify TLE vs. patients with AD vs. healthy controls using T1-weighted magnetic resonance imaging (MRI) scans. We used feature visualization techniques to identify regions the CNN employed to differentiate disease types. RESULTS: We show the following classification results: healthy control accuracy = 81.54% (SD = 1.77%), precision = 0.81 (SD = 0.02), recall = 0.85 (SD = 0.03), and F1-score = 0.83 (SD = 0.02); TLE accuracy = 90.45% (SD = 1.59%), precision = 0.86 (SD = 0.03), recall = 0.86 (SD = 0.04), and F1-score = 0.85 (SD = 0.04); and AD accuracy = 88.52% (SD = 1.27%), precision = 0.64 (SD = 0.05), recall = 0.53 (SD = 0.07), and F1 score = 0.58 (0.05). The high accuracy in identification of TLE was remarkable, considering that only 47% of the cohort had deemed to be lesional based on MRI alone. Model predictions were also considerably better than random permutation classifications (p < 0.01) and were independent of age effects. CONCLUSIONS: AI (CNN deep learning) can classify and distinguish TLE, underscoring its potential utility for future computer-aided radiological assessments of epilepsy, especially for patients who do not exhibit easily identifiable TLE associated MRI features (e.g., hippocampal sclerosis).

In people with temporal lobe epilepsy, seizures start in a particular part of the brain positioned behind the ears called the temporal lobe. It is difficult for a doctor to detect that a person has temporal lobe epilepsy using brain scans. In this study, we developed a computer model that was able to identify people with temporal lobe epilepsy from scans of their brain. This computer model could be used to help doctors identify temporal lobe epilepsy from brain scans in the future.

Discovery and Replication of Time-Resolved Functional Network Connectivity Differences in Adolescence and Adulthood in over 50K fMRI Datasets.

There remains an open question about whether and in what context brain function varies in adolescence and adulthood. In this work, we systematically study the functional brain networks of adolescents and adults, outlining the significant differences in the developing brain detected via time-resolved functional network connectivity (trFNC) derived from a fully automated independent component analysis pipeline applied to resting-state fMRI data in over 50K individuals. We then statistically analyze the transient, recurrent, and robust brain state profiles in both groups. We confirmed the results in independent replication datasets for both groups. Our findings indicate a strengthening of a state reflecting functional coupling within the visual, motor, and auditory domains and anticorrelation with all other domains in a unique adult state profile, a pattern consistently less modular in adolescents. This new insight into possible integration, strengthening, and modularization of resting-state brain connections beyond childhood convergently indicates that the highlighted temporal dynamics likely reflect robust differences in brain function in adolescents versus adults.

Learning Active Multimodal Subspaces in the Brain.

Here we introduce a multimodal framework to identify subspaces in the human brain that are defined by collective changes in structural and functional measures and are actively linked to demographic, biological and cognitive indicators in a population. We determine the multimodal subspaces using principles of active subspace learning (ASL) and demonstrate its application on a sample learning task (biological ageing) on a schizophrenia dataset. The proposed multimodal ASL method successfully identifies latent brain representations as subsets of brain regions and connections forming covarying subspaces in association with biological age. We show that schizophrenia is characterized by different subspace patterns compared to those in a cognitively normal brain. The multimodal features generated by projecting structural and functional MRI components onto these active subspaces perform better than several PCA-based transformations and equally well when compared to non-transformed features on the studied learning task. In essence, the proposed method successfully learns active brain subspaces associated with a specific brain condition but inferred from the brain imaging data along with the biological/cognitive traits of interest. Clinical relevance- The work introduces a novel way to create multimodal brain biomarkers based on subspaces computed in association with cognitive or biological traits of interest. These subspaces collectively covary maximally in association with a given trait and successfully retain predictive information.