Network enrichment significance testing in brain-phenotype association studies.

Functional networks often guide our interpretation of spatial maps of brain-phenotype associations. However, methods for assessing enrichment of associations within networks of interest have varied in terms of both scientific rigor and underlying assumptions. While some approaches have relied on subjective interpretations, others have made unrealistic assumptions about spatial properties of imaging data, leading to inflated false positive rates. We seek to address this gap in existing methodology by borrowing insight from a method widely used in genetics research for testing enrichment of associations between a set of genes and a phenotype of interest. We propose network enrichment significance testing (NEST), a flexible framework for testing the specificity of brain-phenotype associations to functional networks or other sub-regions of the brain. We apply NEST to study enrichment of associations with structural and functional brain imaging data from a large-scale neurodevelopmental cohort study.

Quantifying and correcting slide-to-slide variation in multiplexed immunofluorescence images.

MOTIVATION: Multiplexed imaging is a nascent single-cell assay with a complex data structure susceptible to technical variability that disrupts inference. These in situ methods are valuable in understanding cell-cell interactions, but few standardized processing steps or normalization techniques of multiplexed imaging data are available. RESULTS: We implement and compare data transformations and normalization algorithms in multiplexed imaging data. Our methods adapt the ComBat and functional data registration methods to remove slide effects in this domain, and we present an evaluation framework to compare the proposed approaches. We present clear slide-to-slide variation in the raw, unadjusted data and show that many of the proposed normalization methods reduce this variation while preserving and improving the biological signal. Furthermore, we find that dividing multiplexed imaging data by its slide mean, and the functional data registration methods, perform the best under our proposed evaluation framework. In summary, this approach provides a foundation for better data quality and evaluation criteria in multiplexed imaging. AVAILABILITY AND IMPLEMENTATION: Source code is provided at: https://github.com/statimagcoll/MultiplexedNormalization and an R package to implement these methods is available here: https://github.com/ColemanRHarris/mxnorm. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

Anterior hippocampal dysfunction in early psychosis: a 2-year follow-up study.

BACKGROUND: Cross-sectional studies indicate that hippocampal function is abnormal across stages of psychosis. Neural theories of psychosis pathophysiology suggest that dysfunction worsens with illness stage. Here, we test the hypothesis that hippocampal function is impaired in the early stage of psychosis and declines further over the next 2 years. METHODS: We measured hippocampal function over 2 years using a scene processing task in 147 participants (76 individuals in the early stage of a non-affective psychotic disorder and 71 demographically similar healthy control individuals). Two-year follow-up was completed in 97 individuals (50 early psychosis, 47 healthy control). Voxelwise longitudinal analysis of activation in response to scenes was carried out within a hippocampal region of interest to test for group differences at baseline and a group by time interaction. RESULTS: At baseline, we observed lower anterior hippocampal activation in the early psychosis group relative to the healthy control group. Contrary to our hypothesis, hippocampal activation remained consistent and did not show the predicted decline over 2 years in the early psychosis group. Healthy controls showed a modest reduction in hippocampal activation after 2 years. CONCLUSIONS: The results of this study suggest that hippocampal dysfunction in early psychosis does not worsen over 2 years and highlight the need for longer-term longitudinal studies.

Clinical hypnosis can reduce lower urinary tract symptoms in individuals with chronic pain.

STUDY PURPOSE: Lower urinary tract symptoms (LUTS) can occur in chronic pain populations at high rates and drastically affect quality of life. Hypnosis is a nonpharmacological treatment used in chronic pain known to have beneficial implications to health outside of pain reduction. This study evaluated the potential for hypnosis to reduce LUTS in a sample of individuals with chronic pain, if baseline LUTS severity affected outcomes, and specific LUTS that may respond to hypnosis. METHODS: Sixty-four adults with chronic pain and LUTS at a level of detectable symptom change (American Urological Association Symptom Index, AUASI 3) participated in an 8-week group hypnosis protocol. Participants completed validated assessments of LUTS, pain, and overall functioning before, after, 3- and 6-months posttreatment. Linear mixed effects models assessed improvement in LUTS over time while accounting for known factors associated with outcome (e.g., age, gender). The interaction of baseline symptom severity and treatment assessed the potential effect of baseline symptoms on change scores. RESULTS: Participants experienced significant and meaningful improvements in LUTS following group hypnosis (p = 0.006). There was a significant interaction between baseline symptom severity and treatment (p < 0.001), such that those with severe symptoms experienced the most pronounced gains over time (e.g., an 8.8 point reduction). Gains increased over time for those with moderate and severe symptoms. Changes in LUT symptoms occurred independently of pain relief. CONCLUSIONS: This pilot study suggests hypnosis has the potential to drastically improve LUTS in individuals with chronic pain, even when pain reduction does not occur. Results provide initial evidence for the treatment potential of hypnosis in urologic pain (and possibly non-pain/benign) populations, with randomized trials needed for definitive outcomes.

Imaging local genetic influences on cortical folding.

Recent progress in deciphering mechanisms of human brain cortical folding leave unexplained whether spatially patterned genetic influences contribute to this folding. High-resolution in vivo brain MRI can be used to estimate genetic correlations (covariability due to shared genetic factors) in interregional cortical thickness, and biomechanical studies predict an influence of cortical thickness on folding patterns. However, progress has been hampered because shared genetic influences related to folding patterns likely operate at a scale that is much more local (<1 cm) than that addressed in prior imaging studies. Here, we develop methodological approaches to examine local genetic influences on cortical thickness and apply these methods to two large, independent samples. We find that such influences are markedly heterogeneous in strength, and in some cortical areas are notably stronger in specific orientations relative to gyri or sulci. The overall, phenotypic local correlation has a significant basis in shared genetic factors and is highly symmetric between left and right cortical hemispheres. Furthermore, the degree of local cortical folding relates systematically with the strength of local correlations, which tends to be higher in gyral crests and lower in sulcal fundi. The relationship between folding and local correlations is stronger in primary sensorimotor areas and weaker in association areas such as prefrontal cortex, consistent with reduced genetic constraints on the structural topology of association cortex. Collectively, our results suggest that patterned genetic influences on cortical thickness, measurable at the scale of in vivo MRI, may be a causal factor in the development of cortical folding.

Spatially-enhanced clusterwise inference for testing and localizing intermodal correspondence.

With the increasing availability of neuroimaging data from multiple modalities-each providing a different lens through which to study brain structure or function-new techniques for comparing, integrating, and interpreting information within and across modalities have emerged. Recent developments include hypothesis tests of associations between neuroimaging modalities, which can be used to determine the statistical significance of intermodal associations either throughout the entire brain or within anatomical subregions or functional networks. While these methods provide a crucial foundation for inference on intermodal relationships, they cannot be used to answer questions about where in the brain these associations are most pronounced. In this paper, we introduce a new method, called CLEAN-R, that can be used both to test intermodal correspondence throughout the brain and also to localize this correspondence. Our method involves first adjusting for the underlying spatial autocorrelation structure within each modality before aggregating information within small clusters to construct a map of enhanced test statistics. Using structural and functional magnetic resonance imaging data from a subsample of children and adolescents from the Philadelphia Neurodevelopmental Cohort, we conduct simulations and data analyses where we illustrate the high statistical power and nominal type I error levels of our method. By constructing an interpretable map of group-level correspondence using spatially-enhanced test statistics, our method offers insights beyond those provided by earlier methods.

Longitudinal Development of Brain Iron Is Linked to Cognition in Youth.

Brain iron is vital to multiple aspects of brain function, including oxidative metabolism, myelination, and neurotransmitter synthesis. Atypical iron concentration in the basal ganglia is associated with neurodegenerative disorders in aging and cognitive deficits. However, the normative development of brain iron concentration in adolescence and its relationship to cognition are less well understood. Here, we address this gap in a longitudinal sample of 922 humans aged 8-26 years at the first visit (M = 15.1, SD = 3.72; 336 males, 486 females) with up to four multiecho T2* scans each. Using this sample of 1236 imaging sessions, we assessed the longitudinal developmental trajectories of tissue iron in the basal ganglia. We quantified tissue iron concentration using R2* relaxometry within four basal ganglia regions, including the caudate, putamen, nucleus accumbens, and globus pallidus. The longitudinal development of R2* was modeled using generalized additive mixed models (GAMMs) with splines to capture linear and nonlinear developmental processes. We observed significant increases in R2* across all regions, with the greatest and most prolonged increases occurring in the globus pallidus and putamen. Further, we found that the developmental trajectory of R2* in the putamen is significantly related to individual differences in cognitive ability, such that greater cognitive ability is increasingly associated with greater iron concentration through late adolescence and young-adulthood. Together, our results suggest a prolonged period of basal ganglia iron enrichment that extends into the mid-twenties, with diminished iron concentration associated with poorer cognitive ability during late adolescence.SIGNIFICANCE STATEMENT Brain tissue iron is essential to healthy brain function. Atypical basal ganglia tissue iron levels have been linked to impaired cognition in iron deficient children and adults with neurodegenerative disorders. However, the normative developmental trajectory of basal ganglia iron concentration during adolescence and its association with cognition are less well understood. In the largest study of tissue iron development yet reported, we characterize the developmental trajectory of tissue iron concentration across the basal ganglia during adolescence and provide evidence that diminished iron content is associated with poorer cognitive performance even in healthy youth. These results highlight the transition from adolescence to adulthood as a period of dynamic maturation of tissue iron concentration in the basal ganglia.

Improving the replicability of neuroimaging findings by thresholding effect sizes instead of p-values.

The classical approach for testing statistical images using spatial extent inference (SEI) thresholds the statistical image based on the p-value. This approach has an unfortunate consequence on the replicability of neuroimaging findings because the targeted brain regions are affected by the sample size-larger studies have more power to detect smaller effects. Here, we use simulations based on the preprocessed Autism Brain Imaging Data Exchange (ABIDE) to show that thresholding statistical images by effect sizes has more consistent estimates of activated regions across studies than thresholding by p-values. Using a constant effect size threshold means that the p-value threshold naturally scales with the sample size to ensure that the target set is similar across repetitions of the study that use different sample sizes. As a consequence of thresholding by the effect size, the type 1 and type 2 error rates go to zero as the sample size gets larger. We use a newly proposed robust effect size index that is defined for an arbitrary statistical image so that effect size thresholding can be used regardless of the test statistic or model.

A simple permutation-based test of intermodal correspondence.

Many key findings in neuroimaging studies involve similarities between brain maps, but statistical methods used to measure these findings have varied. Current state-of-the-art methods involve comparing observed group-level brain maps (after averaging intensities at each image location across multiple subjects) against spatial null models of these group-level maps. However, these methods typically make strong and potentially unrealistic statistical assumptions, such as covariance stationarity. To address these issues, in this article we propose using subject-level data and a classical permutation testing framework to test and assess similarities between brain maps. Our method is comparable to traditional permutation tests in that it involves randomly permuting subjects to generate a null distribution of intermodal correspondence statistics, which we compare to an observed statistic to estimate a p-value. We apply and compare our method in simulated and real neuroimaging data from the Philadelphia Neurodevelopmental Cohort. We show that our method performs well for detecting relationships between modalities known to be strongly related (cortical thickness and sulcal depth), and it is conservative when an association would not be expected (cortical thickness and activation on the n-back working memory task). Notably, our method is the most flexible and reliable for localizing intermodal relationships within subregions of the brain and allows for generalizable statistical inference.

Electronic Delivery of Pain Education for Chronic Overlapping Pain Conditions: A Prospective Cohort Study.

OBJECTIVE: To examine the impact of educational materials for chronic overlapping pain conditions (COPCs), the feasibility of delivering materials online, and to explore its impact on self-reported self-management applications at 3-month follow-up. DESIGN: Prospective cohort study. SETTING: Online. SUBJECTS: Individuals from a university-wide active research repository with ≥1 coded diagnostic COPC by ICD-9/10 in the medical record. METHODS: We determined the number of COPCs per participant as indicated by diagnostic codes in the medical record. Consenting participants completed self-report questionnaires and read educational materials. We assessed content awareness and knowledge pre- and post-exposure to education. Comprehension was assessed via embedded questions in reading materials in real time. Participants then completed assessments regarding concept retention, self-management engagement, and pain-related symptoms at 3-months. RESULTS: N = 216 individuals enrolled, with 181 (84%) completing both timepoints. Results indicated that participants understood materials. Knowledge and understanding of COPCs increased significantly after education and was retained at 3-months. Patient characteristics suggested the number of diagnosed COPCs was inversely related to age. Symptoms or self-management application did not change significantly over the 3-month period. CONCLUSIONS: The educational materials facilitated teaching of key pain concepts in self-management programs, which translated easily into an electronic format. Education alone may not elicit self-management engagement or symptom reduction in this population; however, conclusions are limited by the study's uncontrolled design. Education is likely an important and meaningful first step in comprehensive COPC self-management.

Faster family-wise error control for neuroimaging with a parametric bootstrap.

In neuroimaging, hundreds to hundreds of thousands of tests are performed across a set of brain regions or all locations in an image. Recent studies have shown that the most common family-wise error (FWE) controlling procedures in imaging, which rely on classical mathematical inequalities or Gaussian random field theory, yield FWE rates (FWER) that are far from the nominal level. Depending on the approach used, the FWER can be exceedingly small or grossly inflated. Given the widespread use of neuroimaging as a tool for understanding neurological and psychiatric disorders, it is imperative that reliable multiple testing procedures are available. To our knowledge, only permutation joint testing procedures have been shown to reliably control the FWER at the nominal level. However, these procedures are computationally intensive due to the increasingly available large sample sizes and dimensionality of the images, and analyses can take days to complete. Here, we develop a parametric bootstrap joint testing procedure. The parametric bootstrap procedure works directly with the test statistics, which leads to much faster estimation of adjusted p-values than resampling-based procedures while reliably controlling the FWER in sample sizes available in many neuroimaging studies. We demonstrate that the procedure controls the FWER in finite samples using simulations, and present region- and voxel-wise analyses to test for sex differences in developmental trajectories of cerebral blood flow.

Robust spatial extent inference with a semiparametric bootstrap joint inference procedure.

Spatial extent inference (SEI) is widely used across neuroimaging modalities to adjust for multiple comparisons when studying brain-phenotype associations that inform our understanding of disease. Recent studies have shown that Gaussian random field (GRF)-based tools can have inflated family-wise error rates (FWERs). This has led to substantial controversy as to which processing choices are necessary to control the FWER using GRF-based SEI. The failure of GRF-based methods is due to unrealistic assumptions about the spatial covariance function of the imaging data. A permutation procedure is the most robust SEI tool because it estimates the spatial covariance function from the imaging data. However, the permutation procedure can fail because its assumption of exchangeability is violated in many imaging modalities. Here, we propose the (semi-) parametric bootstrap joint (PBJ; sPBJ) testing procedures that are designed for SEI of multilevel imaging data. The sPBJ procedure uses a robust estimate of the spatial covariance function, which yields consistent estimates of standard errors, even if the covariance model is misspecified. We use the methods to study the association between performance and executive functioning in a working memory functional magnetic resonance imaging study. The sPBJ has similar or greater power to the PBJ and permutation procedures while maintaining the nominal type 1 error rate in reasonable sample sizes. We provide an R package to perform inference using the PBJ and sPBJ procedures.

On testing for spatial correspondence between maps of human brain structure and function.

A critical issue in many neuroimaging studies is the comparison between brain maps. Nonetheless, it remains unclear how one should test hypotheses focused on the overlap or spatial correspondence between two or more brain maps. This "correspondence problem" affects, for example, the interpretation of comparisons between task-based patterns of functional activation, resting-state networks or modules, and neuroanatomical landmarks. To date, this problem has been addressed with remarkable variability in terms of methodological approaches and statistical rigor. In this paper, we address the correspondence problem using a spatial permutation framework to generate null models of overlap by applying random rotations to spherical representations of the cortical surface, an approach for which we also provide a theoretical statistical foundation. We use this method to derive clusters of cognitive functions that are correlated in terms of their functional neuroatomical substrates. In addition, using publicly available data, we formally demonstrate the correspondence between maps of task-based functional activity, resting-state fMRI networks and gyral-based anatomical landmarks. We provide open-access code to implement the methods presented for two commonly-used tools for surface based cortical analysis (https://www.github.com/spin-test). This spatial permutation approach constitutes a useful advance over widely-used methods for the comparison of cortical maps, thereby opening new possibilities for the integration of diverse neuroimaging data.

Fully Bayesian spectral methods for imaging data.

Medical imaging data with thousands of spatially correlated data points are common in many fields. Methods that account for spatial correlation often require cumbersome matrix evaluations which are prohibitive for data of this size, and thus current work has either used low-rank approximations or analyzed data in blocks. We propose a method that accounts for nonstationarity, functional connectivity of distant regions of interest, and local signals, and can be applied to large multi-subject datasets using spectral methods combined with Markov Chain Monte Carlo sampling. We illustrate using simulated data that properly accounting for spatial dependence improves precision of estimates and yields valid statistical inference. We apply the new approach to study associations between cortical thickness and Alzheimer's disease, and find several regions of the cortex where patients with Alzheimer's disease are thinner on average than healthy controls.

Impact of puberty on the evolution of cerebral perfusion during adolescence.

Puberty is the defining biological process of adolescent development, yet its effects on fundamental properties of brain physiology such as cerebral blood flow (CBF) have never been investigated. Capitalizing on a sample of 922 youths ages 8-22 y imaged using arterial spin labeled MRI as part of the Philadelphia Neurodevelopmental Cohort, we studied normative developmental differences in cerebral perfusion in males and females, as well as specific associations between puberty and CBF. Males and females had conspicuously divergent nonlinear trajectories in CBF evolution with development as modeled by penalized splines. Seventeen brain regions, including hubs of the executive and default mode networks, showed a robust nonlinear age-by-sex interaction that surpassed Bonferroni correction. Notably, within these regions the decline in CBF was similar between males and females in early puberty and only diverged in midpuberty, with CBF actually increasing in females. Taken together, these results delineate sex-specific growth curves for CBF during youth and for the first time to our knowledge link such differential patterns of development to the effects of puberty.

Topologically dissociable patterns of development of the human cerebral cortex.

Over 90 years ago, anatomists noted the cortex is thinner in sulci than gyri, suggesting that development may occur on a fine scale driven by local topology. However, studies of brain development in youth have focused on describing how cortical thickness varies over large-scale functional and anatomic regions. How the relationship between thickness and local sulcal topology arises in development is still not well understood. Here, we investigated the spatial relationships between cortical thickness, folding, and underlying white matter organization to elucidate the influence of local topology on human brain development. Our approach included using both T1-weighted imaging and diffusion tensor imaging (DTI) in a cross-sectional sample of 932 youths ages 8-21 studied as part of the Philadelphia Neurodevelopmental Cohort. Principal components analysis revealed separable development-related processes of regionally specific nonlinear cortical thickening (from ages 8-14) and widespread linear cortical thinning that have dissociable relationships with cortical topology. Whereas cortical thinning was most prominent in the depths of the sulci, early cortical thickening was present on the gyri. Furthermore, decline in mean diffusivity calculated from DTI in underlying white matter was correlated with cortical thinning, suggesting that cortical thinning is spatially associated with white matter development. Spatial permutation tests were used to assess the significance of these relationships. Together, these data demonstrate that cortical remodeling during youth occurs on a local topological scale and is associated with changes in white matter beneath the cortical surface.

Subject-level measurement of local cortical coupling.

The human cortex is highly folded to allow for a massive expansion of surface area. Notably, the thickness of the cortex strongly depends on cortical topology, with gyral cortex sometimes twice as thick as sulcal cortex. We recently demonstrated that global differences in thickness between gyral and sulcal cortex continue to evolve throughout adolescence. However, human cortical development is spatially heterogeneous, and global comparisons lack power to detect localized differences in development or psychopathology. Here we extend previous work by proposing a new measure - local cortical coupling - that is sensitive to differences in the localized topological relationship between cortical thickness and sulcal depth. After estimation, subject-level coupling maps can be analyzed using standard neuroimaging analysis tools. Capitalizing on a large cross-sectional sample (n=932) of youth imaged as part of the Philadelphia Neurodevelopmental Cohort, we demonstrate that local coupling is spatially heterogeneous and exhibits nonlinear development-related trajectories. Moreover, we uncover sex differences in coupling that indicate divergent patterns of cortical topology. Developmental changes and sex differences in coupling support its potential as a neuroimaging phenotype for investigating neuropsychiatric disorders that are increasingly conceptualized as disorders of brain development. R code to estimate subject-level coupling maps from any two cortical surfaces generated by FreeSurfer is made publicly available along with this manuscript.

The impact of quality assurance assessment on diffusion tensor imaging outcomes in a large-scale population-based cohort.

BACKGROUND: Diffusion tensor imaging (DTI) is applied in investigation of brain biomarkers for neurodevelopmental and neurodegenerative disorders. However, the quality of DTI measurements, like other neuroimaging techniques, is susceptible to several confounding factors (e.g., motion, eddy currents), which have only recently come under scrutiny. These confounds are especially relevant in adolescent samples where data quality may be compromised in ways that confound interpretation of maturation parameters. The current study aims to leverage DTI data from the Philadelphia Neurodevelopmental Cohort (PNC), a sample of 1601 youths with ages of 8-21 who underwent neuroimaging, to: 1) establish quality assurance (QA) metrics for the automatic identification of poor DTI image quality; 2) examine the performance of these QA measures in an external validation sample; 3) document the influence of data quality on developmental patterns of typical DTI metrics. METHODS: All diffusion-weighted images were acquired on the same scanner. Visual QA was performed on all subjects completing DTI; images were manually categorized as Poor, Good, or Excellent. Four image quality metrics were automatically computed and used to predict manual QA status: Mean voxel intensity outlier count (MEANVOX), Maximum voxel intensity outlier count (MAXVOX), mean relative motion (MOTION) and temporal signal-to-noise ratio (TSNR). Classification accuracy for each metric was calculated as the area under the receiver-operating characteristic curve (AUC). A threshold was generated for each measure that best differentiated visual QA status and applied in a validation sample. The effects of data quality on sensitivity to expected age effects in this developmental sample were then investigated using the traditional MRI diffusion metrics: fractional anisotropy (FA) and mean diffusivity (MD). Finally, our method of QA is compared with DTIPrep. RESULTS: TSNR (AUC=0.94) best differentiated Poor data from Good and Excellent data. MAXVOX (AUC=0.88) best differentiated Good from Excellent DTI data. At the optimal threshold, 88% of Poor data and 91% Good/Excellent data were correctly identified. Use of these thresholds on a validation dataset (n=374) indicated high accuracy. In the validation sample 83% of Poor data and 94% of Excellent data was identified using thresholds derived from the training sample. Both FA and MD were affected by the inclusion of poor data in an analysis of an age, sex and race matched comparison sample. In addition, we show that the inclusion of poor data results in significant attenuation of the correlation between diffusion metrics (FA and MD) and age during a critical neurodevelopmental period. We find higher correspondence between our QA method and DTIPrep for Poor data, but we find our method to be more robust for apparently high-quality images. CONCLUSION: Automated QA of DTI can facilitate large-scale, high-throughput quality assurance by reliably identifying both scanner and subject induced imaging artifacts. The results present a practical example of the confounding effects of artifacts on DTI analysis in a large population-based sample, and suggest that estimates of data quality should not only be reported but also accounted for in data analysis, especially in studies of development.

Smaller anterior hippocampal subfields in the early stage of psychosis.

Hippocampal volume is smaller in schizophrenia, but it is unclear when in the illness the changes appear and whether specific regions (anterior, posterior) and subfields (CA1, CA2/3, dentate gyrus, subiculum) are affected. Here, we used a high-resolution T2-weighted sequence specialized for imaging hippocampal subfields to test the hypothesis that anterior CA1 volume is lower in early psychosis. We measured subfield volumes across hippocampal regions in a group of 90 individuals in the early stage of a non-affective psychotic disorder and 70 demographically similar healthy individuals. We observed smaller volume in the anterior CA1 and dentate gyrus subfields in the early psychosis group. Our findings support models that implicate anterior CA1 and dentate gyrus subfield deficits in the mechanism of psychosis.