ENIGMA's simple seven: Recommendations to enhance the reproducibility of resting-state fMRI in traumatic brain injury.

Resting state functional magnetic resonance imaging (rsfMRI) provides researchers and clinicians with a powerful tool to examine functional connectivity across large-scale brain networks, with ever-increasing applications to the study of neurological disorders, such as traumatic brain injury (TBI). While rsfMRI holds unparalleled promise in systems neurosciences, its acquisition and analytical methodology across research groups is variable, resulting in a literature that is challenging to integrate and interpret. The focus of this narrative review is to address the primary methodological issues including investigator decision points in the application of rsfMRI to study the consequences of TBI. As part of the ENIGMA Brain Injury working group, we have collaborated to identify a minimum set of recommendations that are designed to produce results that are reliable, harmonizable, and reproducible for the TBI imaging research community. Part one of this review provides the results of a literature search of current rsfMRI studies of TBI, highlighting key design considerations and data processing pipelines. Part two outlines seven data acquisition, processing, and analysis recommendations with the goal of maximizing study reliability and between-site comparability, while preserving investigator autonomy. Part three summarizes new directions and opportunities for future rsfMRI studies in TBI patients. The goal is to galvanize the TBI community to gain consensus for a set of rigorous and reproducible methods, and to increase analytical transparency and data sharing to address the reproducibility crisis in the field.

Subjective valuation of performance feedback is robust to trait cognitive fatigue in multiple sclerosis.

BACKGROUND: Performance feedback is vital to rehabilitation interventions that treat cognitive impairments from multiple sclerosis (MS). Optimal treatment relies on participants' motivation to learn from feedback throughout these interventions. Cognitive fatigue, a prevalent symptom of MS, is associated with aberrant reward processing, which necessitates research into how fatigue affects perceived reward value of feedback in these individuals. The current study investigated how trait fatigue influences subjective valuation of feedback and subsequent feedback-seeking behavior in people with MS. METHODS: 33 MS and 32 neurotypical (NT) participants completed a willingness-to-pay associative memory paradigm that assessed feedback valuation via trial-by-trial decisions to either purchase or forego feedback in service of maximizing a performance-contingent monetary reward. Participant ratings of trait fatigue were also collected. Generalized logistic mixed modeling was used to analyze factors that influenced trial-wise feedback purchase decisions and task performance. RESULTS: Despite reporting greater trait fatigue, MS participants purchased comparable amounts of feedback as NT participants. Like NT participants, MS participants were more likely to purchase feedback when they were less confident about response accuracy. MS participants also performed comparably to NT participants, who both particularly benefited from purchase decisions that yielded negative feedback (i.e., indicating a response error). CONCLUSIONS: Trait cognitive fatigue may not impact performance feedback valuation in people with MS. Nonetheless, confidence in performance may drive their feedback-seeking behavior and may serve as a target for improving learning throughout cognitive rehabilitation and maximizing treatment success.

Bridging Big Data: Procedures for Combining Non-equivalent Cognitive Measures from the ENIGMA Consortium.

Investigators in neuroscience have turned to Big Data to address replication and reliability issues by increasing sample sizes, statistical power, and representativeness of data. These efforts unveil new questions about integrating data arising from distinct sources and instruments. We focus on the most frequently assessed cognitive domain - memory testing - and demonstrate a process for reliable data harmonization across three common measures. We aggregated global raw data from 53 studies totaling N = 10,505 individuals. A mega-analysis was conducted using empirical bayes harmonization to remove site effects, followed by linear models adjusting for common covariates. A continuous item response theory (IRT) model estimated each individual's latent verbal learning ability while accounting for item difficulties. Harmonization significantly reduced inter-site variance while preserving covariate effects, and our conversion tool is freely available online. This demonstrates that large-scale data sharing and harmonization initiatives can address reproducibility and integration challenges across the behavioral sciences.

ALFF response interaction with learning during feedback in individuals with multiple sclerosis.

Amplitude of low-frequency fluctuations (ALFF) is defined as changes of BOLD signal during resting state (RS) brain activity. Previous studies identified differences in RS activation between healthy and multiple sclerosis (MS) participants. However, no research has investigated the relationship between ALFF and learning in MS. We thus examine this here. Twenty-five MS and nineteen healthy participants performed a paired-associate word learning task where participants were presented with extrinsic or intrinsic performance feedback. Compared to healthy participants, MS participants showed higher local brain activation in the right thalamus. We also observed a positive correlation in the MS group between ALFF and extrinsic feedback within the left inferior frontal gyrus, and within the left superior temporal gyrus in association with intrinsic feedback. Healthy participants showed a positive correlation in the right fusiform gyrus between ALFF and extrinsic feedback. Findings suggest that while MS participants do not show a feedback learning impairment compared to the healthy participants, ALFF differences might suggest a general maladaptive pattern of task unrelated thalamic activation and adaptive activation in frontal and temporal regions. Results indicate that ALFF can be successfully used at capturing pathophysiological changes in local brain activation in MS in association with learning through feedback.

Altered functional connectivity during performance feedback processing in multiple sclerosis.

Effective learning from performance feedback is vital for adaptive behavior regulation necessary for successful cognitive performance. Yet, how this learning operates in clinical groups that experience cognitive dysfunction is not well understood. Multiple sclerosis (MS) is an autoimmune, degenerative disease of the central nervous system characterized by physical and cognitive dysfunction. A highly prevalent impairment in MS is cognitive fatigue (CF). CF is associated with altered functioning within cortico-striatal regions that also facilitate feedback-based learning in neurotypical (NT) individuals. Despite this cortico-striatal overlap, research about feedback-based learning in MS, its associated neural underpinnings, and its sensitivity to CF, are all lacking. The present study investigated feedback-based learning ability in MS, as well as associated cortico-striatal function and connectivity. MS and NT participants completed a functional magnetic resonance imaging (fMRI) paired-word association task during which they received trial-by-trial monetary, non-monetary, and uninformative performance feedback. Despite reporting greater CF throughout the task, MS participants displayed comparable task performance to NTs, suggesting preserved feedback-based learning ability in the MS group. Both groups recruited the ventral striatum (VS), caudate nucleus, and ventromedial prefrontal cortex in response to the receipt of performance feedback, suggesting that people with MS also recruit cortico-striatal regions during feedback-based learning. However, compared to NT participants, MS participants also displayed stronger functional connectivity between the VS and task-relevant regions, including the left angular gyrus and right superior temporal gyrus, in response to feedback receipt. Results indicate that CF may not interfere with feedback-based learning in MS. Nonetheless, people with MS may recruit alternative connections with the striatum to assist with this form of learning. These findings have implications for cognitive rehabilitation treatments that incorporate performance feedback to remediate cognitive dysfunction in clinical populations.

Kessler Foundation Strategy-Based Training to Enhance Memory (KF-STEM™): Study protocol for a single site double-blind randomized, clinical trial in Multiple Sclerosis.

New learning and memory impairments are common in Multiple Sclerosis (MS) and negatively impact everyday life, including occupational and social functioning. Despite the demand for learning and memory treatments, few cognitive rehabilitation protocols are supported by Class I research evidence, limiting the degree to which effective treatments may be utilized with persons with MS. The present double-blind, placebo controlled randomized clinical trial (RCT) examines the efficacy of an 8-session cognitive rehabilitation protocol encompassing training in the application of three strategies with the strongest empirical evidence (self-generation, spaced learning and retrieval practice) to treat impaired learning and memory in persons with MS, Kessler Foundation Strategy-based Training to Enhance Memory (KF-STEM™). A sample of 120 participants with clinically definite MS who have impairments in new learning and memory will be enrolled. Outcomes will be assessed via three mechanisms, an Assessment of Global Functioning, which examines everyday functioning and quality of life, a Neuropsychological Evaluation to examine objective cognitive performance, and functional Magnetic Resonance Imaging to examine the impact of treatment on patterns of cerebral activation. We will additionally evaluate the longer-term efficacy of KF-STEM™ on everyday functioning and neuropsychological assessment through a 6-month follow-up evaluation and evaluate the impact of booster sessions in maintaining the treatment effect over time. The methodologically rigorous design of the current study will provide Class I evidence for the KF-STEM™ treatment protocol for persons with MS.

Reward enhances connectivity between the ventral striatum and the default mode network.

The default mode network (DMN) has been theorized to participate in a range of social, cognitive, and affective functions. Yet, previous accounts do not consider how the DMN contributes to other brain regions depending on psychological context, thus rendering our understanding of DMN function incomplete. We addressed this gap by applying a novel network-based psychophysiological interaction (nPPI) analysis to the reward task within the Human Connectome Project. We first focused on the task-evoked responses of the DMN and other networks involving the prefrontal cortex, including the executive control network (salience network) and the left and right frontoparietal networks. Consistent with a host of prior studies, the DMN exhibited a relative decrease in activation during the task, while the other networks exhibited a relative increase during the task. Next, we used nPPI analyses to assess whether these networks exhibit task-dependent changes in connectivity with other brain regions. Strikingly, we found that the experience of reward enhances task-dependent connectivity between the DMN and the ventral striatum, an effect that was specific to the DMN. Surprisingly, the strength of DMN-VS connectivity was correlated with personality characteristics relating to openness. Taken together, these results advance models of DMN by demonstrating how it contributes to other brain systems during task performance and how those contributions relate to individual differences.

Ex-Gaussian analysis of simple response time as a measure of information processing speed and the relationship with brain morphometry in multiple sclerosis.

BACKGROUND: The polyfactorial nature of the widely used symbol digit modalities test (SDMT) introduces significant measurement challenges in characterizing information processing speed (IPS) deficits in multiple sclerosis (MS). Measures with high psychometric IPS-specificity and less contamination from other cognitive domains are necessary to fully understand IPS changes. OBJECTIVE: Investigate how three mathematical modeling ex-Gaussian parameter estimates (mu, sigma, tau) derived from a simple response time (RT) task (1) differentiate MS from healthy control participants and (2) correspond to structural brain changes, to evaluate a novel IPS measurement approach. METHODS: Persons with and without MS completed a two-minute behavioral simple RT task, structural MRI and the MS functional composite. RT distributions were deconvolved into ex-Gaussian parameter estimates using mathematical modeling. Group differences and brain-behavior relationships were statistically evaluated. RESULTS: Persons with MS experienced a general pattern of slowing as evidenced by a shift in the Gaussian (mu) component of the distribution. This correlated with whole brain volume and white matter specifically. Additionally, persons with MS had larger values of tau (elongated positively skewed tail) that may reflect attentional lapses. CONCLUSION: The ex-Gaussian approach is sensitive to disease-related IPS changes and provides nuanced information about IPS slowing in MS.

Neural correlates of extrinsic and intrinsic outcome processing during learning in individuals with TBI: a pilot investigation.

Outcome processing, the ability to learn from feedback, is an important component of adaptive behavior and rehabilitation. Evidence from healthy adults implicates the striatum and dopamine in outcome processing. Animal research shows that damage to dopaminergic pathways in the brain can lead to a disruption of dopamine tone and transmission. Such evidence thus suggests that persons with TBI experience deficits in outcome processing. However, no research has directly investigated outcome processing and associated neural mechanisms in TBI. Here, we examine outcome processing in individuals with TBI during learning. Given that TBI negatively impacts striatal and dopaminergic systems, we hypothesize that individuals with TBI exhibit deficits in learning from outcomes. To test this hypothesis, individuals with moderate-to-severe TBI and healthy adults were presented with a declarative paired-associate word learning task. Outcomes indicating performance accuracy were presented immediately during task performance and in the form of either monetary or performance-based feedback. Two types of feedback provided the opportunity to test whether extrinsic and intrinsic motivational aspects of outcome presentation play a role during learning and outcome processing. Our results show that individuals with TBI exhibited impaired learning from feedback compared to healthy participants. Additionally, individuals with TBI exhibited increased activation in the striatum during outcome processing. The results of this study suggest that outcome processing and learning from immediate outcomes is impaired in individuals with TBI and might be related to inefficient use of neural resources during task performance as reflected by increased activation of the striatum.

Modulation of Metacognitive Confidence Judgments Through Provision of Performance Feedback in Moderate to Severe Traumatic Brain Injury.

OBJECTIVE: Traumatic brain injury (TBI) may result in metacognitive impairments. Enhancing memory in healthy adults can improve metacognitive accuracy, but it is unclear whether such interventions apply to individuals with TBI. This study examined the effects of manipulating target memory experiences on metacognitive accuracy in TBI. PARTICIPANTS: Fourteen community-dwelling adults with TBI and 17 healthy controls. MAIN MEASURES: Memory was manipulated through performance feedback (monetary, nonmonetary, or none) presented during a word-pair learning task. Recognition of the word pairs was assessed, and metacognition was evaluated by retrospective confidence judgments. RESULTS: Both groups demonstrated greater recognition performance for items learned with nonmonetary feedback. Healthy individuals demonstrated improved metacognitive accuracy for items learned with nonmonetary feedback, but this effect was not seen in individuals with TBI. A notable (but statistically nonsignificant) effect was observed whereby adults with TBI overestimated performance for items learned with monetary feedback compared with other feedback conditions. CONCLUSION: Provision of feedback during learning enhances recognition performance. However, target memory experiences may be utilized differently after injury to facilitate confidence judgments. In addition, the type of feedback provided may have different effects on metacognitive accuracy. These results have implications for rehabilitative efforts in the area of memory and metacognition after injury.

Global hippocampal and selective thalamic nuclei atrophy differentiate chronic TBI from Non-TBI.

Traumatic brain injury (TBI) may increase susceptibility to neurodegenerative diseases later in life. One neurobiological parallel between chronic TBI and neurodegeneration may be accelerated aging and the nature of atrophy across subcortical gray matter structures. The main aim of the present investigation is to evaluate and rank the degree that subcortical gray matter atrophy differentiates chronic moderate-severe TBI from non-TBI participants by evaluating morphometric differences between groups. Forty individuals with moderate-severe chronic TBI (9.23 yrs from injury) and 33 healthy controls (HC) underwent high resolution 3D T1-weighted structural magnetic resonance imaging. Whole brain volume was classified into white matter, cortical and subcortical gray matter structures with hippocampi and thalami further segmented into subfields and nuclei, respectively. Extensive atrophy was observed across nearly all brain regions for chronic TBI participants. A series of multivariate logistic regression models identified subcortical gray matter structures of the hippocampus and thalamus as the most sensitive to differentiating chronic TBI from non-TBI participants (McFadden R2 = .36, p < .001). Further analyses revealed the pattern of hippocampal atrophy to be global, occurring across nearly all subfields. The pattern of thalamic atrophy appeared to be much more selective and non-uniform, with largest between-group differences evident for nuclei bordering the ventricles. Subcortical gray matter was negatively correlated with time since injury (r = -.31, p = .054), while white matter and cortical gray matter were not. Cognitive ability was lower in the chronic TBI group (Cohen's d = .97, p = .003) and correlated with subcortical structures including the pallidum (r2 = .23, p = .038), thalamus (r2 = .36, p = .007) and ventral diencephalon (r2 = .23, p = .036). These data may support an accelerated aging hypothesis in chronic moderate-severe TBI that coincides with a similar neuropathological profile found in neurodegenerative diseases.

Toward a global and reproducible science for brain imaging in neurotrauma: the ENIGMA adult moderate/severe traumatic brain injury working group.

The global burden of mortality and morbidity caused by traumatic brain injury (TBI) is significant, and the heterogeneity of TBI patients and the relatively small sample sizes of most current neuroimaging studies is a major challenge for scientific advances and clinical translation. The ENIGMA (Enhancing NeuroImaging Genetics through Meta-Analysis) Adult moderate/severe TBI (AMS-TBI) working group aims to be a driving force for new discoveries in AMS-TBI by providing researchers world-wide with an effective framework and platform for large-scale cross-border collaboration and data sharing. Based on the principles of transparency, rigor, reproducibility and collaboration, we will facilitate the development and dissemination of multiscale and big data analysis pipelines for harmonized analyses in AMS-TBI using structural and functional neuroimaging in combination with non-imaging biomarkers, genetics, as well as clinical and behavioral measures. Ultimately, we will offer investigators an unprecedented opportunity to test important hypotheses about recovery and morbidity in AMS-TBI by taking advantage of our robust methods for large-scale neuroimaging data analysis. In this consensus statement we outline the working group's short-term, intermediate, and long-term goals.

Variability in the analysis of a single neuroimaging dataset by many teams.

Data analysis workflows in many scientific domains have become increasingly complex and flexible. Here we assess the effect of this flexibility on the results of functional magnetic resonance imaging by asking 70 independent teams to analyse the same dataset, testing the same 9 ex-ante hypotheses1. The flexibility of analytical approaches is exemplified by the fact that no two teams chose identical workflows to analyse the data. This flexibility resulted in sizeable variation in the results of hypothesis tests, even for teams whose statistical maps were highly correlated at intermediate stages of the analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Notably, a meta-analytical approach that aggregated information across teams yielded a significant consensus in activated regions. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset2-5. Our findings show that analytical flexibility can have substantial effects on scientific conclusions, and identify factors that may be related to variability in the analysis of functional magnetic resonance imaging. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for performing and reporting multiple analyses of the same data. Potential approaches that could be used to mitigate issues related to analytical variability are discussed.

Reward presentation reduces on-task fatigue in traumatic brain injury.

While cognitive fatigue is experienced by up to 80% of individuals with traumatic brain injury (TBI), little is known about its neural underpinnings. We previously hypothesized that presentation of rewarding outcomes leads to cognitive fatigue reduction and activation of the striatum, a brain region shown to be associated with cognitive fatigue in clinical populations and processing of rewarding outcomes. We have demonstrated this in individuals with multiple sclerosis. Here, we tested this hypothesis in individuals with TBI. Twenty-one individuals with TBI and 24 healthy participants underwent functional magnetic resonance imaging. Participants performed a task during which they were presented with 1) the Outcome condition where they were exposed to monetary rewards, and 2) the No Outcome condition that served as the control condition and was not associated with monetary rewards. In accordance with our hypothesis, results showed that attainment of rewarding outcomes leads to cognitive fatigue reduction in individuals with TBI, as well as activation of the striatum. Specifically, we observed a significant group by condition interaction on fatigue scores driven by the TBI group reporting lower levels of fatigue after the Outcome condition. fMRI data revealed a significant main-effect of condition in regions previously implicated in outcome processing, while a significant group by condition interaction was observed in the left ventral striatum as revealed by a priori region of interest analysis. Results suggest that a salient motivator can significantly reduce fatigue and that outcome presentation leads to increased activation of the ventral striatum in TBI. These findings can inform the development of future non-pharmacological cognitive fatigue treatment methods and contribute to the growing body of evidence showing the association between cognitive fatigue and the striatum.

Considerations of power and sample size in rehabilitation research.

With the current emphasis on power and reproducibility, pressures are rising to increase sample sizes in rehabilitation research in order to reflect more accurate effect estimation and generalizable results. The conventional way of increasing power by enrolling more participants is less feasible in some fields of research. In particular, rehabilitation research faces considerable challenges in achieving this goal. We describe the specific challenges to increasing power by recruiting large sample sizes and obtaining large effects in rehabilitation research. Specifically, we discuss how variability within clinical populations, lack of common standards for selecting appropriate control groups; potentially reduced reliability of measurements of brain function in individuals recovering from a brain injury; biases involved in a priori effect size estimation, and higher budgetary and staffing requirements can influence considerations of sample and effect size in rehabilitation. We also describe solutions to these challenges, such as increased sampling per participant, improving experimental control, appropriate analyses, transparent result reporting and using innovative ways of harnessing the inherent variability of clinical populations. These solutions can improve statistical power and produce reliable and valid results even in the face of limited availability of large samples.

Brain activation patterns associated with paragraph learning in persons with multiple sclerosis: The MEMREHAB trial.

The modified Story Memory Technique (mSMT) is a memory rehabilitation program that combines training in visualization and context formation to improve learning and memory. Previous studies have shown improvement in learning and memory in individuals with multiple sclerosis (MS) after undergoing the mSMT, including changes in brain activity related to working memory and word encoding. The current study examined changes in brain activity in 16 individuals diagnosed with MS (n treatment = 6; n placebo control = 10) when they were presented with to-be-remembered information within a meaningful context (i.e. a paragraph) from before to after mSMT treatment. We expected treatment-related changes in brain activation in the language network (LAN), default mode network (DMN), and executive control network (ECN). Consistent with this prediction, fMRI results revealed reduced brain activation in the LAN, DMN and ECN after completing the mSMT treatment in the context of paragraph learning. While no significant behavioral changes were observed, a marginally significant improvement with a large effect size was noted between baseline and follow-up performance on the Rivermead Behavioral Memory Test in persons who completed treatment. Results are discussed in terms of the impact of imagery training on patterns of cerebral activation when learning words presented within a context.

Corticostriatal Hyperactivation to Reward Presentation in Individuals With TBI With High Depressive Symptomatology: A Pilot Study.

OBJECTIVE: To examine the impact of depression on neural mechanisms associated with outcome processing (rewarding and punishing outcomes) in persons with traumatic brain injury (TBI). SETTING: Kessler Foundation's Rocco Ortenzio Neuroimaging Center. PARTICIPANTS: A total of 16 adults with moderate to severe TBI. MAIN MEASURES: Chicago Multiscale Depression Inventory (CMDI); Behavioral Inhibition/Behavioral Activation Scale (BIS/BAS); functional MRI of the head while performing a gambling task, with a reward (+$1.00) and punishment (-$0.50). RESULTS: Individuals with TBI reporting high depressive symptomatology exhibited increased activation in the ventromedial prefrontal cortex (VMPFC) and striatum during presentation of rewarding outcomes compared with individuals with TBI reporting low depressive symptomatology. Punishing outcome presentation was not associated with any change in brain activation. No differences in volume of the striatum and VMPFC were observed between groups. CONCLUSIONS: Current findings provide the first evidence of differences in neural mechanisms underlying outcome processing between individuals with TBI with and without depression. The results suggest that depressive symptomatology might have a different effect on individuals with TBI than what is typically observed in individuals without TBI reporting with depression, with the possibility of rewards becoming more reinforcing as depressive symptomatology increases. Future studies should explore the potential implications of behavioral responses to rewards and punishments in TBI and how they can affect rehabilitation approaches and activities of daily living.

Reward circuitry activation reflects social preferences in the face of cognitive effort.

Research at the intersection of social neuroscience and cognitive effort is an interesting new area for exploration. There is great potential to broaden our understanding of how social context and cognitive effort processes, currently addressed in disparate literatures, interact with one another. In this paper, we briefly review the literature on cognitive effort, focusing on effort-linked valuation and the gap in the literature regarding cognitive effort in the social domain. Next, we present a study designed to explore valuation processes linked to cognitive effort within the social context of an inequality manipulation. More specifically, we created monetary inequality among the participant (SELF, endowed with $50) and two confederates: one also endowed with $50 (OTHER HIGH) and another with only $5 (OTHER LOW). We then scanned participants using fMRI as they attempted to earn bonus payments for themselves and others through a cognitively effortful feedback-based learning task. Positive feedback produced significantly greater activation than negative feedback in key valuation regions, the ventral striatum (VS) and ventromedial prefrontal cortex (vmPFC), both when participants were performing the task on their own behalf and when earning rewards for others. While reward-related activity in the VS was exaggerated for SELF compared to OTHER HIGH for both positive and negative feedback, activity in the vmPFC did not distinguish between recipients in the group-level results. Furthermore, participants naturally fell into two groups: those most engaged when playing for themselves and those who reported engagement for others. While Self-Engaged participants showed differences between the SELF and both OTHER conditions in the VS and vmPFC, Other-Engaged participants only showed an attenuated response to negative feedback for OTHER HIGH compared to SELF in the VS and no differences between recipient conditions in the vmPFC. Together, this work shows the importance of individual differences and the fragility of advantageous inequality aversion in the face of cognitive effort, highlighting the need to study cognitive effort in the social domain.