Neural evidence of switch processes during semantic and phonetic foraging in human memory.

Humans may retrieve words from memory by exploring and exploiting in "semantic space" similar to how nonhuman animals forage for resources in physical space. This has been studied using the verbal fluency test (VFT), in which participants generate words belonging to a semantic or phonetic category in a limited time. People produce bursts of related items during VFT, referred to as "clustering" and "switching." The strategic foraging model posits that cognitive search behavior is guided by a monitoring process which detects relevant declines in performance and then triggers the searcher to seek a new patch or cluster in memory after the current patch has been depleted. An alternative body of research proposes that this behavior can be explained by an undirected rather than strategic search process, such as random walks with or without random jumps to new parts of semantic space. This study contributes to this theoretical debate by testing for neural evidence of strategically timed switches during memory search. Thirty participants performed category and letter VFT during functional MRI. Responses were classified as cluster or switch events based on computational metrics of similarity and participant evaluations. Results showed greater hippocampal and posterior cerebellar activation during switching than clustering, even while controlling for interresponse times and linguistic distance. Furthermore, these regions exhibited ramping activity which increased during within-patch search leading up to switches. Findings support the strategic foraging model, clarifying how neural switch processes may guide memory search in a manner akin to foraging in patchy spatial environments.

Case Report of 11 Years of Severe Malabsorption, Muscular Atrophy, Seizures, and Immunodeficiency Resolved After Proximal Intercessory Prayer.

We present the case of 11 years of severe malabsorption, muscular atrophy, seizures, and immunodeficiency resolved after proximal intercessory prayer (PIP). A male infant suffered from severe abdominal pain and impaired development with the introduction of solid food at age five months. The patient had previously appeared healthy, having been born to term and breastfed. Neocate and total parenteral nutrition (TPN) were prescribed, and the former was removed due to abdominal pain and diarrhea. Ultimately, the patient became completely dependent on TPN. It was concluded that he suffered from chronic, idiopathic, severe malabsorption. Development of neutropenia, hypogamma-globulinemia, and hypotonia was recorded. Medical records document atrophy and progressive deterioration of muscular symptoms. At five years of age, frontal lobe epilepsy was detected. Over the course of the disease, several genetic tests were performed. Doctors tried unsuccessfully to diagnose an underlying condition, with various mitochondriopathies and Shwachman-Diamond syndrome suggested as possible causes, but no prognosis of recovery was given. Eleven years following the initial presentation of symptoms, proximal intercessory prayer (PIP) was administered in a single session. The patient reported no unusual sensations during prayer. However, oral feedings were immediately tolerated without discomfort from that time onward. Post-PIP medical records indicate discontinuation of TPN, seizures, and seizure medications. Progressive improvement in the hematological disorders, BMI, and muscular symptoms was also observed. The present case report describes a novel association between PIP and the lasting resolution of multiple symptoms likely related to a genetic disorder. The results inform ongoing discussions about faith-based practices in health care and suggest the need for additional studies of PIP on health outcomes.

The PRO model accounts for the anterior cingulate cortex role in risky decision-making and monitoring.

The anterior cingulate cortex (ACC) has been implicated in a number of functions, including performance monitoring and decision-making involving effort. The prediction of responses and outcomes (PRO) model has provided a unified account of much human and monkey ACC data involving anatomy, neurophysiology, EEG, fMRI, and behavior. We explored the computational nature of ACC with the PRO model, extending it to account specifically for both human and macaque monkey decision-making under risk, including both behavioral and neural data. We show that the PRO model can account for a number of additional effects related to outcome prediction, decision-making under risk, gambling behavior. In particular, we show that the ACC represents the variance of uncertain outcomes, suggesting a link between ACC function and mean-variance theories of decision making. The PRO model provides a unified account of a large set of data regarding the ACC.

Neural correlates of visual attention during risky decision evidence integration.

Value-based decision-making is presumed to involve a dynamic integration process that supports assessing the potential outcomes of different choice options. Decision frameworks assume the value of a decision rests on both the desirability and risk surrounding an outcome. Previous work has highlighted neural representations of risk in the human brain, and their relation to decision choice. Key neural regions including the insula and anterior cingulate cortex (ACC) have been implicated in encoding the effects of risk on decision outcomes, including approach and avoidance. Yet, it remains unknown whether these regions are involved in the dynamic integration processes that precede and drive choice, and their relationship with ongoing attention. Here, we used concurrent fMRI and eye-tracking to discern neural activation related to visual attention preceding choice between sure-thing (i.e. safe) and risky gamble options. We found activation in both dorsal ACC (dACC) and posterior insula (PI) scaled in opposite directions with the difference in attention to risky rewards relative to risky losses. PI activation also differentiated foveations on both risky options (rewards and losses) relative to a sure-thing option. These findings point to ACC involvement in ongoing evaluation of risky but higher value options. The role of PI in risky outcomes points to a more general evaluative role in the decision-making that compares both safe and risky outcomes, irrespective of potential for gains or losses.

Prefrontal Cortex in Control: Broadening the Scope to Identify Mechanisms.

Sometime in the past two decades, neuroimaging and behavioral research converged on pFC as an important locus of cognitive control and decision-making, and that seems to be the last thing anyone has agreed on since. Every year sees an increase in the number of roles and functions attributed to distinct subregions within pFC, roles that may explain behavior and neural activity in one context but might fail to generalize across the many behaviors in which each region is implicated. Emblematic of this ongoing proliferation of functions is dorsal ACC (dACC). Novel tasks that activate dACC are followed by novel interpretations of dACC function, and each new interpretation adds to the number of functionally specific processes contained within the region. This state of affairs, a recurrent and persistent behavior followed by an illusory and transient relief, can be likened to behavioral pathology. In Journal of Cognitive Neuroscience, 29:10 we collect contributed articles that seek to move the conversation beyond specific functions of subregions of pFC, focusing instead on general roles that support pFC involvement in a wide variety of behaviors and across a variety of experimental paradigms.

Does gratitude writing improve the mental health of psychotherapy clients? Evidence from a randomized controlled trial.

Although the past decade has witnessed growing research interest in positive psychological interventions (PPIs), their potential as adjunctive interventions for psychotherapy remains relatively unexplored. Therefore, this article expands the frontiers of PPI research by reporting the first randomized controlled trial to test a gratitude writing adjunctive intervention for psychotherapy clients. Participants were 293 adults seeking university-based psychotherapy services. Participants were randomly assigned to one of three conditions: (a) control (psychotherapy only), (b) a psychotherapy plus expressive writing, and (c) a psychotherapy plus gratitude writing. Participants in the gratitude condition wrote letters expressing gratitude to others, whereas those in the expressive writing condition wrote about their deepest thoughts and feelings about stressful experiences. About 4 weeks as well as 12 weeks after the conclusion of the writing intervention, participants in the gratitude condition reported significantly better mental health than those in the expressive and control conditions, whereas those in the expressive and control conditions did not differ significantly. Moreover, lower proportions of negative emotion words in participants' writing mediated the positive effect of condition (gratitude versus expressive writing) on mental health. These findings are discussed in light of the use of gratitude interventions as adjunctive interventions for psychotherapy clients.

Neural Mechanisms of Credit Assignment in a Multicue Environment.

In complex environments, many potential cues can guide a decision or be assigned responsibility for the outcome of the decision. We know little, however, about how humans and animals select relevant information sources that should guide behavior. We show that subjects solve this relevance selection and credit assignment problem by selecting one cue and its association with a particular outcome as the main focus of a hypothesis. To do this, we examined learning while using a task design that allowed us to estimate the focus of each subject's hypotheses on a trial-by-trial basis. When a prediction is confirmed by the outcome, then credit for the outcome is assigned to that cue rather than an alternative. Activity in medial frontal cortex is associated with the assignment of credit to the cue that is the main focus of the hypothesis. However, when the outcome disconfirms a prediction, the focus shifts between cues, and the credit for the outcome is assigned to an alternative cue. This process of reselection for credit assignment to an alternative cue is associated with lateral orbitofrontal cortex. SIGNIFICANCE STATEMENT: Learners should infer which features of environments are predictive of significant events, such as rewards. This "credit assignment" problem is particularly challenging when any of several cues might be predictive. We show that human subjects solve the credit assignment problem by implicitly "hypothesizing" which cue is relevant for predicting subsequent outcomes, and then credit is assigned according to this hypothesis. This process is associated with a distinctive pattern of activity in a part of medial frontal cortex. By contrast, when unexpected outcomes occur, hypotheses are redirected toward alternative cues, and this process is associated with activity in lateral orbitofrontal cortex.

Distinct Regions within Medial Prefrontal Cortex Process Pain and Cognition.

Neuroimaging studies of the medial prefrontal cortex (mPFC) suggest that the dorsal anterior cingulate cortex (dACC) region is responsive to a wide variety of stimuli and psychological states, such as pain, cognitive control, and prediction error (PE). In contrast, a recent meta-analysis argues that the dACC is selective for pain, whereas the supplementary motor area (SMA) and pre-SMA are specifically associated with higher-level cognitive processes (Lieberman and Eisenberger, 2015). To empirically test this claim, we manipulated effects of pain, conflict, and PE in a single experiment using human subjects. We observed a robust dorsal-ventral dissociation within the mPFC with cognitive effects of PE and conflict overlapping dorsally and pain localized more ventrally. Classification of subjects based on the presence or absence of a paracingulate sulcus showed that PE effects extended across the dorsal area of the dACC and into the pre-SMA. These results begin to resolve recent controversies by showing the following: (1) the mPFC includes dissociable regions for pain and cognitive processing; and (2) meta-analyses are correct in localizing cognitive effects to the dACC, although these effects extend to the pre-SMA as well. These results both provide evidence distinguishing between different theories of mPFC function and highlight the importance of taking individual anatomical variability into account when conducting empirical studies of the mPFC. SIGNIFICANCE STATEMENT: Decades of neuroimaging research have shown the mPFC to represent a wide variety of stimulus processing and cognitive states. However, recently it has been argued whether distinct regions of the mPFC separately process pain and cognitive phenomena. To address this controversy, this study directly compared pain and cognitive processes within subjects. We found a double dissociation within the mPFC with pain localized ventral to the cingulate sulcus and cognitive effects localized more dorsally within the dACC and spreading into the pre-supplementary motor area. This provides empirical evidence to help resolve the current debate about the functional architecture of the mPFC.

Foraging Value, Risk Avoidance, and Multiple Control Signals: How the Anterior Cingulate Cortex Controls Value-based Decision-making.

Recent work on the role of the ACC in cognition has focused on choice difficulty, action value, risk avoidance, conflict resolution, and the value of exerting control among other factors. A main underlying question is what are the output signals of ACC, and relatedly, what is their effect on downstream cognitive processes? Here we propose a model of how ACC influences cognitive processing in other brain regions that choose actions. The model builds on the earlier Predicted Response Outcome model and suggests that ACC learns to represent specifically the states in which the potential costs or risks of an action are high, on both short and long timescales. It then uses those cost signals as a basis to bias decisions to minimize losses while maximizing gains. The model simulates both proactive and reactive control signals and accounts for a variety of empirical findings regarding value-based decision-making.

Hierarchical error representation in medial prefrontal cortex.

The medial prefrontal cortex (mPFC) is reliably activated by both performance and prediction errors. Error signals have typically been treated as a scalar, and it is unknown to what extent multiple error signals may co-exist within mPFC. Previous studies have shown that lateral frontal cortex (LFC) is arranged in a hierarchy of abstraction, such that more abstract concepts and rules are represented in more anterior cortical regions. Given the close interaction between lateral and medial prefrontal cortex, we explored the hypothesis that mPFC would be organized along a similar rostro-caudal gradient of abstraction, such that more abstract prediction errors are represented further anterior and more concrete errors further posterior. We show that multiple prediction error signals can be found in mPFC, and furthermore, these are arranged in a rostro-caudal gradient of abstraction which parallels that found in LFC. We used a task that requires a three-level hierarchy of rules to be followed, in which the rules changed without warning at each level of the hierarchy. Task feedback indicated which level of the rule hierarchy changed and led to corresponding prediction error signals in mPFC. Moreover, each identified region of mPFC was preferentially functionally connected to correspondingly anterior regions of LFC. These results suggest the presence of a parallel structure between lateral and medial prefrontal cortex, with the medial regions monitoring and evaluating performance based on rules maintained in the corresponding lateral regions.

The effects of gratitude expression on neural activity.

Gratitude is a common aspect of social interaction, yet relatively little is known about the neural bases of gratitude expression, nor how gratitude expression may lead to longer-term effects on brain activity. To address these twin issues, we recruited subjects who coincidentally were entering psychotherapy for depression and/or anxiety. One group participated in a gratitude writing intervention, which required them to write letters expressing gratitude. The therapy-as-usual control group did not perform a writing intervention. After three months, subjects performed a "Pay It Forward" task in the fMRI scanner. In the task, subjects were repeatedly endowed with a monetary gift and then asked to pass it on to a charitable cause to the extent they felt grateful for the gift. Operationalizing gratitude as monetary gifts allowed us to engage the subjects and quantify the gratitude expression for subsequent analyses. We measured brain activity and found regions where activity correlated with self-reported gratitude experience during the task, even including related constructs such as guilt motivation and desire to help as statistical controls. These were mostly distinct from brain regions activated by empathy or theory of mind. Also, our between groups cross-sectional study found that a simple gratitude writing intervention was associated with significantly greater and lasting neural sensitivity to gratitude - subjects who participated in gratitude letter writing showed both behavioral increases in gratitude and significantly greater neural modulation by gratitude in the medial prefrontal cortex three months later.

Hierarchical Error Representation: A Computational Model of Anterior Cingulate and Dorsolateral Prefrontal Cortex.

Anterior cingulate and dorsolateral prefrontal cortex (ACC and dlPFC, respectively) are core components of the cognitive control network. Activation of these regions is routinely observed in tasks that involve monitoring the external environment and maintaining information in order to generate appropriate responses. Despite the ubiquity of studies reporting coactivation of these two regions, a consensus on how they interact to support cognitive control has yet to emerge. In this letter, we present a new hypothesis and computational model of ACC and dlPFC. The error representation hypothesis states that multidimensional error signals generated by ACC in response to surprising outcomes are used to train representations of expected error in dlPFC, which are then associated with relevant task stimuli. Error representations maintained in dlPFC are in turn used to modulate predictive activity in ACC in order to generate better estimates of the likely outcomes of actions. We formalize the error representation hypothesis in a new computational model based on our previous model of ACC. The hierarchical error representation (HER) model of ACC/dlPFC suggests a mechanism by which hierarchically organized layers within ACC and dlPFC interact in order to solve sophisticated cognitive tasks. In a series of simulations, we demonstrate the ability of the HER model to autonomously learn to perform structured tasks in a manner comparable to human performance, and we show that the HER model outperforms current deep learning networks by an order of magnitude.

Prefrontal cortex organization: dissociating effects of temporal abstraction, relational abstraction, and integration with FMRI.

The functions of the prefrontal cortex (PFC) underlie higher-level cognition. Varying proposals suggest that the PFC is organized along a rostral-caudal gradient of abstraction with more abstract representations/processes associated with more rostral areas. However, the operational definition of abstraction is unclear. Here, we contrasted 2 prominent theories of abstraction--temporal and relational--using fMRI. We further examined whether integrating abstract rules--a function common to each theory--recruited the PFC independently of other abstraction effects. While robust effects of relational abstraction were present in the PFC, temporal abstraction effects were absent. Instead, we found activations specific to the integration of relational rules in areas previously shown to be associated with temporal abstraction. We suggest that previous effects of temporal abstraction were due to confounds with integration demands. We propose an integration framework to understand the functions of the PFC that resolves discrepancies in prior data.

Distinct regions of anterior cingulate cortex signal prediction and outcome evaluation.

A number of theories have been proposed to account for the role of anterior cingulate cortex (ACC) and the broader medial prefrontal cortex (mPFC) in cognition. The recent Prediction of Response Outcome (PRO) computational model casts the mPFC in part as performing two theoretically distinct functions: learning to predict the various possible outcomes of actions, and then evaluating those predictions against the actual outcomes. Simulations have shown that this new model can account for an unprecedented range of known mPFC effects, but the central theory of distinct prediction and evaluation mechanisms within ACC remains untested. Using combined computational neural modeling and fMRI, we show here that prediction and evaluation signals are indeed each represented in the ACC, and furthermore, they are represented in distinct regions within ACC. Our task independently manipulated both the number of predicted outcomes and the degree to which outcomes violated expectancies, the former providing assessment of regions sensitive to prediction and the latter providing assessment of regions sensitive to evaluation. Using quantitative regressors derived from the PRO computational model, we show that prediction-based model signals load on a network including the posterior and perigenual ACC, but outcome evaluation model signals load on the mid-dorsal ACC. These findings are consistent with distinct prediction and evaluation signals as posited by the PRO model and provide new perspective on a large set of known effects within ACC.

Dissociable frontal-striatal and frontal-parietal networks involved in updating hierarchical contexts in working memory.

Recent theories propose that the prefrontal cortex (PFC) is organized in a hierarchical fashion with more abstract, higher level information represented in anterior regions and more concrete, lower level information represented in posterior regions. This hierarchical organization affords flexible adjustments of action plans based on the context. Computational models suggest that such hierarchical organization in the PFC is achieved through interactions with the basal ganglia (BG) wherein the BG gate relevant contexts into the PFC. Here, we tested this proposal using functional magnetic resonance imaging (fMRI). Participants were scanned while updating working memory (WM) with 2 levels of hierarchical contexts. Consistent with PFC abstraction proposals, higher level context updates involved anterior portions of the PFC (BA 46), whereas lower level context updates involved posterior portions of the PFC (BA 6). Computational models were only partially supported as the BG were sensitive to higher, but not lower level context updates. The posterior parietal cortex (PPC) showed the opposite pattern. Analyses examining changes in functional connectivity confirmed dissociable roles of the anterior PFC-BG during higher level context updates and posterior PFC-PPC during lower level context updates. These results suggest that hierarchical contexts are organized by distinct frontal-striatal and frontal-parietal networks.

A meta-analysis of executive components of working memory.

Working memory (WM) enables the online maintenance and manipulation of information and is central to intelligent cognitive functioning. Much research has investigated executive processes of WM in order to understand the operations that make WM "work." However, there is yet little consensus regarding how executive processes of WM are organized. Here, we used quantitative meta-analysis to summarize data from 36 experiments that examined executive processes of WM. Experiments were categorized into 4 component functions central to WM: protecting WM from external distraction (distractor resistance), preventing irrelevant memories from intruding into WM (intrusion resistance), shifting attention within WM (shifting), and updating the contents of WM (updating). Data were also sorted by content (verbal, spatial, object). Meta-analytic results suggested that rather than dissociating into distinct functions, 2 separate frontal regions were recruited across diverse executive demands. One region was located dorsally in the caudal superior frontal sulcus and was especially sensitive to spatial content. The other was located laterally in the midlateral prefrontal cortex and showed sensitivity to nonspatial content. We propose that dorsal-"where"/ventral-"what" frameworks that have been applied to WM maintenance also apply to executive processes of WM. Hence, WM can largely be simplified to a dual selection model.

Monkey Prefrontal Cortex Learns to Minimize Sequence Prediction Error.

In this study, we develop a novel recurrent neural network (RNN) model of pre-frontal cortex that predicts sensory inputs, actions, and outcomes at the next time step. Synaptic weights in the model are adjusted to minimize sequence prediction error, adapting a deep learning rule similar to those of large language models. The model, called Sequence Prediction Error Learning (SPEL), is a simple RNN that predicts world state at the next time step, but that differs from standard RNNs by using its own prediction errors from the previous state predictions as inputs to the hidden units of the network. We show that the time course of sequence prediction errors generated by the model closely matched the activity time courses of populations of neurons in macaque prefrontal cortex. Hidden units in the model responded to combinations of task variables and exhibited sensitivity to changing stimulus probability in ways that closely resembled monkey prefrontal neurons. Moreover, the model generated prolonged response times to infrequent, unexpected events as did monkeys. The results suggest that prefrontal cortex may generate internal models of the temporal structure of the world even during tasks that do not explicitly depend on temporal expectation, using a sequence prediction error minimization learning rule to do so. As such, the SPEL model provides a unified, general-purpose theoretical framework for modeling the lateral prefrontal cortex.

Transcranial Electrical Neurostimulation as a Potential Addiction Treatment.

Addiction remains difficult to treat, but non-invasive transcranial electrical and magnetic neurostimulation methods may provide promising and cost-effective treatment approaches. We provide a narrative review of recent developments and evidence of effectiveness and consider newer technology that may yield improved treatment approaches. In particular, we review temporal interference electrical neurostimulation, which allows non-invasive and focal stimulation of deep brain regions. This provides a promising new potential approach to treat addiction, because many of the brain regions that seem most important for addiction are deeper in the brain, out of reach of existing technologies such as transcranial direct current stimulation.

Foundations of human spatial problem solving.

Despite great strides in both machine learning and neuroscience, we do not know how the human brain solves problems in the general sense. We approach this question by drawing on the framework of engineering control theory. We demonstrate a computational neural model with only localist learning laws that is able to find solutions to arbitrary problems. The model and humans perform a multi-step task with arbitrary and changing starting and desired ending states. Using a combination of computational neural modeling, human fMRI, and representational similarity analysis, we show here that the roles of a number of brain regions can be reinterpreted as interacting mechanisms of a control theoretic system. The results suggest a new set of functional perspectives on the orbitofrontal cortex, hippocampus, basal ganglia, anterior temporal lobe, lateral prefrontal cortex, and visual cortex, as well as a new path toward artificial general intelligence.

Insular and Striatal Correlates of Uncertain Risky Reward Pursuit in Schizophrenia.

BACKGROUND AND HYPOTHESIS: Risk-taking in specific contexts can be beneficial, leading to rewarding outcomes. Schizophrenia is associated with disadvantageous decision-making, as subjects pursue uncertain risky rewards less than controls. However, it is unclear whether this behavior is associated with more risk sensitivity or less reward incentivization. Matching on demographics and intelligence quotient (IQ), we determined whether risk-taking was more associated with brain activation in regions affiliated with risk evaluation or reward processing. STUDY DESIGN: Subjects (30 schizophrenia/schizoaffective disorder, 30 controls) completed a modified, fMRI Balloon Analogue Risk Task. Brain activation was modeled during decisions to pursue risky rewards and parametrically modeled according to risk level. STUDY RESULTS: The schizophrenia group exhibited less risky-reward pursuit despite previous adverse outcomes (Average Explosions; F(1,59) = 4.06, P = .048) but the comparable point at which risk-taking was volitionally discontinued (Adjusted Pumps; F(1,59) = 2.65, P = .11). Less activation was found in schizophrenia via whole brain and region of interest (ROI) analyses in the right (F(1,59) = 14.91, P < 0.001) and left (F(1,59) = 16.34, P < 0.001) nucleus accumbens (NAcc) during decisions to pursue rewards relative to riskiness. Risk-taking correlated with IQ in schizophrenia, but not controls. Path analyses of average ROI activation revealed less statistically determined influence of anterior insula upon dorsal anterior cingulate bilaterally (left: χ2 = 12.73, P < .001; right: χ2 = 9.54, P = .002) during risky reward pursuit in schizophrenia. CONCLUSIONS: NAcc activation in schizophrenia varied less according to the relative riskiness of uncertain rewards compared to controls, suggesting aberrations in reward processing. The lack of activation differences in other regions suggests similar risk evaluation. Less insular influence on the anterior cingulate may relate to attenuated salience attribution or inability for risk-related brain region collaboration to sufficiently perceive situational risk.