Dopaminergic Modulation of Human Intertemporal Choice: A Diffusion Model Analysis Using the D2-Receptor Antagonist Haloperidol.

The neurotransmitter dopamine is implicated in diverse functions, including reward processing, reinforcement learning, and cognitive control. The tendency to discount future rewards over time has long been discussed in the context of potential dopaminergic modulation. Here we examined the effect of a single dose of the D2 receptor antagonist haloperidol (2 mg) on temporal discounting in healthy female and male human participants. Our approach extends previous pharmacological studies in two ways. First, we applied combined temporal discounting drift diffusion models to examine choice dynamics. Second, we examined dopaminergic modulation of reward magnitude effects on temporal discounting. Hierarchical Bayesian parameter estimation revealed that the data were best accounted for by a temporal discounting drift diffusion model with nonlinear trialwise drift rate scaling. This model showed good parameter recovery, and posterior predictive checks revealed that it accurately reproduced the relationship between decision conflict and response times in individual participants. We observed reduced temporal discounting and substantially faster nondecision times under haloperidol compared with placebo. Discounting was steeper for low versus high reward magnitudes, but this effect was largely unaffected by haloperidol. Results were corroborated by model-free analyses and modeling via more standard approaches. We previously reported elevated caudate activation under haloperidol in this sample of participants, supporting the idea that haloperidol elevated dopamine neurotransmission (e.g., by blocking inhibitory feedback via presynaptic D2 auto-receptors). The present results reveal that this is associated with an augmentation of both lower-level (nondecision time) and higher-level (temporal discounting) components of the decision process.SIGNIFICANCE STATEMENT Dopamine is implicated in reward processing, reinforcement learning, and cognitive control. Here we examined the effects of a single dose of the D2 receptor antagonist haloperidol on temporal discounting and choice dynamics during the decision process. We extend previous studies by applying computational modeling using the drift diffusion model, which revealed that haloperidol reduced the nondecision time and reduced impulsive choice compared with placebo. These findings are compatible with a haloperidol-induced increase in striatal dopamine (e.g., because of a presynaptic mechanism). Our data provide novel insights into the contributions of dopamine to value-based decision-making and highlight how comprehensive model-based analyses using sequential sampling models can inform the effects of pharmacological modulation on choice processes.

Dopamine Enhances Item Novelty Detection via Hippocampal and Associative Recall via Left Lateral Prefrontal Cortex Mechanisms.

The involvement of fronto-striatal circuits in item and associative memory retrieval as well as in the stabilization of memories by retrieval practice suggests that both retrieval and re-encoding of stored memories might rely on dopaminergic mechanisms in humans. We tested these hypotheses in a placebo-controlled pharmacological fMRI study using 2 mg of the D2 antagonist haloperidol administered acutely before a cued associative recall task of previously encoded picture-word pairs in 53 healthy humans of both sexes. The cued associative recall was moreover repeated 3 d later outside the scanner without pharmacological intervention. Dopaminergic modulation significantly improved associative recall performance and recognition accuracy of verbal items. Moreover, we observed a significant dopamine effect on re-encoding in terms of increased specificity of associative memories from the first to the second cued associative recall. Better association memory under haloperidol was linked with higher activity in the left lateral prefrontal cortex and right parietal cortex, suggesting that dopamine facilitates associative retrieval through increased recruitment of frontoparietal monitoring processes. In contrast, improved recognition of verbal items under haloperidol was reflected by enhanced novelty detection in the hippocampus and increased activity in saliency networks. Together, these results show distinct but concomitant positive effects of dopamine on associative recall and item recognition and suggest that the specificity of associative recall through re-encoding mechanisms is likewise augmented by dopamine.SIGNIFICANCE STATEMENT Although the neurotransmitter dopamine has been linked with learning and memory for a long time, dopaminergic effects on item recognition in humans were demonstrated only recently. The involvement of fronto-striatal monitoring processes in association retrieval suggests that associative memory might be particularly affected by dopamine. Moreover, fronto-striatal dopaminergic signals have been hypothesized to determine the updating and re-encoding of previously retrieved memories. We here demonstrate clear facilitative effects of dopamine on associative recall and item recognition mediated by prefrontal and hippocampal mechanisms respectively. Additionally, effects on re-encoding were reflected by increased specificity of associative memories. These results augment our understanding of dopaminergic processes in episodic memory retrieval and offer new perspectives on memory impairments in dopamine-related disorders and their treatment.

Multimodal connectivity of motor learning-related dorsal premotor cortex.

The dorsal premotor cortex (dPMC) is a key region for motor learning and sensorimotor integration, yet we have limited understanding of its functional interactions with other regions. Previous work has started to examine functional connectivity in several brain areas using resting state functional connectivity (RSFC) and meta-analytical connectivity modelling (MACM). More recently, structural covariance (SC) has been proposed as a technique that may also allow delineation of functional connectivity. Here, we applied these three approaches to provide a comprehensive characterization of functional connectivity with a seed in the left dPMC that a previous meta-analysis of functional neuroimaging studies has identified as playing a key role in motor learning. Using data from two sources (the Rockland sample, containing resting state data and anatomical scans from 132 participants, and the BrainMap database, which contains peak activation foci from over 10,000 experiments), we conducted independent whole-brain functional connectivity mapping analyses of a dPMC seed. RSFC and MACM revealed similar connectivity maps spanning prefrontal, premotor, and parietal regions, while the SC map identified more widespread frontal regions. Analyses indicated a relatively consistent pattern of functional connectivity between RSFC and MACM that was distinct from that identified by SC. Notably, results indicate that the seed is functionally connected to areas involved in visuomotor control and executive functions, suggesting that the dPMC acts as an interface between motor control and cognition.

Evidence for an anterior-posterior differentiation in the human hippocampal formation revealed by meta-analytic parcellation of fMRI coordinate maps: focus on the subiculum.

Previous studies, predominantly in experimental animals, have suggested the presence of a differentiation of function across the hippocampal formation. In rodents, ventral regions are thought to be involved in emotional behavior while dorsal regions mediate cognitive or spatial processes. Using a combination of modeling the co-occurrence of significant activations across thousands of neuroimaging experiments and subsequent data-driven clustering of these data we were able to provide evidence of distinct subregions within a region corresponding to the human subiculum, a critical hub within the hippocampal formation. This connectivity-based model consists of a bilateral anterior region, as well as separate posterior and intermediate regions on each hemisphere. Functional connectivity assessed both by meta-analytic and resting fMRI approaches revealed that more anterior regions were more strongly connected to the default mode network, and more posterior regions were more strongly connected to 'task positive' regions. In addition, our analysis revealed that the anterior subregion was functionally connected to the ventral striatum, midbrain and amygdala, a circuit that is central to models of stress and motivated behavior. Analysis of a behavioral taxonomy provided evidence for a role for each subregion in mnemonic processing, as well as implication of the anterior subregion in emotional and visual processing and the right posterior subregion in reward processing. These findings lend support to models which posit anterior-posterior differentiation of function within the human hippocampal formation and complement other early steps toward a comparative (cross-species) model of the region.

Human pulvinar functional organization and connectivity.

The human pulvinar is the largest thalamic area in terms of size and cortical connectivity. Although much is known about regional pulvinar structural anatomy, relatively little is known about pulvinar functional anatomy in humans. Cooccurrence of experimentally induced brain activity is a traditional metric used to establish interregional brain connectivity and forms the foundation of functional neuroimaging connectivity analyses. Because functional neuroimaging studies report task-related coactivations within a standardized space, meta-analysis of many whole-brain studies can define the brain's interregional coactivation across many tasks. Such an analysis can also detect and define variations in functional coactivations within a particular region. Here we use coactivation profiles reported in ∼ 7,700 functional neuroimaging studies to parcellate and define the pulvinar's functional anatomy. Parcellation of the pulvinar's coactivation profile identified five clusters per pulvinar of distinct functional coactivation. These clusters showed a high degree of symmetry across hemispheres and correspondence with the human pulvinar's cytoarchitecture. We investigated the functional coactivation profiles of each resultant pulvinar cluster with meta-analytic methods. By referencing existent neuroimaging and lesion-deficit literature, these profiles make a case for regional pulvinar specialization within the larger human attention-controlling network. Reference to this literature also informs specific hypotheses that can be tested in subsequent studies in healthy and clinical populations.

Comparison of structural covariance with functional connectivity approaches exemplified by an investigation of the left anterior insula.

The anterior insula is a multifunctional region involved in various cognitive, perceptual and socio-emotional processes. In particular, a portion of the left anterior insula is closely associated with working memory processes in healthy participants and shows gray matter reduction in schizophrenia. To unravel the functional networks related to this left anterior insula region, we here combined resting state connectivity, meta-analytic-connectivity modeling (MACM) and structural covariance (SC) in addition to functional characterization based on BrainMap meta-data. Apart from allowing new insight into the seed region, this approach moreover provided an opportunity to systematically compare these different connectivity approaches. The results showed that the left anterior insula has a broad response profile and is part of multiple functional networks including language, memory and socio-emotional networks. As all these domains are linked with several symptoms of schizophrenia, dysfunction of the left anterior insula might be a crucial component contributing to this disorder. Moreover, although converging connectivity across all three connectivity approaches for the left anterior insula were found, also striking differences were observed. RS and MACM as functional connectivity approaches specifically revealed functional networks linked with internal cognition and active perceptual/language processes, respectively. SC, in turn, showed a clear preference for highlighting regions involved in social cognition. These differential connectivity results thus indicate that the use of multiple forms of connectivity is advantageous when investigating functional networks as conceptual differences between these approaches might lead to systematic variation in the revealed functional networks.

Effects of prior information on decoding degraded speech: an fMRI study.

Expectations and prior knowledge are thought to support the perceptual analysis of incoming sensory stimuli, as proposed by the predictive-coding framework. The current fMRI study investigated the effect of prior information on brain activity during the decoding of degraded speech stimuli. When prior information enabled the comprehension of the degraded sentences, the left middle temporal gyrus and the left angular gyrus were activated, highlighting a role of these areas in meaning extraction. In contrast, the activation of the left inferior frontal gyrus (area 44/45) appeared to reflect the search for meaningful information in degraded speech material that could not be decoded because of mismatches with the prior information. Our results show that degraded sentences evoke instantaneously different percepts and activation patterns depending on the type of prior information, in line with prediction-based accounts of perception.

Tackling the multifunctional nature of Broca's region meta-analytically: co-activation-based parcellation of area 44.

Cytoarchitectonic area 44 of Broca's region in the left inferior frontal gyrus is known to be involved in several functional domains including language, action and music processing. We investigated whether this functional heterogeneity is reflected in distinct modules within cytoarchitectonically defined left area 44 using meta-analytic connectivity-based parcellation (CBP). This method relies on identifying the whole-brain co-activation pattern for each area 44 voxel across a wide range of functional neuroimaging experiments and subsequently grouping the voxels into distinct clusters based on the similarity of their co-activation patterns. This CBP analysis revealed that five separate clusters exist within left area 44. A post-hoc functional characterization and functional connectivity analysis of these five clusters was then performed. The two posterior clusters were primarily associated with action processes, in particular with phonology and overt speech (posterior-dorsal cluster) and with rhythmic sequencing (posterior-ventral cluster). The three anterior clusters were primarily associated with language and cognition, in particular with working memory (anterior-dorsal cluster), with detection of meaning (anterior-ventral cluster) and with task switching/cognitive control (inferior frontal junction cluster). These five clusters furthermore showed specific and distinct connectivity patterns. The results demonstrate that left area 44 is heterogeneous, thus supporting anatomical data on the molecular architecture of this region, and provide a basis for more specific interpretations of activations localized in area 44.

Region-specific effects of acute haloperidol in the human midbrain, striatum and cortex.

D2 autoreceptors provide an important regulatory mechanism of dopaminergic neurotransmission. However, D2 receptors are also expressed as heteroreceptors at postsynaptic membranes. The expression and the functional characteristics of both, D2 auto- and heteroreceptors, differ between brain regions. Therefore, one would expect that also the net response to a D2 antagonist, i.e. whether and to what degree overall neural activity increases or decreases, varies across brain areas. In the current study we systematically tested this hypothesis by parametrically increasing haloperidol levels (placebo, 2 and 3 mg) in healthy volunteers and measuring brain activity in the three major dopaminergic pathways. In particular, activity was assessed using fMRI while participants performed a working memory and a reinforcement learning task. Consistent with the hypothesis, across brain regions activity parametrically in- and decreased. Moreover, even within the same area there were function-specific concurrent de- and increases of activity, likely caused by input from upstream dopaminergic regions. In the ventral striatum, for instance, activity during reinforcement learning decreased for outcome processing while prediction error related activity increased. In conclusion, the current study highlights the intricacy of D2 neurotransmission which makes it difficult to predict the function-specific net response of a given area to pharmacological manipulations.

Dopamine is a double-edged sword: dopaminergic modulation enhances memory retrieval performance but impairs metacognition.

While memory encoding and consolidation processes have been linked with dopaminergic signaling for a long time, the role of dopamine in episodic memory retrieval remained mostly unexplored. Based on previous observations of striatal activity during memory retrieval, we used pharmacological functional magnetic resonance imaging to investigate the effects of dopamine on retrieval performance and metacognitive memory confidence in healthy humans. Dopaminergic modulation by the D2 antagonist haloperidol administered acutely during the retrieval phase improved recognition accuracy of previously learned pictures significantly and was associated with increased activity in the substantia nigra/ventral tegmental area, locus coeruleus, hippocampus, and amygdala during retrieval. In contrast, confidence for new decisions was impaired by unsystematically increased activity of the striatum across confidence levels and restricted range of responsiveness in frontostriatal networks under haloperidol. These findings offer new insights into the mechanisms underlying memory retrieval and metacognition and provide a broader perspective on the presence of memory problems in dopamine-related diseases and the treatment of memory disorders.

Enhanced transformation of incidentally learned knowledge into explicit memory by dopaminergic modulation.

During incidental learning statistical regularities are extracted from the environment without the intention to learn. Acquired implicit memory of these regularities can affect behavior in the absence of awareness. However, conscious insight in the underlying regularities can also develop during learning. Such emergence of explicit memory is an important learning mechanism that is assumed to involve prediction errors in the striatum and to be dopamine-dependent. Here we directly tested this hypothesis by manipulating dopamine levels during incidental learning in a modified serial reaction time task (SRTT) featuring a hidden regular sequence of motor responses in a placebo-controlled between-group study. Awareness for the sequential regularity was subsequently assessed using cued generation and additionally verified using free recall. The results demonstrated that dopaminergic modulation nearly doubled the amount of explicit sequence knowledge emerged during learning in comparison to the placebo group. This strong effect clearly argues for a causal role of dopamine-dependent processing for the development of awareness for sequential regularities during learning.

Differential Patterns of Dysconnectivity in Mirror Neuron and Mentalizing Networks in Schizophrenia.

Impairments of social cognition are well documented in patients with schizophrenia (SCZ), but the neural basis remains poorly understood. In light of evidence that suggests that the "mirror neuron system" (MNS) and the "mentalizing network" (MENT) are key substrates of intersubjectivity and joint action, it has been suggested that dysfunction of these neural networks may underlie social difficulties in SCZ patients. Additionally, MNS and MENT might be associated differently with positive vs negative symptoms, given prior social cognitive and symptom associations. We assessed resting state functional connectivity (RSFC) in meta-analytically defined MNS and MENT networks in this patient group. Magnetic resonance imaging (MRI) scans were obtained from 116 patients and 133 age-, gender- and movement-matched healthy controls (HC) at 5 different MRI sites. Network connectivity was analyzed for group differences and correlations with clinical symptoms. Results demonstrated decreased connectivity within the MNS and also the MENT in patients compared to controls. Notably, dysconnectivity of the MNS was related to symptom severity, while no such relationship was observed for the MENT. In sum, these findings demonstrate that differential patterns of dysconnectivity exist in SCZ patients, which may contribute differently to the interpersonal difficulties commonly observed in the disorder.

Goal- and retrieval-dependent activity in the striatum during memory recognition.

The striatum has been associated with successful memory retrieval but the precise functional link still remains unclear. One hypothesis is that striatal activity reflects an active evaluation process of the retrieval outcome dependent on the current behavioral goals rather than being a consequence of memory reactivation. We have recently shown that the striatum also correlates with confidence in memory recognition, which could reflect high subjective value ascribed to high certainty decisions. To examine whether striatal activity during memory recognition reflects subjective value indeed, we conducted an fMRI study using a recognition memory paradigm in which the participants rated not only the recognition confidence but also indicated the pleasantness associated with the previous memory retrieval. The results demonstrated a high positive correlation between confidence and pleasantness both on the behavioral and brain activation level particularly in the striatum. As almost all of variance in the striatal confidence signal could be explained by experienced pleasantness, this part of the striatal memory recognition response probably corresponds to greater subjective value of high confidence responses. While perceived oldness was also strongly correlated with striatal activity, this activation pattern was clearly distinct from that associated with confidence and pleasantness and thus could not be explained by higher subjective value to detect "old" items. Together, these results show that at least two independent processes contribute to striatal activation in recognition memory: a more flexible evaluation response dependent on context and goals captured by memory confidence and a potentially retrieval-related response captured by perceived oldness.

Aberrant connectivity of areas for decoding degraded speech in patients with auditory verbal hallucinations.

Auditory verbal hallucinations (AVH) are a hallmark of psychotic experience. Various mechanisms including misattribution of inner speech and imbalance between bottom-up and top-down factors in auditory perception potentially due to aberrant connectivity between frontal and temporo-parietal areas have been suggested to underlie AVH. Experimental evidence for disturbed connectivity of networks sustaining auditory-verbal processing is, however, sparse. We compared functional resting-state connectivity in 49 psychotic patients with frequent AVH and 49 matched controls. The analysis was seeded from the left middle temporal gyrus (MTG), thalamus, angular gyrus (AG) and inferior frontal gyrus (IFG) as these regions are implicated in extracting meaning from impoverished speech-like sounds. Aberrant connectivity was found for all seeds. Decreased connectivity was observed between the left MTG and its right homotope, between the left AG and the surrounding inferior parietal cortex (IPC) and the left inferior temporal gyrus, between the left thalamus and the right cerebellum, as well as between the left IFG and left IPC, and dorsolateral and ventrolateral prefrontal cortex (DLPFC/VLPFC). Increased connectivity was observed between the left IFG and the supplementary motor area (SMA) and the left insula and between the left thalamus and the left fusiform gyrus/hippocampus. The predisposition to experience AVH might result from decoupling between the speech production system (IFG, insula and SMA) and the self-monitoring system (DLPFC, VLPFC, IPC) leading to misattribution of inner speech. Furthermore, decreased connectivity between nodes involved in speech processing (AG, MTG) and other regions implicated in auditory processing might reflect aberrant top-down influences in AVH.

Meta-analytically informed network analysis of resting state FMRI reveals hyperconnectivity in an introspective socio-affective network in depression.

Alterations of social cognition and dysfunctional interpersonal expectations are thought to play an important role in the etiology of depression and have, thus, become a key target of psychotherapeutic interventions. The underlying neurobiology, however, remains elusive. Based upon the idea of a close link between affective and introspective processes relevant for social interactions and alterations thereof in states of depression, we used a meta-analytically informed network analysis to investigate resting-state functional connectivity in an introspective socio-affective (ISA) network in individuals with and without depression. Results of our analysis demonstrate significant differences between the groups with depressed individuals showing hyperconnectivity of the ISA network. These findings demonstrate that neurofunctional alterations exist in individuals with depression in a neural network relevant for introspection and socio-affective processing, which may contribute to the interpersonal difficulties that are linked to depressive symptomatology.

Resting state functional connectivity in patients with chronic hallucinations.

Auditory verbal hallucinations (AVH) are not only among the most common but also one of the most distressing symptoms of schizophrenia. Despite elaborate research, the underlying brain mechanisms are as yet elusive. Functional MRI studies have associated the experience of AVH with activation of bilateral language-related areas, in particular the right inferior frontal gyrus (rIFG) and the left superior temporal gyrus (lSTG). While these findings helped to understand the neural underpinnings of hearing voices, they provide little information about possible brain mechanisms that predispose a person to experience AVH, i.e. the traits to hallucinate. In this study, we compared resting state connectivity between 49 psychotic patients with chronic AVH and 49 matched controls using the rIFG and the lSTG as seed regions, to identify functional brain systems underlying the predisposition to hallucinate. The right parahippocampal gyrus showed increased connectivity with the rIFG in patients as compared to controls. Reduced connectivity with the rIFG in patients was found for the right dorsolateral prefrontal cortex. Reduced connectivity with the lSTG in patients was identified in the left frontal operculum as well as the parietal opercular area. Connectivity between the lSTG and the left hippocampus was also reduced in patients and showed a negative correlation with the severity of hallucinations. Concluding, we found aberrant connectivity between the seed regions and medial temporal lobe structures which have a prominent role in memory retrieval. Moreover, we found decreased connectivity between language-related areas, indicating aberrant integration in this system potentially including corollary discharge mechanisms.