Cross-paradigm integration shows a common neural basis for aversive and appetitive conditioning.

Sharing imaging data and comparing them across different psychological tasks is becoming increasingly possible as the open science movement advances. Such cross-paradigm integration has the potential to identify commonalities in findings that neighboring areas of study thought to be paradigm-specific. However, even the integration of research from closely related paradigms, such as aversive and appetitive classical conditioning is rare - even though qualitative comparisons already hint at how similar the 'fear network' and 'reward network' may be. We aimed to validate these theories by taking a multivariate approach to assess commonalities across paradigms empirically. Specifically, we quantified the similarity of an aversive conditioning pattern derived from meta-analysis to appetitive conditioning fMRI data. We tested pattern expression in three independent appetitive conditioning studies with 29, 76 and 38 participants each. During fMRI scanning, participants in each cohorts performed an appetitive conditioning task in which a CS+ was repeatedly rewarded with money and a CS- was never rewarded. The aversive pattern was highly similar to appetitive CS+ > CS- contrast maps across samples and variations of the appetitive conditioning paradigms. Moreover, the pattern distinguished the CS+ from the CS- with above-chance accuracy in every sample. These findings provide robust empirical evidence for an underlying neural system common to appetitive and aversive learning. We believe that this approach provides a way to empirically integrate the steadily growing body of fMRI findings across paradigms.

Amygdala and nucleus accumbens involvement in appetitive extinction.

Extinction of appetitive conditioning is regarded as an important model for the treatment of psychiatric disorders like addiction. However, very few studies have investigated its neural correlates. Therefore, we investigated neural correlates of appetitive extinction in a large human sample including all genders (N = 76, 40 females) to replicate and extend results from a previous study. During differential appetitive conditioning, one stimulus (CS+) was paired with the chance to win a monetary reward, whereas another stimulus (CS-) was not. During appetitive extinction on the next day, neither the CS+ nor the CS- were reinforced. After successful acquisition of appetitive conditioning, the extinction phase elicited significant reductions of valence and arousal ratings toward the CS+ and a significant reduction in skin conductance responses to the CS+ from early to late extinction. On a neural level, early extinction showed significant differential (CS+ - CS-) activation in dACC and hippocampus, whereas involvement of the vACC and caudate nucleus did not replicate. The differential activation of amygdala and nucleus accumbens during late extinction was replicated, with the amygdala displaying significantly higher differential activation during the late phase of extinction as compared to the early phase of extinction. We show discernible signals for reward learning and extinction in subregions of amygdala and nucleus accumbens after extinction learning. This successful replication underlines the role of nucleus accumbens and amygdala in neural models of appetitive extinction in humans that was previously only based on animal findings.

The relationship between neuroticism and appetitive conditioning.

Appetitive conditioning is considered a central mechanism for the vulnerability to psychiatric disorders. However, the investigation of individual differences that are related to altered appetitive learning has been almost neglected so far. The aim of this study was to investigate the link between neuroticism and appetitive conditioning processes. 79 subjects participated in a differential conditioning procedure in which a conditioned stimulus (CS+) was paired with a reward (money) after a fast behavioral response, while a second conditioned stimulus (CS-) was never followed by a reward, irrespective of the behavioral response. As a main result, neuroticism correlated negatively with the underlying neural processes of appetitive conditioning in females, but not in males. In detail, higher levels of neuroticism were associated with decreased neural responses in the left (p = .001) and right amygdala (p = .011), left (p = .063) and right (p = .019) nucleus accumbens, and left (p = .002) and right (p = .021) orbitofrontal cortex (all results are family-wise-error-corrected). The present results support previous findings, which also showed an inverse sex-specific effect in the context of neuroticism and emotional processing in females. In addition, the findings suggest that neuroticism is not solely linked to increased amygdala sensitivity during the processing of negative stimuli but also to decreased neural responses when processing rewarding stimuli. Possible explanations for the sex differences and implications are discussed.

Altered reward learning and hippocampal connectivity following psychosocial stress.

Acute stress has a profound influence on learning, as has been demonstrated in verbal learning or fear conditioning. However, its effect on appetitive conditioning is still unclear. Fear conditioning research suggests the possibility of overgeneralization of conditioning to the CS- under acute stress due to its effect on prefrontal and hippocampal processing. In this study, participants (N = 56 males) were subjected to the Trier Social Stress Test or a placebo version. After that, all participants underwent an appetitive conditioning paradigm in the fMRI, in which one neutral cue (CS+) was repeatedly paired with reward, while another (CS-) was not. Importantly, the stress-group revealed overgeneralization of conditioning to the CS- on the behavioral level. On the neural level, stressed participants showed increased connectivity between the hippocampus and amygdala, vACC, and OFC, which maintain specificity of conditioning and also showed reduced differential activation. The results indicate overgeneralization of appetitive conditioning promoted by maladaptive balancing of pattern separation and pattern completion in the hippocampus under acute stress and are discussed with respect to clinical implications.

Neural correlates of subjective CS/UCS association in appetitive conditioning.

Explicit knowledge of conditioned stimulus (CS)/unconditioned stimulus (UCS) associations is proposed as important factor in classical conditioning. However, while previous studies have focused on its roles in fear conditioning, it has been neglected in the context of appetitive conditioning. The present functional magnetic resonance study aimed to investigate neural activation and functional connectivity linked to subjective CS/UCS association in appetitive conditioning. In total, 85 subjects participated in an appetitive acquisition procedure in which a neutral stimulus (CS+) was paired with a monetary reward, while another neutral stimulus (CS-) was never paired with the reward. Directly afterwards, subjective CS/UCS association was assessed by measuring the extent to which the CS+ was thought to be associated with the UCS compared to the CS-. Close relationships were established between subjective CS/UCS association and activations in the primary visual cortex (V1) during the early phase of conditioning and in the striatum during the late conditioning phase. In addition, we observed inverse relationships between subjective CS/UCS association and both V1/ventromedial prefrontal cortex (vmPFC) and striatal/vmPFC connectivity. The results suggest the involvement of decoupling vmPFC connectivity in reward learning in general and the roles of attentional processes in the formation of the subjective CS/UCS association during the early phase and reward prediction during the late phase of appetitive conditioning.

Cardiac response in aversive and appetitive olfactory conditioning: Evidence for a valence-independent CS-elicited bradycardia.

While the examination of conditioned cardiac responses is well established in human fear conditioning research, comparable studies using less-aversive or rather appetitive unconditioned stimuli (UCS) are sparse and results are mixed. Therefore, the aim of this study was a systematic analysis of cardiac reactions in aversive and appetitive conditioning. Olfactory stimuli were used as unconditioned stimuli as they are suitable reinforcers in both an aversive and an appetitive conditioning offering the opportunity for a comparison between conditioned responses. In total, n = 86 participants took part in both an aversive and an appetitive differential conditioning task with a counterbalanced order across participants. Aversive or appetitive odors, respectively, served as UCS and neutral geometrical figures as CS. Subjective ratings, skin conductance response (SCRs), and evoked cardiac reactions were analyzed and compared between tasks. Conditioned responses in subjective ratings could be observed in both aversive conditioning and appetitive conditioning, while SCRs discriminated between CS+ and CS- in aversive conditioning only. Regarding conditioned cardiac responses, the deceleration for the CS+ was longer than for the CS- in both tasks. In addition, a higher deceleration magnitude and a shorter acceleration for the CS+ as compared to the CS- were found in aversive but not in appetitive conditioning. There were medium-size correlations between aversive and appetitive CRs for subjective ratings and none for physiological responses. The results suggest similarities between cardiac response patterns in aversive and appetitive conditioning, which implies that bradycardia in conditioning might not be fear-specific but presents a valence-independent CS-elicited bradycardia.

Subjective reward value of visual sexual stimuli is coded in human striatum and orbitofrontal cortex.

Human neuroimaging research suggests the existence of one core network for the subjective valuation of rewards, including the striatum and orbitofrontal cortex. However, there is little research on the neural representation of subjective reward values of visual sexual stimuli (VSS) and on the role of these subjective valuations in the development of related addictive behaviors. Here, we investigate how neural reactivity to VSS is connected to individual preference using functional magnetic resonance imaging (fMRI). During the fMRI scan, 72 men viewed different VSS film clips. Ratings regarding valence and sexual arousal were collected and used as parametric modulators in the fMRI analysis. Subjects also filled out questionnaires on self-reported symptoms of problematic pornography use (PPU). Firstly, we found that neural reactivity towards VSS clips in the nucleus accumbens, caudate nucleus and orbitofrontal cortex was positively correlated with individual ratings of the respective VSS in all subjects. Second, the strength of the association between neural activity and sexual arousal ratings was positively correlated with self-reported symptoms of PPU. The first result suggests a precise appraisal of VSS according to individual preferences in established reward valuation regions. Secondly, stronger neural differentiation based on preference in participants with more PPU symptoms indicates an increased importance of VSS/preference fit in these individuals. This heightened correspondence between individual liking and neural activity may facilitate PPU development by increased signaling of incentive salience, thus boosting motivation to seek out and respond to these preferred stimuli.

Relationship of sensation seeking with the neural correlates of appetitive conditioning.

Previous research has linked sensation seeking with a heightened risk for drug abuse and other risk-taking behavior. As appetitive conditioning presents a model for the etiology and maintenance of addictive behavior, investigating sensation seeking in a classical conditioning paradigm might elucidate possible pathways toward addiction within this model. Furthermore, the theoretical concept underlying sensation seeking proposes a negative relationship between reward processing and sensation seeking in only moderately arousing situations, which has been neglected by previous research. This study aimed to investigate this inverse relationship in moderately stimulating situations entailing reward processing using functional magnetic resonance imaging. Subjects (N = 38) participated in a classical conditioning paradigm in which a neutral stimulus (CS+) was repeatedly paired with a monetary reward, while another neutral stimulus (CS-) was not. Imaging results revealed a negative relationship between sensation seeking and neural responses in the insula, amygdala and nucleus accumbens during the early phase and in the dorsal anterior cingulate cortex during the late phase of conditioning. These findings suggest reduced reward learning and consequently diminished processing of outcome expectancy in appetitive conditioning in subjects with high sensation seeking scores. The results are discussed with respect to clinical implications.

Increased neural reactivity to emotional pictures in men with high hair testosterone concentrations.

Testosterone has been linked to alterations in the activity of emotion neurocircuitry including amygdala, orbitofrontal cortex (OFC) and insula and diminished functional amygdala/prefrontal coupling. Such associations have only ever been studied using acute measures of testosterone, thus little is known about respective relationships with long-term testosterone secretion. Here, we examine associations between hair testosterone concentration (HTC), an index of long-term cumulative testosterone levels and neural reactivity during an emotional passive viewing task using functional magnetic resonance imaging (fMRI). Forty-six men viewed negative, positive and neutral pictures in the MRI. HTCs were assessed from 2 cm hair segments. The emotional paradigm elicited neural activation in the amygdala, insula and OFC. HTCs were associated with increased reactivity to negative pictures in the insula and increased reactivity to positive pictures in the OFC. We show an association of long-term testosterone levels with increased emotional reactivity in the brain. These results suggest a heightened emotional vigilance in individuals with high trait testosterone levels.

Failure to Replicate the Association Between Fractional Anisotropy and the Serotonin Transporter Gene (5-HTTLPR, rs25531).

Recent work underlines the importance of alterations in white matter (e.g., measured by fractional anisotropy (FA)) as a neural vulnerability marker for psychiatric disorders. In this context, the uncinate fasciculus (UF), which connects the limbic system with prefrontal areas, has repeatedly been linked to psychiatric disorders, fear processing, and anxiety-related traits. Individual differences in FA may partly be genetically determined. Variation in the promoter region of the serotonin transporter gene (serotonin transporter-linked polymorphic region [5-HTTLPR]) is a particularly promising candidate in this context, which has been linked to psychiatric disorders as well as to limbic and prefrontal reactivity. However, findings on the association between the 5-HTTLPR and FA within the UF-tract have been heterogeneous. The present study investigated this relationship and extended previous work by considering different genetic classification approaches as well as sex effects in a human sample (n = 114). All participants were genotyped for the 5-HTTLPR and the rs25531 polymorphism. As a main result, we did not find any significant relationship between the 5-HTTLPR and FA in the UF-tract although power analyses showed an adequate power. In addition, genotype effects were neither found when different classification approaches were used nor when analyses were carried out in males or females only. The present findings suggest that the association of the 5-HTTLPR and FA seems to be a more labile phenomenon than previously assumed. Possible explanations and limitations are discussed.

Neural correlates of appetitive extinction in humans.

Appetitive extinction receives attention as an important model for the treatment of psychiatric disorders. However, in humans, its underlying neural correlates remain unknown. To close this gap, we investigated appetitive acquisition and extinction with fMRI in a 2-day monetary incentive delay paradigm. During appetitive conditioning, one stimulus (CS+) was paired with monetary reward, while another stimulus (CS-) was never rewarded. Twenty-four hours later, subjects underwent extinction, in which neither CS was reinforced. Appetitive conditioning elicited stronger skin conductance responses to the CS+ as compared with the CS-. Regarding subjective ratings, the CS+ was rated more pleasant and arousing than the CS- after conditioning. Furthermore, fMRI-results (CS+ - CS-) showed activation of the reward circuitry including amygdala, midbrain and striatal areas. During extinction, conditioned responses were successfully extinguished. In the early phase of extinction, we found a significant activation of the caudate, the hippocampus, the dorsal and ventral anterior cingulate cortex (dACC and vACC). In the late phase, we found significant activation of the nucleus accumbens (NAcc) and the amygdala. Correlational analyses with subjective ratings linked extinction success to the vACC and the NAcc, while associating the dACC with reduced extinction. The results reveal neural correlates of appetitive extinction in humans and extend assumptions from models for human extinction learning.