Social Cognition as Reinforcement Learning: Feedback Modulates Emotion Inference.

Neuroscientific studies of social cognition typically employ paradigms in which perceivers draw single-shot inferences about the internal states of strangers. Real-world social inference features much different parameters: People often encounter and learn about particular social targets (e.g., friends) over time and receive feedback about whether their inferences are correct or incorrect. Here, we examined this process and, more broadly, the intersection between social cognition and reinforcement learning. Perceivers were scanned using fMRI while repeatedly encountering three social targets who produced conflicting visual and verbal emotional cues. Perceivers guessed how targets felt and received feedback about whether they had guessed correctly. Visual cues reliably predicted one target's emotion, verbal cues predicted a second target's emotion, and neither reliably predicted the third target's emotion. Perceivers successfully used this information to update their judgments over time. Furthermore, trial-by-trial learning signals-estimated using two reinforcement learning models-tracked activity in ventral striatum and ventromedial pFC, structures associated with reinforcement learning, and regions associated with updating social impressions, including TPJ. These data suggest that learning about others' emotions, like other forms of feedback learning, relies on domain-general reinforcement mechanisms as well as domain-specific social information processing.

The ventral pallidum and orbitofrontal cortex support food pleasantness inferences.

Food advertisements often promote choices that are driven by inferences about the hedonic pleasures of eating a particular food. Given the individual and public health consequences of obesity, it is critical to address unanswered questions about the specific neural systems underlying these hedonic inferences. For example, although regions such as the orbitofrontal cortex (OFC) are frequently observed to respond more to pleasant food images than less hedonically pleasing stimuli, one important hedonic brain region in particular has largely remained conspicuously absent among human studies of hedonic response to food images. Based on rodent research demonstrating that activity in the ventral pallidum underlies the hedonic pleasures experienced upon eating food rewards, one might expect that activity in this important 'hedonic hotspot' might also track inferred food pleasantness. To date, however, no human studies have assessed this question. We thus asked human subjects to undergo fMRI and make item-by-item ratings of how pleasant it would be to eat particular visually perceived foods. Activity in the ventral pallidum was strongly modulated with pleasantness inferences. Additionally, activity within a region of the orbitofrontal cortex that tracks the pleasantness of tastes was also modulated with inferred pleasantness. Importantly, the reliability of these findings is demonstrated by their replication when we repeated the experiment at a new site with new subjects. These two experiments demonstrate that the ventral pallidum, in addition to the OFC, plays a central role in the moment-to-moment hedonic inferences that influence food-related decision-making.

Neuropeptide orphanin FQ inhibits dendritic morphogenesis through activation of RhoA.

Brain-derived neurotrophic factor (BDNF) plays a facilitatory role in neuronal development and promotion of differentiation. Mechanisms that oppose BDNF's stimulatory effects create balance and regulate dendritic growth. However, these mechanisms have not been studied. We have focused our studies on the BDNF-induced neuropeptide OrphaninFQ/ Nociceptin (OFQ); while BDNF is known to enhance synaptic activity, OFQ has opposite effects on activity, learning, and memory. We have now examined whether OFQ provides a balance to the stimulatory effects of BDNF on neuronal differentiation in the hippocampus. Golgi staining in OFQ knockout (KO) mice revealed an increase in primary dendrite length as well as spine density, suggesting that endogenous OFQ inhibits dendritic morphology. We have also used cultured hippocampal neurons to demonstrate that exogenous OFQ has an inhibitory effect on dendritic growth and that the neuropeptide alters the response to BDNF when pre-administered. To determine if BDNF and OFQ act in a feedback loop, we inhibited the actions of the BDNF and OFQ receptors, TrkB and NOP using ANA-12 and NOP KO mice respectively but our data suggest that the two factors do not act in a negative feedback loop. We found that the inhibition of dendritic morphology induced by OFQ is via enhanced RhoA activity. Finally, we have evidence that RhoA activation is required for the inhibitory effects of OFQ on dendritic morphology. Our results reveal basic mechanisms by which neurons not only regulate the formation of proper dendritic growth during development but also control plasticity in the mature nervous system.

Category-specific integration of homeostatic signals in caudal but not rostral human insula.

Prevailing theories hold that the insula is functionally organized along its caudal-to-rostral axis, with posterior regions coding lower-level sensory information and anterior regions coding higher-level stimulus significance relative to the body's homeostatic needs. Contrary to predictions of this model, the response of the taste-sensitive region of the caudal, but not rostral, insula to food images was directly related to the body's homeostatic state as indexed by levels of peripheral glucose.