A dedicated hypothalamic oxytocin circuit controls aversive social learning.

To survive in a complex social group, one needs to know who to approach and, more importantly, who to avoid. In mice, a single defeat causes the losing mouse to stay away from the winner for weeks1. Here through a series of functional manipulation and recording experiments, we identify oxytocin neurons in the retrochiasmatic supraoptic nucleus (SOROXT) and oxytocin-receptor-expressing cells in the anterior subdivision of the ventromedial hypothalamus, ventrolateral part (aVMHvlOXTR) as a key circuit motif for defeat-induced social avoidance. Before defeat, aVMHvlOXTR cells minimally respond to aggressor cues. During defeat, aVMHvlOXTR cells are highly activated and, with the help of an exclusive oxytocin supply from the SOR, potentiate their responses to aggressor cues. After defeat, strong aggressor-induced aVMHvlOXTR cell activation drives the animal to avoid the aggressor and minimizes future defeat. Our study uncovers a neural process that supports rapid social learning caused by defeat and highlights the importance of the brain oxytocin system in social plasticity.

Visuo-frontal interactions during social learning in freely moving macaques.

Social interactions represent a ubiquitous aspect of our everyday life that we acquire by interpreting and responding to visual cues from conspecifics1. However, despite the general acceptance of this view, how visual information is used to guide the decision to cooperate is unknown. Here, we wirelessly recorded the spiking activity of populations of neurons in the visual and prefrontal cortex in conjunction with wireless recordings of oculomotor events while freely moving macaques engaged in social cooperation. As animals learned to cooperate, visual and executive areas refined the representation of social variables, such as the conspecific or reward, by distributing socially relevant information among neurons in each area. Decoding population activity showed that viewing social cues influences the decision to cooperate. Learning social events increased coordinated spiking between visual and prefrontal cortical neurons, which was associated with improved accuracy of neural populations to encode social cues and the decision to cooperate. These results indicate that the visual-frontal cortical network prioritizes relevant sensory information to facilitate learning social interactions while freely moving macaques interact in a naturalistic environment.

A distinct cortical code for socially learned threat.

Animals can learn about sources of danger while minimizing their own risk by observing how others respond to threats. However, the distinct neural mechanisms by which threats are learned through social observation (known as observational fear learning1-4 (OFL)) to generate behavioural responses specific to such threats remain poorly understood. The dorsomedial prefrontal cortex (dmPFC) performs several key functions that may underlie OFL, including processing of social information and disambiguation of threat cues5-11. Here we show that dmPFC is recruited and required for OFL in mice. Using cellular-resolution microendoscopic calcium imaging, we demonstrate that dmPFC neurons code for observational fear and do so in a manner that is distinct from direct experience. We find that dmPFC neuronal activity predicts upcoming switches between freezing and moving state elicited by threat. By combining neuronal circuit mapping, calcium imaging, electrophysiological recordings and optogenetics, we show that dmPFC projections to the midbrain periaqueductal grey (PAG) constrain observer freezing, and that amygdalar and hippocampal inputs to dmPFC opposingly modulate observer freezing. Together our findings reveal that dmPFC neurons compute a distinct code for observational fear and coordinate long-range neural circuits to select behavioural responses.

Humans flexibly integrate social information despite interindividual differences in reward.

There has been much progress in understanding human social learning, including recent studies integrating social information into the reinforcement learning framework. Yet previous studies often assume identical payoffs between observer and demonstrator, overlooking the diversity of social information in real-world interactions. We address this gap by introducing a socially correlated bandit task that accommodates payoff differences among participants, allowing for the study of social learning under more realistic conditions. Our Social Generalization (SG) model, tested through evolutionary simulations and two online experiments, outperforms existing models by incorporating social information into the generalization process, but treating it as noisier than individual observations. Our findings suggest that human social learning is more flexible than previously believed, with the SG model indicating a potential resource-rational trade-off where social learning partially replaces individual exploration. This research highlights the flexibility of humans' social learning, allowing us to integrate social information from others with different preferences, skills, or goals.

The neural and computational systems of social learning.

Learning the value of stimuli and actions from others - social learning - adaptively contributes to individual survival and plays a key role in cultural evolution. We review research across species targeting the neural and computational systems of social learning in both the aversive and appetitive domains. Social learning generally follows the same principles as self-experienced value-based learning, including computations of prediction errors and is implemented in brain circuits activated across task domains together with regions processing social information. We integrate neural and computational perspectives of social learning with an understanding of behaviour of varying complexity, from basic threat avoidance to complex social learning strategies and cultural phenomena.

Immature wild orangutans acquire relevant ecological knowledge through sex-specific attentional biases during social learning.

As a part of growing up, immature orangutans must acquire vast repertoires of skills and knowledge, a process that takes several years of observational social learning and subsequent practice. Adult female and male orangutans show behavioral differences including sex-specific foraging patterns and male-biased dispersal. We investigated how these differing life trajectories affect social interest and emerging ecological knowledge in immatures. We analyzed 15 years of detailed observational data on social learning, associations, and diet repertoires of 50 immatures (16 females and 34 males), from 2 orangutan populations. Specific to the feeding context, we found sex differences in the development of social interest: Throughout the dependency period, immature females direct most of their social attention at their mothers, whereas immature males show an increasing attentional preference for individuals other than their mothers. When attending to non-mother individuals, males show a significant bias toward immigrant individuals and a trend for a bias toward adult males. In contrast, females preferentially attend to neighboring residents. Accordingly, by the end of the dependency period, immature females show a larger dietary overlap with their mothers than do immature males. These results suggest that immature orangutans show attentional biases through which they learn from individuals with the most relevant ecological knowledge. Diversifying their skills and knowledge likely helps males when they move to a new area. In sum, our findings underline the importance of fine-grained social inputs for the acquisition of ecological knowledge and skills in orangutans and likely in other apes as well.

Observation of others' threat reactions recovers memories previously shaped by firsthand experiences.

Information about dangers can spread effectively by observation of others' threat responses. Yet, it is unclear if such observational threat information interacts with associative memories that are shaped by the individual's direct, firsthand experiences. Here, we show in humans and rats that the mere observation of a conspecific's threat reactions reinstates previously learned and extinguished threat responses in the observer. In two experiments, human participants displayed elevated physiological responses to threat-conditioned cues after observational reinstatement in a context-specific manner. The elevation of physiological responses (arousal) was further specific to the context that was observed as dangerous. An analogous experiment in rats provided converging results by demonstrating reinstatement of defensive behavior after observing another rat's threat reactions. Taken together, our findings provide cross-species evidence that observation of others' threat reactions can recover associations previously shaped by direct, firsthand aversive experiences. Our study offers a perspective on how retrieval of threat memories draws from associative mechanisms that might underlie both observations of others' and firsthand experiences.

Synchronous caregiving from birth to adulthood tunes humans' social brain.

Mammalian young are born with immature brain and rely on the mother's body and caregiving behavior for maturation of neurobiological systems that sustain adult sociality. While research in animal models indicated the long-term effects of maternal contact and caregiving on the adult brain, little is known about the effects of maternal-newborn contact and parenting behavior on social brain functioning in human adults. We followed human neonates, including premature infants who initially lacked or received maternal-newborn skin-to-skin contact and full-term controls, from birth to adulthood, repeatedly observing mother-child social synchrony at key developmental nodes. We tested the brain basis of affect-specific empathy in young adulthood and utilized multivariate techniques to distinguish brain regions sensitive to others' distinct emotions from those globally activated by the empathy task. The amygdala, insula, temporal pole (TP), and ventromedial prefrontal cortex (VMPFC) showed high sensitivity to others' distinct emotions. Provision of maternal-newborn contact enhanced social synchrony across development from infancy and up until adulthood. The experience of synchrony, in turn, predicted the brain's sensitivity to emotion-specific empathy in the amygdala and insula, core structures of the social brain. Social synchrony linked with greater empathic understanding in adolescence, which was longitudinally associated with higher neural sensitivity to emotion-specific empathy in TP and VMPFC. Findings demonstrate the centrality of synchronous caregiving, by which infants practice the detection and sharing of others' affective states, for tuning the human social brain, particularly in regions implicated in salience detection, interoception, and mentalization that underpin affect sharing and human attachment.

The added value of affective processes for models of human cognition and learning.

Building on the affectivism approach, we expand on Binz et al.'s meta-learning research program by highlighting that emotion and other affective phenomena should be key to the modeling of human learning. We illustrate the added value of affective processes for models of learning across multiple domains with a focus on reinforcement learning, knowledge acquisition, and social learning.

The actions of others act as a pseudo-reward to drive imitation in the context of social reinforcement learning.

While there is no doubt that social signals affect human reinforcement learning, there is still no consensus about how this process is computationally implemented. To address this issue, we compared three psychologically plausible hypotheses about the algorithmic implementation of imitation in reinforcement learning. The first hypothesis, decision biasing (DB), postulates that imitation consists in transiently biasing the learner's action selection without affecting their value function. According to the second hypothesis, model-based imitation (MB), the learner infers the demonstrator's value function through inverse reinforcement learning and uses it to bias action selection. Finally, according to the third hypothesis, value shaping (VS), the demonstrator's actions directly affect the learner's value function. We tested these three hypotheses in 2 experiments (N = 24 and N = 44) featuring a new variant of a social reinforcement learning task. We show through model comparison and model simulation that VS provides the best explanation of learner's behavior. Results replicated in a third independent experiment featuring a larger cohort and a different design (N = 302). In our experiments, we also manipulated the quality of the demonstrators' choices and found that learners were able to adapt their imitation rate, so that only skilled demonstrators were imitated. We proposed and tested an efficient meta-learning process to account for this effect, where imitation is regulated by the agreement between the learner and the demonstrator. In sum, our findings provide new insights and perspectives on the computational mechanisms underlying adaptive imitation in human reinforcement learning.

Social reinforcement learning as a predictor of real-life experiences in individuals with high and low depressive symptomatology.

BACKGROUND: Several studies have reported diminished learning from non-social outcomes in depressed individuals. However, it is not clear how depression impacts learning from social feedback. Notably, mood disorders are commonly associated with deficits in social functioning, which raises the possibility that potential impairments in social learning may negatively affect real-life social experiences in depressed subjects. METHODS: Ninety-two participants with high (HD; N = 40) and low (LD; N = 52) depression scores were recruited. Subjects performed a learning task, during which they received monetary outcomes or social feedback which they were told came from other people. Additionally, participants answered questions about their everyday social experiences. Computational models were fit to the data and model parameters were related to social experience measures. RESULTS: HD subjects reported a reduced quality and quantity of social experiences compared to LD controls, including an increase in the amount of time spent in negative social situations. Moreover, HD participants showed lower learning rates than LD subjects in the social condition of the task. Interestingly, across all participants, reduced social learning rates predicted higher amounts of time spent in negative social situations, even when depression scores were controlled for. CONCLUSION: These findings indicate that deficits in social learning may affect the quality of everyday social experiences. Specifically, the impaired ability to use social feedback to appropriately update future actions, which was observed in HD subjects, may lead to suboptimal interpersonal behavior in real life. This, in turn, may evoke negative feedback from others, thus bringing about more unpleasant social encounters.

Functional neuroanatomy and neural oscillations during social eavesdropping in male golden hamsters.

Social eavesdropping is a low-cost learning mechanism by which individuals extract relevant social information from social interactions between conspecifics, thereby gaining subsequent advantages in information gathering and usage. The aim of this study was to take advantage of a new hamster model of social eavesdropping to investigate behavioral consequences and neural activity in male hamsters during social eavesdropping. Bystander hamsters with a defeat experience were exposed to either a fighting interaction, a neutral encounter, or control conditions for 3 days of social eavesdropping. In Experiment 1, bystanders in the fight and neutral groups displayed more information gathering behaviors and less nonsocial behavior than control hamsters. The fight group displayed significant increases in c-Fos-positive neurons in the anterior mid-cingulate cortex (aMCC) and the piriform cortex. A slight but not significant group difference was found in their serum cortisol levels. In vivo local field potential oscillation recordings in Experiment 2 revealed that bystanders in the fight group had more delta oscillations in the aMCC during information gathering across 3-day social eavesdropping than those in the other 2 groups. Experiment 3 confirmed that 20 min of social eavesdropping on Day 1 was sufficient to evoke differential behavioral outcomes, and the behavioral responses became more prominent after 3 days of social eavesdropping. Collectively, our study confirmed that male golden hamsters are capable of social eavesdropping and indicated the involvement of aMCC delta oscillations in social eavesdropping.

Reduction in social learning and increased policy uncertainty about harmful intent is associated with pre-existing paranoid beliefs: Evidence from modelling a modified serial dictator game.

Current computational models suggest that paranoia may be explained by stronger higher-order beliefs about others and increased sensitivity to environments. However, it is unclear whether this applies to social contexts, and whether it is specific to harmful intent attributions, the live expression of paranoia. We sought to fill this gap by fitting a computational model to data (n = 1754) from a modified serial dictator game, to explore whether pre-existing paranoia could be accounted by specific alterations to cognitive parameters characterising harmful intent attributions. We constructed a 'Bayesian brain' model of others' intent, which we fitted to harmful intent and self-interest attributions made over 18 trials, across three different partners. We found that pre-existing paranoia was associated with greater uncertainty about other's actions. It moderated the relationship between learning rates and harmful intent attributions, making harmful intent attributions less reliant on prior interactions. Overall, the magnitude of harmful intent attributions was directly related to their uncertainty, and importantly, the opposite was true for self-interest attributions. Our results explain how pre-existing paranoia may be the result of an increased need to attend to immediate experiences in determining intentional threat, at the expense of what is already known, and more broadly, they suggest that environments that induce greater probabilities of harmful intent attributions may also induce states of uncertainty, potentially as an adaptive mechanism to better detect threatening others. Importantly, we suggest that if paranoia were able to be explained exclusively by core domain-general alterations we would not observe differential parameter estimates underlying harmful-intent and self-interest attributions.

Aberrant computational mechanisms of social learning and decision-making in schizophrenia and borderline personality disorder.

Psychiatric disorders are ubiquitously characterized by debilitating social impairments. These difficulties are thought to emerge from aberrant social inference. In order to elucidate the underlying computational mechanisms, patients diagnosed with major depressive disorder (N = 29), schizophrenia (N = 31), and borderline personality disorder (N = 31) as well as healthy controls (N = 34) performed a probabilistic reward learning task in which participants could learn from social and non-social information. Patients with schizophrenia and borderline personality disorder performed more poorly on the task than healthy controls and patients with major depressive disorder. Broken down by domain, borderline personality disorder patients performed better in the social compared to the non-social domain. In contrast, controls and major depressive disorder patients showed the opposite pattern and schizophrenia patients showed no difference between domains. In effect, borderline personality disorder patients gave up a possible overall performance advantage by concentrating their learning in the social at the expense of the non-social domain. We used computational modeling to assess learning and decision-making parameters estimated for each participant from their behavior. This enabled additional insights into the underlying learning and decision-making mechanisms. Patients with borderline personality disorder showed slower learning from social and non-social information and an exaggerated sensitivity to changes in environmental volatility, both in the non-social and the social domain, but more so in the latter. Regarding decision-making the modeling revealed that compared to controls and major depression patients, patients with borderline personality disorder and schizophrenia showed a stronger reliance on social relative to non-social information when making choices. Depressed patients did not differ significantly from controls in this respect. Overall, our results are consistent with the notion of a general interpersonal hypersensitivity in borderline personality disorder and schizophrenia based on a shared computational mechanism characterized by an over-reliance on beliefs about others in making decisions and by an exaggerated need to make sense of others during learning specifically in borderline personality disorder.

Neural Pattern Similarity Unveils the Integration of Social Information and Aversive Learning.

Attributing intentions to others' actions is important for learning to avoid their potentially harmful consequences. Here, we used functional magnetic resonance imaging multivariate pattern analysis to investigate how the brain integrates information about others' intentions with the aversive outcome of their actions. In an interactive aversive learning task, participants (n = 33) were scanned while watching two alleged coparticipants (confederates)-one making choices intentionally and the other unintentionally-leading to aversive (a mild shock) or safe (no shock) outcomes to the participant. We assessed the trial-by-trial changes in participants' neural activation patterns related to observing the coparticipants and experiencing the outcome of their choices. Participants reported a higher number of shocks, more discomfort, and more anger to shocks given by the intentional player. Intentionality enhanced responses to aversive actions in the insula, anterior cingulate cortex, inferior frontal gyrus, dorsal medial prefrontal cortex, and the anterior superior temporal sulcus. Our findings indicate that neural pattern similarities index the integration of social and threat information across the cortex.

Community through Culture: From Insects to Whales: How Social Learning and Culture Manifest across Diverse Animal Communities.

It has become increasingly clear that social learning and culture occur much more broadly, and in a wider variety of animal communities, than initially believed. Recent research has expanded the list to include insects, fishes, elephants, and cetaceans. Such diversity allows scientists to expand the scope of potential research questions, which can help form a more complete understanding of animal culture than any single species can provide on its own. It is crucial to understand how culture and social learning present in different communities, as well as what influences community structure and culture may have on one another, so that the results across these different studies may most effectively inform one another. This review presents an overview of social learning in species across a spectrum of community structures, providing the necessary infrastructure to allow a comparison of studies that will help move the field of animal culture forward.

Instructor-learner brain coupling discriminates between instructional approaches and predicts learning.

The neural mechanisms that support naturalistic learning via effective pedagogical approaches remain elusive. Here we used functional near-infrared spectroscopy to measure brain activity from instructor-learner dyads simultaneously during dynamic conceptual learning. Results revealed that brain-to-brain coupling was correlated with learning outcomes, and, crucially, appeared to be driven by specific scaffolding behaviors on the part of the instructors (e.g., asking guiding questions or providing hints). Brain-to-brain coupling enhancement was absent when instructors used an explanation approach (e.g., providing definitions or clarifications). Finally, we found that machine-learning techniques were more successful when decoding instructional approaches (scaffolding vs. explanation) from brain-to-brain coupling data than when using a single-brain method. These findings suggest that brain-to-brain coupling as a pedagogically relevant measure tracks the naturalistic instructional process during instructor-learner interaction throughout constructive engagement, but not information clarification.

Synchronization between instructor and observer when learning a complex bimanual skill.

While learning from an instructor by watching a 'how-to' video has become common practice, we know surprisingly little about the relation between brain activities in instructor and observers. In this fMRI study we investigated the temporal synchronization between instructor and observers using intersubject correlation in the naturalistic setting of learning to fold origami. Brain activity of the blindfolded instructor during action production was compared to the observers while they viewed the instructor's video-taped actions. We demonstrate for the first time that the BOLD activity in the instructor's and observer's brain are synchronized while observing and learning a manual complex task with the goal of reproducing it. We can rule out that this synchrony originates from visual feedback. Observers exhibiting higher synchrony with the instructor in the ventral premotor cortex, while viewing the video for the first time, were more successful in reproducing the origami afterwards. Furthermore, changes in instructor-observer synchrony across observational learning sessions occur in cerebellar areas, as well as differences in instructor-observer synchrony between learning and the counting folds, our non-learning control. Not only known cerebellar motor production areas show synchrony, shedding new light on the involvement of the cerebellum in action observation and learning.

Experience selectively alters functional connectivity within a neural network to predict learned behavior in juvenile songbirds.

One of the central questions of neuroethology is how specialized brain areas communicate to form dynamic networks that support complex cognitive and behavioral processes. Developmental song learning in the male zebra finch songbird (Taeniopygia guttata) provides a unique window into the complex interplay among sensory, sensorimotor, and motor network nodes. The foundation of a young male's song structure is the sensory memory he forms during interactions with an adult "tutor." However, even in the absence of tutoring, juveniles produce a song-like behavior. Thus, by controlling a juvenile male's tutor exposure, we can examine how tutor experience affects distributed neural networks and how network properties predict behavior. Here, we used longitudinal, resting-state fMRI (rs-fMRI) functional connectivity (FC) and song analyses to examine known nodes of the song network, and to allow discovery of additional areas functionally related to song learning. We present three major novel findings. First, tutor deprivation significantly reduced the global FC strength of the caudomedial nidopallium (NCM) subregion of the auditory forebrain required for sensory song learning. Second, tutor deprivation resulted in reduced FC between NCM and cerebellar lobule VI, a region analogous to areas that regulate limbic, social, and language functions in humans. Third, NCM FC strength predicted song stereotypy and mediated the relationship between tutoring and stereotypy, thus completing the link between experience, neural network properties, and complex learned behavior.

Physical and observational practices of unusual actions prime action verb processing.

Numerous studies have highlighted a strong relationship between language and sensorimotor processes, showing, for example, that perceiving an action influences subsequent language processing. Moreover, previous studies have demonstrated that the context in which actions are perceived is crucial to enable this action-language relationship. In particular, action verb processing is facilitated when an action is perceived in its usual context (e.g., someone watering a plant) but not in an unusual context (e.g., someone watering a computer). This difference could be explained in terms of experience; because people always practice actions in accordance with the context, they have no (visual or motor) experience related to the unusual context. The aim of the present study was to test this assumption by assessing and comparing the effect of physical practice and observational learning on the action-language relationship. The results of two experiments showed a facilitation effect of both training methods. Whereas usual actions systematically prime action verb processing, the link between action and language appears for unusual actions only after training by practicing (experiment 1, physical practice) or observing (experiment 2, observational learning). Overall, these findings support the role of experience in the activation of sensorimotor representations during action verb processing.