Oxytocin receptor behavioral effects and cell types in the bed nucleus of the stria terminalis.

Oxytocin is a neuropeptide that can produce anxiolytic effects and promote social approach. However, emerging evidence shows that under some conditions, oxytocin can instead induce anxiety-related behaviors. These diverse effects of oxytocin appear to be mediated by circuit-specific actions. Recent data showed that inhibition of oxytocin receptors (OTRs) in the bed nucleus of the stria terminalis (BNST) was sufficient to increase social approach and decrease social vigilance in female California mice (Peromyscus californicus) exposed to social defeat stress. As a member of the G-protein coupled receptor family, OTRs can induce distinct downstream pathways by coupling to different G-protein isoforms. We show that infusion of carbetocin, a biased OTR-Gq agonist, in the BNST reduced social approach in both female and male California mice. In both females and males, carbetocin also increased social vigilance. To gain insight into cell types that could be mediating this effect, we analyzed previously published single-cell RNAseq data from the BNST and nucleus accumbens (NAc). In the NAc, we and others showed that OTR activation promotes social approach behaviors. In the BNST, Oxtr was expressed in over 40 cell types, that span both posterior and anterior subregions of the BNST. The majority of Oxtr-expressing neurons were GABAergic. In the anterior regions of BNST targeted in our carbetocin experiments, Cyp26b1-expressing neurons had high average Oxtr expression. In the NAc, most Oxtr+ cells were D1 dopamine receptor-expressing neurons and interneurons. These differences in Oxtr cell type distribution may help explain how activation of OTR in BNST versus NAc can have different effects on social approach and social vigilance.

Social approach and social vigilance are differentially regulated by oxytocin receptors in the nucleus accumbens.

Oxytocin is currently being considered as a novel therapeutic for anxiety disorders due to its ability to promote affiliative behaviors. In the nucleus accumbens (NAc) activation of oxytocin receptors (OTR) promotes social approach (time spent near an unfamiliar individual). Here, we show that stressful social experiences reduce the expression of NAc OTR mRNA, coinciding with decreases in social approach. Social stressors also increase social vigilance, characterized as orienting to an unfamiliar individual without approaching. Vigilance is a key component of behavioral inhibition, a personality trait that is a risk factor for anxiety disorders. To understand whether NAc OTR can modulate both social approach and vigilance, we use pharmacological approaches to assess the impact of activation or inhibition of NAc OTR downstream pathways on these behaviors. First, we show that in unstressed male and female California mice, inhibition of OTR by an unbiased antagonist (L-368,899) reduces social approach but does not induce social vigilance. Next, we show that infusion of Atosiban, an OTR-Gq antagonist/OTR-Gi agonist, has the same effect in unstressed females. Finally, we show that Carbetocin, a biased OTR-Gq agonist, increases social approach in stressed females while simultaneously inhibiting social vigilance. Taken together these data suggest that OTR in the NAc differentially modulate social approach and social vigilance, primarily through an OTR-Gq mechanism. Importantly, pharmacological inhibition of OTR alone is insufficient to induce vigilance in unstressed mice, suggesting that mechanisms modulating social approach may be distinct from mechanisms modulating social vigilance.