The psychological, computational, and neural foundations of indebtedness.

Receiving a favor from another person may induce a negative feeling of indebtedness for the beneficiary. In this study, we explore these hidden costs by developing and validating a conceptual model of indebtedness across three studies that combine a large-scale online questionnaire, an interpersonal game, computational modeling, and neuroimaging. Our model captures how individuals perceive the altruistic and strategic intentions of the benefactor. These inferences produce distinct feelings of guilt and obligation that together comprise indebtedness and motivate reciprocity. Perceived altruistic intentions convey care and communal concern and are associated with activity in insula, ventromedial prefrontal cortex and dorsolateral prefrontal cortex, while inferred strategic intentions convey expectations of future reciprocity and are associated with activation in temporal parietal junction and dorsomedial prefrontal cortex. We further develop a neural utility model of indebtedness using multivariate patterns of brain activity that captures the tradeoff between these feelings and reliably predicts reciprocity behavior.

The Emerging Science of Interacting Minds.

For over a century, psychology has focused on uncovering mental processes of a single individual. However, humans rarely navigate the world in isolation. The most important determinants of successful development, mental health, and our individual traits and preferences arise from interacting with other individuals. Social interaction underpins who we are, how we think, and how we behave. Here we discuss the key methodological challenges that have limited progress in establishing a robust science of how minds interact and the new tools that are beginning to overcome these challenges. A deep understanding of the human mind requires studying the context within which it originates and exists: social interaction.

Py-Feat: Python Facial Expression Analysis Toolbox.

Studying facial expressions is a notoriously difficult endeavor. Recent advances in the field of affective computing have yielded impressive progress in automatically detecting facial expressions from pictures and videos. However, much of this work has yet to be widely disseminated in social science domains such as psychology. Current state-of-the-art models require considerable domain expertise that is not traditionally incorporated into social science training programs. Furthermore, there is a notable absence of user-friendly and open-source software that provides a comprehensive set of tools and functions that support facial expression research. In this paper, we introduce Py-Feat, an open-source Python toolbox that provides support for detecting, preprocessing, analyzing, and visualizing facial expression data. Py-Feat makes it easy for domain experts to disseminate and benchmark computer vision models and also for end users to quickly process, analyze, and visualize face expression data. We hope this platform will facilitate increased use of facial expression data in human behavior research. Supplementary Information: The online version contains supplementary material available at 10.1007/s42761-023-00191-4.

Characterizing the mechanisms of social connection.

Understanding how individuals form and maintain strong social networks has emerged as a significant public health priority as a result of the increased focus on the epidemic of loneliness and the myriad protective benefits conferred by social connection. In this review, we highlight the psychological and neural mechanisms that enable us to connect with others, which in turn help buffer against the consequences of stress and isolation. Central to this process is the experience of rewards derived from positive social interactions, which encourage the sharing of perspectives and preferences that unite individuals. Sharing affective states with others helps us to align our understanding of the world with another's, thereby continuing to reinforce bonds and strengthen relationships. These psychological processes depend on neural systems supporting reward and social cognitive function. Lastly, we also consider limitations associated with pursuing healthy social connections and outline potential avenues of future research.

Synchronized affect in shared experiences strengthens social connection.

People structure their days to experience events with others. We gather to eat meals, watch TV, and attend concerts together. What constitutes a shared experience and how does it manifest in dyadic behavior? The present study investigates how shared experiences-measured through emotional, motoric, physiological, and cognitive alignment-promote social bonding. We recorded the facial expressions and electrodermal activity (EDA) of participants as they watched four episodes of a TV show for a total of 4 h with another participant. Participants displayed temporally synchronized and spatially aligned emotional facial expressions and the degree of synchronization predicted the self-reported social connection ratings between viewing partners. We observed a similar pattern of results for dyadic physiological synchrony measured via EDA and their cognitive impressions of the characters. All four of these factors, temporal synchrony of positive facial expressions, spatial alignment of expressions, EDA synchrony, and character impression similarity, contributed to a latent factor of a shared experience that predicted social connection. Our findings suggest that the development of interpersonal affiliations in shared experiences emerges from shared affective experiences comprising synchronous processes and demonstrate that these complex interpersonal processes can be studied in a holistic and multi-modal framework leveraging naturalistic experimental designs.

Long gaps between turns are awkward for strangers but not for friends.

When people feel connected they tend to respond quickly in conversation, creating short gaps between turns. But are long gaps always a sign that things have gone awry? We analysed the frequency and impact of long gaps (greater than 2 s) in conversations between strangers and between friends. As predicted, long gaps signalled disconnection between strangers. However, long gaps between friends marked moments of increased connection and friends tended to have more of them. These differences in connection were also perceived by independent raters: only the long gaps between strangers were rated as awkward, and increasingly so the longer they lasted. Finally, we show that, compared to strangers, long gaps between friends include more genuine laughter and are less likely to precede a topic change. This suggests that the gaps of friends may not function as 'gaps' at all, but instead allow space for enjoyment and mutual reflection. Together, these findings suggest that the turn-taking dynamics of friends are meaningfully different from those of strangers and may be less bound by social conventions. More broadly, this work illustrates that samples of convenience-pairs of strangers being the modal paradigm for interaction research-may not capture the social dynamics of more familiar relationships. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

Similarity Among Friends Serves as a Social Prior: The Assumption That "Birds of a Feather Flock Together" Shapes Social Decisions and Relationship Beliefs.

Social interactions unfold within networks of relationships. How do beliefs about others' social ties shape-and how are they shaped by-expectations about how others will behave? Here, participants joined a fictive online game-playing community and interacted with its purported members, who varied in terms of their trustworthiness and apparent relationships with one another. Participants were less trusting of partners with untrustworthy friends, even after they consistently showed themselves to be trustworthy, and were less willing to engage with them in the future. To test whether people not only expect friends to behave similarly but also expect those who behave similarly to be friends, an incidental memory test was given. Participants were exceptionally likely to falsely remember similarly behaving partners as friends. Thus, people expect friendship to predict similar behavior and vice versa. These results suggest that knowledge of social networks and others' behavioral tendencies reciprocally interact to shape social thought and behavior.

Recovering Individual Emotional States from Sparse Ratings Using Collaborative Filtering.

A fundamental challenge in emotion research is measuring feeling states with high granularity and temporal precision without disrupting the emotion generation process. Here we introduce and validate a new approach in which responses are sparsely sampled and the missing data are recovered using a computational technique known as collaborative filtering (CF). This approach leverages structured covariation across individual experiences and is available in Neighbors, an open-source Python toolbox. We validate our approach across three different experimental contexts by recovering dense individual ratings using only a small subset of the original data. In dataset 1, participants (n=316) separately rated 112 emotional images on 6 different discrete emotions. In dataset 2, participants (n=203) watched 8 short emotionally engaging autobiographical stories while simultaneously providing moment-by-moment ratings of the intensity of their affective experience. In dataset 3, participants (n=60) with distinct social preferences made 76 decisions about how much money to return in a hidden multiplier trust game. Across all experimental contexts, CF was able to accurately recover missing data and importantly outperformed mean and multivariate imputation, particularly in contexts with greater individual variability. This approach will enable new avenues for affective science research by allowing researchers to acquire high dimensional ratings from emotional experiences with minimal disruption to the emotion-generation process. Supplementary Information: The online version contains supplementary material available at 10.1007/s42761-022-00161-2.

Fast response times signal social connection in conversation.

Clicking is one of the most robust metaphors for social connection. But how do we know when two people "click"? We asked pairs of friends and strangers to talk with each other and rate their felt connection. For both friends and strangers, speed in response was a robust predictor of feeling connected. Conversations with faster response times felt more connected than conversations with slower response times, and within conversations, connected moments had faster response times than less-connected moments. This effect was determined primarily by partner responsivity: People felt more connected to the degree that their partner responded quickly to them rather than by how quickly they responded to their partner. The temporal scale of these effects (<250 ms) precludes conscious control, thus providing an honest signal of connection. Using a round-robin design in each of six closed networks, we show that faster responders evoked greater feelings of connection across partners. Finally, we demonstrate that this signal is used by third-party listeners as a heuristic of how well people are connected: Conversations with faster response times were perceived as more connected than the same conversations with slower response times. Together, these findings suggest that response times comprise a robust and sufficient signal of whether two minds "click."

Effect sizes and test-retest reliability of the fMRI-based neurologic pain signature.

Identifying biomarkers that predict mental states with large effect sizes and high test-retest reliability is a growing priority for fMRI research. We examined a well-established multivariate brain measure that tracks pain induced by nociceptive input, the Neurologic Pain Signature (NPS). In N = 295 participants across eight studies, NPS responses showed a very large effect size in predicting within-person single-trial pain reports (d = 1.45) and medium effect size in predicting individual differences in pain reports (d = 0.49). The NPS showed excellent short-term (within-day) test-retest reliability (ICC = 0.84, with average 69.5 trials/person). Reliability scaled with the number of trials within-person, with ≥60 trials required for excellent test-retest reliability. Reliability was tested in two additional studies across 5-day (N = 29, ICC = 0.74, 30 trials/person) and 1-month (N = 40, ICC = 0.46, 5 trials/person) test-retest intervals. The combination of strong within-person correlations and only modest between-person correlations between the NPS and pain reports indicate that the two measures have different sources of between-person variance. The NPS is not a surrogate for individual differences in pain reports but can serve as a reliable measure of pain-related physiology and mechanistic target for interventions.

Endogenous variation in ventromedial prefrontal cortex state dynamics during naturalistic viewing reflects affective experience.

How we process ongoing experiences is shaped by our personal history, current needs, and future goals. Consequently, ventromedial prefrontal cortex (vmPFC) activity involved in processing these subjective appraisals appears to be highly idiosyncratic across individuals. To elucidate the role of the vmPFC in processing our ongoing experiences, we developed a computational framework and analysis pipeline to characterize the spatiotemporal dynamics of individual vmPFC responses as participants viewed a 45-minute television drama. Through a combination of functional magnetic resonance imaging, facial expression tracking, and self-reported emotional experiences across four studies, our data suggest that the vmPFC slowly transitions through a series of discretized states that broadly map onto affective experiences. Although these transitions typically occur at idiosyncratic times across people, participants exhibited a marked increase in state alignment during high affectively valenced events in the show. Our work suggests that the vmPFC ascribes affective meaning to our ongoing experiences.

Gossip drives vicarious learning and facilitates social connection.

Complex language and communication is one of the unique hallmarks that distinguishes humans from most other animals. Interestingly, the overwhelming majority of our communication consists of social topics involving self-disclosure and discussions about others, broadly construed as gossip. Yet the precise social function of gossip remains poorly understood as research has been heavily influenced by folk intuitions narrowly casting gossip as baseless trash talk. Using a novel empirical paradigm that involves real interactions between a large sample of participants, we provide evidence that gossip is a rich, multifaceted construct, that plays a critical role in vicarious learning and social bonding. We demonstrate how the visibility or lack thereof of others' behavior shifts conversational content between self-disclosure and discussions about others. Social information acquired through gossip aids in vicarious learning, directly influencing future behavior and impression formation. At the same time, conversation partners come to influence each other, form more similar impressions, and build robust social bonds. Consistent with prior work, gossip also helps promote cooperation in groups without a need for formal sanctioning mechanisms. Altogether these findings demonstrate the rich and diverse social functions and effects of this ubiquitous human behavior and lay the groundwork for future investigations.

The Neural Correlates of Cued Reward Omission.

Compared to our understanding of positive prediction error signals occurring due to unexpected reward outcomes, less is known about the neural circuitry in humans that drives negative prediction errors during omission of expected rewards. While classical learning theories such as Rescorla-Wagner or temporal difference learning suggest that both types of prediction errors result from a simple subtraction, there has been recent evidence suggesting that different brain regions provide input to dopamine neurons which contributes to specific components of this prediction error computation. Here, we focus on the brain regions responding to negative prediction error signals, which has been well-established in animal studies to involve a distinct pathway through the lateral habenula. We examine the activity of this pathway in humans, using a conditioned inhibition paradigm with high-resolution functional MRI. First, participants learned to associate a sensory stimulus with reward delivery. Then, reward delivery was omitted whenever this stimulus was presented simultaneously with a different sensory stimulus, the conditioned inhibitor (CI). Both reward presentation and the reward-predictive cue activated midbrain dopamine regions, insula and orbitofrontal cortex. While we found significant activity at an uncorrected threshold for the CI in the habenula, consistent with our predictions, it did not survive correction for multiple comparisons and awaits further replication. Additionally, the pallidum and putamen regions of the basal ganglia showed modulations of activity for the inhibitor that did not survive the corrected threshold.

Surprise Signals Changing Affective Experiences in Naturalistic Sports Spectating.

What role does surprise play in a spectating experience? In this issue of Neuron, Antony et al. (2021) develop and validate a model of surprise to characterize the psychological and neurobiological processes underlying sports fans' experiences as they watch the final minutes of NCAA college basketball games.

Movie viewing elicits rich and reliable brain state dynamics.

Adaptive brain function requires that sensory impressions of the social and natural milieu are dynamically incorporated into intrinsic brain activity. While dynamic switches between brain states have been well characterised in resting state acquisitions, the remodelling of these state transitions by engagement in naturalistic stimuli remains poorly understood. Here, we show that the temporal dynamics of brain states, as measured in fMRI, are reshaped from predominantly bistable transitions between two relatively indistinct states at rest, toward a sequence of well-defined functional states during movie viewing whose transitions are temporally aligned to specific features of the movie. The expression of these brain states covaries with different physiological states and reflects subjectively rated engagement in the movie. In sum, a data-driven decoding of brain states reveals the distinct reshaping of functional network expression and reliable state transitions that accompany the switch from resting state to perceptual immersion in an ecologically valid sensory experience.

Stable distribution of reciprocity motives in a population.

Evolutionary models show that human cooperation can arise through direct reciprocity relationships. However, it remains unclear which psychological mechanisms proximally motivate individuals to reciprocate. Recent evidence suggests that the psychological motives for choosing to reciprocate trust differ between individuals, which raises the question whether these differences have a stable distribution in a population or are rather an artifact of the experimental task. Here, we combine data from three independent trust game studies to find that the relative prevalence of different reciprocity motives is highly stable across participant samples. Furthermore, the distribution of motives is relatively unaffected by changes to the salient features of the experimental paradigm. Finally, the motive classification assigned by our computational modeling analysis corresponds to the participants' own subjective experience of their psychological decision process, and no existing models of social preference can account for the observed individual differences in reciprocity motives. These findings support the view that reciprocal decision-making is not just regulated by individual differences in 'pro-social' versus 'pro-self' tendencies, but also by trait-like differences across several alternative pro-social motives, whose distribution in a population is stable.

Arbitrating Computational Models of Observational Learning.

How do we learn in the absence of direct experience? In this issue of Neuron, Charpentier et al. (2020) proposes a new computational account of observational learning, which arbitrates between choice imitation and goal emulation.

Intersubject representational similarity analysis reveals individual variations in affective experience when watching erotic movies.

We spend much of our lives pursuing or avoiding affective experiences. However, surprisingly little is known about how these experiences are represented in the brain and if they are shared across individuals. Here, we explored variations in the construction of an affective experience during a naturalistic viewing paradigm based on subjective preferences in sociosexual desire and self-control using intersubject representational similarity analysis (IS-RSA). We found that when watching erotic movies, intersubject variations in sociosexual desire preferences of 26 heterosexual males were associated with similarly structured fluctuations in the cortico-striatal reward, default mode, and mentalizing networks. In contrast, variations in the self-control preferences were associated with shared dynamics in the fronto-parietal executive control and cingulo-insular salience networks. Importantly, these results were specific to the affective experience, as we did not observe any relationship with variation in preferences when individuals watched neutral movies. Moreover, these results appear to require multivariate representations of preferences as we did not observe any significant associations using single scalar summary scores. Our findings indicate that multidimensional variations in individual preferences can be used to uncover unique dimensions of an affective experience, and that IS-RSA can provide new insights into the neural processes underlying psychological experiences elicited through naturalistic experimental designs.

A Generalizable Multivariate Brain Pattern for Interpersonal Guilt.

Feeling guilty when we have wronged another is a crucial aspect of prosociality, but its neurobiological bases are elusive. Although multivariate patterns of brain activity show promise for developing brain measures linked to specific emotions, it is less clear whether brain activity can be trained to detect more complex social emotional states such as guilt. Here, we identified a distributed guilt-related brain signature (GRBS) across two independent neuroimaging datasets that used interpersonal interactions to evoke guilt. This signature discriminated conditions associated with interpersonal guilt from closely matched control conditions in a cross-validated training sample (N = 24; Chinese population) and in an independent test sample (N = 19; Swiss population). However, it did not respond to observed or experienced pain, or recalled guilt. Moreover, the GRBS only exhibited weak spatial similarity with other brain signatures of social-affective processes, further indicating the specificity of the brain state it represents. These findings provide a step toward developing biological markers of social emotions, which could serve as important tools to investigate guilt-related brain processes in both healthy and clinical populations.

Socially transmitted placebo effects.

Medical treatments typically occur in the context of a social interaction between healthcare providers and patients. Although decades of research have demonstrated that patients' expectations can dramatically affect treatment outcomes, less is known about the influence of providers' expectations. Here we systematically manipulated providers' expectations in a simulated clinical interaction involving administration of thermal pain and found that patients' subjective experiences of pain were directly modulated by providers' expectations of treatment success, as reflected in the patients' subjective ratings, skin conductance responses and facial expression behaviours. The belief manipulation also affected patients' perceptions of providers' empathy during the pain procedure and manifested as subtle changes in providers' facial expression behaviours during the clinical interaction. Importantly, these findings were replicated in two more independent samples. Together, our results provide evidence of a socially transmitted placebo effect, highlighting how healthcare providers' behaviour and cognitive mindsets can affect clinical interactions.