A framework for studying emotions across species.

Since the 19th century, there has been disagreement over the fundamental question of whether "emotions" are cause or consequence of their associated behaviors. This question of causation is most directly addressable in genetically tractable model organisms, including invertebrates such as Drosophila. Yet there is ongoing debate about whether such species even have "emotions," as emotions are typically defined with reference to human behavior and neuroanatomy. Here, we argue that emotional behaviors are a class of behaviors that express internal emotion states. These emotion states exhibit certain general functional and adaptive properties that apply across any specific human emotions like fear or anger, as well as across phylogeny. These general properties, which can be thought of as "emotion primitives," can be modeled and studied in evolutionarily distant model organisms, allowing functional dissection of their mechanistic bases and tests of their causal relationships to behavior. More generally, our approach not only aims at better integration of such studies in model organisms with studies of emotion in humans, but also suggests a revision of how emotion should be operationalized within psychology and psychiatry.

Collective events and individual affect shape autobiographical memory.

How do collective events shape how we remember our lives? We leveraged advances in natural language processing as well as a rich, longitudinal assessment of 1,000 Americans throughout 2020 to examine how memory is influenced by two prominent factors: surprise and emotion. Autobiographical memory for 2020 displayed a unique signature: There was a substantial bump in March, aligning with pandemic onset and lockdowns, consistent across three memory collections 1 y apart. We further investigated how emotion, using both immediate and retrieved measures, predicted the amount and content of autobiographical memory: Negative affect increased recall across all measures, whereas its more clinical indices, depression and posttraumatic stress disorder, selectively increased nonepisodic recall. Finally, in a separate cohort, we found pandemic news to be better remembered, surprising, and negative, while lockdowns compressed remembered time. Our work connects laboratory findings to the real world and delineates the effects of acute versus clinical signatures of negative emotion on memory.

Video-evoked fMRI BOLD responses are highly consistent across different data acquisition sites.

Naturalistic imaging paradigms, in which participants view complex videos in the scanner, are increasingly used in human cognitive neuroscience. Videos evoke temporally synchronized brain responses that are similar across subjects as well as within subjects, but the reproducibility of these brain responses across different data acquisition sites has not yet been quantified. Here, we characterize the consistency of brain responses across independent samples of participants viewing the same videos in functional magnetic resonance imaging (fMRI) scanners at different sites (Indiana University and Caltech). We compared brain responses collected at these different sites for two carefully matched datasets with identical scanner models, acquisition, and preprocessing details, along with a third unmatched dataset in which these details varied. Our overall conclusion is that for matched and unmatched datasets alike, video-evoked brain responses have high consistency across these different sites, both when compared across groups and across pairs of individuals. As one might expect, differences between sites were larger for unmatched datasets than matched datasets. Residual differences between datasets could in part reflect participant-level variability rather than scanner- or data- related effects. Altogether our results indicate promise for the development and, critically, generalization of video fMRI studies of individual differences in healthy and clinical populations alike.

A new look at domain specificity: insights from social neuroscience.

The concept of domain specificity - which suggests that some aspects of neural processing are specialized for particular types of stimuli - has been invoked to explain a range of cognitive phenomena, including language, face perception and theory of mind, and has been a hallmark of theories of cognitive architecture. More recent usage of this concept draws on neuroscientific data and, in particular, on work in social neuroscience. A critical examination of the part that the concept of domain specificity has played in theories of human brain function leads us to suggest a new view according to which domain specificity pertains to centrally generated constraints on information processing that can be both dynamic and context sensitive.

Multivariate Lesion-Behavior Mapping of General Cognitive Ability and Its Psychometric Constituents.

General cognitive ability, or general intelligence (g), is central to cognitive science, yet the processes that constitute it remain unknown, in good part because most prior work has relied on correlational methods. Large-scale behavioral and neuroanatomical data from neurologic patients with focal brain lesions can be leveraged to advance our understanding of the key mechanisms of g, as this approach allows inference on the independence of cognitive processes along with elucidation of their respective neuroanatomical substrates. We analyzed behavioral and neuroanatomical data from 402 humans (212 males; 190 females) with chronic, focal brain lesions. Structural equation models (SEMs) demonstrated a psychometric isomorphism between g and working memory in our sample (which we refer to as g/Gwm), but not between g and other cognitive abilities. Multivariate lesion-behavior mapping analyses indicated that g and working memory localize most critically to a site of converging white matter tracts deep to the left temporo-parietal junction. Tractography analyses demonstrated that the regions in the lesion-behavior map of g/Gwm were primarily associated with the arcuate fasciculus. The anatomic findings were validated in an independent cohort of acute stroke patients (n = 101) using model-based predictions of cognitive deficits generated from the Iowa cohort lesion-behavior maps. The neuroanatomical localization of g/Gwm provided the strongest prediction of observed g in the new cohort (r = 0.42, p < 0.001), supporting the anatomic specificity of our findings. These results provide converging behavioral and anatomic evidence that working memory is a key mechanism contributing to domain-general cognition.SIGNIFICANCE STATEMENT General cognitive ability (g) is thought to play an important role in individual differences in adaptive behavior, yet its core processes remain unknown, in large part because of difficulties in making causal inferences from correlated data. Using data from patients with focal brain damage, we demonstrate that there is a strong psychometric correspondence between g and working memory - the ability to maintain and control mental information, and that the critical neuroanatomical substrates of g and working memory include the arcuate fasciculus. This work provides converging behavioral and neuroanatomical evidence that working memory is a key mechanism contributing to domain-general cognition.

Abstract goal representation in visual search by neurons in the human pre-supplementary motor area.

The medial frontal cortex is important for goal-directed behaviours such as visual search. The pre-supplementary motor area (pre-SMA) plays a critical role in linking higher-level goals to actions, but little is known about the responses of individual cells in this area in humans. Pre-SMA dysfunction is thought to be a critical factor in the cognitive deficits that are observed in diseases such as Parkinson's disease and schizophrenia, making it important to develop a better mechanistic understanding of the pre-SMA's role in cognition. We simultaneously recorded single neurons in the human pre-SMA and eye movements while subjects performed goal-directed visual search tasks. We characterized two groups of neurons in the pre-SMA. First, 40% of neurons changed their firing rate whenever a fixation landed on the search target. These neurons responded to targets in an abstract manner across several conditions and tasks. Responses were invariant to motor output (i.e. button press or not), and to different ways of defining the search target (by instruction or pop-out). Second, ∼50% of neurons changed their response as a function of fixation order. Together, our results show that human pre-SMA neurons carry abstract signals during visual search that indicate whether a goal was reached in an action- and cue-independent manner. This suggests that the pre-SMA contributes to goal-directed behaviour by flexibly signalling goal detection and time elapsed since start of the search, and this process occurs regardless of task. These observations provide insights into how pre-SMA dysfunction might impact cognitive function.

Anthropomorphizing without Social Cues Requires the Basolateral Amygdala.

Anthropomorphism, the attribution of distinctively human mental characteristics to nonhuman animals and objects, illustrates the human propensity for extending social cognition beyond typical social targets. Yet, its processing components remain challenging to study because they are typically all engaged simultaneously. Across one pilot study and one focal study, we tested three rare people with basolateral amygdala lesions to dissociate two specific processing components: those triggered by attention to social cues (e.g., seeing a face) and those triggered by endogenous semantic knowledge (e.g., imbuing a machine with animacy). A pilot study demonstrated that, like neurologically intact control group participants, the three amygdala-damaged participants produced anthropomorphic descriptions for highly socially salient stimuli but not for stimuli lacking clear social cues. A focal study found that the three amygdala participants could anthropomorphize animate and living entities normally, but anthropomorphized inanimate stimuli less than control participants. Our findings suggest that the amygdala contributes to how we anthropomorphize stimuli that are not explicitly social.

Neural phase locking predicts BOLD response in human auditory cortex.

Natural environments elicit both phase-locked and non-phase-locked neural responses to the stimulus in the brain. The interpretation of the BOLD signal to date has been based on an association of the non-phase-locked power of high-frequency local field potentials (LFPs), or the related spiking activity in single neurons or groups of neurons. Previous studies have not examined the prediction of the BOLD signal by phase-locked responses. We examined the relationship between the BOLD response and LFPs in the same nine human subjects from multiple corresponding points in the auditory cortex, using amplitude modulated pure tone stimuli of a duration to allow an analysis of phase locking of the sustained time period without contamination from the onset response. The results demonstrate that both phase locking at the modulation frequency and its harmonics, and the oscillatory power in gamma/high-gamma bands are required to predict the BOLD response. Biophysical models of BOLD signal generation in auditory cortex therefore require revision and the incorporation of both phase locking to rhythmic sensory stimuli and power changes in the ensemble neural activity.

Inferring Whether Officials Are Corruptible From Looking at Their Faces.

While inferences of traits from unfamiliar faces prominently reveal stereotypes, some facial inferences also correlate with real-world outcomes. We investigated whether facial inferences are associated with an important real-world outcome closely linked to the face bearer's behavior: political corruption. In four preregistered studies ( N = 325), participants made trait judgments of unfamiliar government officials on the basis of their photos. Relative to peers with clean records, federal and state officials convicted of political corruption (Study 1) and local officials who violated campaign finance laws (Study 2) were perceived as more corruptible, dishonest, selfish, and aggressive but similarly competent, ambitious, and masculine (Study 3). Mediation analyses and experiments in which the photos were digitally manipulated showed that participants' judgments of how corruptible an official looked were causally influenced by the face width of the stimuli (Study 4). The findings shed new light on the complex causal mechanisms linking facial appearances with social behavior.

Amygdala lesions do not compromise the cortical network for false-belief reasoning.

The amygdala plays an integral role in human social cognition and behavior, with clear links to emotion recognition, trust judgments, anthropomorphization, and psychiatric disorders ranging from social phobia to autism. A central feature of human social cognition is a theory-of-mind (ToM) that enables the representation other people's mental states as distinct from one's own. Numerous neuroimaging studies of the best studied use of ToM--false-belief reasoning--suggest that it relies on a specific cortical network; moreover, the amygdala is structurally and functionally connected with many components of this cortical network. It remains unknown whether the cortical implementation of any form of ToM depends on amygdala function. Here we investigated this question directly by conducting functional MRI on two patients with rare bilateral amygdala lesions while they performed a neuroimaging protocol standardized for measuring cortical activity associated with false-belief reasoning. We compared patient responses with those of two healthy comparison groups that included 480 adults. Based on both univariate and multivariate comparisons, neither patient showed any evidence of atypical cortical activity or any evidence of atypical behavioral performance; moreover, this pattern of typical cortical and behavioral response was replicated for both patients in a follow-up session. These findings argue that the amygdala is not necessary for the cortical implementation of ToM in adulthood and suggest a reevaluation of the role of the amygdala and its cortical interactions in human social cognition.

Panic Anxiety in Humans with Bilateral Amygdala Lesions: Pharmacological Induction via Cardiorespiratory Interoceptive Pathways.

We previously demonstrated that carbon dioxide inhalation could induce panic anxiety in a group of rare lesion patients with focal bilateral amygdala damage. To further elucidate the amygdala-independent mechanisms leading to aversive emotional experiences, we retested two of these patients (B.G. and A.M.) to examine whether triggering palpitations and dyspnea via stimulation of non-chemosensory interoceptive channels would be sufficient to elicit panic anxiety. Participants rated their affective and sensory experiences following bolus infusions of either isoproterenol, a rapidly acting peripheral ß-adrenergic agonist akin to adrenaline, or saline. Infusions were administered during two separate conditions: a panic induction and an assessment of cardiorespiratory interoception. Isoproterenol infusions induced anxiety in both patients, and full-blown panic in one (patient B.G.). Although both patients demonstrated signs of diminished awareness for cardiac sensation, patient A.M., who did not panic, reported a complete lack of awareness for dyspnea, suggestive of impaired respiratory interoception. These findings indicate that the amygdala may play a role in dynamically detecting changes in cardiorespiratory sensation. The induction of panic anxiety provides further evidence that the amygdala is not required for the conscious experience of fear induced via interoceptive sensory channels. SIGNIFICANCE STATEMENT: We found that monozygotic twins with focal bilateral amygdala lesions report panic anxiety in response to intravenous infusions of isoproterenol, a ß-adrenergic agonist similar to adrenaline. Heightened anxiety was evident in both twins, with one twin experiencing a panic attack. The twin who did not panic displayed signs of impaired cardiorespiratory interoception, including a complete absence of dyspnea sensation. These findings highlight that the amygdala is not strictly required for the experience of panic anxiety, and suggest that neural systems beyond the amygdala are also involved. Determining these additional systems could provide key neural modulation targets for future anxiolytic treatments.

Intracranial markers of conscious face perception in humans.

Investigations of the neural basis of consciousness have greatly benefited from protocols that involve the presentation of stimuli at perceptual threshold, enabling the assessment of the patterns of brain activity that correlate with conscious perception, independently of any changes in sensory input. However, the comparison between perceived and unperceived trials would be expected to reveal not only the core neural substrate of a particular conscious perception, but also aspects of brain activity that facilitate, hinder or tend to follow conscious perception. We take a step towards the resolution of these confounds by combining an analysis of neural responses observed during the presentation of faces partially masked by Continuous Flash Suppression, and those responses observed during the unmasked presentation of faces and other images in the same subjects. We employed multidimensional classifiers to decode physical properties of stimuli or perceptual states from spectrotemporal representations of electrocorticographic signals (1071 channels in 5 subjects). Neural activity in certain face responsive areas located in both the fusiform gyrus and in the lateral-temporal/inferior-parietal cortex discriminated seen vs. unseen faces in the masked paradigm and upright faces vs. other categories in the unmasked paradigm. However, only the former discriminated upright vs. inverted faces in the unmasked paradigm. Our results suggest a prominent role for the fusiform gyrus in the configural perception of faces, and possibly other objects that are holistically processed. More generally, we advocate comparative analysis of neural recordings obtained during different, but related, experimental protocols as a promising direction towards elucidating the functional specificities of the patterns of neural activation that accompany our conscious experiences.

Decision ambiguity is mediated by a late positive potential originating from cingulate cortex.

People often make decisions in the face of ambiguous information, but it remains unclear how ambiguity is represented in the brain. We used three types of ambiguous stimuli and combined EEG and fMRI to examine the neural representation of perceptual decisions under ambiguity. We identified a late positive potential, the LPP, which differentiated levels of ambiguity, and which was specifically associated with behavioral judgments about choices that were ambiguous, rather than passive perception of ambiguous stimuli. Mediation analyses together with two further control experiments confirmed that the LPP was generated only when decisions are made (not during mere perception of ambiguous stimuli), and only when those decisions involved choices on a dimension that is ambiguous. A further control experiment showed that a stronger LPP arose in the presence of ambiguous stimuli compared to when only unambiguous stimuli were present. Source modeling suggested that the LPP originated from multiple loci in cingulate cortex, a finding we further confirmed using fMRI and fMRI-guided ERP source prediction. Taken together, our findings argue for a role of an LPP originating from cingulate cortex in encoding decisions based on task-relevant perceptual ambiguity, a process that may in turn influence confidence judgment, response conflict, and error correction.

Neurons in the human amygdala selective for perceived emotion.

The human amygdala plays a key role in recognizing facial emotions and neurons in the monkey and human amygdala respond to the emotional expression of faces. However, it remains unknown whether these responses are driven primarily by properties of the stimulus or by the perceptual judgments of the perceiver. We investigated these questions by recording from over 200 single neurons in the amygdalae of 7 neurosurgical patients with implanted depth electrodes. We presented degraded fear and happy faces and asked subjects to discriminate their emotion by button press. During trials where subjects responded correctly, we found neurons that distinguished fear vs. happy emotions as expressed by the displayed faces. During incorrect trials, these neurons indicated the patients' subjective judgment. Additional analysis revealed that, on average, all neuronal responses were modulated most by increases or decreases in response to happy faces, and driven predominantly by judgments about the eye region of the face stimuli. Following the same analyses, we showed that hippocampal neurons, unlike amygdala neurons, only encoded emotions but not subjective judgment. Our results suggest that the amygdala specifically encodes the subjective judgment of emotional faces, but that it plays less of a role in simply encoding aspects of the image array. The conscious percept of the emotion shown in a face may thus arise from interactions between the amygdala and its connections within a distributed cortical network, a scheme also consistent with the long response latencies observed in human amygdala recordings.

Idiosyncratic brain activation patterns are associated with poor social comprehension in autism.

Autism spectrum disorder (ASD) features profound social deficits but neuroimaging studies have failed to find any consistent neural signature. Here we connect these two facts by showing that idiosyncratic patterns of brain activation are associated with social comprehension deficits. Human participants with ASD (N = 17) and controls (N = 20) freely watched a television situation comedy (sitcom) depicting seminaturalistic social interactions ("The Office", NBC Universal) in the scanner. Intersubject correlations in the pattern of evoked brain activation were reduced in the ASD group-but this effect was driven entirely by five ASD subjects whose idiosyncratic responses were also internally unreliable. The idiosyncrasy of these five ASD subjects was not explained by detailed neuropsychological profile, eye movements, or data quality; however, they were specifically impaired in understanding the social motivations of characters in the sitcom. Brain activation patterns in the remaining ASD subjects were indistinguishable from those of control subjects using multiple multivariate approaches. Our findings link neurofunctional abnormalities evoked by seminaturalistic stimuli with a specific impairment in social comprehension, and highlight the need to conceive of ASD as a heterogeneous classification.

A causal role for posterior medial frontal cortex in choice-induced preference change.

After a person chooses between two items, preference for the chosen item will increase and preference for the unchosen item will decrease because of the choice made. In other words, we tend to justify or rationalize our past behavior by changing our attitude. This phenomenon of choice-induced preference change has been traditionally explained by cognitive dissonance theory. Choosing something that is disliked or not choosing something that is liked are both cognitively inconsistent and, to reduce this inconsistency, people tend to change their subsequently stated preference in accordance with their past choices. Previously, human neuroimaging studies identified posterior medial frontal cortex (pMFC) as a key brain region involved in cognitive dissonance. However, it remains unknown whether the pMFC plays a causal role in inducing preference change after cognitive dissonance. Here, we demonstrate that 25 min, 1 Hz repetitive transcranial magnetic stimulation applied over the pMFC significantly reduces choice-induced preference change compared with sham stimulation or control stimulation over a different brain region, demonstrating a causal role for the pMFC.

Social equality in the number of choice options is represented in the ventromedial prefrontal cortex.

A distinct aspect of the sense of fairness in humans is that we care not only about equality in material rewards but also about equality in nonmaterial values. One such value is the opportunity to choose freely among many options, often regarded as a fundamental right to economic freedom. In modern developed societies, equal opportunities in work, living, and lifestyle are enforced by antidiscrimination laws. Despite the widespread endorsement of equal opportunity, no studies have explored how people assign value to it. We used functional magnetic resonance imaging to identify the neural substrates for subjective valuation of equality in choice opportunity. Participants performed a two-person choice task in which the number of choices available was varied across trials independently of choice outcomes. By using this procedure, we manipulated the degree of equality in choice opportunity between players and dissociated it from the value of reward outcomes and their equality. We found that activation in the ventromedial prefrontal cortex (vmPFC) tracked the degree to which the number of options between the two players was equal. In contrast, activation in the ventral striatum tracked the number of options available to participants themselves but not the equality between players. Our results demonstrate that the vmPFC, a key brain region previously implicated in the processing of social values, is also involved in valuation of equality in choice opportunity between individuals. These findings may provide valuable insight into the human ability to value equal opportunity, a characteristic long emphasized in politics, economics, and philosophy.

Emotion processing and the amygdala: from a 'low road' to 'many roads' of evaluating biological significance.

A subcortical pathway through the superior colliculus and pulvinar to the amygdala is commonly assumed to mediate the non-conscious processing of affective visual stimuli. We review anatomical and physiological data that argue against the notion that such a pathway plays a prominent part in processing affective visual stimuli in humans. Instead, we propose that the primary role of the amygdala in visual processing, like that of the pulvinar, is to coordinate the function of cortical networks during evaluation of the biological significance of affective visual stimuli. Under this revised framework, the cortex has a more important role in emotion processing than is traditionally assumed.

Folk explanations of behavior: a specialized use of a domain-general mechanism.

People typically explain others' behaviors by attributing them to the beliefs and motives of an unobservable mind. Although such attributional inferences are critical for understanding the social world, it is unclear whether they rely on processes distinct from those used to understand the nonsocial world. In the present study, we used functional MRI to identify brain regions associated with making attributions about social and nonsocial situations. Attributions in both domains activated a common set of brain regions, and individual differences in the domain-specific recruitment of one of these regions--the dorsomedial prefrontal cortex (DMPFC)--correlated with attributional accuracy in each domain. Overall, however, the DMPFC showed greater activation for attributions about social than about nonsocial situations, and this selective response to the social domain was greatest in participants who reported the highest levels of social expertise. We conclude that folk explanations of behavior are an expert use of a domain-general cognitive ability.