Neural Support for Contributions of Utility and Narrative Processing of Evidence in Juror Decision Making.

Efforts to explain complex human decisions have focused on competing theories emphasizing utility and narrative mechanisms. These are difficult to distinguish using behavior alone. Both narrative and utility theories have been proposed to explain juror decisions, which are among the most consequential complex decisions made in a modern society. Here, we asked jury-eligible male and female subjects to rate the strength of a series of criminal cases while recording the resulting patterns of brain activation. We compared patterns of brain activation associated with evidence accumulation to patterns of brain activation derived from a large neuroimaging database to look for signatures of the cognitive processes associated with different models of juror decision-making. Evidence accumulation correlated with multiple narrative processes, including reading and recall. Of the cognitive processes traditionally viewed as components of utility, activation patterns associated with uncertainty, but not value, were more active with stronger evidence. Independent of utility and narrative, activations linked to reasoning and relational logic also correlated with increasing evidence. Hierarchical modeling of cognitive processes associated with evidence accumulation supported a more prominent role for narrative in weighing evidence in complex decisions. However, utility processes were also associated with evidence accumulation. These complementary findings support an emerging view that integrates utility and narrative processes in complex decisions.SIGNIFICANCE STATEMENT The last decade has seen a sharply increased interest in narrative as a central cognitive process in human decision-making and as an important factor in the evolution of human societies. However, the roles of narrative versus utility models of decision-making remain hotly debated. While available models frequently produce similar behavioral predictions, they rely on different cognitive processes and so their roles can be separated using the right neural tests. Here, we use brain imaging during mock juror decisions to show that cognitive processes associated with narrative, and to a lesser extent utility, were engaged while subjects evaluated evidence. These results are consistent with interactions between narrative and utility processes during complex decision-making.

Machine learning prediction of neurocognitive impairment among people with HIV using clinical and multimodal magnetic resonance imaging data.

Diagnosis of HIV-associated neurocognitive impairment (NCI) continues to be a clinical challenge. The purpose of this study was to develop a prediction model for NCI among people with HIV using clinical- and magnetic resonance imaging (MRI)-derived features. The sample included 101 adults with chronic HIV disease. NCI was determined using a standardized neuropsychological testing battery comprised of seven domains. MRI features included gray matter volume from high-resolution anatomical scans and white matter integrity from diffusion-weighted imaging. Clinical features included demographics, substance use, and routine laboratory tests. Least Absolute Shrinkage and Selection Operator Logistic regression was used to perform variable selection on MRI features. These features were subsequently used to train a support vector machine (SVM) to predict NCI. Three different classification tasks were performed: one used only clinical features; a second used only selected MRI features; a third used both clinical and selected MRI features. Model performance was evaluated by area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity with a tenfold cross-validation. The SVM classifier that combined selected MRI with clinical features outperformed the model using clinical features or MRI features alone (AUC: 0.83 vs. 0.62 vs. 0.79; accuracy: 0.80 vs. 0.65 vs. 0.72; sensitivity: 0.86 vs. 0.85 vs. 0.86; specificity: 0.71 vs. 0.37 vs. 0.52). Our results provide preliminary evidence that combining clinical and MRI features can increase accuracy in predicting NCI and could be developed as a potential tool for NCI diagnosis in HIV clinical practice.

Monkeys and humans implement causal inference to simultaneously localize auditory and visual stimuli.

The environment is sampled by multiple senses, which are woven together to produce a unified perceptual state. However, optimally unifying such signals requires assigning particular signals to the same or different underlying objects or events. Many prior studies (especially in animals) have assumed fusion of cross-modal information, whereas recent work in humans has begun to probe the appropriateness of this assumption. Here we present results from a novel behavioral task in which both monkeys (Macaca mulatta) and humans localized visual and auditory stimuli and reported their perceived sources through saccadic eye movements. When the locations of visual and auditory stimuli were widely separated, subjects made two saccades, while when the two stimuli were presented at the same location they made only a single saccade. Intermediate levels of separation produced mixed response patterns: a single saccade to an intermediate position on some trials or separate saccades to both locations on others. The distribution of responses was well described by a hierarchical causal inference model that accurately predicted both the explicit "same vs. different" source judgments as well as biases in localization of the source(s) under each of these conditions. The results from this task are broadly consistent with prior work in humans across a wide variety of analogous tasks, extending the study of multisensory causal inference to nonhuman primates and to a natural behavioral task with both a categorical assay of the number of perceived sources and a continuous report of the perceived position of the stimuli.NEW & NOTEWORTHY We developed a novel behavioral paradigm for the study of multisensory causal inference in both humans and monkeys and found that both species make causal judgments in the same Bayes-optimal fashion. To our knowledge, this is the first demonstration of behavioral causal inference in animals, and this cross-species comparison lays the groundwork for future experiments using neuronal recording techniques that are impractical or impossible in human subjects.

Latent goal models for dynamic strategic interaction.

Understanding the principles by which agents interact with both complex environments and each other is a key goal of decision neuroscience. However, most previous studies have used experimental paradigms in which choices are discrete (and few), play is static, and optimal solutions are known. Yet in natural environments, interactions between agents typically involve continuous action spaces, ongoing dynamics, and no known optimal solution. Here, we seek to bridge this divide by using a "penalty shot" task in which pairs of monkeys competed against each other in a competitive, real-time video game. We modeled monkeys' strategies as driven by stochastically evolving goals, onscreen positions that served as set points for a control model that produced observed joystick movements. We fit this goal-based dynamical system model using approximate Bayesian inference methods, using neural networks to parameterize players' goals as a dynamic mixture of Gaussian components. Our model is conceptually simple, constructed of interpretable components, and capable of generating synthetic data that capture the complexity of real player dynamics. We further characterized players' strategies using the number of change points on each trial. We found that this complexity varied more across sessions than within sessions, and that more complex strategies benefited offensive players but not defensive players. Together, our experimental paradigm and model offer a powerful combination of tools for the study of realistic social dynamics in the laboratory setting.

Feedback-Based Learning in Aging: Contributions and Trajectories of Change in Striatal and Hippocampal Systems.

The striatum supports learning from immediate feedback by coding prediction errors (PEs), whereas the hippocampus (HC) plays a parallel role in learning from delayed feedback. Both regions show evidence of decline in human aging, but behavioral research suggests greater decline in HC versus striatal functions. The present study included male and female humans and used fMRI to examine younger and older adults' brain activation patterns during a learning task with choice feedback presented immediately or after a brief delay. Participants then completed a surprise memory task that tested their recognition of trial-unique feedback stimuli, followed by assessments of postlearning cue preference, outcome probability awareness, and willingness to pay. The study yielded three main findings. First, behavioral measures indicated similar rates of learning in younger and older adults across conditions, but postlearning measures indicated impairment in older adults' ability to subsequently apply learning to discriminate between cues. Second, PE signals in the striatum were greater for immediate versus delayed feedback in both age groups, but PE signals in the HC were greater for delayed versus immediate feedback only in younger adults. Third, unlike younger adults, older adults failed to exhibit enhanced episodic memory for outcome stimuli in the delayed-feedback condition. Together, these findings indicate that HC circuits supporting learning and memory decline more than striatal circuits in healthy aging, which suggests that declines in HC learning signals may be an important predictor of deficits in learning-dependent economic decisions among older adults.SIGNIFICANCE STATEMENT The hippocampus (HC) and striatum play distinct and critical roles in learning. Substantial research suggests that age-related decline in learning supported by the HC outpaces decline in learning supported by the striatum; however, such inferences have been drawn by comparing performance in tasks with fundamentally different structures. The present study overcomes this obstacle by implementing a single fMRI-learning paradigm with a subtle variation in feedback timing to examine differential age effects on memory supported by the HC and striatum. Our results provide converging behavioral and brain-imaging evidence showing that HC circuits supporting learning and memory decline more than striatal circuits in healthy aging and that declines in HC learning signals may predict early deficits in learning-dependent decisions among older adults.

Neuron's eye view: Inferring features of complex stimuli from neural responses.

Experiments that study neural encoding of stimuli at the level of individual neurons typically choose a small set of features present in the world-contrast and luminance for vision, pitch and intensity for sound-and assemble a stimulus set that systematically varies along these dimensions. Subsequent analysis of neural responses to these stimuli typically focuses on regression models, with experimenter-controlled features as predictors and spike counts or firing rates as responses. Unfortunately, this approach requires knowledge in advance about the relevant features coded by a given population of neurons. For domains as complex as social interaction or natural movement, however, the relevant feature space is poorly understood, and an arbitrary a priori choice of features may give rise to confirmation bias. Here, we present a Bayesian model for exploratory data analysis that is capable of automatically identifying the features present in unstructured stimuli based solely on neuronal responses. Our approach is unique within the class of latent state space models of neural activity in that it assumes that firing rates of neurons are sensitive to multiple discrete time-varying features tied to the stimulus, each of which has Markov (or semi-Markov) dynamics. That is, we are modeling neural activity as driven by multiple simultaneous stimulus features rather than intrinsic neural dynamics. We derive a fast variational Bayesian inference algorithm and show that it correctly recovers hidden features in synthetic data, as well as ground-truth stimulus features in a prototypical neural dataset. To demonstrate the utility of the algorithm, we also apply it to cluster neural responses and demonstrate successful recovery of features corresponding to monkeys and faces in the image set.

Neural mechanisms of social decision-making in the primate amygdala.

Social decisions require evaluation of costs and benefits to oneself and others. Long associated with emotion and vigilance, the amygdala has recently been implicated in both decision-making and social behavior. The amygdala signals reward and punishment, as well as facial expressions and the gaze of others. Amygdala damage impairs social interactions, and the social neuropeptide oxytocin (OT) influences human social decisions, in part, by altering amygdala function. Here we show in monkeys playing a modified dictator game, in which one individual can donate or withhold rewards from another, that basolateral amygdala (BLA) neurons signaled social preferences both across trials and across days. BLA neurons mirrored the value of rewards delivered to self and others when monkeys were free to choose but not when the computer made choices for them. We also found that focal infusion of OT unilaterally into BLA weakly but significantly increased both the frequency of prosocial decisions and attention to recipients for context-specific prosocial decisions, endorsing the hypothesis that OT regulates social behavior, in part, via amygdala neuromodulation. Our findings demonstrate both neurophysiological and neuroendocrinological connections between primate amygdala and social decisions.

Postreward delays and systematic biases in measures of animal temporal discounting.

Intertemporal choice tasks, which pit smaller/sooner rewards against larger/later ones, are frequently used to study time preferences and, by extension, impulsivity and self-control. When used in animals, many trials are strung together in sequence and an adjusting buffer is added after the smaller/sooner option to hold the total duration of each trial constant. Choices of the smaller/sooner option are not reward maximizing and so are taken to indicate that the animal is discounting future rewards. However, if animals fail to correctly factor in the duration of the postreward buffers, putative discounting behavior may instead reflect constrained reward maximization. Here, we report three results consistent with this discounting-free hypothesis. We find that (i) monkeys are insensitive to the association between the duration of postreward delays and their choices; (ii) they are sensitive to the length of postreward delays, although they greatly underestimate them; and (iii) increasing the salience of the postreward delay biases monkeys toward the larger/later option, reducing measured discounting rates. These results are incompatible with standard discounting-based accounts but are compatible with an alternative heuristic model. Our data suggest that measured intertemporal preferences in animals may not reflect impulsivity, or even mental discounting of future options, and that standard human and animal intertemporal choice tasks measure unrelated mental processes.

Neuroethology of primate social behavior.

A neuroethological approach to human and nonhuman primate behavior and cognition predicts biological specializations for social life. Evidence reviewed here indicates that ancestral mechanisms are often duplicated, repurposed, and differentially regulated to support social behavior. Focusing on recent research from nonhuman primates, we describe how the primate brain might implement social functions by coopting and extending preexisting mechanisms that previously supported nonsocial functions. This approach reveals that highly specialized mechanisms have evolved to decipher the immediate social context, and parallel circuits have evolved to translate social perceptual signals and nonsocial perceptual signals into partially integrated social and nonsocial motivational signals, which together inform general-purpose mechanisms that command behavior. Differences in social behavior between species, as well as between individuals within a species, result in part from neuromodulatory regulation of these neural circuits, which itself appears to be under partial genetic control. Ultimately, intraspecific variation in social behavior has differential fitness consequences, providing fundamental building blocks of natural selection. Our review suggests that the neuroethological approach to primate behavior may provide unique insights into human psychopathology.

Rapid brain responses independently predict gain maximization and loss minimization during economic decision making.

Success in many decision-making scenarios depends on the ability to maximize gains and minimize losses. Even if an agent knows which cues lead to gains and which lead to losses, that agent could still make choices yielding suboptimal rewards. Here, by analyzing event-related potentials (ERPs) recorded in humans during a probabilistic gambling task, we show that individuals' behavioral tendencies to maximize gains and to minimize losses are associated with their ERP responses to the receipt of those gains and losses, respectively. We focused our analyses on ERP signals that predict behavioral adjustment: the frontocentral feedback-related negativity (FRN) and two P300 (P3) subcomponents, the frontocentral P3a and the parietal P3b. We found that, across participants, gain maximization was predicted by differences in amplitude of the P3b for suboptimal versus optimal gains (i.e., P3b amplitude difference between the least good and the best gains). Conversely, loss minimization was predicted by differences in the P3b amplitude to suboptimal versus optimal losses (i.e., difference between the worst and the least bad losses). Finally, we observed that the P3a and P3b, but not the FRN, predicted behavioral adjustment on subsequent trials, suggesting a specific adaptive mechanism by which prior experience may alter ensuing behavior. These findings indicate that individual differences in gain maximization and loss minimization are linked to individual differences in rapid neural responses to monetary outcomes.

Through their eyes: selective attention in peahens during courtship.

Conspicuous, multicomponent ornamentation in male animals can be favored by female mate choice but we know little about the cognitive processes females use to evaluate these traits. Sexual selection may favor attention mechanisms allowing the choosing females to selectively and efficiently acquire relevant information from complex male display traits and, in turn, may favor male display traits that effectively capture and hold female attention. Using a miniaturized telemetric gaze-tracker, we show that peahens (Pavo cristatus) selectively attend to specific components of peacock courtship displays and virtually ignore other, highly conspicuous components. Females gazed at the lower train but largely ignored the head, crest and upper train. When the lower train was obscured, however, females spent more time gazing at the upper train and approached the upper train from a distance. Our results suggest that peahens mainly evaluate the lower train during close-up courtship but use the upper train as a long-distance attraction signal. Furthermore, we found that behavioral display components (train rattling and wing shaking) captured and maintained female attention, indicating that interactions between display components may promote the evolution of multicomponent displays. Taken together, these findings suggest that selective attention plays a crucial role in sexual selection and likely influences the evolution of male display traits.

Bayesian and Discriminative Models for Active Visual Perception across Saccades.

The brain interprets sensory inputs to guide behavior, but behavior itself disrupts sensory inputs. Perceiving a coherent world while acting in it constitutes active perception. For example, saccadic eye movements displace visual images on the retina and yet the brain perceives visual stability. Because this percept of visual stability has been shown to be influenced by prior expectations, we tested the hypothesis that it is Bayesian. The key prediction was that priors would be used more as sensory uncertainty increases. Humans and rhesus macaques reported whether an image moved during saccades. We manipulated both prior expectations and levels of sensory uncertainty. All psychophysical data were compared with the predictions of Bayesian ideal observer models. We found that humans were Bayesian for continuous judgments. For categorical judgments, however, they were anti-Bayesian: they used their priors less with greater uncertainty. We studied this categorical result further in macaques. The animals' judgments were similarly anti-Bayesian for sensory uncertainty caused by external, image noise, but Bayesian for uncertainty due to internal, motor-driven noise. A discriminative learning model explained the anti-Bayesian effects. We conclude that active vision uses both Bayesian and discriminative models depending on task requirements (continuous vs categorical) and the source of uncertainty (image noise vs motor-driven noise). In the context of previous knowledge about the saccadic system, our results provide an example of how the comparative analysis of Bayesian versus non-Bayesian models of perception offers novel insights into underlying neural organization.

Neuronal mechanisms of dynamic strategic competition.

Competitive social interactions, as in chess or poker, often involve multiple moves and countermoves deployed tactically within a broader strategic plan. Such maneuvers are supported by mentalizing or theory-of-mind-reasoning about the beliefs, plans, and goals of an opponent. The neuronal mechanisms underlying strategic competition remain largely unknown. To address this gap, we studied humans and monkeys playing a virtual soccer game featuring continuous competitive interactions. Humans and monkeys deployed similar tactics within broadly identical strategies, which featured unpredictable trajectories and precise timing for kickers, and responsiveness to opponents for goalies. We used Gaussian Process (GP) classification to decompose continuous gameplay into a series of discrete decisions predicated on the evolving states of self and opponent. We extracted relevant model parameters as regressors for neuronal activity in macaque mid-superior temporal sulcus (mSTS), the putative homolog of human temporo-parietal junction (TPJ), an area selectively engaged during strategic social interactions. We discovered two spatially-segregated populations of mSTS neurons that signaled actions of self and opponent, sensitivities to state changes, and previous and current trial outcomes. Inactivating mSTS reduced kicker unpredictability and impaired goalie responsiveness. These findings demonstrate mSTS neurons multiplex information about the current states of self and opponent as well as history of previous interactions to support ongoing strategic competition, consistent with hemodynamic activity found in human TPJ.

Social cognitive processes explain bias in juror decisions.

Jury decisions are among the most consequential social decisions in which bias plays a notable role. While courts take measures to reduce the influence of non-evidentiary factors, jurors may still incorporate biases into their decisions. One common bias, crime-type bias, is the extent to which the perceived strength of a prosecutor's case depends on the severity of the crime. Moral judgment, affect and social cognition have been proposed as core processes underlying this and other biases. Behavioral evidence alone has been insufficient to distinguish these explanations. To identify the mechanism underlying crime-type bias, we collected functional magnetic resonance imaging patterns of brain activation from mock jurors reading criminal scenarios. Brain patterns from crime-type bias were most similar to those associated with social cognition (mentalizing and racial bias) but not affect or moral judgment. Our results support a central role for social cognition in juror decisions and suggest that crime-type bias and cultural bias may arise from similar mechanisms.

Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior.

In attentional models of learning, associations between actions and subsequent rewards are stronger when outcomes are surprising, regardless of their valence. Despite the behavioral evidence that surprising outcomes drive learning, neural correlates of unsigned reward prediction errors remain elusive. Here we show that in a probabilistic choice task, trial-to-trial variations in preference track outcome surprisingness. Concordant with this behavioral pattern, responses of neurons in macaque (Macaca mulatta) dorsal anterior cingulate cortex (dACC) to both large and small rewards were enhanced when the outcome was surprising. Moreover, when, on some trials, probabilities were hidden, neuronal responses to rewards were reduced, consistent with the idea that the absence of clear expectations diminishes surprise. These patterns are inconsistent with the idea that dACC neurons track signed errors in reward prediction, as dopamine neurons do. Our results also indicate that dACC neurons do not signal conflict. In the context of other studies of dACC function, these results suggest a link between reward-related modulations in dACC activity and attention and motor control processes involved in behavioral adjustment. More speculatively, these data point to a harmonious integration between reward and learning accounts of ACC function on one hand, and attention and cognitive control accounts on the other.

Efficient coding, channel capacity, and the emergence of retinal mosaics.

Among the most striking features of retinal organization is the grouping of its output neurons, the retinal ganglion cells (RGCs), into a diversity of functional types. Each of these types exhibits a mosaic-like organization of receptive fields (RFs) that tiles the retina and visual space. Previous work has shown that many features of RGC organization, including the existence of ON and OFF cell types, the structure of spatial RFs, and their relative arrangement, can be predicted on the basis of efficient coding theory. This theory posits that the nervous system is organized to maximize information in its encoding of stimuli while minimizing metabolic costs. Here, we use efficient coding theory to present a comprehensive account of mosaic organization in the case of natural videos as the retinal channel capacity-the number of simulated RGCs available for encoding-is varied. We show that mosaic density increases with channel capacity up to a series of critical points at which, surprisingly, new cell types emerge. Each successive cell type focuses on increasingly high temporal frequencies and integrates signals over larger spatial areas. In addition, we show theoretically and in simulation that a transition from mosaic alignment to anti-alignment across pairs of cell types is observed with increasing output noise and decreasing input noise. Together, these results offer a unified perspective on the relationship between retinal mosaics, efficient coding, and channel capacity that can help to explain the stunning functional diversity of retinal cell types.

Continuous decisions.

Humans and other animals evolved to make decisions that extend over time with continuous and ever-changing options. Nonetheless, the academic study of decision-making is mostly limited to the simple case of choice between two options. Here, we advocate that the study of choice should expand to include continuous decisions. Continuous decisions, by our definition, involve a continuum of possible responses and take place over an extended period of time during which the response is continuously subject to modification. In most continuous decisions, the range of options can fluctuate and is affected by recent responses, making consideration of reciprocal feedback between choices and the environment essential. The study of continuous decisions raises new questions, such as how abstract processes of valuation and comparison are co-implemented with action planning and execution, how we simulate the large number of possible futures our choices lead to, and how our brains employ hierarchical structure to make choices more efficiently. While microeconomic theory has proven invaluable for discrete decisions, we propose that engineering control theory may serve as a better foundation for continuous ones. And while the concept of value has proven foundational for discrete decisions, goal states and policies may prove more useful for continuous ones. This article is part of the theme issue 'Existence and prevalence of economic behaviours among non-human primates'.

Neurons in primate prefrontal cortex signal valuable social information during natural viewing.

Information about social partners is innately valuable to primates. Decisions about which sources of information to consume are highly naturalistic but also complex and place unusually strong demands on the brain's decision network. In particular, both the orbitofrontal cortex (OFC) and lateral prefrontal cortex (LPFC) play key roles in decision making and social behaviour, suggesting a likely role in social information-seeking as well. To test this idea, we developed a 'channel surfing' task in which monkeys were shown a series of 5 s video clips of conspecifics engaged in natural behaviours at a field site. Videos were annotated frame-by-frame using an ethogram of species-typical behaviours, an important source of social information. Between each clip, monkeys were presented with a choice between targets that determined which clip would be seen next. Monkeys' gaze during playback indicated differential engagement depending on what behaviours were presented. Neurons in both OFC and LPFC responded to choice targets and to video, and discriminated a subset of the behaviours in the ethogram during video viewing. These findings suggest that both OFC and LPFC are engaged in processing social information that is used to guide dynamic information-seeking decisions. This article is part of the theme issue 'Existence and prevalence of economic behaviours among non-human primates'.

Attention-deficit/hyperactivity disorder and the explore/exploit trade-off.

The ability to maximize rewards and minimize the costs of obtaining them is vital to making advantageous explore/exploit decisions. Exploratory decisions are theorized to be greater among individuals with attention-deficit/hyperactivity disorder (ADHD), potentially due to deficient catecholamine transmission. Here, we examined the effects of ADHD status and methylphenidate, a common ADHD medication, on explore/exploit decisions using a 6-armed bandit task. We hypothesized that ADHD participants would make more exploratory decisions than controls, and that MPH would reduce group differences. On separate study days, adults with (n = 26) and without (n = 23) ADHD completed the bandit task at baseline, and after methylphenidate or placebo in counter-balanced order. Explore/exploit decisions were modeled using reinforcement learning algorithms. ADHD participants made more exploratory decisions (i.e., chose options without the highest expected reward value) and earned fewer points than controls in all three study days, and methylphenidate did not affect these outcomes. Baseline exploratory choices were positively associated with hyperactive ADHD symptoms across all participants. These results support several theoretical models of increased exploratory choices in ADHD and suggest the unexplained variance in ADHD decisions may be due to less value tracking. The inability to suppress actions with little to no reward value may be a key feature of hyperactive ADHD symptoms.