Cyclical population dynamics of automatic versus controlled processing: An evolutionary pendulum.

Psychologists, neuroscientists, and economists often conceptualize decisions as arising from processes that lie along a continuum from automatic (i.e., "hardwired" or overlearned, but relatively inflexible) to controlled (less efficient and effortful, but more flexible). Control is central to human cognition, and plays a key role in our ability to modify the world to suit our needs. Given its advantages, reliance on controlled processing may seem predestined to increase within the population over time. Here, we examine whether this is so by introducing an evolutionary game theoretic model of agents that vary in their use of automatic versus controlled processes, and in which cognitive processing modifies the environment in which the agents interact. We find that, under a wide range of parameters and model assumptions, cycles emerge in which the prevalence of each type of processing in the population oscillates between 2 extremes. Rather than inexorably increasing, the emergence of control often creates conditions that lead to its own demise by allowing automaticity to also flourish, thereby undermining the progress made by the initial emergence of controlled processing. We speculate that this observation may have relevance for understanding similar cycles across human history, and may lend insight into some of the circumstances and challenges currently faced by our species. (PsycINFO Database Record

The integration of social influence and reward: Computational approaches and neural evidence.

Decades of research have established that decision-making is dramatically impacted by both the rewards an individual receives and the behavior of others. How do these distinct influences exert their influence on an individual's actions, and can the resulting behavior be effectively captured in a computational model? To address this question, we employed a novel spatial foraging game in which groups of three participants sought to find the most rewarding location in an unfamiliar two-dimensional space. As the game transitioned from one block to the next, the availability of information regarding other group members was varied systematically, revealing the relative impacts of feedback from the environment and information from other group members on individual decision-making. Both reward-based and socially-based sources of information exerted a significant influence on behavior, and a computational model incorporating these effects was able to recapitulate several key trends in the behavioral data. In addition, our findings suggest how these sources were processed and combined during decision-making. Analysis of reaction time, location of gaze, and functional magnetic resonance imaging (fMRI) data indicated that these distinct sources of information were integrated simultaneously for each decision, rather than exerting their influence in a separate, all-or-none fashion across separate subsets of trials. These findings add to our understanding of how the separate influences of reward from the environment and information derived from other social agents are combined to produce decisions.

Rational Constraints and the Evolution of Fairness in the Ultimatum Game.

Behavior in the Ultimatum Game has been well-studied experimentally, and provides a marked contrast between the theoretical model of a self-interested economic agent and that of an actual human concerned with social norms such as fairness. How did such norms evolve, when punishing unfair behavior can be costly to the punishing agent? The work described here simulated a series of Ultimatum Games, in which populations of agents earned resources based on their preferences for proposing and accepting (or rejecting) offers of various sizes. Two different systems governing the acceptance or rejection of offers were implemented. Under one system, the probability that an agent accepted an offer of a given size was independent of the probabilities of accepting the other possible offers. Under the other system, a simple, ordinal constraint was placed on the acceptance probabilities such that a given offer was at least as likely to be accepted as a smaller offer. For simulations under either system, agents' preferences and their corresponding behavior evolved over multiple generations. Populations without the ordinal constraint came to emulate maximizing economic agents, while populations with the constraint came to resemble the behavior of human players.

The evolution and devolution of cognitive control: The costs of deliberation in a competitive world.

Dual-system theories of human cognition, under which fast automatic processes can complement or compete with slower deliberative processes, have not typically been incorporated into larger scale population models used in evolutionary biology, macroeconomics, or sociology. However, doing so may reveal important phenomena at the population level. Here, we introduce a novel model of the evolution of dual-system agents using a resource-consumption paradigm. By simulating agents with the capacity for both automatic and controlled processing, we illustrate how controlled processing may not always be selected over rigid, but rapid, automatic processing. Furthermore, even when controlled processing is advantageous, frequency-dependent effects may exist whereby the spread of control within the population undermines this advantage. As a result, the level of controlled processing in the population can oscillate persistently, or even go extinct in the long run. Our model illustrates how dual-system psychology can be incorporated into population-level evolutionary models, and how such a framework can be used to examine the dynamics of interaction between automatic and controlled processing that transpire over an evolutionary time scale.

The neural substrates of social influence on decision making.

The mechanisms that govern human learning and decision making under uncertainty have been the focus of intense behavioral and, more recently, neuroscientific investigation. Substantial progress has been made in building models of the processes involved, and identifying underlying neural mechanisms using simple, two-alternative forced choice decision tasks. However, less attention has been given to how social information influences these processes, and the neural systems that mediate this influence. Here we sought to address these questions by using tasks similar to ones that have been used to study individual decision making behavior, and adding conditions in which participants were given trial-by-trial information about the performance of other individuals (their choices and/or their rewards) simultaneously playing the same tasks. We asked two questions: How does such information about the behavior of others influence performance in otherwise simple decision tasks, and what neural systems mediate this influence? We found that bilateral insula exhibited a parametric relationship to the degree of misalignment of the individual's performance with those of others in the group. Furthermore, activity in the bilateral insula significantly predicted participants' subsequent choices to align their behavior with others in the group when they were misaligned either in their choices (independent of success) or their degree of success (independent of specific choices). These findings add to the growing body of empirical data suggesting that the insula participates in an important way in social information processing and decision making.

Self responses along cingulate cortex reveal quantitative neural phenotype for high-functioning autism.

Attributing behavioral outcomes correctly to oneself or to other agents is essential for all productive social exchange. We approach this issue in high-functioning males with autism spectrum disorder (ASD) using two separate fMRI paradigms. First, using a visual imagery task, we extract a basis set for responses along the cingulate cortex of control subjects that reveals an agent-specific eigenvector (self eigenmode) associated with imagining oneself executing a specific motor act. Second, we show that the same self eigenmode arises during one's own decision (the self phase) in an interpersonal exchange game (iterated trust game). Third, using this exchange game, we show that ASD males exhibit a severely diminished cingulate self response when playing the game with a human partner. This diminishment covaries parametrically with their behaviorally assessed symptom severity, suggesting its value as an objective endophenotype. These findings may provide a quantitative assessment tool for high-functioning ASD.

Agent-specific responses in the cingulate cortex during economic exchanges.

Interactions with other responsive agents lie at the core of all social exchange. During a social exchange with a partner, one fundamental variable that must be computed correctly is who gets credit for a shared outcome; this assignment is crucial for deciding on an optimal level of cooperation that avoids simple exploitation. We carried out an iterated, two-person economic exchange and made simultaneous hemodynamic measurements from each player's brain. These joint measurements revealed agent-specific responses in the social domain ("me" and "not me") arranged in a systematic spatial pattern along the cingulate cortex. This systematic response pattern did not depend on metrical aspects of the exchange, and it disappeared completely in the absence of a responding partner.

Getting to know you: reputation and trust in a two-person economic exchange.

Using a multiround version of an economic exchange (trust game), we report that reciprocity expressed by one player strongly predicts future trust expressed by their partner-a behavioral finding mirrored by neural responses in the dorsal striatum. Here, analyses within and between brains revealed two signals-one encoded by response magnitude, and the other by response timing. Response magnitude correlated with the "intention to trust" on the next play of the game, and the peak of these "intention to trust" responses shifted its time of occurrence by 14 seconds as player reputations developed. This temporal transfer resembles a similar shift of reward prediction errors common to reinforcement learning models, but in the context of a social exchange. These data extend previous model-based functional magnetic resonance imaging studies into the social domain and broaden our view of the spectrum of functions implemented by the dorsal striatum.

Neural correlates of behavioral preference for culturally familiar drinks.

Coca-Cola (Coke) and Pepsi are nearly identical in chemical composition, yet humans routinely display strong subjective preferences for one or the other. This simple observation raises the important question of how cultural messages combine with content to shape our perceptions; even to the point of modifying behavioral preferences for a primary reward like a sugared drink. We delivered Coke and Pepsi to human subjects in behavioral taste tests and also in passive experiments carried out during functional magnetic resonance imaging (fMRI). Two conditions were examined: (1) anonymous delivery of Coke and Pepsi and (2) brand-cued delivery of Coke and Pepsi. For the anonymous task, we report a consistent neural response in the ventromedial prefrontal cortex that correlated with subjects' behavioral preferences for these beverages. In the brand-cued experiment, brand knowledge for one of the drinks had a dramatic influence on expressed behavioral preferences and on the measured brain responses.