The utility of a latent-cause framework for understanding addiction phenomena.

Computational models of addiction often rely on a model-free reinforcement learning (RL) formulation, owing to the close associations between model-free RL, habitual behavior and the dopaminergic system. However, such formulations typically do not capture key recurrent features of addiction phenomena such as craving and relapse. Moreover, they cannot account for goal-directed aspects of addiction that necessitate contrasting, model-based formulations. Here we synthesize a growing body of evidence and propose that a latent-cause framework can help unify our understanding of several recurrent phenomena in addiction, by viewing them as the inferred return of previous, persistent "latent causes". We demonstrate that applying this framework to Pavlovian and instrumental settings can help account for defining features of craving and relapse such as outcome-specificity, generalization, and cyclical dynamics. Finally, we argue that this framework can bridge model-free and model-based formulations, and account for individual variability in phenomenology by accommodating the memories, beliefs, and goals of those living with addiction, motivating a centering of the individual, subjective experience of addiction and recovery.

The challenges of lifelong learning in biological and artificial systems.

How do biological systems learn continuously throughout their lifespans, adapting to change while retaining old knowledge, and how can these principles be applied to artificial learning systems? In this Forum article we outline challenges and strategies of 'lifelong learning' in biological and artificial systems, and argue that a collaborative study of each system's failure modes can benefit both.

Lapses in perceptual decisions reflect exploration.

Perceptual decision-makers often display a constant rate of errors independent of evidence strength. These 'lapses' are treated as a nuisance arising from noise tangential to the decision, e.g. inattention or motor errors. Here, we use a multisensory decision task in rats to demonstrate that these explanations cannot account for lapses' stimulus dependence. We propose a novel explanation: lapses reflect a strategic trade-off between exploiting known rewarding actions and exploring uncertain ones. We tested this model's predictions by selectively manipulating one action's reward magnitude or probability. As uniquely predicted by this model, changes were restricted to lapses associated with that action. Finally, we show that lapses are a powerful tool for assigning decision-related computations to neural structures based on disruption experiments (here, posterior striatum and secondary motor cortex). These results suggest that lapses reflect an integral component of decision-making and are informative about action values in normal and disrupted brain states.

Visual Evidence Accumulation Guides Decision-Making in Unrestrained Mice.

The ability to manipulate neural activity with precision is an asset in uncovering neural circuits for decision-making. Diverse tools for manipulating neurons are available for mice, but their feasibility remains unclear, especially when decisions require accumulating visual evidence. For example, whether mice' decisions reflect leaky accumulation is unknown, as are the relevant/irrelevant factors that influence decisions. Further, causal circuits for visual evidence accumulation are poorly understood. To address this, we measured decisions in mice judging the fluctuating rate of a flash sequence. An initial analysis (>500,000 trials, 29 male and female mice) demonstrated that information throughout the 1000 ms trial influenced choice, with early information most influential. This suggests that information persists in neural circuits for ∼1000 ms with minimal accumulation leak. Next, in a subset of animals, we probed strategy more extensively and found that although animals were influenced by stimulus rate, they were unable to entirely suppress the influence of stimulus brightness. Finally, we identified anteromedial (AM) visual area via retinotopic mapping and optogenetically inhibited it using JAWS. Light activation biased choices in both injected and uninjected animals, demonstrating that light alone influences behavior. By varying stimulus-response contingency while holding stimulated hemisphere constant, we surmounted this obstacle to demonstrate that AM suppression biases decisions. By leveraging a large dataset to quantitatively characterize decision-making behavior, we establish mice as suitable for neural circuit manipulation studies. Further, by demonstrating that mice accumulate visual evidence, we demonstrate that this strategy for reducing uncertainty in decision-making is used by animals with diverse visual systems.SIGNIFICANCE STATEMENT To connect behaviors to their underlying neural mechanism, a deep understanding of behavioral strategy is needed. This understanding is incomplete for mice. To surmount this, we measured the outcome of >500,000 decisions made by 29 mice trained to judge visual stimuli and performed behavioral/optogenetic manipulations in smaller subsets. Our analyses offer new insights into mice' decision-making strategies and compares them with those of other species. We then disrupted neural activity in a candidate neural structure and examined the effect on decisions. Our findings establish mice as suitable for visual accumulation of evidence decisions. Further, the results highlight similarities in decision-making strategies across very different species.

Decision Activity in Parietal Cortex - Leader or Follower?

Katz and colleagues demonstrate that inactivating the primate lateral intraparietal area (LIP) spares visual motion decisions, even though these same decisions strongly modulate LIP neurons. This work is the latest addition to an intense effort spanning sensory modalities, animals, and techniques to understand which structures comprise the circuits responsible for interpreting sensory signals to make decisions.