Arithmetic and local circuitry underlying dopamine prediction errors.

Dopamine neurons are thought to facilitate learning by comparing actual and expected reward. Despite two decades of investigation, little is known about how this comparison is made. To determine how dopamine neurons calculate prediction error, we combined optogenetic manipulations with extracellular recordings in the ventral tegmental area while mice engaged in classical conditioning. Here we demonstrate, by manipulating the temporal expectation of reward, that dopamine neurons perform subtraction, a computation that is ideal for reinforcement learning but rarely observed in the brain. Furthermore, selectively exciting and inhibiting neighbouring GABA (γ-aminobutyric acid) neurons in the ventral tegmental area reveals that these neurons are a source of subtraction: they inhibit dopamine neurons when reward is expected, causally contributing to prediction-error calculations. Finally, bilaterally stimulating ventral tegmental area GABA neurons dramatically reduces anticipatory licking to conditioned odours, consistent with an important role for these neurons in reinforcement learning. Together, our results uncover the arithmetic and local circuitry underlying dopamine prediction errors.

An olfactory cocktail party: figure-ground segregation of odorants in rodents.

In odorant-rich environments, animals must be able to detect specific odorants of interest against variable backgrounds. However, studies have found that both humans and rodents are poor at analyzing the components of odorant mixtures, suggesting that olfaction is a synthetic sense in which mixtures are perceived holistically. We found that mice could be easily trained to detect target odorants embedded in unpredictable and variable mixtures. To relate the behavioral performance to neural representation, we imaged the responses of olfactory bulb glomeruli to individual odors in mice expressing the Ca(2+) indicator GCaMP3 in olfactory receptor neurons. The difficulty of segregating the target from the background depended strongly on the extent of overlap between the glomerular responses to target and background odors. Our study indicates that the olfactory system has powerful analytic abilities that are constrained by the limits of combinatorial neural representation of odorants at the level of the olfactory receptors.