Explaining dopamine through prediction errors and beyond.

The most influential account of phasic dopamine holds that it reports reward prediction errors (RPEs). The RPE-based interpretation of dopamine signaling is, in its original form, probably too simple and fails to explain all the properties of phasic dopamine observed in behaving animals. This Perspective helps to resolve some of the conflicting interpretations of dopamine that currently exist in the literature. We focus on the following three empirical challenges to the RPE theory of dopamine: why does dopamine (1) ramp up as animals approach rewards, (2) respond to sensory and motor features and (3) influence action selection? We argue that the prediction error concept, once it has been suitably modified and generalized based on an analysis of each computational problem, answers each challenge. Nonetheless, there are a number of additional empirical findings that appear to demand fundamentally different theoretical explanations beyond encoding RPE. Therefore, looking forward, we discuss the prospects for a unifying theory that respects the diversity of dopamine signaling and function as well as the complex circuitry that both underlies and responds to dopaminergic transmission.

Dopamine mediates the bidirectional update of interval timing.

The role of dopamine (DA) as a reward prediction error (RPE) signal in reinforcement learning (RL) tasks has been well-established over the past decades. Recent work has shown that the RPE interpretation can also account for the effects of DA on interval timing by controlling the speed of subjective time. According to this theory, the timing of the dopamine signal relative to reward delivery dictates whether subjective time speeds up or slows down: Early DA signals speed up subjective time and late signals slow it down. To test this bidirectional prediction, we reanalyzed measurements of dopaminergic neurons in the substantia nigra pars compacta of mice performing a self-timed movement task. Using the slope of ramping dopamine activity as a readout of subjective time speed, we found that trial-by-trial changes in the slope could be predicted from the timing of dopamine activity on the previous trial. This result provides a key piece of evidence supporting a unified computational theory of RL and interval timing. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Tapered fibertrodes for optoelectrical neural interfacing in small brain volumes with reduced artefacts.

Deciphering the neural patterns underlying brain functions is essential to understanding how neurons are organized into networks. This deciphering has been greatly facilitated by optogenetics and its combination with optoelectronic devices to control neural activity with millisecond temporal resolution and cell type specificity. However, targeting small brain volumes causes photoelectric artefacts, in particular when light emission and recording sites are close to each other. We take advantage of the photonic properties of tapered fibres to develop integrated 'fibertrodes' able to optically activate small brain volumes with abated photoelectric noise. Electrodes are positioned very close to light emitting points by non-planar microfabrication, with angled light emission allowing the simultaneous optogenetic manipulation and electrical read-out of one to three neurons, with no photoelectric artefacts, in vivo. The unconventional implementation of two-photon polymerization on the curved taper edge enables the fabrication of recoding sites all around the implant, making fibertrodes a promising complement to planar microimplants.

Slowly evolving dopaminergic activity modulates the moment-to-moment probability of reward-related self-timed movements.

Clues from human movement disorders have long suggested that the neurotransmitter dopamine plays a role in motor control, but how the endogenous dopaminergic system influences movement is unknown. Here, we examined the relationship between dopaminergic signaling and the timing of reward-related movements in mice. Animals were trained to initiate licking after a self-timed interval following a start-timing cue; reward was delivered in response to movements initiated after a criterion time. The movement time was variable from trial-to-trial, as expected from previous studies. Surprisingly, dopaminergic signals ramped-up over seconds between the start-timing cue and the self-timed movement, with variable dynamics that predicted the movement/reward time on single trials. Steeply rising signals preceded early lick-initiation, whereas slowly rising signals preceded later initiation. Higher baseline signals also predicted earlier self-timed movements. Optogenetic activation of dopamine neurons during self-timing did not trigger immediate movements, but rather caused systematic early-shifting of movement initiation, whereas inhibition caused late-shifting, as if modulating the probability of movement. Consistent with this view, the dynamics of the endogenous dopaminergic signals quantitatively predicted the moment-by-moment probability of movement initiation on single trials. We propose that ramping dopaminergic signals, likely encoding dynamic reward expectation, can modulate the decision of when to move.

Neuronal Mechanisms of Visual Categorization: An Abstract View on Decision Making.

Categorization is our ability to flexibly assign sensory stimuli into discrete, behaviorally relevant groupings. Categorical decisions can be used to study decision making more generally by dissociating category identity of stimuli from the actions subjects use to signal their decisions. Here we discuss the evidence for such abstract categorical encoding in the primate brain and consider the relationship with other perceptual decision paradigms. Recent work on visual categorization has examined neuronal activity across a hierarchically organized network of cortical areas in monkeys trained to group visual stimuli into arbitrary categories. This has revealed a transformation of visual-feature encoding in early visual cortical areas into more flexible categorical representations in downstream parietal and prefrontal areas. These neuronal category representations are encoded as abstract internal cognitive states because they are not rigidly linked with either specific sensory stimuli or the actions that the monkeys use to signal their categorical choices.

Multipoint-emitting optical fibers for spatially addressable in vivo optogenetics.

Optical stimulation and silencing of neural activity is a powerful technique for elucidating the structure and function of neural circuitry. In most in vivo optogenetic experiments, light is delivered into the brain through a single optical fiber. However, this approach limits illumination to a fixed volume of the brain. Here a focused ion beam is used to pattern multiple light windows on a tapered optical fiber. We show that such fibers allow selective and dynamic illumination of different brain regions along the taper. Site selection is achieved by a simple coupling strategy at the fiber input, and the use of a single tapered waveguide minimizes the implant invasiveness. We demonstrate the effectiveness of this approach for multipoint optical stimulation in the mammalian brain in vivo by coupling the fiber to a microelectrode array and performing simultaneous extracellular recording and stimulation at multiple sites in the mouse striatum and cerebral cortex.

Relative timing: from behaviour to neurons.

Processing of temporal information is critical to behaviour. Here, we review the phenomenology and mechanism of relative timing, ordinal comparisons between the timing of occurrence of events. Relative timing can be an implicit component of particular brain computations or can be an explicit, conscious judgement. Psychophysical measurements of explicit relative timing have revealed clues about the interaction of sensory signals in the brain as well as in the influence of internal states, such as attention, on those interactions. Evidence from human neurophysiological and functional imaging studies, neuropsychological examination in brain-lesioned patients, and temporary disruptive interventions such as transcranial magnetic stimulation (TMS), point to a role of the parietal cortex in relative timing. Relative timing has traditionally been modelled as a 'race' between competing neural signals. We propose an updated race process based on the integration of sensory evidence towards a decision threshold rather than simple signal propagation. The model suggests a general approach for identifying brain regions involved in relative timing, based on looking for trial-by-trial correlations between neural activity and temporal order judgements (TOJs). Finally, we show how the paradigm can be used to reveal signals related to TOJs in parietal cortex of monkeys trained in a TOJ task.

Visuomotor adaptation changes stereoscopic depth perception and tactile discrimination.

Perceptual judgments of relative depth from binocular disparity are systematically distorted in humans, despite in principle having access to reliable 3D information. Interestingly, these distortions vanish at a natural grasping distance, as if perceived stereo depth is contingent on a specific reference distance for depth-disparity scaling that corresponds to the length of our arm. Here we show that the brain's representation of the arm indeed powerfully modulates depth perception, and that this internal calibration can be quickly updated. We used a classic visuomotor adaptation task in which subjects execute reaching movements with the visual feedback of their reaching finger displaced farther in depth, as if they had a longer arm. After adaptation, 3D perception changed dramatically, and became accurate at the "new" natural grasping distance, the updated disparity scaling reference distance. We further tested whether the rapid adaptive changes were restricted to the visual modality or were characteristic of sensory systems in general. Remarkably, we found an improvement in tactile discrimination consistent with a magnified internal image of the arm. This suggests that the brain integrates sensory signals with information about arm length, and quickly adapts to an artificially updated body structure. These adaptive processes are most likely a relic of the mechanisms needed to optimally correct for changes in size and shape of the body during ontogenesis.

Biased associative representations in parietal cortex.

Neurons in cortical sensory areas respond selectively to sensory stimuli, and the preferred stimulus typically varies among neurons so as to continuously span the sensory space. However, some neurons reflect sensory features that are learned or task dependent. For example, neurons in the lateral intraparietal area (LIP) reflect learned associations between visual stimuli. One might expect that roughly even numbers of LIP neurons would prefer each set of associated stimuli. However, in two associative learning experiments and a perceptual decision experiment, we found striking asymmetries: nearly all neurons recorded from an animal had a similar order of preference among associated stimuli. Behavioral factors could not account for these neuronal biases. A recent computational study proposed that population-firing patterns in parietal cortex have one-dimensional dynamics on long timescales, a possible consequence of recurrent connections that could drive persistent activity. One-dimensional dynamics would predict the biases in selectivity that we observed.

Generalized associative representations in parietal cortex.

Making associations between sensory stimuli is a critical aspect of behavior. We previously found that neurons in the lateral intraparietal area (LIP) of Macaca mulatta reflect learned associations between directions of moving visual stimuli. Individual LIP neurons might encode associations only for specific stimuli, such as motion directions; alternatively, they may encode more general associations whenever animals must decide between discrete alternatives. To test this, we asked whether LIP neurons encode learned associations between pairs of arbitrarily chosen static shapes and, in a separate task, whether the same neurons also encode associations between motion directions. Our experimental design dissociated the visual associations from the movements used to report those associations. We found robust encoding of the learned pair associations between shapes, and shape-pair-selective neurons tended to be selective for direction associations. These findings suggest that representing generic categorical outcomes may be a fundamental role of parietal neurons.

A proposed common neural mechanism for categorization and perceptual decisions.

One of the most fascinating issues in neuroscience is how the brain makes decisions. Recent evidence points to the parietal cortex as an important locus for certain kinds of decisions. Because parietal neurons are also involved in movements, it has been proposed that decisions are encoded in an intentional, action-based framework based on the movements used to report decisions. An alternative or complementary view is that decisions represent more abstract information not linked to movements per se. Parallel experiments on categorization suggest that parietal neurons can indeed represent abstract categorical outcomes that are not linked to movements. This could provide a unified or complementary view of how the brain decides and categorizes.

Temporal sequence of attentional modulation in the lateral intraparietal area and middle temporal area during rapid covert shifts of attention.

In the visual system, spatial attention enhances sensory responses to stimuli at attended locations relative to unattended locations. Which brain structures direct the locus of attention, and how is attentional modulation delivered to structures in the visual system? We trained monkeys on an attention-switch task designed to precisely measure the onset of attentional modulation during rapid shifts of spatial attention. Here we show that attentional modulation appears substantially earlier in the lateral intraparietal area (LIP) than in an anatomically connected lower visual area, the middle temporal area. This temporal sequence of attentional latencies demonstrates that endogenous changes of state can occur in higher visual areas before lower visual areas and satisfies a critical prediction of the hypothesis that LIP is a source of top-down attentional signals to early visual cortex.

Neural activity in the middle temporal area and lateral intraparietal area during endogenously cued shifts of attention.

We measured the behavioral time course of endogenously cued attentional shifts while recording from neurons in the middle temporal area (MT) and lateral intraparietal area (LIP) of two macaque monkeys. The monkeys were required to detect a subtle speed change of one of two continuously moving stimuli. The likely location of the speed change was cued throughout each trial but could switch at an unpredictable time. Attention was evident as an improvement in detection ability and reaction time at the cued location, and the focus of attention shifted over a 400 ms period in response to a switch of the cued stimulus. Attention modulated the ongoing neural response in both MT and LIP, and the sign of this modulation also rapidly shifted after a cue switch. Our data provide a framework for understanding the link between the neural and behavioral effects of attention. The responses of single neurons to the test stimulus in MT and LIP were correlated with stimulus detection and reaction time and, at the population level, a spike-rate threshold model was able to account for the effect of attention on detection rate and reaction time. In this view, the time course of the attentional shift can be understood as an interaction between the emerging attentional modulation and the neural response to the test stimulus in LIP. We also present evidence that the threshold model is not wholly explained by sensory (feedforward) information but may also be influenced by cognitive (feedback) processes at the time of stimulus detection.

The effect of microsaccades on the correlation between neural activity and behavior in middle temporal, ventral intraparietal, and lateral intraparietal areas.

It is widely reported that the activity of single neurons in visual cortex is correlated with the perceptual decision of the subject. The strength of this correlation has implications for the neuronal populations generating the percepts. Here we asked whether microsaccades, which are small, involuntary eye movements, contribute to the correlation between neural activity and behavior. We analyzed data from three different visual detection experiments, with neural recordings from the middle temporal (MT), lateral intraparietal (LIP), and ventral intraparietal (VIP) areas. All three experiments used random dot motion stimuli, with the animals required to detect a transient or sustained change in the speed or strength of motion. We found that microsaccades suppressed neural activity and inhibited detection of the motion stimulus, contributing to the correlation between neural activity and detection behavior. Microsaccades accounted for as much as 19% of the correlation for area MT, 21% for area LIP, and 17% for VIP. While microsaccades only explain part of the correlation between neural activity and behavior, their effect has implications when considering the neuronal populations underlying perceptual decisions.

Distinct encoding of spatial and nonspatial visual information in parietal cortex.

It is well established that the primate parietal cortex plays an important role in visuospatial processing. Parietal cortex damage in both humans and monkeys can lead to behavioral deficits in spatial processing, and many parietal neurons, such as in the macaque lateral intraparietal area (LIP), are strongly influenced by visual-spatial factors. Several recent studies have shown that LIP neurons can also convey robust signals related to nonspatial factors, such as color, shape, and the behavioral context or rule that is relevant for solving the task at hand. But what is the relationship between the encoding of spatial factors and more abstract, nonspatial, influences in LIP? To examine this, we trained monkeys to group visual motion patterns into two arbitrary categories, and recorded the activity of LIP neurons while monkeys performed a categorization task in which stimuli were presented either inside each neuron's receptive field (RF) or at a location in the opposite visual field. While the activity of nearly all LIP neurons showed strong spatial dependence (i.e., greater responses when stimuli were presented within neurons' RFs), we also found that many LIP neurons also showed reliable encoding of the category membership of stimuli even when the stimuli were presented away from neurons' RFs. This suggests that both spatial and nonspatial information can be encoded by individual LIP neurons, and that parietal cortex may be a nexus for the integration of visuospatial signals and more abstract task-dependent information during complex visually based behaviors.

Beyond Poisson: increased spike-time regularity across primate parietal cortex.

Cortical areas differ in their patterns of connectivity, cellular composition, and functional architecture. Spike trains, on the other hand, are commonly assumed to follow similarly irregular dynamics across neocortex. We examined spike-time statistics in four parietal areas using a method that accounts for nonstationarities in firing rate. We found that, whereas neurons in visual areas fire irregularly, many cells in association and motor-like parietal regions show increasingly regular spike trains by comparison. Regularity was evident both in the shape of interspike interval distributions and in spike-count variability across trials. Thus, Poisson-like randomness is not a universal feature of neocortex. Rather, many parietal cells have reduced trial-to-trial variability in spike counts that could provide for more reliable firing-rate signals. These results suggest that spiking dynamics may play different roles in different cortical areas and should not be assumed to arise from fundamentally irreducible noise sources.

Direction selectivity of neurons in the macaque lateral intraparietal area.

The lateral intraparietal area (LIP) of the macaque is believed to play a role in the allocation of attention and the plan to make saccadic eye movements. Many studies have shown that LIP neurons generally encode the static spatial location demarked by the receptive field (RF). LIP neurons might also provide information about the features of visual stimuli within the RF. For example, LIP receives input from cortical areas in the dorsal visual pathway that contain many direction-selective neurons. Here we examine direction selectivity of LIP neurons. Animals were only required to fixate while motion stimuli appeared in the RF. To avoid spatial confounds, the motion stimuli were patches of randomly arrayed dots that moved with 100% coherence in eight different directions. We found that the majority (61%) of LIP neurons were direction selective. The direction tuning was fairly broad, with a median direction-tuning bandwidth of 136 degrees. The average strength of direction selectivity was weaker in LIP than that of other areas of the dorsal visual stream but that difference may be because of the fact that LIP neurons showed a tonic offset in firing whenever a visual stimulus was in the RF, independent of direction. Direction-selective neurons do not seem to constitute a functionally distinct subdivision within LIP, because those neurons had robust, sustained delay-period activity during a memory delayed saccade task. The direction selectivity could also not be explained by asymmetries in the spatial RF, in the hypothetical case that the animals attended to slightly different locations depending on the direction of motion in the RF. Our results show that direction selectivity is a distinct attribute of LIP neurons in addition to spatial encoding.

The representation of economic value in the orbitofrontal cortex is invariant for changes of menu.

Economic choice entails assigning values to the available options and is impaired by lesions to the orbitofrontal cortex (OFC). Recent results show that some neurons in the OFC encode the values that monkeys (Macaca mulatta) assign to different goods when they choose between them. A broad and fundamental question is how this neuronal representation of value depends on the behavioral context. Here we show that neuronal responses in the OFC are typically invariant for changes of menu. In other words, the activity of a neuron in response to one particular good usually does not depend on what other goods are available at the same time. Neurons in the OFC encode economic value, not relative preference. The fact that their responses are menu invariant suggests that transitivity, a fundamental trait of economic choice, may be rooted in the activity of individual neurons.

Experience-dependent representation of visual categories in parietal cortex.

Categorization is a process by which the brain assigns meaning to sensory stimuli. Through experience, we learn to group stimuli into categories, such as 'chair', 'table' and 'vehicle', which are critical for rapidly and appropriately selecting behavioural responses. Although much is known about the neural representation of simple visual stimulus features (for example, orientation, direction and colour), relatively little is known about how the brain learns and encodes the meaning of stimuli. We trained monkeys to classify 360 degrees of visual motion directions into two discrete categories, and compared neuronal activity in the lateral intraparietal (LIP) and middle temporal (MT) areas, two interconnected brain regions known to be involved in visual motion processing. Here we show that neurons in LIP--an area known to be centrally involved in visuo-spatial attention, motor planning and decision-making-robustly reflect the category of motion direction as a result of learning. The activity of LIP neurons encoded directions of motion according to their category membership, and that encoding shifted after the monkeys were retrained to group the same stimuli into two new categories. In contrast, neurons in area MT were strongly direction selective but carried little, if any, explicit category information. This indicates that LIP might be an important nexus for the transformation of visual direction selectivity to more abstract representations that encode the behavioural relevance, or meaning, of stimuli.