The Role of the Lateral Intraparietal Area in (the Study of) Decision Making.

Over the past two decades, neurophysiological responses in the lateral intraparietal area (LIP) have received extensive study for insight into decision making. In a parallel manner, inferred cognitive processes have enriched interpretations of LIP activity. Because of this bidirectional interplay between physiology and cognition, LIP has served as fertile ground for developing quantitative models that link neural activity with decision making. These models stand as some of the most important frameworks for linking brain and mind, and they are now mature enough to be evaluated in finer detail and integrated with other lines of investigation of LIP function. Here, we focus on the relationship between LIP responses and known sensory and motor events in perceptual decision-making tasks, as assessed by correlative and causal methods. The resulting sensorimotor-focused approach offers an account of LIP activity as a multiplexed amalgam of sensory, cognitive, and motor-related activity, with a complex and often indirect relationship to decision processes. Our data-driven focus on multiplexing (and de-multiplexing) of various response components can complement decision-focused models and provides more detailed insight into how neural signals might relate to cognitive processes such as decision making.

Dissociated functional significance of decision-related activity in the primate dorsal stream.

During decision making, neurons in multiple brain regions exhibit responses that are correlated with decisions. However, it remains uncertain whether or not various forms of decision-related activity are causally related to decision making. Here we address this question by recording and reversibly inactivating the lateral intraparietal (LIP) and middle temporal (MT) areas of rhesus macaques performing a motion direction discrimination task. Neurons in area LIP exhibited firing rate patterns that directly resembled the evidence accumulation process posited to govern decision making, with strong correlations between their response fluctuations and the animal's choices. Neurons in area MT, in contrast, exhibited weak correlations between their response fluctuations and choices, and had firing rate patterns consistent with their sensory role in motion encoding. The behavioural impact of pharmacological inactivation of each area was inversely related to their degree of decision-related activity: while inactivation of neurons in MT profoundly impaired psychophysical performance, inactivation in LIP had no measurable impact on decision-making performance, despite having silenced the very clusters that exhibited strong decision-related activity. Although LIP inactivation did not impair psychophysical behaviour, it did influence spatial selection and oculomotor metrics in a free-choice control task. The absence of an effect on perceptual decision making was stable over trials and sessions and was robust to changes in stimulus type and task geometry, arguing against several forms of compensation. Thus, decision-related signals in LIP do not appear to be critical for computing perceptual decisions, and may instead reflect secondary processes. Our findings highlight a dissociation between decision correlation and causation, showing that strong neuron-decision correlations do not necessarily offer direct access to the neural computations underlying decisions.

A simple linear readout of MT supports motion direction-discrimination performance.

Motion discrimination is a well-established model system for investigating how sensory signals are used to form perceptual decisions. Classic studies relating single-neuron activity in the middle temporal area (MT) to perceptual decisions have suggested that a simple linear readout could underlie motion discrimination behavior. A theoretically optimal readout, in contrast, would take into account the correlations between neurons and the sensitivity of individual neurons at each time point. However, it remains unknown how sophisticated the readout needs to be to support actual motion-discrimination behavior or to approach optimal performance. In this study, we evaluated the performance of various neurally plausible decoders, trained to discriminate motion direction from small ensembles of simultaneously recorded MT neurons. We found that decoding the stimulus without knowledge of the interneuronal correlations was sufficient to match an optimal (correlation aware) decoder. Additionally, a decoder could match the psychophysical performance of the animals with flat integration of up to half the stimulus and inherited temporal dynamics from the time-varying MT responses. These results demonstrate that simple, linear decoders operating on small ensembles of neurons can match both psychophysical performance and optimal sensitivity without taking correlations into account and that such simple read-out mechanisms can exhibit complex temporal properties inherited from the sensory dynamics themselves.NEW & NOTEWORTHY Motion perception depends on the ability to decode the activity of neurons in the middle temporal area. Theoretically optimal decoding requires knowledge of the sensitivity of neurons and interneuronal correlations. We report that a simple correlation-blind decoder performs as well as the optimal decoder for coarse motion discrimination. Additionally, the decoder could match the psychophysical performance with moderate temporal integration and dynamics inherited from sensory responses.

Decision-related perturbations of decision-irrelevant eye movements.

It is well established that ongoing cognitive functions affect the trajectories of limb movements mediated by corticospinal circuits, suggesting an interaction between cognition and motor action. Although there are also many demonstrations that decision formation is reflected in the ongoing neural activity in oculomotor brain circuits, it is not known whether the decision-related activity in those oculomotor structures interacts with eye movements that are decision irrelevant. Here we tested for an interaction between decisions and instructed saccades unrelated to the perceptual decision. Observers performed a direction-discrimination decision-making task, but made decision-irrelevant saccades before registering their motion decision with a button press. Probing the oculomotor circuits with these decision-irrelevant saccades during decision making revealed that saccade reaction times and peak velocities were influenced in proportion to motion strength, and depended on the directional congruence between decisions about visual motion and decision-irrelevant saccades. These interactions disappeared when observers passively viewed the motion stimulus but still made the same instructed saccades, and when manual reaction times were measured instead of saccade reaction times, confirming that these interactions result from decision formation as opposed to visual stimulation, and are specific to the oculomotor system. Our results demonstrate that oculomotor function can be affected by decision formation, even when decisions are communicated without eye movements, and that this interaction has a directionally specific component. These results not only imply a continuous and interactive mixture of motor and decision signals in oculomotor structures, but also suggest nonmotor recruitment of oculomotor machinery in decision making.

A Distinct Mechanism of Temporal Integration for Motion through Depth.

Temporal integration of visual motion has been studied extensively within the frontoparallel plane (i.e., 2D). However, the majority of motion occurs within a 3D environment, and it is unknown whether the principles from 2D motion processing generalize to more realistic 3D motion. We therefore characterized and compared temporal integration underlying 2D (left/right) and 3D (toward/away) direction discrimination in human observers, varying motion coherence across a range of viewing durations. The resulting discrimination-versus-duration functions followed three stages, as follows: (1) a steep improvement during the first ∼150 ms, likely reflecting early sensory processing; (2) a subsequent, more gradual benefit of increasing duration over several hundreds of milliseconds, consistent with some form of temporal integration underlying decision formation; and (3) a final stage in which performance ceased to improve with duration over ∼1 s, which is consistent with an upper limit on integration. As previously found, improvements in 2D direction discrimination with time were consistent with near-perfect integration. In contrast, 3D motion sensitivity was lower overall and exhibited a substantial departure from perfect integration. These results confirm that there are overall differences in sensitivity for 2D and 3D motion that are consistent with a sensory difference between binocular and dichoptic sensory mechanisms. They also reveal a difference at the integration stage, in which 3D motion is not accumulated as perfectly as in the 2D motion model system.

What is attention?

We define attention as "the set of evolved brain processes that leads to adaptive and effective behavioral selection." Our emphasis is on understanding the biological and neural mechanisms that make the behavioral properties of attention possible. Although much has been learned about the functional operation of attention by postulating and testing different aspects of attention, our view is that the distinctions most frequently relied upon are much less useful for identifying the detailed biological mechanisms and brain circuits. Instead, we adopt an evolutionary perspective that, while speculative, generates a different set of guiding principles for understanding the form and function of attention. We then provide a thought experiment, introducing a device that we intend to serve as an intuition pump for thinking about how the brain processes for attention might be organized, and that illustrates the features of the biological processes that might ultimately answer the question. This article is categorized under: Cognitive Biology > Evolutionary Roots of Cognition Psychology > Attention Philosophy > Psychological Capacities.

Correlated variability in primate superior colliculus depends on functional class.

Correlated variability in neuronal activity (spike count correlations, rSC) can constrain how information is read out from populations of neurons. Traditionally, rSC is reported as a single value summarizing a brain area. However, single values, like summary statistics, stand to obscure underlying features of the constituent elements. We predict that in brain areas containing distinct neuronal subpopulations, different subpopulations will exhibit distinct levels of rSC that are not captured by the population rSC. We tested this idea in macaque superior colliculus (SC), a structure containing several functional classes (i.e., subpopulations) of neurons. We found that during saccade tasks, different functional classes exhibited differing degrees of rSC. "Delay class" neurons displayed the highest rSC, especially during saccades that relied on working memory. Such dependence of rSC on functional class and cognitive demand underscores the importance of taking functional subpopulations into account when attempting to model or infer population coding principles.

Short-latency preference for faces in the primate superior colliculus.

Face processing is fundamental to primates and has been extensively studied in higher-order visual cortex. Here we report that visual neurons in the midbrain superior colliculus (SC) display a preference for faces, that the preference emerges within 50ms of stimulus onset - well before "face patches" in visual cortex - and that this activity can distinguish faces from other visual objects with accuracies of ~80%. This short-latency preference in SC depends on signals routed through early visual cortex, because inactivating the lateral geniculate nucleus, the key relay from retina to cortex, virtually eliminates visual responses in SC, including face-related activity. These results reveal an unexpected circuit in the primate visual system for rapidly detecting faces in the periphery, complementing the higher-order areas needed for recognizing individual faces.

Temporal integration is a robust feature of perceptual decisions.

Making informed decisions in noisy environments requires integrating sensory information over time. However, recent work has suggested that it may be difficult to determine whether an animal's decision-making strategy relies on evidence integration or not. In particular, strategies based on extrema-detection or random snapshots of the evidence stream may be difficult or even impossible to distinguish from classic evidence integration. Moreover, such non-integration strategies might be surprisingly common in experiments that aimed to study decisions based on integration. To determine whether temporal integration is central to perceptual decision-making, we developed a new model-based approach for comparing temporal integration against alternative 'non-integration' strategies for tasks in which the sensory signal is composed of discrete stimulus samples. We applied these methods to behavioral data from monkeys, rats, and humans performing a variety of sensory decision-making tasks. In all species and tasks, we found converging evidence in favor of temporal integration. First, in all observers across studies, the integration model better accounted for standard behavioral statistics such as psychometric curves and psychophysical kernels. Second, we found that sensory samples with large evidence do not contribute disproportionately to subject choices, as predicted by an extrema-detection strategy. Finally, we provide a direct confirmation of temporal integration by showing that the sum of both early and late evidence contributed to observer decisions. Overall, our results provide experimental evidence suggesting that temporal integration is an ubiquitous feature in mammalian perceptual decision-making. Our study also highlights the benefits of using experimental paradigms where the temporal stream of sensory evidence is controlled explicitly by the experimenter, and known precisely by the analyst, to characterize the temporal properties of the decision process.

Microsaccades as a marker not a cause for attention-related modulation.

Recent evidence suggests that microsaccades are causally linked to the attention-related modulation of neurons-specifically, that microsaccades toward the attended location are required for the subsequent changes in firing rate. These findings have raised questions about whether attention-related modulation is due to different states of attention as traditionally assumed or might instead be a secondary effect of microsaccades. Here, in two rhesus macaques, we tested the relationship between microsaccades and attention-related modulation in the superior colliculus (SC), a brain structure crucial for allocating attention. We found that attention-related modulation emerged even in the absence of microsaccades, was already present prior to microsaccades toward the cued stimulus, and persisted through the suppression of activity that accompanied all microsaccades. Nonetheless, consistent with previous findings, we also found significant attention-related modulation when microsaccades were directed toward, rather than away from, the cued location. Thus, despite the clear links between microsaccades and attention, microsaccades are not necessary for attention-related modulation, at least not in the SC. They do, however, provide an additional marker for the state of attention, especially at times when attention is shifting from one location to another.

Midbrain activity shapes high-level visual properties in the primate temporal cortex.

Recent fMRI experiments identified an attention-related region in the macaque temporal cortex, here called the floor of the superior temporal sulcus (fSTS), as the primary cortical target of superior colliculus (SC) activity. However, it remains unclear which aspects of attention are processed by fSTS neurons and how or why these might depend on SC activity. Here, we show that SC inactivation decreases attentional modulations in fSTS neurons by increasing their activity for ignored stimuli in addition to decreasing their activity for attended stimuli. Neurons in the fSTS also exhibit event-related activity during attention tasks linked to detection performance, and this link is eliminated during SC inactivation. Finally, fSTS neurons respond selectively to particular visual objects, and this selectivity is reduced markedly during SC inactivation. These diverse, high-level properties of fSTS neurons all involve visual signals that carry behavioral relevance. Their dependence on SC activity could reflect a circuit that prioritizes cortical processing of events detected subcortically.

A Neural Pathway for Nonreinforced Preference Change.

How is value processed in the brain to inform decision making? A plethora of studies describe how preferences are shaped by experience with external reinforcements. While research on this reinforced pathway is well established, far less research has explored the neural pathways promoting preference change in the absence of external reinforcements. Here, we review behavioral paradigms linking nonreinforced preference change with manipulations of stimulus exposure, response, and gaze position. Based on this work, we propose that several brain regions traditionally associated with selective attention constitute a pathway for nonreinforced preference change. Together, this nonreinforced pathway (termed here the dorsal value pathway; DVP) and the more famously studied reinforced pathway (ventral value pathway; VVP), interface with prefrontal regions of the primate brain to guide value-based decisions.

Publisher Correction: Midbrain activity can explain perceptual decisions during an attention task.

The original and corrected figures are shown in the accompanying Publisher Correction.

Midbrain activity can explain perceptual decisions during an attention task.

We introduce a decision model that interprets the relative levels of moment-by-moment spiking activity from the right and left superior colliculus to distinguish relevant from irrelevant stimulus events. The model explains detection performance in a covert attention task, both in intact animals and when performance is perturbed by causal manipulations. This provides a specific example of how midbrain activity could support perceptual judgments during attention tasks.

Strategic and Dynamic Temporal Weighting for Perceptual Decisions in Humans and Macaques.

Perceptual decision-making is often modeled as the accumulation of sensory evidence over time. Recent studies using psychophysical reverse correlation have shown that even though the sensory evidence is stationary over time, subjects may exhibit a time-varying weighting strategy, weighting some stimulus epochs more heavily than others. While previous work has explained time-varying weighting as a consequence of static decision mechanisms (e.g., decision bound or leak), here we show that time-varying weighting can reflect strategic adaptation to stimulus statistics, and thus can readily take a number of forms. We characterized the temporal weighting strategies of humans and macaques performing a motion discrimination task in which the amount of information carried by the motion stimulus was manipulated over time. Both species could adapt their temporal weighting strategy to match the time-varying statistics of the sensory stimulus. When early stimulus epochs had higher mean motion strength than late, subjects adopted a pronounced early weighting strategy, where early information was weighted more heavily in guiding perceptual decisions. When the mean motion strength was greater in later stimulus epochs, in contrast, subjects shifted to a marked late weighting strategy. These results demonstrate that perceptual decisions involve a temporally flexible weighting process in both humans and monkeys, and introduce a paradigm with which to manipulate sensory weighting in decision-making tasks.

Functional dissection of signal and noise in MT and LIP during decision-making.

During perceptual decision-making, responses in the middle temporal (MT) and lateral intraparietal (LIP) areas appear to map onto theoretically defined quantities, with MT representing instantaneous motion evidence and LIP reflecting the accumulated evidence. However, several aspects of the transformation between the two areas have not been empirically tested. We therefore performed multistage systems identification analyses of the simultaneous activity of MT and LIP during individual decisions. We found that monkeys based their choices on evidence presented in early epochs of the motion stimulus and that substantial early weighting of motion was present in MT responses. LIP responses recapitulated MT early weighting and contained a choice-dependent buildup that was distinguishable from motion integration. Furthermore, trial-by-trial variability in LIP did not depend on MT activity. These results identify important deviations from idealizations of MT and LIP and motivate inquiry into sensorimotor computations that may intervene between MT and LIP.

Differential effects of deep TMS of the prefrontal cortex on apathy and depression.

BACKGROUND: Apathy is one hallmark of major depression (MDD). It is distinguished by lack of emotion, whereas other aspects of depression involve considerable emotional distress. Investigating both apathy and depression may increase the degree of treatment efficacy for both ailments together and apart. OBJECTIVE: Evaluate the differential effects of deep transcranial magnetic stimulation (DTMS) over the prefrontal cortex (PFC) on apathy and other aspects of depression in patients suffering from a depressive episode. METHODS: Fifty-four treatment-resistant MDD patients were evaluated with the Hamilton Rating Scale for Depression (HRSD), and then treated with DTMS. Apathy-related items from HRSD (ApHRSD) were compared with the remaining items from HRSD (DepHRSD). Antidepressant medications were withdrawn and active DTMS treatment was administered at 20 Hz, 5 days a week for 4 weeks. Changes in HRSD were recorded. Primary efficacy time point was 1 week after the end of active treatment. RESULTS: At screening, ApHRSD distribution was unimodal (moderate apathy), with low correlation (r = 0.17) between ApHRSD and DepHRSD. After treatment, a third had remitted apathy, and the correlation between ApHRSD and DepHRSD had dramatically increased (r = 0.83). Severe ApHRSD (≥ 7) at screening correlated with nonremission for both ApHRSD (R(2) = 0.1993, P = .0012) and DepHRSD (R(2) = 0.0860, P = .0334). CONCLUSIONS: DTMS over the PFC improved both apathy and depression similarly. However, DTMS did not lead to MDD remission if ApHRSD at screening was ≥ 7 of 12. Further investigation using a larger sample will determine whether screening apathy at baseline could be used to predict efficacy of DTMS in MDD patients.

Deep transcranial magnetic stimulation over the prefrontal cortex: evaluation of antidepressant and cognitive effects in depressive patients.

BACKGROUND: Electroconvulsive therapy (ECT) is an effective alternative for pharmacotherapy in treatment-resistant depressive patients, but the side effects limit its use. Transcranial magnetic stimulation (TMS) has been proposed as a refined alternative, but most studies do not indicate that TMS is as effective as ECT for severe depression. OBJECTIVE: We propose that the limited effectiveness of standard TMS resides in its superficial effect on the cortex, although much of the pathophysiology of depression is associated with deeper and larger brain regions implicated in the reward system. Herein, we tested the effectiveness and safety of a novel TMS coil, the "H-coil," which enables direct stimulation of deeper brain regions, at the expense of focality. METHODS: We have studied the antidepressant and cognitive effects induced by 4 weeks of high-frequency (20 Hz) repeated deep TMS (DTMS) over the prefrontal cortex (PFC) of 65 medication-free depressive patients, who have failed to benefit from prior medications. Patients were randomly assigned to various treatment configurations, differing in stimulation intensity and laterality. Effects were assessed by the 24-item Hamilton depression rating scale (HDRS-24) and several secondary outcome measures. RESULTS: A significant improvement in HDRS scores was found when high, but not low, stimulation intensity was used. Several cognitive improvements were evident, and no treatment-related serious adverse events were observed. CONCLUSIONS: DTMS over the PFC was found safe and effective in alleviating depression. The results accentuate the significance of deep, high-intensity stimulation over low, and serve as the first study to indicate the potential of DTMS in psychiatric and neurologic disorders.