Emergence of an abstract categorical code enabling the discrimination of temporally structured tactile stimuli.

The problem of neural coding in perceptual decision making revolves around two fundamental questions: (i) How are the neural representations of sensory stimuli related to perception, and (ii) what attributes of these neural responses are relevant for downstream networks, and how do they influence decision making? We studied these two questions by recording neurons in primary somatosensory (S1) and dorsal premotor (DPC) cortex while trained monkeys reported whether the temporal pattern structure of two sequential vibrotactile stimuli (of equal mean frequency) was the same or different. We found that S1 neurons coded the temporal patterns in a literal way and only during the stimulation periods and did not reflect the monkeys' decisions. In contrast, DPC neurons coded the stimulus patterns as broader categories and signaled them during the working memory, comparison, and decision periods. These results show that the initial sensory representation is transformed into an intermediate, more abstract categorical code that combines past and present information to ultimately generate a perceptually informed choice.

Behavioral response inhibition and maturation of goal representation in prefrontal cortex after puberty.

Executive functions including behavioral response inhibition mature after puberty, in tandem with structural changes in the prefrontal cortex. Little is known about how activity of prefrontal neurons relates to this profound cognitive development. To examine this, we tracked neuronal responses of the prefrontal cortex in monkeys as they transitioned from puberty into adulthood and compared activity at different developmental stages. Performance of the antisaccade task greatly improved in this period. Among neural mechanisms that could facilitate it, reduction of stimulus-driven activity, increased saccadic activity, or enhanced representation of the opposing goal location, only the latter was evident in adulthood. Greatly accentuated in adults, this neural correlate of vector inversion may be a prerequisite to the formation of a motor plan to look away from the stimulus. Our results suggest that the prefrontal mechanisms that underlie mature performance on the antisaccade task are more strongly associated with forming an alternative plan of action than with suppressing the neural impact of the prepotent stimulus.

When the simplest voluntary decisions appear patently suboptimal.

Rahnev & Denison (R&D) catalog numerous experiments in which performance deviates, often in subtle ways, from the theoretical ideal. We discuss an extreme case, an elementary behavior (reactive saccades to single targets) for which a simple contextual manipulation results in responses that are dramatically different from those expected based on reward maximization - and yet are highly informative and amenable to mechanistic examination.

Age-dependent changes in prefrontal intrinsic connectivity.

The prefrontal cortex continues to mature after puberty and into early adulthood, mirroring the time course of maturation of cognitive abilities. However, the way in which prefrontal activity changes during peri- and postpubertal cortical maturation is largely unknown. To address this question, we evaluated the developmental stage of peripubertal rhesus monkeys with a series of morphometric, hormonal, and radiographic measures, and conducted behavioral and neurophysiological tests as the monkeys performed working memory tasks. We compared firing rate and the strength of intrinsic functional connectivity between neurons in peripubertal vs. adult monkeys. Notably, analyses of spike train cross-correlations demonstrated that the average magnitude of functional connections measured between neurons was lower overall in the prefrontal cortex of peripubertal monkeys compared with adults. The difference resulted because negative functional connections (indicative of inhibitory interactions) were stronger and more prevalent in peripubertal compared with adult monkeys, whereas the positive connections showed similar distributions in the two groups. Our results identify changes in the intrinsic connectivity of prefrontal neurons, particularly that mediated by inhibition, as a possible substrate for peri- and postpubertal advances in cognitive capacity.

Task dependence of decision- and choice-related activity in monkey oculomotor thalamus.

Oculomotor signals circulate within putative recurrent feedback loops that include the frontal eye field (FEF) and the oculomotor thalamus (OcTh). To examine how OcTh contributes to visuomotor control, and perceptually informed saccadic choices in particular, neural correlates of perceptual judgment and motor selection in OcTh were evaluated and compared with those previously reported for FEF in the same subjects. Monkeys performed three tasks: a choice task in which perceptual decisions are urgent, a choice task in which identical decisions are made without time pressure, and a single-target, delayed saccade task. The OcTh yielded far fewer task-responsive neurons than the FEF, but across responsive pools, similar neuron types were found, ranging from purely visual to purely saccade related. Across such types, the impact of the perceptual information relevant to saccadic choices was qualitatively the same in FEF and OcTh. However, distinct from that in FEF, activity in OcTh was strongly task dependent, typically being most vigorous in the urgent task, less so in the easier choice task, and least in the single-target task. This was true for responsive and nonresponsive cells alike. Neurons with exclusively motor-related activity showed strong task dependence, fired less, and differed most patently from their FEF counterparts, whereas those that combined visual and motor activity fired most similarly to their FEF counterparts. The results suggest that OcTh activity is more distantly related to saccade production per se, because its degree of commitment to a motor choice varies markedly as a function of ongoing cognitive or behavioral demands.

Transformation of the neural code for tactile detection from thalamus to cortex.

To understand how sensory-driven neural activity gives rise to perception, it is essential to characterize how various relay stations in the brain encode stimulus presence. Neurons in the ventral posterior lateral (VPL) nucleus of the somatosensory thalamus and in primary somatosensory cortex (S1) respond to vibrotactile stimulation with relatively slow modulations (∼100 ms) of their firing rate. In addition, faster modulations (∼10 ms) time-locked to the stimulus waveform are observed in both areas, but their contribution to stimulus detection is unknown. Furthermore, it is unclear whether VPL and S1 neurons encode stimulus presence with similar accuracy and via the same response features. To address these questions, we recorded single neurons while trained monkeys judged the presence or absence of a vibrotactile stimulus of variable amplitude, and their activity was analyzed with a unique decoding method that is sensitive to the time scale of the firing rate fluctuations. We found that the maximum detection accuracy of single neurons is similar in VPL and S1. However, VPL relies more heavily on fast rate modulations than S1, and as a consequence, the neural code in S1 is more tolerant: its performance degrades less when the readout method or the time scale of integration is suboptimal. Therefore, S1 neurons implement a more robust code, one less sensitive to the temporal integration window used to infer stimulus presence downstream. The differences between VPL and S1 responses signaling the appearance of a stimulus suggest a transformation of the neural code from thalamus to cortex.

Differences in intrinsic functional organization between dorsolateral prefrontal and posterior parietal cortex.

The dorsolateral prefrontal and posterior parietal cortex are 2 components of the cortical network controlling attention, working memory, and executive function. Little is known about how the anatomical organization of the 2 areas accounts for their functional specialization. In order to address this question, we examined the strength of intrinsic functional connectivity between neurons sampled in each area by means of cross-correlation analyses of simultaneous recordings from monkeys trained to perform working memory tasks. In both areas, effective connectivity declined as a function of distance between neurons. However, the strength of effective connectivity was higher overall and more localized over short distances in the posterior parietal than the prefrontal cortex. The difference in connectivity strength between the 2 areas could not be explained by differences in firing rate or selectivity for the stimuli and task events, it was present when the fixation period alone was analyzed, and according to simulation results, was consistent with a systematic difference either in the strength or in the relative numbers of shared inputs between neurons. Our results indicate that the 2 areas are characterized by unique intrinsic functional organization, consistent with known differences in their response patterns during working memory.

Neural coding and perceptual detection in the primate somatosensory thalamus.

The contribution of the sensory thalamus to perception and decision making is not well understood. We addressed this problem by recording single neurons in the ventral posterior lateral (VPL) nucleus of the somatosensory thalamus while trained monkeys judged the presence or absence of a vibrotactile stimulus of variable amplitude applied to the skin of a fingertip. We found that neurons in the VPL nucleus modulated their firing rate as a function of stimulus amplitude, and that such modulations accounted for the monkeys' overall psychophysical performance. These neural responses did not predict the animals' decision reports in individual trials, however. Moreover, the sensitivity to changes in stimulus amplitude was similar when the monkeys' performed the detection task and when they were not required to report stimulus detection. These results suggest that the primate somatosensory thalamus likely provides a reliable neural representation of the sensory input to the cerebral cortex, where sensory information is transformed and combined with other cognitive components associated with behavioral performance.

The countermanding task revisited: fast stimulus detection is a key determinant of psychophysical performance.

The countermanding task is a standard method for assessing cognitive/inhibitory control over action and for investigating its neural correlates. In it, the subject plans a movement and either executes it, if no further instruction is given, or attempts to prevent it, if a stop signal is shown. Through various experimental manipulations, many studies have sought to characterize the inhibitory mechanisms thought to be at work in the task, typically using an inferred, model-dependent metric called the stop-signal reaction time. This approach has consistently overlooked the impact of perceptual evaluation on performance. Through analytical work and computer simulations, here we show that psychophysical performance in the task can be easily understood as the result of an ongoing motor plan that is modified (decelerated) by the outcome of a rapid sensory detection process. Notably, no specific assumptions about hypothetical inhibitory mechanisms are needed. This modeling framework achieves four things: (1) it replicates and reconciles behavioral results in numerous variants of the countermanding task; (2) it provides a new, objective metric for characterizing task performance that is more effective than the stop-signal reaction time; (3) it shows that the time window over which detection of a high-visibility stimulus effectively occurs is extremely short (∼20 ms); and (4) it indicates that modulating neuronal latencies and the buildup rates of developing motor plans are two key neural mechanisms for controlling action. The results suggest that manipulations of the countermanding task often cause changes in perceptual detection processes, and not necessarily in inhibition.

Perceptual modulation of motor--but not visual--responses in the frontal eye field during an urgent-decision task.

Neuronal activity in the frontal eye field (FEF) ranges from purely motor (related to saccade production) to purely visual (related to stimulus presence). According to numerous studies, visual responses correlate strongly with early perceptual analysis of the visual scene, including the deployment of spatial attention, whereas motor responses do not. Thus, functionally, the consensus is that visually responsive FEF neurons select a target among visible objects, whereas motor-related neurons plan specific eye movements based on such earlier target selection. However, these conclusions are based on behavioral tasks that themselves promote a serial arrangement of perceptual analysis followed by motor planning. So, is the presumed functional hierarchy in FEF an intrinsic property of its circuitry or does it reflect just one possible mode of operation? We investigate this in monkeys performing a rapid-choice task in which, crucially, motor planning always starts ahead of task-critical perceptual analysis, and the two relevant spatial locations are equally informative and equally likely to be target or distracter. We find that the choice is instantiated in FEF as a competition between oculomotor plans, in agreement with model predictions. Notably, although perception strongly influences the motor neurons, it has little if any measurable impact on the visual cells; more generally, the more dominant the visual response, the weaker the perceptual modulation. The results indicate that, contrary to expectations, during rapid saccadic choices perceptual information may directly modulate ongoing saccadic plans, and this process is not contingent on prior selection of the saccadic goal by visually driven FEF responses.

Conditional independence as a statistical assessment of evidence integration processes.

Intuitively, combining multiple sources of evidence should lead to more accurate decisions than considering single sources of evidence individually. In practice, however, the proper computation may be difficult, or may require additional data that are inaccessible. Here, based on the concept of conditional independence, we consider expressions that can serve either as recipes for integrating evidence based on limited data, or as statistical benchmarks for characterizing evidence integration processes. Consider three events, A, B, and C. We find that, if A and B are conditionally independent with respect to C, then the probability that C occurs given that both A and B are known, P(C|A, B), can be easily calculated without the need to measure the full three-way dependency between A, B, and C. This simplified approach can be used in two general ways: to generate predictions by combining multiple (conditionally independent) sources of evidence, or to test whether separate sources of evidence are functionally independent of each other. These applications are demonstrated with four computer-simulated examples, which include detecting a disease based on repeated diagnostic testing, inferring biological age based on multiple biomarkers of aging, discriminating two spatial locations based on multiple cue stimuli (multisensory integration), and examining how behavioral performance in a visual search task depends on selection histories. Besides providing a sound prescription for predicting outcomes, this methodology may be useful for analyzing experimental data of many types.

Memorable first impressions.

Our ability to recall details from a remembered image depends on a single mechanism that is engaged from the very moment the image disappears from view.

Location- and feature-based selection histories make independent, qualitatively distinct contributions to urgent visuomotor performance.

Attention mechanisms that guide visuomotor behaviors are classified into three broad types according to their reliance on stimulus salience, current goals, and selection histories (i.e., recent experience with events of many sorts). These forms of attentional control are clearly distinct and multifaceted, but what is largely unresolved is how they interact dynamically to determine impending visuomotor choices. To investigate this, we trained two macaque monkeys to perform an urgent version of an oddball search task in which a red target appears among three green distracters, or vice versa. By imposing urgency, performance can be tracked continuously as it transitions from uninformed guesses to informed choices, and this, in turn, permits assessment of attentional control as a function of time. We found that the probability of making a correct choice was strongly modulated by the histories of preceding target colors and target locations. Crucially, although both effects were gated by success (or reward), the two variables played dynamically distinct roles: whereas location history promoted an early motor bias, color history modulated the later perceptual evaluation. Furthermore, target color and location influenced performance independently of each other. The results show that, when combined, selection histories can give rise to enormous swings in visuomotor performance even in simple tasks with highly discriminable stimuli.

Coupling of saccade plans to endogenous attention during urgent choices.

The neural mechanisms that willfully direct attention to specific locations in space are closely related to those for generating targeting eye movements (saccades). However, the degree to which the voluntary deployment of attention to a location is necessarily accompanied by a corresponding saccade plan remains unclear. One problem is that attention and saccades are both automatically driven by salient sensory events; another is that the underlying processes unfold within tens of milliseconds only. Here, we use an urgent task design to resolve the evolution of a visuomotor choice on a moment-by-moment basis while independently controlling the endogenous (goal-driven) and exogenous (salience-driven) contributions to performance. Human participants saw a peripheral cue and, depending on its color, either looked at it (prosaccade) or looked at a diametrically opposite, uninformative non-cue (antisaccade). By varying the luminance of the stimuli, the exogenous contributions could be cleanly dissociated from the endogenous process guiding the choice over time. According to the measured timecourses, generating a correct antisaccade requires about 30 ms more processing time than generating a correct prosaccade based on the same perceptual signal. The results indicate that saccade plans are biased toward the location where attention is endogenously deployed, but the coupling is weak and can be willfully overridden very rapidly.

Working memory performance and neural activity in prefrontal cortex of peripubertal monkeys.

The dorsolateral prefrontal cortex matures late into adolescence or early adulthood. This pattern of maturation mirrors working memory abilities, which continue to improve into adulthood. However, the nature of the changes that prefrontal neuronal activity undergoes during this process is poorly understood. We investigated behavioral performance and neural activity in working memory tasks around the time of puberty, a developmental event associated with the release of sex hormones and significant neurological change. The developmental stages of male rhesus monkeys were evaluated with a series of morphometric, hormonal, and radiographic measures. Peripubertal monkeys were trained to perform an oculomotor delayed response task and a variation of this task involving a distractor stimulus. We found that the peripubertal monkeys tended to abort a relatively large fraction of trials, and these were associated with low levels of task-related neuronal activity. However, for completed trials, accuracy in the delayed saccade task was high and the appearance of a distractor stimulus did not impact performance significantly. In correct trials delay period activity was robust and was not eliminated by the presentation of a distracting stimulus, whereas in trials that resulted in errors the sustained cue-related activity was significantly weaker. Our results show that in peripubertal monkeys the prefrontal cortex is capable of generating robust persistent activity in the delay periods of working memory tasks, although in general it may be more prone to stochastic failure than in adults.

Conditional independence as a statistical assessment of evidence integration processes.

Intuitively, combining multiple sources of evidence should lead to more accurate decisions than considering single sources of evidence individually. In practice, however, the proper computation may be difficult, or may require additional data that are inaccessible. Here, based on the concept of conditional independence, we consider expressions that can serve either as recipes for integrating evidence based on limited data, or as statistical benchmarks for characterizing evidence integration processes. Consider three events, A, B, and C. We find that, if A and B are conditionally independent with respect to C, then the probability that C occurs given that both A and B are known, PC|A,B, can be easily calculated without the need to measure the full three-way dependency between A, B, and C. This simplified approach can be used in two general ways: to generate predictions by combining multiple (conditionally independent) sources of evidence, or to test whether separate sources of evidence are functionally independent of each other. These applications are demonstrated with four computer-simulated examples, which include detecting a disease based on repeated diagnostic testing, inferring biological age based on multiple biomarkers of aging, discriminating two spatial locations based on multiple cue stimuli (multisensory integration), and examining how behavioral performance in a visual search task depends on selection histories. Besides providing a sound prescription for predicting outcomes, this methodology may be useful for analyzing experimental data of many types.

Stimulus salience conflicts and colludes with endogenous goals during urgent choices.

Selecting where to look next depends on both the salience of objects and current goals (what we are looking for), but discerning their relative contributions over the time frame of typical visuomotor decisions (200-250 ms) has been difficult. Here we investigate this problem using an urgent choice task with which the two contributions can be dissociated and tracked moment by moment. Behavioral data from three monkeys corresponded with model-based predictions: when salience favored the target, perceptual performance evolved rapidly and steadily toward an asymptotic level; when salience favored the distracter, many rapid errors were produced and the rise in performance took more time-effects analogous to oculomotor and attentional capture. The results show that salience has a brief (∼50 ms) but inexorable impact that leads to exogenous, involuntary capture, and this can either help or hinder performance, depending on the alignment between salience and ongoing internal goals.

Tracking the temporal evolution of a perceptual judgment using a compelled-response task.

Choice behavior and its neural correlates have been intensely studied with tasks in which a subject makes a perceptual judgment and indicates the result with a motor action. Yet a question crucial for relating behavior to neural activity remains unresolved: what fraction of a subject's reaction time (RT) is devoted to the perceptual evaluation step, as opposed to executing the motor report? Making such timing measurements accurately is complicated because RTs reflect both sensory and motor processing, and because speed and accuracy may be traded. To overcome these problems, we designed the compelled-saccade task, a two-alternative forced-choice task in which the instruction to initiate a saccade precedes the appearance of the relevant sensory information. With this paradigm, it is possible to track perceptual performance as a function of the amount of time during which sensory information is available to influence a subject's choice. The result-the tachometric curve-directly reveals a subject's perceptual processing capacity independently of motor demands. Psychophysical data, together with modeling and computer-simulation results, reveal that task performance depends on three separable components: the timing of the motor responses, the speed of the perceptual evaluation, and additional cognitive factors. Each can vary quickly, from one trial to the next, or can show stable, longer-term changes. This novel dissociation between sensory and motor processes yields a precise metric of how perceptual capacity varies under various experimental conditions and serves to interpret choice-related neuronal activity as perceptual, motor, or both.

Exogenous capture accounts for fundamental differences between pro- and antisaccade performance.

To generate the next eye movement, oculomotor circuits take into consideration the physical salience of objects in view and current behavioral goals, exogenous and endogenous influences, respectively. However, the interactions between exogenous and endogenous mechanisms and their dynamic contributions to target selection have been difficult to resolve because they evolve extremely rapidly. In a recent study (Salinas et al., 2019), we achieved the necessary temporal precision using an urgent variant of the antisaccade task wherein motor plans are initiated early and choice accuracy depends sharply on when exactly the visual cue information becomes available. Empirical and modeling results indicated that the exogenous signal arrives ∼80 ms after cue onset and rapidly accelerates the (incorrect) plan toward the cue, whereas the informed endogenous signal arrives ∼25 ms later to favor the (correct) plan away from the cue. Here, we scrutinize a key mechanistic hypothesis about this dynamic, that the exogenous and endogenous signals act at different times and independently of each other. We test quantitative model predictions by comparing the performance of human participants instructed to look toward a visual cue or away from it under high urgency. We find that, indeed, the exogenous response is largely impervious to task instructions; it simply flips its sign relative to the correct choice, and this largely explains the drastic differences in psychometric performance between the two tasks. Thus, saccadic choices are strongly dictated by the alignment between salience and behavioral goals.

A conflict between spatial selection and evidence accumulation in area LIP.

The lateral intraparietal area (LIP) contains spatially selective neurons that help guide eye movements and, according to numerous studies, do so by accumulating sensory evidence in favor of one choice (e.g., look left) or another (look right). To examine this functional link, we trained two monkeys on an urgent motion discrimination task, a task with which the evolution of both the recorded neuronal activity and the subject's choice can be tracked millisecond by millisecond. We found that while choice accuracy increased steeply with increasing sensory evidence, at the same time, the LIP selection signal became progressively weaker, as if it hindered performance. This effect was consistent with the transient deployment of spatial attention to disparate locations away from the relevant sensory cue. The results demonstrate that spatial selection in LIP is dissociable from, and may even conflict with, evidence accumulation during informed saccadic choices.