Distinct neural markers of evidence accumulation index metacognitive processing before and after simple visual decisions.

Perceptual decision-making is affected by uncertainty arising from the reliability of incoming sensory evidence (perceptual uncertainty) and the categorization of that evidence relative to a choice boundary (categorical uncertainty). Here, we investigated how these factors impact the temporal dynamics of evidence processing during decision-making and subsequent metacognitive judgments. Participants performed a motion discrimination task while electroencephalography was recorded. We manipulated perceptual uncertainty by varying motion coherence, and categorical uncertainty by varying the angular offset of motion signals relative to a criterion. After each trial, participants rated their desire to change their mind. High uncertainty impaired perceptual and metacognitive judgments and reduced the amplitude of the centro-parietal positivity, a neural marker of evidence accumulation. Coherence and offset affected the centro-parietal positivity at different time points, suggesting that perceptual and categorical uncertainty affect decision-making in sequential stages. Moreover, the centro-parietal positivity predicted participants' metacognitive judgments: larger predecisional centro-parietal positivity amplitude was associated with less desire to change one's mind, whereas larger postdecisional centro-parietal positivity amplitude was associated with greater desire to change one's mind, but only following errors. These findings reveal a dissociation between predecisional and postdecisional evidence processing, suggesting that the CPP tracks potentially distinct cognitive processes before and after a decision.

Fractionating distraction: How past- and future-relevant distractors influence integrated decisions.

Many everyday tasks require us to integrate information from multiple steps to make a decision. Dominant accounts of flexible cognition suggest that we are able to navigate such complex tasks by attending to each step in turn, yet few studies measure how we direct our attention to immediate and future task steps. Here, we used a two-step task to test whether participants are sensitive to information that is currently irrelevant but will be relevant in a future task step. Participants viewed two displays in sequence, each containing two superimposed moving dot clouds of different colors. Participants attended to one cued target color in each display and reported the average direction of the two target dot clouds. In a subset of trials, we presented a "decoy" distractor: the second target color appeared as the distractor in the first display. We regressed behavioral responses on the dot clouds' motion directions to track how this future-relevant "decoy" distractor influenced participants' reporting of the average target direction. We compared the influence of decoy distractors to never-relevant, recently relevant, and globally relevant distractor baselines. Across four experiments, we found that responses reflected what was immediately relevant, as well as the broader historical relevance of the distractors. However, relevance for a future task step did not reliably influence attention. We propose that attention in multistep tasks is shaped by what has been relevant in the current setting, and by the immediate demands of each task step. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

White matter microstructure is associated with the precision of visual working memory.

Visual working memory is critical for goal-directed behavior as it maintains continuity between previous and current visual input. Functional neuroimaging studies have shown that visual working memory relies on communication between distributed brain regions, which implies an important role for long-range white matter connections in visual working memory performance. Here, we characterized the relationship between the microstructure of white matter association tracts and the precision of visual working memory representations. To that purpose, we devised a delayed estimation task which required participants to reproduce visual features along a continuous scale. A sample of 80 healthy adults performed the task and underwent diffusion-weighted MRI. We applied mixture distribution modelling to quantify the precision of working memory representations, swap errors, and guess rates, all of which contribute to observed responses. Latent components of microstructural properties in sets of anatomical tracts were identified by principal component analysis. We found an interdependency between fibre coherence in the bilateral superior longitudinal fasciculus (SLF) I, SLF II, and SLF III, on one hand, and the bilateral inferior fronto-occipital fasciculus (IFOF), on the other, in mediating the precision of visual working memory in a functionally specific manner. We also found that individual differences in axonal density in a network comprising the bilateral inferior longitudinal fasciculus (ILF) and SLF III and right SLF II, in combination with a supporting network located elsewhere in the brain, form a common system for visual working memory to modulate response precision, swap errors, and random guess rates.

Distinct early and late neural mechanisms regulate feature-specific sensory adaptation in the human visual system.

A canonical feature of sensory systems is that they adapt to prolonged or repeated inputs, suggesting the brain encodes the temporal context in which stimuli are embedded. Sensory adaptation has been observed in the central nervous systems of many animal species, using techniques sensitive to a broad range of spatiotemporal scales of neural activity. Two competing models have been proposed to account for the phenomenon. One assumes that adaptation reflects reduced neuronal sensitivity to sensory inputs over time (the "fatigue" account); the other posits that adaptation arises due to increased neuronal selectivity (the "sharpening" account). To adjudicate between these accounts, we exploited the well-known "tilt aftereffect", which reflects adaptation to orientation information in visual stimuli. We recorded whole-brain activity with millisecond precision from human observers as they viewed oriented gratings before and after adaptation, and used inverted encoding modeling to characterize feature-specific neural responses. We found that both fatigue and sharpening mechanisms contribute to the tilt aftereffect, but that they operate at different points in the sensory processing cascade to produce qualitatively distinct outcomes. Specifically, fatigue operates during the initial stages of processing, consistent with tonic inhibition of feedforward responses, whereas sharpening occurs ~200 ms later, consistent with feedback or local recurrent activity. Our findings reconcile two major accounts of sensory adaptation, and reveal how this canonical process optimizes the detection of change in sensory inputs through efficient neural coding.

On second thoughts: changes of mind in decision-making.

The ability to change initial decisions in the face of new or potentially conflicting information is fundamental to adaptive behavior. From perceptual tasks to multiple-choice tests, research has shown that changes of mind often improve task performance by correcting initial errors. Decision makers must, however, strike a balance between improvements that might arise from changes of mind and potential energetic, temporal, and psychological costs. In this review, we provide an overview of the change-of-mind literature, focusing on key behavioral findings, computational mechanisms, and neural correlates. We propose a conceptual framework that comprises two core decision dimensions - time and evidence source - which link changes of mind across decision contexts, as a first step toward an integrated psychological account of changes of mind.

Biased weighting of temporally discrete visual stimuli in a continuous report decision-making task: A combined behavioral and electrophysiological study.

Integrating evidence from multiple sources to guide decisions is something humans do on a daily basis. Existing research suggests that not all sources of information are weighted equally in decision-making tasks, and that observers are subject to biases in the face of internal and external noise. Here we describe two experiments that measured observers' ability to integrate successive visual signals. Participants viewed pairs of gratings presented sequentially and reproduced their average orientation. Experiment 1 revealed a recency bias in evidence integration, such that observers' average judgments were closer to the orientation of the second grating than the first. Mixture distribution modeling revealed that this was caused by a recency bias in averaging, as well as a tendency to disregard the first stimulus altogether in some trials. In Experiment 2 we replicated these findings, and quantified orientation-specific patterns of neural activity recorded during the task using population-tuning curve modeling of electroencephalography data. This analysis yielded robust orientation tuning to both the presented gratings and observers' decisions, and suggested that observers were storing both grating stimuli for subsequent averaging rather than computing a running average. The neural representation of the second grating was not reliably stronger than that of the first, suggesting that the recency bias is not due to a difference in the strength of encoding of the second stimulus, and instead may arise at a later decision stage where information is retrieved or integrated. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Stimulus Reliability Automatically Biases Temporal Integration of Discrete Perceptual Targets in the Human Brain.

Many decisions, from crossing a busy street to choosing a profession, require integration of discrete sensory events. Previous studies have shown that integrative decision-making favors more reliable stimuli, mimicking statistically optimal integration. It remains unclear, however, whether reliability biases operate even when they lead to suboptimal performance. To address this issue, we asked human observers to reproduce the average motion direction of two suprathreshold coherent motion signals presented successively and with varying levels of reliability, while simultaneously recording whole-brain activity using electroencephalography. By definition, the averaging task should engender equal weighting of the two component motion signals, but instead we found robust behavioral biases in participants' average decisions that favored the more reliable stimulus. Using population-tuning modeling of brain activity we characterized tuning to the average motion direction. In keeping with the behavioral biases, the neural tuning profiles also exhibited reliability biases. A control experiment revealed that observers were able to reproduce motion directions of low and high reliability with equal precision, suggesting that unbiased integration in this task was not only theoretically optimal but demonstrably possible. Our findings reveal that temporal integration of discrete sensory events in the brain is automatically and suboptimally weighted according to stimulus reliability.SIGNIFICANCE STATEMENT Many everyday decisions require integration of several sources of information. To safely cross a busy road, for example, one must consider the movement of vehicles with different speeds and trajectories. Previous research has shown that individual stimuli are weighted according to their reliability. Whereas reliability biases typically yield performance that closely mimics statistically optimal integration, it remains unknown whether such biases arise even when they lead to suboptimal performance. Here we combined a novel integrative decision-making task with concurrent brain recording and modeling to address this question. While unbiased decisions were optimal in the task, observers nevertheless exhibited robust reliability biases in both behavior and brain activity, suggesting that reliability-weighted integration is automatic and dissociable from statistically optimal integration.

Evidence accumulation during perceptual decision-making is sensitive to the dynamics of attentional selection.

The ability to select and combine multiple sensory inputs in support of accurate decisions is a hallmark of adaptive behaviour. Attentional selection is often needed to prioritize task-relevant stimuli relative to irrelevant, potentially distracting stimuli. As most studies of perceptual decision-making to date have made use of task-relevant stimuli only, relatively little is known about how attention modulates decision making. To address this issue, we developed a novel 'integrated' decision-making task, in which participants judged the average direction of successive target motion signals while ignoring concurrent and spatially overlapping distractor motion signals. In two experiments that varied the role of attentional selection, we used regression to quantify the influence of target and distractor stimuli on behaviour. Using electroencephalography, we characterised the neural correlates of decision making, attentional selection and feature-specific responses to target and distractor signals. While targets strongly influenced perceptual decisions and associated neural activity, we also found that concurrent and spatially coincident distractors exerted a measurable bias on both behaviour and brain activity. Our findings suggest that attention operates as a real-time but imperfect filter during perceptual decision-making by dynamically modulating the contributions of task-relevant and irrelevant sensory inputs.

Pre-saccadic remapping relies on dynamics of spatial attention.

Each saccade shifts the projections of the visual scene on the retina. It has been proposed that the receptive fields of neurons in oculomotor areas are predictively remapped to account for these shifts. While remapping of the whole visual scene seems prohibitively complex, selection by attention may limit these processes to a subset of attended locations. Because attentional selection consumes time, remapping of attended locations should evolve in time, too. In our study, we cued a spatial location by presenting an attention-capturing cue at different times before a saccade and constructed maps of attentional allocation across the visual field. We observed no remapping of attention when the cue appeared shortly before saccade. In contrast, when the cue appeared sufficiently early before saccade, attentional resources were reallocated precisely to the remapped location. Our results show that pre-saccadic remapping takes time to develop suggesting that it relies on the spatial and temporal dynamics of spatial attention.

Saliency maps for finding changes in visual scenes?

Sudden changes in the environment reliably summon attention. This rapid change detection appears to operate in a similar fashion as pop-out in visual search, the phenomenon that very salient stimuli are directly attended, independently of the number of distracting objects. Pop-out is usually explained by the workings of saliency maps, i.e., map-like representations that code for the conspicuity at each location of the visual field. While past research emphasized similarities between pop-out search and change detection, our study highlights differences between the saliency computations in the two tasks: in contrast to pop-out search, saliency computation in change detection (i) operates independently across different stimulus properties (e.g., color and orientation), and (ii) is little influenced by trial history. These deviations from pop-out search are not due to idiosyncrasies of the stimuli or task design, as evidenced by a replication of standard findings in a comparable visual-search design. To explain these results, we outline a model of change detection involving the computation of feature-difference maps, which explains the known similarities and differences with visual search.

Failure to pop out: Feature singletons do not capture attention under low signal-to-noise ratio conditions.

Pop-out search implies that the target is always the first item selected, no matter how many distractors are presented. However, increasing evidence indicates that search is not entirely independent of display density even for pop-out targets: search is slower with sparse (few distractors) than with dense displays (many distractors). Despite its significance, the cause of this anomaly remains unclear. We investigated several mechanisms that could slow down search for pop-out targets. Consistent with the assumption that pop-out targets frequently fail to pop out in sparse displays, we observed greater variability of search duration for sparse displays relative to dense. Computational modeling of the response time distributions also supported the view that pop-out targets fail to pop out in sparse displays. Our findings strongly question the classical assumption that early processing of pop-out targets is independent of the distractors. Rather, the density of distractors critically influences whether or not a stimulus pops out. These results call for new, more reliable measures of pop-out search and potentially a reinterpretation of studies that used relatively sparse displays. (PsycINFO Database Record

Item-based selection is in good shape in visual compound search: A view from electrophysiology.

We argue that although the framework put forward by Hulleman & Olivers (H&O) can successfully explain much of visual search behaviour, it appears limited to tasks without precise target identification demands. In particular, we contend that the unit of selection may be larger than a single item in standard detection tasks, whereas the unit may mandatorily be item-based in compound tasks.

Occipital TMS at phosphene detection threshold captures attention automatically.

Strong stimuli may capture attention automatically, suggesting that attentional selection is determined primarily by physical stimulus properties. The mechanisms underlying capture remain controversial, in particular, whether feedforward subcortical processes are its main source. Also, it remains unclear whether only physical stimulus properties determine capture strength. Here, we demonstrate strong capture in the absence of feedforward input to subcortical structures such as the superior colliculus, by using transcranial magnetic stimulation (TMS) over occipital visual cortex as an attention cue. This implies that the feedforward sweep through subcortex is not necessary for capture to occur but rather provides an additional source of capture. Furthermore, seen cues captured attention more strongly than (physically identical) unseen cues, suggesting that the momentary state of the nervous system modulates attentional selection. In summary, we demonstrate the existence of several sources of attentional capture, and that both physical stimulus properties and the state of the nervous system influence capture.

Local feature suppression effect in face and non-face stimuli.

There is evidence that the cognitive system processes human faces faster and more precisely than other stimuli. Also, faces summon visual attention in an automatic manner, as evidenced by efficient, 'pop-out' search for face targets amongst homogeneous non-face distractors. Pop-out for faces implies that faces are processed as a basic visual 'feature' by specialized face-tuned detectors, similar to the coding of other features (e.g., color, orientation, motion, etc.). However, it is unclear whether such face detectors encode only the global face configuration or both global and local face features. If the former were correct, the face detectors should be unable to support search for a local face feature, rendering search slower relative to non-face stimuli; that is, there would be local feature suppression (LFS) for faces. If the latter was the case, there should be no difference in the processing of local and, respectively, global face features. In two experiments, participants discerned the presence (vs. absence) of a local target defined as a part of either a normal or a scrambled (schematic or realistic) face or of a non-face (Kanizsa diamond or realistic house) configuration. The results consistently showed a robust LFS effect in both reaction times and error rates for face stimuli, and either no difference or even a local feature enhancement effect for the control stimuli. Taken together, these findings indicate that faces are encoded as a basic visual feature by means of globally tuned face detectors.

Non-binding relationship between visual features.

The answer as to how visual attributes processed in different brain loci at different speeds are bound together to give us our unitary experience of the visual world remains unknown. In this study we investigated whether bound representations arise, as commonly assumed, through physiological interactions between cells in the visual areas. In a focal attentional task in which correct responses from either bound or unbound representations were possible, participants discriminated the color or orientation of briefly presented single bars. On the assumption that representations of the two attributes are bound, the accuracy of reporting the color and orientation should co-vary. By contrast, if the attributes are not mandatorily bound, the accuracy of reporting the two attributes should be independent. The results of our psychophysical studies reported here supported the latter, non-binding, relationship between visual features, suggesting that binding does not necessarily occur even under focal attention. We propose a task-contingent binding mechanism, postulating that binding occurs at late, post-perceptual (PP), stages through the intervention of memory.

What are task-sets: a single, integrated representation or a collection of multiple control representations?

Performing two randomly alternating tasks typically results in higher reaction times (RTs) following a task switch, relative to a task repetition. These task switch costs (TSC) reflect processes of switching between control settings for different tasks. The present study investigated whether task sets operate as a single, integrated representation or as an agglomeration of relatively independent components. In a cued task switch paradigm, target detection (present/absent) and discrimination (blue/green/right-/left-tilted) tasks alternated randomly across trials. The target was either a color or an orientation singleton among homogeneous distractors. Across two trials, the task and target-defining dimension repeated or changed randomly. For task switch trials, agglomerated task sets predict a difference between dimension changes and repetitions: joint task and dimension switches require full task set reconfiguration, while dimension repetitions permit re-using some control settings from the previous trial. By contrast, integrated task sets always require full switches, predicting dimension repetition effects (DREs) to be absent across task switches. RT analyses showed significant DREs across task switches as well as repetitions supporting the notion of agglomerated task sets. Additionally, two event-related potentials (ERP) were analyzed: the Posterior-Contralateral-Negativity (PCN) indexing spatial selection dynamics, and the Sustained-Posterior-Contralateral-Negativity (SPCN) indexing post-selective perceptual/semantic analysis. Significant DREs across task switches were observed for both the PCN and SPCN components. Together, DREs across task switches for RTs and two functionally distinct ERP components suggest that re-using control settings across different tasks is possible. The results thus support the "agglomerated-task-set" hypothesis, and are inconsistent with "integrated task sets."

Visual search for feature singletons: multiple mechanisms produce sequence effects in visual search.

Selection of a feature singleton target in visual search tasks, e.g., a red target among green distractors, is very fast--as if the target "popped out" of the display. Interestingly, reaction times (RTs) sometimes even decrease with an increase in the number of distractors (while keeping the presentation area fixed), i.e., there is a negative RT/display density relationship. Furthermore, repeating--versus changing--target-defining properties across trials also speeds up RTs. The present study investigated how display density influences two similar but dissociable types of such intertrial effects, namely (a) priming of pop-out (PoP), observed when the target-defining dimension is fixed, e.g., color, and only the features of the target and distractors, e.g., red and green, vary across trials and (b) the dimension-repetition effect (DRE), observed when both the features and dimensions of the target vary, e.g., from red circle (color) to blue square (shape target) among blue circles. Experiment 1 examined PoP magnitude with sparse (three-item) versus dense (36-item) displays in conditions in which the distractors' color either (a) varied, i.e., red target, green distractors versus green target, red distractors, or (b) it was fixed (blue). Significant PoP was observed only for sparse distractors conditions. Experiment 2 investigated the DRE magnitude across display densities with distractors always being fixed: Significant DREs of comparable magnitude were observed with both sparse and dense displays. This dissociation between the PoP and DREs suggests, first, the existence of multiple mechanisms of intertrial effects and, second, that PoP is specific to low target-distractor signal-to-noise ratios when the target fails to pop out.

How the speed of motor-response decisions, but not focal-attentional selection, differs as a function of task set and target prevalence.

Over the last decades, the visual-search paradigm has provided a powerful test bed for competing theories of visual selective attention. However, the information required to decide upon the correct motor response differs fundamentally across experimental studies, being based, for example, on the presence, spatial location, or identity of the target item. This variability raises the question as to whether estimates of the time taken for (i) focal-attentional selection, (ii) deciding on the motor response, and (iii) response execution generalize across search studies or are specific to the demands of a particular task set. To examine this issue, we presented physically identical stimulus material in four different search task conditions, requiring target localization, detection, discrimination, or compound responses, and combined mental chronometry with two specific electroencephalographic brain responses that are directly linkable to either preattentive or postselective levels of visual processing. Behaviorally, reactions were fastest for localization, slowest for compound responses, and of intermediate speed for detection and discrimination responses. At the electroencephalographic level, this effect of task type manifested in the timing of the stimulus- and response-locked lateralized readiness potential (indexing motor-response decisions), but not posterior contralateral negativity (indexing focal-attentional selection), component. This result demonstrates that only the stage of preattentive visual coding generalizes across task settings, whereas processes that follow focal target selection are dependent on the nature of the task. Consequently, this task set-specific pattern has fundamental implications for all types of experimental paradigms, within and beyond visual search, that require humans to generate motor responses on the basis of external sensory stimulation.

Partial repetition costs persist in nonsearch compound tasks: evidence for multiple-weighting-systems hypothesis.

Search performance is sequence-dependent. A specific finding observed in compound-search tasks consists of an interaction between cross-trial sequences (repetition vs. change) of the target-defining (primary) and response-defining (secondary) features: The effect of a target change is greater when the response stays the same than when the response changes. The present study tested whether this interaction arises from processes involved in target search or from later processes in compound tasks. Uncertainty about the upcoming target location-that is, the search component of compound tasks-was removed in different experiments, either by the use of exogenous spatial precues or by presenting only one, central item. Despite having removed the search component, we observed a robust interaction between target (primary) and response (secondary) feature sequences. These results suggest that this interaction originates from a processing stage concerned with discriminating the response feature of a single (selected) item, rather than from a search-related stage. Furthermore, the results support our multiple-weighting-systems hypothesis, according to which sequence effects in visual search tasks do not stem from a single, unitary mechanism; rather, multiple stages of processing on any given trial can lead to separate memory traces, which in turn have effects on different stages of processing on the subsequent trial.

The multiple-weighting-systems hypothesis: theory and empirical support.

Observers respond faster when the task-relevant perceptual dimension repeats across consecutive trials (e.g., color-color) relative to when it changes (orientation-color)-the phenomenon termed the dimension repetition effect (DRE). Similarly, when two (or more) different tasks are made to vary randomly across trials, observers are faster when the task repeats, relative to task changes-the phenomenon termed task-switch cost (TSC). Hitherto, the DRE and TSC effects have been discussed independently of each other. Critically, either effect was explained by assuming a single mechanism giving rise to DREs or TSCs. Here, we elaborate strong conceptual similarities between the DRE and TSC effects; we introduce the concept of criterion-specific intertrial sequence effects, with DREs and TSCs being different manifestations of criterion-specific effects. Second, we review available evidence suggesting that none of the single mechanism explanations can readily account for all the findings in the literature. Third, we elaborate on the multiple-weighting-systems (or MWS) hypothesis, a recently proposed account that postulates the existence of several, independent mechanisms sensitive to intertrial sequences. Finally, we test predictions derived from the MWS hypothesis in two novel experiments and discuss the results from both the single- and multiple-mechanism perspectives.