Neurophysiological evidence of motor preparation in inner speech and the effect of content predictability.

Self-generated overt actions are preceded by a slow negativity as measured by electroencephalogram, which has been associated with motor preparation. Recent studies have shown that this neural activity is modulated by the predictability of action outcomes. It is unclear whether inner speech is also preceded by a motor-related negativity and influenced by the same factor. In three experiments, we compared the contingent negative variation elicited in a cue paradigm in an active vs. passive condition. In Experiment 1, participants produced an inner phoneme, at which an audible phoneme whose identity was unpredictable was concurrently presented. We found that while passive listening elicited a late contingent negative variation, inner speech production generated a more negative late contingent negative variation. In Experiment 2, the same pattern of results was found when participants were instead asked to overtly vocalize the phoneme. In Experiment 3, the identity of the audible phoneme was made predictable by establishing probabilistic expectations. We observed a smaller late contingent negative variation in the inner speech condition when the identity of the audible phoneme was predictable, but not in the passive condition. These findings suggest that inner speech is associated with motor preparatory activity that may also represent the predicted action-effects of covert actions.

Model-free decision making resists improved instructions and is enhanced by stimulus-response associations.

Human behaviour may be thought of as supported by two different computational-learning mechanisms, model-free and model-based respectively. In model-free strategies, stimulus-response associations are strengthened when actions are followed by a reward and weakened otherwise. In model-based learning, previous to selecting an action, the current values of the different possible actions are computed based on a detailed model of the environment. Previous research with the two-stage task suggests that participants' behaviour usually shows a mixture of both strategies. But, interestingly, a recent study by da Silva and Hare (2020) found that participants primarily deploy model-based behaviour when they are given detailed instructions about the structure of the task. In the present study, we reproduce this essential experiment. Our results confirm that improved instructions give rise to a stronger model-based component. Crucially, we also found a significant effect of reward that became stronger under conditions that favoured the development of strong stimulus-response associations. This suggests that the effect of reward, often taken as indicator of a model-free component, is related to stimulus-response learning.

Learning to suppress a distractor may not be unconscious.

The additional singleton task has become a popular paradigm to explore visual statistical learning and selective attention. In this task, participants are instructed to find a different-shaped target among a series of distractors as fast as possible. In some trials, the search display includes a singleton distractor with a different color, making search more difficult. This singleton distractor appears more often in one location than in the remaining locations. The typical results of these experiments show that participants learn to ignore the area of the screen that is more likely to contain the singleton distractor. It is often claimed that this learning takes place unconsciously, because at the end of the experiment participants seem to be unable to identify the location where the singleton distractor appeared most frequently during the task. In the present study, we tested participants' awareness in three high-powered experiments using alternative measures. Contrary to previous studies, the results show clear evidence of explicit knowledge about which area of the display was more likely to contain the singleton distractor, suggesting that this type of learning might not be unconscious.

The role of working memory in probabilistic cuing of visual search.

In a typical probabilistic cuing experiment, participants are asked to find a visual target among a series of distractors. Although participants are not informed about this, the target appears more frequently in one region of the display, resulting in faster search times for targets located in this region. This bias is thought to depend on a habit-like attentional control mechanism, unconstrained by the availability of working memory (WM) resources. However, the only study that has explored this feature in the past suffers from methodological shortcomings that leave the results open to alternative explanations. In three experiments, we aimed to confirm whether probabilistic cuing is unaffected by visual, spatial, and spatiotemporal WM load. For each experiment, one group of participants performed the visual search task during the retention interval of a WM task (high-load group), whereas another group of participants (no-load group) carried out the visual search task after the WM task. We hypothesized that the probabilistic cuing effect would be larger for the no-load group compared to the high-load group. This hypothesis was confirmed in one experiment, but exploratory analyses suggest that the results can be highly dependent on the analytic approach, casting doubts on its robustness. Overall, our results provide partial support for the hypothesis that probabilistic cuing is not affected by a secondary task. However, given that some analyses reveal an effect of WM load, we conclude that it might be premature to rule out the possibility that the expression of this attentional bias requires WM resources. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

An fMRI meta-analysis of the role of the striatum in everyday-life vs laboratory-developed habits.

The dorsolateral striatum plays a critical role in the acquisition and expression of stimulus-response habits that are learned in experimental laboratories. Here, we use meta-analytic procedures to contrast the neural circuits activated by laboratory-acquired habits with those activated by stimulus-response behaviours acquired in everyday-life. We confirmed that newly learned habits rely more on the anterior putamen with activation extending into caudate and nucleus accumbens. Motor and associative components of everyday-life habits were identified. We found that motor-dominant stimulus-response associations developed outside the laboratory primarily engaged posterior dorsal putamen, supplementary motor area (SMA) and cerebellum. Importantly, associative components were also represented in the posterior putamen. Thus, common neural representations for both naturalistic and laboratory-based habits were found in the left posterior and right anterior putamen. These findings suggest a partial common striatal substrate for habitual actions that are performed predominantly by stimulus-response associations represented in the posterior striatum. The overlapping neural substrates for laboratory and everyday-life habits supports the use of both methods for the analysis of habitual behaviour.

Is probabilistic cuing of visual search an inflexible attentional habit? A meta-analytic review.

In studies on probabilistic cuing of visual search, participants search for a target among several distractors and report some feature of the target. In a biased stage the target appears more frequently in one specific area of the search display. Eventually, participants become faster at finding the target in that rich region compared to the sparse region. In some experiments, this stage is followed by an unbiased stage, where the target is evenly located across all regions of the display. Despite this change in the spatial distribution of targets, search speed usually remains faster when the target is located in the previously rich region. The persistence of the bias even when it is no longer advantageous has been taken as evidence that this phenomenon is an attentional habit. The aim of this meta-analysis was to test whether the magnitude of probabilistic cuing decreases from the biased to the unbiased stage. A meta-analysis of 42 studies confirmed that probabilistic cuing during the unbiased stage was roughly half the size of cuing during the biased stage, and this decrease persisted even after correcting for publication bias. Thus, the evidence supporting the claim that probabilistic cuing is an attentional habit might not be as compelling as previously thought.

Intolerance of uncertainty and decisions about delayed, probabilistic rewards: A replication and extension of Luhmann, C. C., Ishida, K., & Hajcak, G. (2011).

Intolerance of Uncertainty (IU) is thought to lead to maladaptive behaviours and dysfunctional decision making, both in the clinical and healthy population. The seminal study reported by Luhmann and collaborators in 2011 [1] showed that IU was negatively associated with choosing a delayed, but more probable and valuable, reward over choosing an immediate, but less probable and valuable, reward. These findings have been widely disseminated across the field of personality and individual differences because of their relevance for the understanding of the role of IU in the development and maintenance of anxiety-related disorders. Given their importance it would be desirable to have replications of this study, but none have been carried out so far. The current study has been designed to replicate and extend Luhmann et al.'s results. Our sample will include 266 healthy participants (more than five times the sample size used by Luhmann et al.) to detect with a power of 95% the effect size that can be detected with a power of 33% in the original study. To increase our chances of getting such a sample size, the experiment will be conducted online, To increase our chances of getting such a sample size, the experiment will be conducted online, adding check trials to the original decision-making task to monitor participants' engagement. Additionally, we will explore the role of impulsivity in the relationship between IU and willingness to wait. This study will add empirical evidence about the role of IU in decision making and, in case of replication of Luhmann et al.'s results, will support the hypothesis that high-IU individuals may engage in inefficient or costly behaviour in exchange for less time enduring an uncertain situation.

Contextual cuing of visual search does not guide attention automatically in the presence of top-down goals.

Visual search is faster when it occurs within repeated displays, a phenomenon known as contextual cuing (CC). CC has been explained as the result of an automatic orientation of attention toward a target item driven by learned distractor-target associations. In 3 experiments we tested the specific hypothesis that CC is an automatic process of attentional guidance. Participants first searched for a T target in a standard CC procedure. Then, they experienced the same repeated configurations (with the T still present), but now searched for a Y target that was positioned either in a location on the same, or on a different side, from the old T target. Results suggested that there was no interference caused by the old T-target: target search was not affected by the relative positions of the T and Y. Instead, we found a general facilitation in search times for repeated configurations (Experiments 1 and 2). This main effect disappeared when the need for visual search was eliminated in Experiment 3 using a "feature search task". These results suggest that repeated sets of distractors did not trigger an uncontrollable response toward the position of the T; instead, CC was produced by perceptual learning processes. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Is the habit system altered in individuals with obesity? A systematic review.

Habit-like eating behavior is repeatedly pointed to as a key cognitive mechanism contributing to the emergence and maintenance of obesity. Here, we conducted a systematic review of the literature to assess the existent behavioral evidence for the Habit Hypothesis for Overeating (HHO) which states that obesity is the consequence of an imbalance between the habit and goal-directed reward learning systems, leading to overconsumption of food. We found a total of 19 studies implementing a variety of experimental protocols (i.e., free operant paradigm, slips-of-action test, two-step task, Pavlovian-to-Instrumental paradigm, probabilistic learning task) and manipulations. Taken together, the studies on clinical (binge eating disorder) and non-clinical individuals with overweight or obesity do not support the HHO conclusively. While the scientific literature on HHO is still in its infancy, the heterogeneity of the extant studies makes it difficult to evaluate the degree of convergence of these findings. Uncovering the role of reward learning systems in eating behaviors might have a transformative impact on public health.

#EEGManyLabs: Investigating the replicability of influential EEG experiments.

There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.

Stimulus-response learning and expected reward value enhance stimulus cognitive processing: An ERP study.

Reward affects our attention to stimuli, prioritizing those that lead to high-value outcomes. Recently, it has been suggested that such reward-related cognitive prioritization might be associated with the process of learning new stimulus-response (S-R) associations, because both are acquired through extended reward training, and once established, they are hard to overcome. We used event-related potentials (ERP) to analyze the contribution of S-R links to the formation of reward-related cognitive prioritization during reinforcement learning. Reward-related cognitive prioritization was measured by comparing the ERP signals for stimuli predicting high-value and low-value outcomes. In addition, we compared a strong S-R link (same stimulus, same response), with a weak S-R link condition (same stimulus, two different responses). The participants' performance was more accurate and faster when the procedure allowed for establishing strong S-R links and for high-value outcomes. Furthermore, those stimuli associated with strong S-R links showed a larger P3 amplitude at parietal sites. Value effects (larger ERP activity for those stimuli predicting a high-value outcome) were obtained at parietal and occipital sites in the P3 time window. However, value effects did not benefit from strong S-R links in either the P1 or the P3 components. These results suggest that strong S-R learning is not necessary to develop reward-related modulations of ERP activity.

There is more to contextual cuing than meets the eye: Improving visual search without attentional guidance toward predictable target locations.

It is usually easier to find objects in a visual scene as we gain familiarity with it. Two decades of research on contextual cuing of visual search show that repeated exposure to a search display can facilitate the detection of targets that appear at predictable locations in that display. Typical accounts for this effect attribute an essential role to learned associations between the target and other stimuli in the search display. These associations improve visual search either by driving attention toward the usual location of the target or by facilitating its recognition. Contrary to this view, we show that a robust contextual cuing effect can also be observed when repeated search displays do not allow the location of the target to be predicted. These results suggest that, in addition to the mechanisms already explored by previous research, participants learn to ignore the locations usually occupied by distractors, which in turn facilitates the detection of targets even when they appear in unpredictable locations. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Probabilistic cuing of visual search: Neither implicit nor inflexible.

In probabilistic cuing of visual search, participants search for a target object that appears more frequently in one region of the display. This task results in a search bias toward the rich quadrant compared with other quadrants. Previous research has suggested that this bias is inflexible (difficult to unlearn) and implicit (participants are unaware of the biased distribution of targets). We tested these hypotheses in two preregistered, high-powered experiments (Ns = 160 and 161). In an initial biased stage, participants performed a standard probabilistic cuing task. In a subsequent unbiased stage, the target appeared in all quadrants with equal probability. Awareness questions were included after the biased stage in one group of participants, and after the unbiased stage in a second group. Results showed that participants were aware of the rich area, and this effect was larger for the group whose awareness was assessed after the biased stage. In addition, analyses of visual search times indicated that the search bias toward the rich area (formed during the biased stage) was reduced during the unbiased stage. These results cast doubts on the characterization of probabilistic cuing as an implicit and inflexible search habit. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Testing the automaticity of an attentional bias towards predictive cues in human associative learning.

It is well established that associative learning, such as learning new cue-outcome pairings, produces changes in attention: cues that are good predictors of relevant outcomes become prioritised compared with those that are non-predictive or redundant. However, there is controversy about whether such a learnt attentional bias results from a controlled orientation of attention, or whether it can be involuntary in nature. In three experiments, participants learned that cues of certain colours were predictive or non-predictive, and we assessed attention to cues using a dot-probe task. On dot-probe trials, participants were instructed to control attention by orienting towards a cue of a certain shape (target), while trying to ignore another cue (distractor). Although the colours of the cues were critical for the associative learning task, they were irrelevant for the dot-probe task. The results show that, even though participants' controlled attention was focused on the target shape (as evident in response times and accuracy data), response times to the probe were slower (Experiments 1 and 2) and error rates were higher (Experiments 2 and 3) when the distractor was of a (previously) predictive colour. These data suggest that attention was captured involuntarily by the predictive value of the distractor, despite this being counterproductive to the task goal.

Measuring habit formation through goal-directed response switching.

Reward-learning theory views habits as stimulus-response links formed through extended reward training. Accordingly, animal research has shown that actions that are initially goal-directed can become habitual after operant overtraining. However, a similar demonstration is absent in human research, which poses a serious problem for translational models of behavior. We propose that response-time (RT) switch cost after operant training can be used as a new, reliable marker for the operation of the habit system in humans. Using a new method, we show that RT switch cost demonstrates the properties that would be expected of a habitual behavior: (a) it increases with overtraining, (b) it increases when rewards are larger, and (c) it increases when time pressure is added to the task, thereby hindering the competing goal-directed system. These results offer a promising new pathway for studying the operation of the habit system in humans. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

The role of uncertainty in attentional and choice exploration.

The exploitation-exploration (EE) trade-off describes how, when making a decision, an organism must often choose between a safe alternative with a known pay-off, and one or more riskier alternatives with uncertain pay-offs. Recently, the concept of the EE trade-off has been extended to the examination of how organisms distribute limited attentional resources between several stimuli. This work suggests that when the rules governing the environment are certain, participants learn to "exploit" by attending preferentially to cues that provide the most information about upcoming events. However, when the rules are uncertain, people "explore" by increasing their attention to all cues that may provide information to help in predicting upcoming events. In the current study, we examine how uncertainty affects the EE trade-off in attention using a contextual two-armed bandit task, where participants explore with both their attention and their choice behavior. We find evidence for an influence of uncertainty on the EE trade-off in both choice and attention. These findings provide support for the idea of an EE trade-off in attention, and that uncertainty is a primary motivator for exploration in both choice and attentional allocation.

Reward and emotion influence attentional bias in rapid serial visual presentation.

Facial emotion constitutes an important source of information, and rapid processing of this information may bring adaptive advantages. Previous evidence suggests that emotional faces are sometimes prioritised for cognitive processing. Three experiments used an emotion-induced blindness task to examine whether this prioritisation occurs in a purely stimulus-driven fashion or whether it emerges only when the faces are task-relevant. Angry or neutral faces appeared as distractors in a rapid serial visual presentation sequence, shortly before a target that participants were required to identify. Either the emotion (Experiment 1) or gender (Experiments 2 and 3) of the distractor face indicated whether a correct/incorrect response to the target would produce reward/punishment, or not. The three experiments found that reward-related faces impaired subsequent target identification, replicating previous results. Target identification accuracy was also impaired following angry faces, compared with neutral faces, demonstrating an emotion-induced attentional bias. Importantly, this impairment was observed even when face emotion was entirely irrelevant to the participants' ongoing task (in Experiments 2 and 3), suggesting that rapid processing of the facial emotion might arise (at least in part) from the operation of relatively automatic cognitive-perceptual processes.

Oculomotor capture is influenced by expected reward value but (maybe) not predictiveness.

A large body of research has shown that learning about relationships between neutral stimuli and events of significance - rewards or punishments - influences the extent to which people attend to those stimuli in the future. However, different accounts of this influence differ in terms of the critical variable that is proposed to determine learned changes in attention. We describe two experiments using eye-tracking with a rewarded visual search procedure to investigate whether attentional capture is influenced by the predictiveness of stimuli (i.e., the extent to which they provide information about upcoming events) or by their absolute associative value (i.e., the expected incentive value of the outcome that a stimulus predicts). Results demonstrated a clear influence of associative value on the likelihood that stimuli will capture eye-movements, but the evidence for a distinct influence of predictiveness was less compelling. The results of these experiments can be reconciled within a simple account under which attentional prioritization is a monotonic function of the expected, subjective value of the reward that is signalled by a stimulus.

Semantic prediction-errors are context-dependent: An ERP study.

The human brain is an efficient, adaptive, and predictive machine, constructing a generative model of the environment that we then perceive and become conscious of. Here, we show that different types of prediction-errors - the discrepancies between top-down expectations and bottom-up sensory input - are integrated across processing levels and sensory modalities of the cortical hierarchy. We designed a novel, hybrid protocol in which five prediction-establishing sounds were played in rapid succession (e.g., "meow", "meow", "meow", etc.), followed by either a standard (e.g., "meow") or a deviant (e.g., "woof") prime sound, then a visual target word that was either congruent or incongruent (e.g., "cat" or "dog") with the prime sound. We found that the deviants elicited a more negative voltage than the standards at about 150 ms - the mismatch negativity (MMN), an event-related potential (ERP) sensitive to low-level perceptual violations - and that the incongruent words elicited a more negative voltage than the congruent words at about 350 ms - the N400, an ERP sensitive to high-level semantic violations. We also found that the N400 was context-dependent: the N400 was larger when the target words were preceded by a standard than a deviant. Our results suggest that perceptual prediction-errors modulate subsequent semantic prediction-errors. We conclude that our results are consistent with one of the most important assumptions of predictive coding theories: hierarchical prediction-error processing.

Learned predictiveness acquired through experience prevails over the influence of conflicting verbal instructions in rapid selective attention.

Previous studies have provided evidence that selective attention tends to prioritize the processing of stimuli that are good predictors of upcoming events over nonpredictive stimuli. Moreover, studies using eye-tracking to measure attention demonstrate that this attentional bias towards predictive stimuli is at least partially under voluntary control and can be flexibly adapted via instruction. Our experiment took a similar approach to these prior studies, manipulating participants' experience of the predictiveness of different stimuli over the course of trial-by-trial training; we then provided explicit verbal instructions regarding stimulus predictiveness that were designed to be either consistent or inconsistent with the previously established learned predictiveness. Critically, we measured the effects of training and instruction on attention to stimuli using a dot probe task, which allowed us to assess rapid shifts of attention (unlike the eye-gaze measures used in previous studies). Results revealed a rapid attentional bias towards stimuli experienced as predictive (versus those experienced as nonpredictive), that was completely unaffected by verbal instructions. This was not due to participants' failure to recall or use instructions appropriately, as revealed by analyses of their learning about stimuli, and their memory for instructions. Overall, these findings suggest that rapid attentional biases such as those measured by the dot probe task are more strongly influenced by our prior experience during training than by our current explicit knowledge acquired via instruction.