Neurophysiological evidence of motor preparation in inner speech and the effect of content predictability.

Self-generated overt actions are preceded by a slow negativity as measured by electroencephalogram, which has been associated with motor preparation. Recent studies have shown that this neural activity is modulated by the predictability of action outcomes. It is unclear whether inner speech is also preceded by a motor-related negativity and influenced by the same factor. In three experiments, we compared the contingent negative variation elicited in a cue paradigm in an active vs. passive condition. In Experiment 1, participants produced an inner phoneme, at which an audible phoneme whose identity was unpredictable was concurrently presented. We found that while passive listening elicited a late contingent negative variation, inner speech production generated a more negative late contingent negative variation. In Experiment 2, the same pattern of results was found when participants were instead asked to overtly vocalize the phoneme. In Experiment 3, the identity of the audible phoneme was made predictable by establishing probabilistic expectations. We observed a smaller late contingent negative variation in the inner speech condition when the identity of the audible phoneme was predictable, but not in the passive condition. These findings suggest that inner speech is associated with motor preparatory activity that may also represent the predicted action-effects of covert actions.

Targeted Memory Reactivation during Sleep Adaptively Promotes the Strengthening or Weakening of Overlapping Memories.

System memory consolidation is conceptualized as an active process whereby newly encoded memory representations are strengthened through selective memory reactivation during sleep. However, our learning experience is highly overlapping in content (i.e., shares common elements), and memories of these events are organized in an intricate network of overlapping associated events. It remains to be explored whether and how selective memory reactivation during sleep has an impact on these overlapping memories acquired during awake time. Here, we test in a group of adult women and men the prediction that selective memory reactivation during sleep entails the reactivation of associated events and that this may lead the brain to adaptively regulate whether these associated memories are strengthened or pruned from memory networks on the basis of their relative associative strength with the shared element. Our findings demonstrate the existence of efficient regulatory neural mechanisms governing how complex memory networks are shaped during sleep as a function of their associative memory strength.SIGNIFICANCE STATEMENT Numerous studies have demonstrated that system memory consolidation is an active, selective, and sleep-dependent process in which only subsets of new memories become stabilized through their reactivation. However, the learning experience is highly overlapping in content and thus events are encoded in an intricate network of related memories. It remains to be explored whether and how memory reactivation has an impact on overlapping memories acquired during awake time. Here, we show that sleep memory reactivation promotes strengthening and weakening of overlapping memories based on their associative memory strength. These results suggest the existence of an efficient regulatory neural mechanism that avoids the formation of cluttered memory representation of multiple events and promotes stabilization of complex memory networks.

Goal-Directed and Habit-Like Modulations of Stimulus Processing during Reinforcement Learning.

Recent research has shown that perceptual processing of stimuli previously associated with high-value rewards is automatically prioritized even when rewards are no longer available. It has been hypothesized that such reward-related modulation of stimulus salience is conceptually similar to an "attentional habit." Recording event-related potentials in humans during a reinforcement learning task, we show strong evidence in favor of this hypothesis. Resistance to outcome devaluation (the defining feature of a habit) was shown by the stimulus-locked P1 component, reflecting activity in the extrastriate visual cortex. Analysis at longer latencies revealed a positive component (corresponding to the P3b, from 550-700 ms) sensitive to outcome devaluation. Therefore, distinct spatiotemporal patterns of brain activity were observed corresponding to habitual and goal-directed processes. These results demonstrate that reinforcement learning engages both attentional habits and goal-directed processes in parallel. Consequences for brain and computational models of reinforcement learning are discussed.SIGNIFICANCE STATEMENT The human attentional network adapts to detect stimuli that predict important rewards. A recent hypothesis suggests that the visual cortex automatically prioritizes reward-related stimuli, driven by cached representations of reward value; that is, stimulus-response habits. Alternatively, the neural system may track the current value of the predicted outcome. Our results demonstrate for the first time that visual cortex activity is increased for reward-related stimuli even when the rewarding event is temporarily devalued. In contrast, longer-latency brain activity was specifically sensitive to transient changes in reward value. Therefore, we show that both habit-like attention and goal-directed processes occur in the same learning episode at different latencies. This result has important consequences for computational models of reinforcement learning.

Previously acquired cue-outcome structural knowledge guides new learning: Evidence from the retroactive-interference-between-cues effect.

The effect of retroactive interference between cues predicting the same outcome (RIBC) occurs when the behavioral expression of a cue-outcome association (e.g., A→O1) is reduced due to the later acquisition of an association between a different cue and the same outcome (e.g., B→O1). In the present experimental series, we show that this effect can be modulated by knowledge concerning the structure of these cue-outcome relationships. In Experiments 1A and 1B, a pretraining phase was included to promote the expectation of either a one-to-one (OtO) or a many-to-one (MtO) cue-outcome structure during the subsequent RIBC training phases. We hypothesized that the adoption of an OtO expectation would make participants infer that the previously learned A→O1 relationship would not hold any longer after the exposure to B→O1 trials. Alternatively, the adoption of an MtO expectation would prevent participants from making such an inference. Experiment 1B included an additional condition without pretraining, to assess whether the OtO structure was expected by default. Experiment 2 included control conditions to assess the RIBC effect and induced the expectation of an OtO or MtO structure without the addition of a pretraining phase. Overall, the results suggest that participants effectively induced structural expectations regarding the cue-outcome contingencies. In turn, these expectations may have potentiated (OtO expectation) or alleviated (MtO expectation) the RIBC effect, depending on how well these expectations could accommodate the target A→O1 test association. This pattern of results poses difficulties for current explanations of the RIBC effect, since these explanations do not consider the incidence of cue-outcome structural expectations.

Ambiguity produces attention shifts in category learning.

It has been suggested that people and nonhuman animals protect their knowledge from interference by shifting attention toward the context when presented with information that contradicts their previous beliefs. Despite that suggestion, no studies have directly measured changes in attention while participants are exposed to an interference treatment. In the present experiments, we adapted a dot-probe task to track participants' attention to cues and contexts while they were completing a simple category learning task. The results support the hypothesis that interference produces a change in the allocation of attention to cues and contexts.

Revisiting the role of within-compound associations in cue-interaction phenomena.

Although it is thought that within-compound associations are necessary for the occurrence of both backward blocking and unovershadowing, it is not known whether this variable plays a similar role in mediating the two phenomena. Similarly, the roles of within-compound associations in forward blocking and in reduced overshadowing have not been tested independently. The present experiments evaluated how the strength of within-compound associations affects backward blocking, unovershadowing, forward blocking, and reduced overshadowing. Using an allergy task, the strength of within-compound associations was varied by taking advantage of the participants' prior knowledge of common and uncommon food pairings. Backward blocking and unovershadowing effects were present only when highly memorable compound cues were used. Moreover, the magnitudes of both retrospective revaluation effects were affected by the strength of within-compound associations. Forward blocking and reduced overshadowing effects were independent of within-compound associations. These results have important theoretical implications for causal learning research.

Model-free decision making resists improved instructions and is enhanced by stimulus-response associations.

Human behaviour may be thought of as supported by two different computational-learning mechanisms, model-free and model-based respectively. In model-free strategies, stimulus-response associations are strengthened when actions are followed by a reward and weakened otherwise. In model-based learning, previous to selecting an action, the current values of the different possible actions are computed based on a detailed model of the environment. Previous research with the two-stage task suggests that participants' behaviour usually shows a mixture of both strategies. But, interestingly, a recent study by da Silva and Hare (2020) found that participants primarily deploy model-based behaviour when they are given detailed instructions about the structure of the task. In the present study, we reproduce this essential experiment. Our results confirm that improved instructions give rise to a stronger model-based component. Crucially, we also found a significant effect of reward that became stronger under conditions that favoured the development of strong stimulus-response associations. This suggests that the effect of reward, often taken as indicator of a model-free component, is related to stimulus-response learning.

Learning to suppress a distractor may not be unconscious.

The additional singleton task has become a popular paradigm to explore visual statistical learning and selective attention. In this task, participants are instructed to find a different-shaped target among a series of distractors as fast as possible. In some trials, the search display includes a singleton distractor with a different color, making search more difficult. This singleton distractor appears more often in one location than in the remaining locations. The typical results of these experiments show that participants learn to ignore the area of the screen that is more likely to contain the singleton distractor. It is often claimed that this learning takes place unconsciously, because at the end of the experiment participants seem to be unable to identify the location where the singleton distractor appeared most frequently during the task. In the present study, we tested participants' awareness in three high-powered experiments using alternative measures. Contrary to previous studies, the results show clear evidence of explicit knowledge about which area of the display was more likely to contain the singleton distractor, suggesting that this type of learning might not be unconscious.

The role of working memory in probabilistic cuing of visual search.

In a typical probabilistic cuing experiment, participants are asked to find a visual target among a series of distractors. Although participants are not informed about this, the target appears more frequently in one region of the display, resulting in faster search times for targets located in this region. This bias is thought to depend on a habit-like attentional control mechanism, unconstrained by the availability of working memory (WM) resources. However, the only study that has explored this feature in the past suffers from methodological shortcomings that leave the results open to alternative explanations. In three experiments, we aimed to confirm whether probabilistic cuing is unaffected by visual, spatial, and spatiotemporal WM load. For each experiment, one group of participants performed the visual search task during the retention interval of a WM task (high-load group), whereas another group of participants (no-load group) carried out the visual search task after the WM task. We hypothesized that the probabilistic cuing effect would be larger for the no-load group compared to the high-load group. This hypothesis was confirmed in one experiment, but exploratory analyses suggest that the results can be highly dependent on the analytic approach, casting doubts on its robustness. Overall, our results provide partial support for the hypothesis that probabilistic cuing is not affected by a secondary task. However, given that some analyses reveal an effect of WM load, we conclude that it might be premature to rule out the possibility that the expression of this attentional bias requires WM resources. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Feedback-related brain potential activity complies with basic assumptions of associative learning theory.

Feedback-related negativity (FRN) is an ERP component that distinguishes positive from negative feedback. FRN has been hypothesized to be the product of an error signal that may be used to adjust future behavior. In addition, associative learning models assume that the trial-to-trial learning of cue-outcome mappings involves the minimization of an error term. This study evaluated whether FRN is a possible electrophysiological correlate of this error term in a predictive learning task where human subjects were asked to learn different cue-outcome relationships. Specifically, we evaluated the sensitivity of the FRN to the course of learning when different stimuli interact or compete to become a predictor of certain outcomes. Importantly, some of these cues were blocked by more informative or predictive cues (i.e., the blocking effect). Interestingly, the present results show that both learning and blocking affect the amplitude of the FRN component. Furthermore, independent analyses of positive and negative feedback event-related signals showed that the learning effect was restricted to the ERP component elicited by positive feedback. The blocking test showed differences in the FRN magnitude between a predictive and a blocked cue. Overall, the present results show that ERPs that are related to feedback processing correspond to the main predictions of associative learning models.

Is probabilistic cuing of visual search an inflexible attentional habit? A meta-analytic review.

In studies on probabilistic cuing of visual search, participants search for a target among several distractors and report some feature of the target. In a biased stage the target appears more frequently in one specific area of the search display. Eventually, participants become faster at finding the target in that rich region compared to the sparse region. In some experiments, this stage is followed by an unbiased stage, where the target is evenly located across all regions of the display. Despite this change in the spatial distribution of targets, search speed usually remains faster when the target is located in the previously rich region. The persistence of the bias even when it is no longer advantageous has been taken as evidence that this phenomenon is an attentional habit. The aim of this meta-analysis was to test whether the magnitude of probabilistic cuing decreases from the biased to the unbiased stage. A meta-analysis of 42 studies confirmed that probabilistic cuing during the unbiased stage was roughly half the size of cuing during the biased stage, and this decrease persisted even after correcting for publication bias. Thus, the evidence supporting the claim that probabilistic cuing is an attentional habit might not be as compelling as previously thought.

An fMRI meta-analysis of the role of the striatum in everyday-life vs laboratory-developed habits.

The dorsolateral striatum plays a critical role in the acquisition and expression of stimulus-response habits that are learned in experimental laboratories. Here, we use meta-analytic procedures to contrast the neural circuits activated by laboratory-acquired habits with those activated by stimulus-response behaviours acquired in everyday-life. We confirmed that newly learned habits rely more on the anterior putamen with activation extending into caudate and nucleus accumbens. Motor and associative components of everyday-life habits were identified. We found that motor-dominant stimulus-response associations developed outside the laboratory primarily engaged posterior dorsal putamen, supplementary motor area (SMA) and cerebellum. Importantly, associative components were also represented in the posterior putamen. Thus, common neural representations for both naturalistic and laboratory-based habits were found in the left posterior and right anterior putamen. These findings suggest a partial common striatal substrate for habitual actions that are performed predominantly by stimulus-response associations represented in the posterior striatum. The overlapping neural substrates for laboratory and everyday-life habits supports the use of both methods for the analysis of habitual behaviour.

Backward versus forward blocking: evidence for performance-based models of human contingency learning.

Two types of theories are usually invoked to account for cue-interaction effects in human-contingency learning, performance-based theories, such as the comparator hypothesis and statistical models, and learning-based theories, such as associative models. Interestingly, the former models predict two important cue-interaction effects, forward and backward blocking, should affect responding in a similar manner, whereas learning-based models predict the effect of forward blocking should be larger than the effect of backward blocking. Previous experiments involved important methodological problems, and results have been contradictory. The present experiment was designed to explore potential asymmetries between forward and backward blocking. Analyses yielded similar effect sizes, thereby favoring the explanation by performance-based models.

Is the habit system altered in individuals with obesity? A systematic review.

Habit-like eating behavior is repeatedly pointed to as a key cognitive mechanism contributing to the emergence and maintenance of obesity. Here, we conducted a systematic review of the literature to assess the existent behavioral evidence for the Habit Hypothesis for Overeating (HHO) which states that obesity is the consequence of an imbalance between the habit and goal-directed reward learning systems, leading to overconsumption of food. We found a total of 19 studies implementing a variety of experimental protocols (i.e., free operant paradigm, slips-of-action test, two-step task, Pavlovian-to-Instrumental paradigm, probabilistic learning task) and manipulations. Taken together, the studies on clinical (binge eating disorder) and non-clinical individuals with overweight or obesity do not support the HHO conclusively. While the scientific literature on HHO is still in its infancy, the heterogeneity of the extant studies makes it difficult to evaluate the degree of convergence of these findings. Uncovering the role of reward learning systems in eating behaviors might have a transformative impact on public health.

Contextual cuing of visual search does not guide attention automatically in the presence of top-down goals.

Visual search is faster when it occurs within repeated displays, a phenomenon known as contextual cuing (CC). CC has been explained as the result of an automatic orientation of attention toward a target item driven by learned distractor-target associations. In 3 experiments we tested the specific hypothesis that CC is an automatic process of attentional guidance. Participants first searched for a T target in a standard CC procedure. Then, they experienced the same repeated configurations (with the T still present), but now searched for a Y target that was positioned either in a location on the same, or on a different side, from the old T target. Results suggested that there was no interference caused by the old T-target: target search was not affected by the relative positions of the T and Y. Instead, we found a general facilitation in search times for repeated configurations (Experiments 1 and 2). This main effect disappeared when the need for visual search was eliminated in Experiment 3 using a "feature search task". These results suggest that repeated sets of distractors did not trigger an uncontrollable response toward the position of the T; instead, CC was produced by perceptual learning processes. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Stimulus-response learning and expected reward value enhance stimulus cognitive processing: An ERP study.

Reward affects our attention to stimuli, prioritizing those that lead to high-value outcomes. Recently, it has been suggested that such reward-related cognitive prioritization might be associated with the process of learning new stimulus-response (S-R) associations, because both are acquired through extended reward training, and once established, they are hard to overcome. We used event-related potentials (ERP) to analyze the contribution of S-R links to the formation of reward-related cognitive prioritization during reinforcement learning. Reward-related cognitive prioritization was measured by comparing the ERP signals for stimuli predicting high-value and low-value outcomes. In addition, we compared a strong S-R link (same stimulus, same response), with a weak S-R link condition (same stimulus, two different responses). The participants' performance was more accurate and faster when the procedure allowed for establishing strong S-R links and for high-value outcomes. Furthermore, those stimuli associated with strong S-R links showed a larger P3 amplitude at parietal sites. Value effects (larger ERP activity for those stimuli predicting a high-value outcome) were obtained at parietal and occipital sites in the P3 time window. However, value effects did not benefit from strong S-R links in either the P1 or the P3 components. These results suggest that strong S-R learning is not necessary to develop reward-related modulations of ERP activity.

There is more to contextual cuing than meets the eye: Improving visual search without attentional guidance toward predictable target locations.

It is usually easier to find objects in a visual scene as we gain familiarity with it. Two decades of research on contextual cuing of visual search show that repeated exposure to a search display can facilitate the detection of targets that appear at predictable locations in that display. Typical accounts for this effect attribute an essential role to learned associations between the target and other stimuli in the search display. These associations improve visual search either by driving attention toward the usual location of the target or by facilitating its recognition. Contrary to this view, we show that a robust contextual cuing effect can also be observed when repeated search displays do not allow the location of the target to be predicted. These results suggest that, in addition to the mechanisms already explored by previous research, participants learn to ignore the locations usually occupied by distractors, which in turn facilitates the detection of targets even when they appear in unpredictable locations. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Intolerance of uncertainty and decisions about delayed, probabilistic rewards: A replication and extension of Luhmann, C. C., Ishida, K., & Hajcak, G. (2011).

Intolerance of Uncertainty (IU) is thought to lead to maladaptive behaviours and dysfunctional decision making, both in the clinical and healthy population. The seminal study reported by Luhmann and collaborators in 2011 [1] showed that IU was negatively associated with choosing a delayed, but more probable and valuable, reward over choosing an immediate, but less probable and valuable, reward. These findings have been widely disseminated across the field of personality and individual differences because of their relevance for the understanding of the role of IU in the development and maintenance of anxiety-related disorders. Given their importance it would be desirable to have replications of this study, but none have been carried out so far. The current study has been designed to replicate and extend Luhmann et al.'s results. Our sample will include 266 healthy participants (more than five times the sample size used by Luhmann et al.) to detect with a power of 95% the effect size that can be detected with a power of 33% in the original study. To increase our chances of getting such a sample size, the experiment will be conducted online, To increase our chances of getting such a sample size, the experiment will be conducted online, adding check trials to the original decision-making task to monitor participants' engagement. Additionally, we will explore the role of impulsivity in the relationship between IU and willingness to wait. This study will add empirical evidence about the role of IU in decision making and, in case of replication of Luhmann et al.'s results, will support the hypothesis that high-IU individuals may engage in inefficient or costly behaviour in exchange for less time enduring an uncertain situation.

#EEGManyLabs: Investigating the replicability of influential EEG experiments.

There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.

Testing the automaticity of an attentional bias towards predictive cues in human associative learning.

It is well established that associative learning, such as learning new cue-outcome pairings, produces changes in attention: cues that are good predictors of relevant outcomes become prioritised compared with those that are non-predictive or redundant. However, there is controversy about whether such a learnt attentional bias results from a controlled orientation of attention, or whether it can be involuntary in nature. In three experiments, participants learned that cues of certain colours were predictive or non-predictive, and we assessed attention to cues using a dot-probe task. On dot-probe trials, participants were instructed to control attention by orienting towards a cue of a certain shape (target), while trying to ignore another cue (distractor). Although the colours of the cues were critical for the associative learning task, they were irrelevant for the dot-probe task. The results show that, even though participants' controlled attention was focused on the target shape (as evident in response times and accuracy data), response times to the probe were slower (Experiments 1 and 2) and error rates were higher (Experiments 2 and 3) when the distractor was of a (previously) predictive colour. These data suggest that attention was captured involuntarily by the predictive value of the distractor, despite this being counterproductive to the task goal.