Electrical brain activations in young children during a probabilistic reward-learning task are associated with behavioral strategy.

Both adults and children learn through feedback which events and choices in the environment are associated with higher probability of reward. This probability reward-learning ability is thought to be supported by the development of fronto-striatal reward circuits. Recent developmental studies have applied computational models of reward learning to investigate such learning in children. However, there has been limited development of task tools capable of measuring the cascade of neural reward-learning processes in children. Using a child-version of a probabilistic reward-learning task while recording event-related-potential (ERP) measures of electrical brain activity, this study examined key processes of reward learning in preadolescents (n=30), namely: (1) reward-feedback sensitivity, as measured by the early reward-related frontal ERP positivity, (2) rapid attentional shifting of processing toward favored visual stimuli, as measured by the N2pc component, and (3) longer-latency attention-related responses to reward feedback as a function of behavior strategies (i.e., Win-Stay-Lose-Shift), as measured by the central-parietal P300. Consistent with our prior work in adults, the behavioral findings indicate that preadolescents could learn stimulus-reward outcome associations, but at varying levels of performance. Neurally, poor preadolescent learners (those with slower learning rates) showed greater reward-related positivity amplitudes relative to good learners, suggesting greater reward sensitivity. We also found attention shifting towards to-be-chosen stimuli, as evidenced by the N2pc, but not to more highly rewarded stimuli. Lastly, we found an effect of behavioral learning strategies (i.e., Win-Stay-Lose-Shift) on the feedback-locked P300 over the parietal cortex. These findings provide novel insights into the key neural processes underlying reinforcement learning in preadolescents.

Dynamic modulation of neural feedback processing and attention during spatial probabilistic learning.

Learned stimulus-reward associations can modulate behavior and the underlying neural processing of information. We investigated the cascade of these neurocognitive mechanisms involved in the learning of spatial stimulus-reward associations. Using electroencephalogram recordings while participants performed a probabilistic spatial reward learning task, we observed that the feedback-related negativity component was more negative in response to loss feedback compared to gain feedback but showed no modulation by learning. The late positive component became larger in response to losses as the learning set progressed but smaller in response to gains. In addition, feedback-locked alpha frequency oscillations measured over occipital sites were predictive of N2pc amplitudes-a marker of spatial attention orienting-observed on the next trial. This relationship was found to become stronger with learning set progression. Taken together, we elucidated neurocognitive dynamics underlying feedback processing during spatial reward learning, and the subsequent effects of these learned spatial stimulus-reward associations on spatial attention.

Reward and expectancy effects on neural signals of motor preparation and execution.

The magnitude and prospect of rewards can have strong modulatory effects on response preparation and execution. Importantly, reward-seeking behavior in real life happens under an environment characterized by uncertainty and dynamic changes. The current study investigated how the brain's motor and cognitive control system adapts to the dynamic changes in the environment in pursuit of rewards. To this end, we tested the effect of reward and expectancy on the hallmark neural signals that reflect activity in motor and prefrontal systems, the lateralized readiness potential (LRP) and the mediofrontal (mPFC) theta oscillations, while participants performed an expected and unexpected actions to retrieve rewards. To better capture the dynamic changes in neural processes represented in the LRP waveform, we decomposed the LRP into the preparation (LRPprep) and execution (LRPexec) components. In the comparison of LRP magnitude across task conditions, we found a greater LRPprep when large rewards were more likely, reflecting a greater motor preparation to obtain larger rewards. We also found a greater LRPexec when large rewards were presented unexpectedly, suggesting a greater motor effort placed for executing a correct movement when presented with large rewards. In the analysis of mPFC theta, we found a greater theta power prior to performing an unexpected than expected response, indicating its contribution in response conflict resolution. Collectively, these results demonstrate an optimized motor and cognitive control to maximize rewards under the dynamic changes of real-life environment.

EEG-based visual deviance detection in freely behaving mice.

The mouse is widely used as an experimental model to study visual processing. To probe how the visual system detects changes in the environment, functional paradigms in freely behaving mice are strongly needed. We developed and validated the first EEG-based method to investigate visual deviance detection in freely behaving mice. Mice with EEG implants were exposed to a visual deviant detection paradigm that involved changes in light intensity as standard and deviant stimuli. By subtracting the standard from the deviant evoked waveform, deviant detection was evident as bi-phasic negativity (starting around 70 ms) in the difference waveform. Additionally, deviance-associated evoked (beta/gamma) and induced (gamma) oscillatory responses were found. We showed that the results were stimulus-independent by applying a "flip-flop" design and the results showed good repeatability in an independent measurement. Together, we put forward a validated, easy-to-use paradigm to measure visual deviance processing in freely behaving mice.

Neuroscience and climate change: How brain recordings can help us understand human responses to climate change.

There is little published neuroscience research on the psychology of climate change. This review outlines how carefully designed experiments that measure key neural processes, linked to specific cognitive processes, can provide powerful tools to answer research questions in climate change psychology. We review relevant literature from social neuroscience that can be applicable to environmental research-the neural correlates of fairness and cooperation, altruistic behaviour and personal values-and discuss important factors when translating environmental psychology constructs to neuroscientific measurement. We provide a practical overview of how to implement environmental neuroscience using electroencephalography, summarising important event-related potential components and how they can be used to answer questions in climate change psychology. Challenges for the field include accurate attribution of findings, both within and between studies, the need for interdisciplinary collaboration, peer review and reporting processes.

Diminished Feedback Evaluation and Knowledge Updating Underlying Age-Related Differences in Choice Behavior During Feedback Learning.

In our daily lives, we continuously evaluate feedback information, update our knowledge, and adapt our behavior in order to reach desired goals. This ability to learn from feedback information, however, declines with age. Previous research has indicated that certain higher-level learning processes, such as feedback evaluation, integration of feedback information, and updating of knowledge, seem to be affected by age, and recent studies have shown how the adaption of choice behavior following feedback can differ with age. The neural mechanisms underlying this age-related change in choice behavior during learning, however, remain unclear. The aim of this study is therefore to investigate the relation between learning-related neural processes and choice behavior during feedback learning in two age groups. Behavioral and fMRI data were collected, while a group of young (age 18-30) and older (age 60-75) adults performed a probabilistic learning task consisting of 10 blocks of 20 trials each. On each trial, the participants chose between a house and a face, after which they received visual feedback (loss vs. gain). In each block, either the house or the face image had a higher probability of yielding a reward (62.5 vs. 37.5%). Participants were instructed to try to maximize their gains. Our results showed that less successful learning in older adults, as indicated by a lower learning rate, corresponded with a higher tendency to switch to the other stimulus option, and with a reduced adaptation of this switch choice behavior following positive feedback. At the neural level, activation following positive and negative feedback was found to be less distinctive in the older adults, due to a smaller feedback-evaluation response to positive feedback in this group. Furthermore, whereas young adults displayed increased levels of knowledge updating prior to adapting choice behavior, we did not find this effect in older adults. Together, our results suggest that diminished learning performance with age corresponds with diminished evaluation of positive feedback and reduced knowledge updating related to changes in choice behavior, indicating how such differences in feedback processing at the trial level in older adults might lead to reduced learning performance across trials.

Caffeine Boosts Preparatory Attention for Reward-related Stimulus Information.

The intake of caffeine and the prospect of reward have both been associated with increased arousal, enhanced attention, and improved behavioral performance on cognitive tasks, but how they interact to exert these effects is not well understood. To investigate this question, we had participants engage in a two-session cued-reward cognitive task while we recorded their electrical brain activity using scalp electroencephalography. The cue indicated whether monetary reward could be received for fast and accurate responses to a color-word Stroop stimulus that followed. Before each session, participants ingested decaffeinated coffee with either caffeine (3-mg/kg bodyweight) or placebo (3-mg/kg bodyweight lactose). The behavioral results showed that both caffeine and reward-prospect improved response accuracy and speed. In the brain, reward-prospect resulted in an enlarged frontocentral slow wave (contingent negative variation, or CNV) and reduced posterior alpha power (indicating increased cortical activity) before stimulus presentation, both neural markers for preparatory attention. Moreover, the CNV enhancement for reward-prospect trials was considerably more pronounced in the caffeine condition as compared to the placebo condition. These interactive neural enhancements due to caffeine and reward-prospect were mainly visible in preparatory attention activity triggered by the cue (CNV). In addition, some interactive neural enhancements in the processing of the Stroop target stimulus that followed were also observed. The results suggest that caffeine facilitates the neural processes underlying attentional preparation and stimulus processing, especially for task-relevant information.

Thinking fast or slow? Functional magnetic resonance imaging reveals stronger connectivity when experienced neurologists diagnose ambiguous cases.

For ∼40 years, thinking about reasoning has been dominated by dual-process theories. This model, consisting of two distinct types of human reasoning, one fast and effortless and the other slow and deliberate, has also been applied to medical diagnosis. Medical experts are trained to diagnose patients based on their symptoms. When symptoms are prototypical for a certain diagnosis, practitioners may rely on fast, recognition-based reasoning. However, if they are confronted with ambiguous clinical information slower, analytical reasoning is required. To examine the neural underpinnings of these two hypothesized forms of reasoning, 16 highly experienced clinical neurologists were asked to diagnose two types of medical cases, straightforward and ambiguous cases, while functional magnetic resonance imaging was being recorded. Compared with reading control sentences, diagnosing cases resulted in increased activation in brain areas typically found to be active during reasoning such as the caudate nucleus and frontal and parietal cortical regions. In addition, we found vast increased activity in the cerebellum. Regarding the activation differences between the two types of reasoning, no pronounced differences were observed in terms of regional activation. Notable differences were observed, though, in functional connectivity: cases containing ambiguous information showed stronger connectivity between specific regions in the frontal, parietal and temporal cortex in addition to the cerebellum. Based on these results, we propose that the higher demands in terms of controlled cognitive processing during analytical medical reasoning may be subserved by stronger communication between key regions for detecting and resolving uncertainty.

A key role for stimulus-specific updating of the sensory cortices in the learning of stimulus-reward associations.

Successful adaptive behavior requires the learning of associations between stimulus-specific choices and rewarding outcomes. Most research on the mechanisms underlying such processes has focused on subcortical reward-processing regions, in conjunction with frontal circuits. Given the extensive stimulus-specific coding in the sensory cortices, we hypothesized they would play a key role in the learning of stimulus-specific reward associations. We recorded electrical brain activity (using electroencephalogram) during a learning-based decision-making gambling task where, on each trial, participants chose between a face and a house and then received feedback (gain or loss). Within each 20-trial set, either faces or houses were more likely to predict a gain. Results showed that early feedback processing (~200-1200 ms) was independent of the choice made. In contrast, later feedback processing (~1400-1800 ms) was stimulus-specific, reflected by decreased alpha power (reflecting increased cortical activity) over face-selective regions, for winning-vs-losing after a face choice but not after a house choice. Finally, as the reward association was learned in a set, there was an increasingly stronger attentional bias towards the more likely winning stimulus, reflected by increasing attentional orienting-related brain activity and increasing likelihood of choosing that stimulus. These results delineate the processes underlying the updating of stimulus-reward associations during feedback-guided learning, which then guide future attentional allocation and decision-making.

Developmental trajectory of neural specialization for letter and number visual processing.

Adult neuroimaging studies have demonstrated dissociable neural activation patterns in the visual cortex in response to letters (Latin alphabet) and numbers (Arabic numerals), which suggest a strong experiential influence of reading and mathematics on the human visual system. Here, developmental trajectories in the event-related potential (ERP) patterns evoked by visual processing of letters, numbers, and false fonts were examined in four different age groups (7-, 10-, 15-year-olds, and young adults). The 15-year-olds and adults showed greater neural sensitivity to letters over numbers in the left visual cortex and the reverse pattern in the right visual cortex, extending previous findings in adults to teenagers. In marked contrast, 7- and 10-year-olds did not show this dissociable neural pattern. Furthermore, the contrast of familiar stimuli (letters or numbers) versus unfamiliar ones (false fonts) showed stark ERP differences between the younger (7- and 10-year-olds) and the older (15-year-olds and adults) participants. These results suggest that both coarse (familiar versus unfamiliar) and fine (letters versus numbers) tuning for letters and numbers continue throughout childhood and early adolescence, demonstrating a profound impact of uniquely human cultural inventions on visual cognition and its development.

Neural cascade of conflict processing: Not just time-on-task.

In visual conflict tasks (e.g., Stroop or flanker), response times (RTs) are generally longer on incongruent trials relative to congruent ones. Two event-related-potential (ERP) components classically associated with the processing of stimulus conflict are the fronto-central, incongruency-related negativity (Ninc) and the posterior late-positive complex (LPC), which are derived from the ERP difference waves for incongruent minus congruent trials. It has been questioned, however, whether these effects, or other neural measures of incongruency (e.g., fMRI responses in the anterior cingulate), reflect true conflict processing, or whether such effects derive mainly from differential time-on-task. To address this question, we leveraged high-temporal-resolution ERP measures of brain activity during two behavioral tasks. The first task, a modified Erikson flanker paradigm (with congruent and incongruent trials), was used to evoke the classic RT and ERP effects associated with conflict. The second was a non-conflict control task in which, participants visually discriminated a single stimulus (with easy and hard discrimination conditions). Behaviorally, the parameters were titrated to yield similar RT effects of conflict and difficulty (27ms). Neurally, both within-task contrasts showed an initial fronto-central negative-polarity wave (N2-latency effect), but they then diverged. In the difficulty difference wave, the initial negativity led directly into the posterior LPC, whereas in the incongruency contrast the initial negativity was followed a by a second fronto-central negative peak (Ninc), which was then followed by a considerably longer-latency LPC. These results provide clear evidence that the longer processing for incongruent stimulus inputs do not just reflect time-on-task or difficulty, but include a true conflict-processing component.

Visual search performance is predicted by both prestimulus and poststimulus electrical brain activity.

An individual's performance on cognitive and perceptual tasks varies considerably across time and circumstances. We investigated neural mechanisms underlying such performance variability using regression-based analyses to examine trial-by-trial relationships between response times (RTs) and different facets of electrical brain activity. Thirteen participants trained five days on a color-popout visual-search task, with EEG recorded on days one and five. The task was to find a color-popout target ellipse in a briefly presented array of ellipses and discriminate its orientation. Later within a session, better preparatory attention (reflected by less prestimulus Alpha-band oscillatory activity) and better poststimulus early visual responses (reflected by larger sensory N1 waves) correlated with faster RTs. However, N1 amplitudes decreased by half throughout each session, suggesting adoption of a more efficient search strategy within a session. Additionally, fast RTs were preceded by earlier and larger lateralized N2pc waves, reflecting faster and stronger attentional orienting to the targets. Finally, SPCN waves associated with target-orientation discrimination were smaller for fast RTs in the first but not the fifth session, suggesting optimization with practice. Collectively, these results delineate variations in visual search processes that change over an experimental session, while also pointing to cortical mechanisms underlying performance in visual search.

Reward-prospect interacts with trial-by-trial preparation for potential distraction.

When attending for impending visual stimuli, cognitive systems prepare to identify relevant information while ignoring irrelevant, potentially distracting input. Recent work (Marini et al., 2013) showed that a supramodal distracter-filtering mechanism is invoked in blocked designs involving expectation of possible distracter stimuli, although this entails a cost (distraction-filtering cost) on speeded performance when distracters are expected but not presented. Here we used an arrow-flanker task to study whether an analogous cost, potentially reflecting the recruitment of a specific distraction-filtering mechanism, occurs dynamically when potential distraction is cued trial-to-trial (cued distracter-expectation cost). In order to promote the maximal utilization of cue information by participants, in some experimental conditions the cue also signaled the possibility of earning a monetary reward for fast and accurate performance. This design also allowed us to investigate the interplay between anticipation for distracters and anticipation of reward, which is known to engender attentional preparation. Only in reward contexts did participants show a cued distracter-expectation cost, which was larger with higher reward prospect and when anticipation for both distracters and reward were manipulated trial-to-trial. Thus, these results indicate that reward prospect interacts with the distracter expectation during trial-by-trial preparatory processes for potential distraction. These findings highlight how reward guides cue-driven attentional preparation.

Improvement in visual search with practice: mapping learning-related changes in neurocognitive stages of processing.

Practice can improve performance on visual search tasks; the neural mechanisms underlying such improvements, however, are not clear. Response time typically shortens with practice, but which components of the stimulus-response processing chain facilitate this behavioral change? Improved search performance could result from enhancements in various cognitive processing stages, including (1) sensory processing, (2) attentional allocation, (3) target discrimination, (4) motor-response preparation, and/or (5) response execution. We measured event-related potentials (ERPs) as human participants completed a five-day visual-search protocol in which they reported the orientation of a color popout target within an array of ellipses. We assessed changes in behavioral performance and in ERP components associated with various stages of processing. After practice, response time decreased in all participants (while accuracy remained consistent), and electrophysiological measures revealed modulation of several ERP components. First, amplitudes of the early sensory-evoked N1 component at 150 ms increased bilaterally, indicating enhanced visual sensory processing of the array. Second, the negative-polarity posterior-contralateral component (N2pc, 170-250 ms) was earlier and larger, demonstrating enhanced attentional orienting. Third, the amplitude of the sustained posterior contralateral negativity component (SPCN, 300-400 ms) decreased, indicating facilitated target discrimination. Finally, faster motor-response preparation and execution were observed after practice, as indicated by latency changes in both the stimulus-locked and response-locked lateralized readiness potentials (LRPs). These electrophysiological results delineate the functional plasticity in key mechanisms underlying visual search with high temporal resolution and illustrate how practice influences various cognitive and neural processing stages leading to enhanced behavioral performance.

Utilization of reward-prospect enhances preparatory attention and reduces stimulus conflict.

The prospect of gaining money is an incentive widely at play in the real world. Such monetary motivation might have particularly strong influence when the cognitive system is challenged, such as when needing to process conflicting stimulus inputs. Here, we employed manipulations of reward-prospect and attentional-preparation levels in a cued-Stroop stimulus conflict task, along with the high temporal resolution of electrical brain recordings, to provide insight into the mechanisms by which reward-prospect and attention interact and modulate cognitive task performance. In this task, the cue indicated whether or not the participant needed to prepare for an upcoming Stroop stimulus and, if so, whether there was the potential for monetary reward (dependent on performance on that trial). Both cued attention and cued reward-prospect enhanced preparatory neural activity, as reflected by increases in the hallmark attention-related negative-polarity ERP slow wave (contingent negative variation [CNV]) and reductions in oscillatory Alpha activity, which was followed by enhanced processing of the subsequent Stroop stimulus. In addition, similar modulations of preparatory neural activity (larger CNVs and reduced Alpha) predicted shorter versus longer response times (RTs) to the subsequent target stimulus, consistent with such modulations reflecting trial-to-trial variations in attention. Particularly striking were the individual differences in the utilization of reward-prospect information. In particular, the size of the reward effects on the preparatory neural activity correlated across participants with the degree to which reward-prospect both facilitated overall task performance (shorter RTs) and reduced conflict-related behavioral interference. Thus, the prospect of reward appears to recruit attentional preparation circuits to enhance processing of task-relevant target information.