The neural basis of swap errors in working memory.

When making decisions in a cluttered world, humans and other animals often have to hold multiple items in memory at once-such as the different items on a shopping list. Psychophysical experiments in humans and other animals have shown remembered stimuli can sometimes become confused, with participants reporting chimeric stimuli composed of features from different stimuli. In particular, subjects will often make "swap errors" where they misattribute a feature from one object as belonging to another object. While swap errors have been described behaviorally and theoretical explanations have been proposed, their neural mechanisms are unknown. Here, we elucidate these neural mechanisms by analyzing neural population recordings from monkeys performing two multistimulus working memory tasks. In these tasks, monkeys were cued to report the color of an item that either was previously shown at a corresponding location or will be shown at the corresponding location. Animals made swap errors in both tasks. In the neural data, we find evidence that the neural correlates of swap errors emerged when correctly remembered information is selected from working memory. This led to a representation of the distractor color as if it were the target color, underlying the eventual swap error. We did not find consistent evidence that swap errors arose from misinterpretation of the cue or errors during encoding or storage in working memory. These results provide evidence that swap errors emerge during selection of correctly remembered information from working memory, and highlight this selection as a crucial-yet surprisingly brittle-neural process.

Causal functional maps of brain rhythms in working memory.

Human working memory is a key cognitive process that engages multiple functional anatomical nodes across the brain. Despite a plethora of correlative neuroimaging evidence regarding the working memory architecture, our understanding of critical hubs causally controlling overall performance is incomplete. Causal interpretation requires cognitive testing following safe, temporal, and controllable neuromodulation of specific functional anatomical nodes. Such experiments became available in healthy humans with the advance of transcranial alternating current stimulation (tACS). Here, we synthesize findings of 28 placebo-controlled studies (in total, 1,057 participants) that applied frequency-specific noninvasive stimulation of neural oscillations and examined working memory performance in neurotypical adults. We use a computational meta-modeling method to simulate each intervention in realistic virtual brains and test reported behavioral outcomes against the stimulation-induced electric fields in different brain nodes. Our results show that stimulating anterior frontal and medial temporal theta oscillations and occipitoparietal gamma rhythms leads to significant dose-dependent improvement in working memory task performance. Conversely, prefrontal gamma modulation is detrimental to performance. Moreover, we found distinct spatial expression of theta subbands, where working memory changes followed orbitofrontal high-theta modulation and medial temporal low-theta modulation. Finally, all these results are driven by changes in working memory accuracy rather than processing time measures. These findings provide a fresh view of the working memory mechanisms, complementary to neuroimaging research, and propose hypothesis-driven targets for the clinical treatment of working memory deficits.

Dynamic fading memory and expectancy effects in the monkey primary visual cortex.

In order to investigate the involvement of the primary visual cortex (V1) in working memory (WM), parallel, multisite recordings of multi-unit activity were obtained from monkey V1 while the animals performed a delayed match-to-sample (DMS) task. During the delay period, V1 population firing rate vectors maintained a lingering trace of the sample stimulus that could be reactivated by intervening impulse stimuli that enhanced neuronal firing. This fading trace of the sample did not require active engagement of the monkeys in the DMS task and likely reflects the intrinsic dynamics of recurrent cortical networks in lower visual areas. This renders an active, attention-dependent involvement of V1 in the maintenance of WM contents unlikely. By contrast, population responses to the test stimulus depended on the probabilistic contingencies between sample and test stimuli. Responses to tests that matched expectations were reduced which agrees with concepts of predictive coding.

Cholinergic Neuromodulation of Prefrontal Attractor Dynamics Controls Performance in Spatial Working Memory.

The behavioral and neural effects of the endogenous release of acetylcholine following stimulation of the nucleus basalis (NB) of Meynert have been recently examined in two male monkeys (Qi et al., 2021). Counterintuitively, NB stimulation enhanced behavioral performance while broadening neural tuning in the prefrontal cortex (PFC). The mechanism by which a weaker mnemonic neural code could lead to better performance remains unclear. Here, we show that increased neural excitability in a simple continuous bump attractor model can induce broader neural tuning and decrease bump diffusion, provided neural rates are saturated. Increased memory precision in the model overrides memory accuracy, improving overall task performance. Moreover, we show that bump attractor dynamics can account for the nonuniform impact of neuromodulation on distractibility, depending on distractor distance from the target. Finally, we delve into the conditions under which bump attractor tuning and diffusion balance in biologically plausible heterogeneous network models. In these discrete bump attractor networks, we show that reducing spatial correlations or enhancing excitatory transmission can improve memory precision. Altogether, we provide a mechanistic understanding of how cholinergic neuromodulation controls spatial working memory through perturbed attractor dynamics in the PFC.

Trying Harder: How Cognitive Effort Sculpts Neural Representations during Working Memory.

While the exertion of mental effort improves performance on cognitive tasks, the neural mechanisms by which motivational factors impact cognition remain unknown. Here, we used fMRI to test how changes in cognitive effort, induced by changes in task difficulty, impact neural representations of working memory (WM). Participants (both sexes) were precued whether WM difficulty would be hard or easy. We hypothesized that hard trials demanded more effort as a later decision required finer mnemonic precision. Behaviorally, pupil size was larger and response times were slower on hard compared with easy trials suggesting our manipulation of effort succeeded. Neurally, we observed robust persistent activity during delay periods in the prefrontal cortex (PFC), especially during hard trials. Yet, details of the memoranda could not be decoded from patterns in prefrontal activity. In the patterns of activity in the visual cortex, however, we found strong decoding of memorized targets, where accuracy was higher on hard trials. To potentially link these across-region effects, we hypothesized that effort, carried by persistent activity in the PFC, impacts the quality of WM representations encoded in the visual cortex. Indeed, we found that the amplitude of delay period activity in the frontal cortex predicted decoded accuracy in the visual cortex on a trial-wise basis. These results indicate that effort-related feedback signals sculpt population activity in the visual cortex, improving mnemonic fidelity.

N-Methyl-D-Aspartate Receptor-Antibody Encephalitis Impairs Maintenance of Attention to Items in Working Memory.

NMDA receptors (NMDARs) may be crucial to working memory (WM). Computational models predict that they sustain neural firing and produce associative memory, which may underpin maintaining and binding information, respectively. We test this in patients with antibodies to NMDAR (n = 10, female) and compare them with healthy control participants (n = 55, 20 male, 35 female). Patients were tested after recovery with a task that separates two aspects of WM: sustaining attention and feature binding. Participants had to remember two colored arrows. Then attention was directed to one of them. After a variable delay, they reported the direction of either the same arrow (congruent cue) or of the other arrow (incongruent cue). We asked how congruency affected recall precision and measured types of error. Patients had difficulty in both sustaining attention to an item over time and feature binding. Controls were less precise after longer delays and incongruent cues. In contrast, patients did not benefit from congruent cues at longer delays [group × congruency (long condition); p = 0.041], indicating they could not sustain attention. Additionally, patients reported the wrong item (misbinding errors) more than controls after congruent cues [group × delay (congruent condition), main effect of group; p ≤ 0.001]. Our results suggest NMDARs are critical for both maintaining attention and feature binding.

Seven Tesla Evidence for Columnar and Rostral-Caudal Organization of the Human Periaqueductal Gray Response in the Absence of Threat: A Working Memory Study.

The periaqueductal gray (PAG) is a small midbrain structure that surrounds the cerebral aqueduct, regulates brain-body communication, and is often studied for its role in "fight-or-flight" and "freezing" responses to threat. We used ultra-high-field 7 T fMRI to resolve the PAG in humans and distinguish it from the cerebral aqueduct, examining its in vivo function during a working memory task (N = 87). Both mild and moderate cognitive demands elicited spatially similar patterns of whole-brain blood oxygenation level-dependent (BOLD) response, and moderate cognitive demand elicited widespread BOLD increases above baseline in the brainstem. Notably, these brainstem increases were not significantly greater than those in the mild demand condition, suggesting that a subthreshold brainstem BOLD increase occurred for mild cognitive demand as well. Subject-specific masks were group aligned to examine PAG response. In PAG, both mild and moderate demands elicited a well-defined response in ventrolateral PAG, a region thought to be functionally related to anticipated painful threat in humans and nonhuman animals-yet, the present task posed only the most minimal (if any) "threat," with the cognitive tasks used being approximately as challenging as remembering a phone number. These findings suggest that the PAG may play a more general role in visceromotor regulation, even in the absence of threat.

Internal Representations Are Prioritized by Frontoparietal Theta Connectivity and Suppressed by alpha Oscillation Dynamics: Evidence from Concurrent Transcranial Magnetic Stimulation EEG and Invasive EEG.

Control over internal representations requires the prioritization of relevant information and suppression of irrelevant information. The frontoparietal network exhibits prominent neural oscillations during these distinct cognitive processes. Yet, the causal role of this network-scale activity is unclear. Here, we targeted theta-frequency frontoparietal coherence and dynamic alpha oscillations in the posterior parietal cortex using online rhythmic transcranial magnetic stimulation (TMS) in women and men while they prioritized or suppressed internally maintained working memory (WM) representations. Using concurrent high-density EEG, we provided evidence that we acutely drove the targeted neural oscillation and TMS improved WM capacity only when the evoked activity corresponded with the desired cognitive process. To suppress an internal representation, we increased the amplitude of lateralized alpha oscillations in the posterior parietal cortex contralateral to the irrelevant visual field. For prioritization, we found that TMS to the prefrontal cortex increased theta-frequency connectivity in the prefrontoparietal network contralateral to the relevant visual field. To understand the spatial specificity of these effects, we administered the WM task to participants with implanted electrodes. We found that theta connectivity during prioritization was directed from the lateral prefrontal to the superior posterior parietal cortex. Together, these findings provide causal evidence in support of a model where a frontoparietal theta network prioritizes internally maintained representations and alpha oscillations in the posterior parietal cortex suppress irrelevant representations.

A Neural Decision Signal during Internal Sampling from Working Memory in Humans.

How humans transform sensory information into decisions that steer purposeful behavior is a central question in psychology and neuroscience that is traditionally investigated during the sampling of external environmental signals. The decision-making framework of gradual information sampling toward a decision has also been proposed to apply when sampling internal sensory evidence from working memory. However, neural evidence for this proposal remains scarce. Here we show (using scalp EEG in male and female human volunteers) that sampling internal visual representations from working memory elicits a scalp EEG potential associated with gradual evidence accumulation-the central parietal positivity. Consistent with an evolving decision process, we show how this signal (1) scales with the time participants require to reach a decision about the cued memory content and (2) is amplified when having to decide among multiple contents in working memory. These results bring the electrophysiology of decision-making into the domain of working memory and suggest that variability in memory-guided behavior may be driven (at least in part) by variations in the sampling of our inner mental contents.

Transient Attention Gates Access Consciousness: Coupling N2pc and P3 Latencies Using Dynamic Time Warping.

The N2pc and P3 event-related potentials (ERPs), used to index selective attention and access to working memory and conscious awareness, respectively, have been important tools in cognitive sciences. Although it is likely that these two components and the underlying cognitive processes are temporally and functionally linked, such links have not yet been convincingly demonstrated. Adopting a novel methodological approach based on dynamic time warping (DTW), we provide evidence that the N2pc and P3 ERP components are temporally linked. We analyzed data from an experiment where 23 participants (16 women) monitored bilateral rapid serial streams of letters and digits in order to report a target digit indicated by a shape cue, separately for trials with correct responses and trials where a temporally proximal distractor was reported instead (distractor intrusion). DTW analyses revealed that N2pc and P3 latencies were correlated in time, both when the target or a distractor was reported. Notably, this link was weaker on distractor intrusion trials. This N2pc-P3 association is discussed with respect to the relationship between attention and access consciousness. Our results demonstrate that our novel method provides a valuable approach for assessing temporal links between two cognitive processes and their underlying modulating factors. This method allows to establish links and their modulator for any two time-series across all domains of the field (general-purpose MATLAB functions and a Python module are provided alongside this paper).

Integration of history information Drives Serial Dependence and Stabilizes Working Memory Representations.

Serial dependence has shown seemingly contradictory effects on visual perception and working memory. While serial dependence promotes perpetual and mnemonic stability, it biases behavioral reports toward prior information. The neural mechanisms that drive both biasing and adaptive stabilizing effects are not well understood. We proposed and tested a reactivation and integration mechanism that can account for these contradictory effects. We used multivariate pattern analyses of EEG data (26 human participants, 17 females, 9 males) to examine the reactivation of prior reported orientation during the delay period of a visual working memory task. The reactivation strength of prior reports, but not prior sensory items, was predictive of the magnitude of serial dependency biases. These reactivated representations integrated with the representation of the current memory item and improved the ability to decode the current contents of memory. Overall, our data provide convergent evidence suggesting that prior reports in a visual working memory task are reactivated on the subsequent trial and become integrated with current memory representations. This similarity-dependent reactivation mechanism drives both report biasing and stabilization effects attributed to serial dependence in working memory.

Theta frequency deep brain stimulation in the subthalamic nucleus improves working memory in Parkinson's disease.

Most research in Parkinson's disease focuses on improving motor symptoms. Yet, up to 80% of patients present with non-motor symptoms that often have a large impact on patients' quality of life. Impairment in working memory, a fundamental cognitive process, is common in Parkinson's disease. While deep brain stimulation (DBS) of the subthalamic nucleus (STN) improves motor symptoms in Parkinson's disease, its impact on cognitive functions is less well studied. Here, we examine the effect of DBS in the theta, beta, low and high gamma frequency on working memory in 20 Parkinson's disease patients with bilateral STN-DBS. A linear mixed effects model demonstrates that STN-DBS in the theta frequency improves working memory performance. This effect is frequency-specific and was absent for beta and gamma frequency stimulation. Further, this effect is specific to cognitive performance, as theta frequency DBS did not affect motor function. A non-parametric cluster-based permutation analysis of whole-brain normative structural connectivity shows that working memory enhancement by theta frequency stimulation is associated with higher connectivity between the stimulated subthalamic area and the right middle frontal gyrus. Again, this association is frequency- and task-specific. These findings highlight the potential of theta frequency STN-DBS as a targeted intervention to improve working memory in patients with Parkinson's disease.

The meso-connectomes of mouse, marmoset, and macaque: network organization and the emergence of higher cognition.

The recent publications of the inter-areal connectomes for mouse, marmoset, and macaque cortex have allowed deeper comparisons across rodent vs. primate cortical organization. In general, these show that the mouse has very widespread, "all-to-all" inter-areal connectivity (i.e. a "highly dense" connectome in a graph theoretical framework), while primates have a more modular organization. In this review, we highlight the relevance of these differences to function, including the example of primary visual cortex (V1) which, in the mouse, is interconnected with all other areas, therefore including other primary sensory and frontal areas. We argue that this dense inter-areal connectivity benefits multimodal associations, at the cost of reduced functional segregation. Conversely, primates have expanded cortices with a modular connectivity structure, where V1 is almost exclusively interconnected with other visual cortices, themselves organized in relatively segregated streams, and hierarchically higher cortical areas such as prefrontal cortex provide top-down regulation for specifying precise information for working memory storage and manipulation. Increased complexity in cytoarchitecture, connectivity, dendritic spine density, and receptor expression additionally reveal a sharper hierarchical organization in primate cortex. Together, we argue that these primate specializations permit separable deconstruction and selective reconstruction of representations, which is essential to higher cognition.

Noninvasive brain stimulations modulated brain modular interactions to ameliorate working memory in community-dwelling older adults.

Non-invasive brain stimulations have drawn attention in remediating memory decline in older adults. However, it remains unclear regarding the cognitive and neural mechanisms underpinning the neurostimulation effects on memory rehabilitation. We evaluated the intervention effects of 2-weeks of neurostimulations (high-definition transcranial direct current stimulation, HD-tDCS, and electroacupuncture, EA versus controls, CN) on brain activities and functional connectivity during a working memory task in normally cognitive older adults (age 60+, n = 60). Results showed that HD-tDCS and EA significantly improved the cognitive performance, potentiated the brain activities of overlapping neural substrates (i.e. hippocampus, dlPFC, and lingual gyrus) associated with explicit and implicit memory, and modulated the nodal topological properties and brain modular interactions manifesting as increased intramodular connection of the limbic-system dominated network, decreased intramodular connection of default-mode-like network, as well as stronger intermodular connection between frontal-dominated network and limbic-system-dominated network. Predictive model further identified the neuro-behavioral association between modular connections and working memory. This preliminary study provides evidence that noninvasive neurostimulations can improve older adults' working memory through potentiating the brain activity of working memory-related areas and mediating the modular interactions of related brain networks. These findings have important implication for remediating older adults' working memory and cognitive declines.

Boolean map and object reconcile as the unit of visual working memory.

The unit of visual working memory is a fundamental issue under debate in the fields of cognitive psychology and neuroscience, with some traditional research suggesting that it is an object, while other recent studies demonstrating that a Boolean map offers a better account. The controversy surrounding the unit of visual working memory often centers on the representation of objects consist of same dimensional features (e.g. bicolor objects). For 2 colors in a bicolor object, some behavioral studies have suggested that they need to be represented by separate units, while some other studies using electrophysiological measures have found that they can be represented within a single unit. This apparent conflict hints that Boolean map and object may reconcile as the unit of visual working memory. Adopting the contralateral delay activity as an electrophysiological marker of visual working memory, experiments 1 and 2 consistently found that the contralateral delay activity amplitude for memorizing bicolor circles at P7/P8 conformed the Boolean map-based storage throughout the whole maintenance, while the contralateral delay activity amplitude at P3/P4 just conformed the object-based storage during the early period. It suggests though Boolean map got stronger supporting evidence than object, they 2 may coexist as the unit of visual working memory.

Dynamic reconfiguration of brain coactivation states that underlying working memory correlates with cognitive decline in clinically unimpaired older adults.

Impairments in working memory (WM) are evident in both clinically diagnosed patients with mild cognitive decline and older adults at risk, as indicated by lower scores on neuropsychological tests. Examining the WM-related neural signatures in at-risk older adults becomes essential for timely intervention. WM functioning relies on dynamic brain activities, particularly within the frontoparietal system. However, it remains unclear whether the cognitive decline would be reflected in the decreased dynamic reconfiguration of brain coactivation states during WM tasks. We enrolled 47 older adults and assessed their cognitive function using the Montreal Cognitive Assessment. The temporal dynamics of brain coactivations during a WM task were investigated through graph-based time-frame modularity analysis. Four primary recurring states emerged: two task-positive states with positive activity in the frontoparietal system (dorsal attention and central executive); two task-negative states with positive activity in the default mode network accompanied by negative activity in the frontoparietal networks. Heightened WM load was associated with increased flexibility of the frontoparietal networks, but the cognitive decline was correlated with reduced capacity for neuroplastic changes in response to increased task demands. These findings advance our understanding of aberrant brain reconfiguration linked to cognitive decline, potentially aiding early identification of at-risk individuals.

Unveiling serotonergic dysfunction of obsessive-compulsive disorder on prefrontal network dynamics: a computational perspective.

Serotonin (5-HT) regulates working memory within the prefrontal cortex network, which is crucial for understanding obsessive-compulsive disorder. However, the mechanisms how network dynamics and serotonin interact in obsessive-compulsive disorder remain elusive. Here, we incorporate 5-HT receptors (5-HT1A, 5-HT2A) and dopamine receptors into a multistable prefrontal cortex network model, replicating the experimentally observed inverted U-curve phenomenon. We show how the two 5-HT receptors antagonize neuronal activity and modulate network multistability. Reduced binding of 5-HT1A receptors increases global firing, while reduced binding of 5-HT2A receptors deepens attractors. The obtained results suggest reward-dependent synaptic plasticity mechanisms may attenuate 5-HT related network impairments. Integrating serotonin-mediated dopamine release into circuit, we observe that decreased serotonin concentration triggers the network into a deep attractor state, expanding the domain of attraction of stable nodes with high firing rate, potentially causing aberrant reverse learning. This suggests a hypothesis wherein elevated dopamine concentrations in obsessive-compulsive disorder might result from primary deficits in serotonin levels. Findings of this work underscore the pivotal role of serotonergic dysregulation in modulating synaptic plasticity through dopamine pathways, potentially contributing to learned obsessions. Interestingly, serotonin reuptake inhibitors and antidopaminergic potentiators can counteract the over-stable state of high-firing stable points, providing new insights into obsessive-compulsive disorder treatment.

Strengthening of alpha synchronization is a neural correlate of cognitive transfer.

Cognitive training can lead to improvements in both task-specific strategies and general capacities, such as visuo-spatial working memory (VSWM). The latter emerge slowly and linearly throughout training, in contrast to strategy where changes typically occur within the first days of training. Changes in strategy and capacity have not been separated in prior neuroimaging studies. Here, we used a within-participants design with dense temporal sampling to capture the time dynamics of neural mechanisms associated with change in capacity. In four participants, neural activity was recorded with magnetoencephalography on seven occasions over two months of visuo-spatial working memory training. During scanning, the participants performed a trained visuo-spatial working memory task, a transfer task, and a control task. First, we extracted an individual visuo-spatial working memory-load-dependent synchronization network for each participant. Next, we identified linear changes over time in the network, congruent with the temporal dynamics of capacity change. Three out of four participants showed a gradual strengthening of alpha synchronization. Strengthening of the same connections was also found in the transfer task but not in the control task. This suggests that cognitive transfer occurs through slow, gradual strengthening of alpha synchronization between cortical regions that are vital for both the trained task and the transfer task.

Healthy dietary choices involve prefrontal mechanisms associated with long-term reward maximization but not working memory.

Taste and health are critical factors to be considered when choosing foods. Prioritizing healthiness over tastiness requires self-control. It has also been suggested that self-control is guided by cognitive control. We then hypothesized that neural mechanisms underlying healthy food choice are associated with both self-control and cognitive control. Human participants performed a food choice task and a working memory task during functional MRI scanning. Their degree of self-control was assessed behaviorally by the value discount of delayed monetary rewards in intertemporal choice. Prioritizing healthiness in food choice was associated with greater activity in the superior, dorsolateral, and medial prefrontal cortices. Importantly, the prefrontal activity was greater in individuals with smaller delay discounting (i.e. high self-control) who preferred a delayed larger reward to an immediate smaller reward in intertemporal choice. On the other hand, working memory activity did not show a correlation with delay discounting or food choice activity, which was further supported by supplementary results that analyzed data from the Human Connectome Project. Our results suggest that the prefrontal cortex plays a critical role in healthy food choice, which requires self-control, but not working memory, for maximization of reward attainments in a remote future.

Cognitive stimulation as a mechanism linking socioeconomic status and neural function supporting working memory: a longitudinal fMRI study.

Childhood experiences of low socioeconomic status are associated with alterations in neural function in the frontoparietal network and ventral visual stream, which may drive differences in working memory. However, the specific features of low socioeconomic status environments that contribute to these disparities remain poorly understood. Here, we examined experiences of cognitive deprivation (i.e. decreased variety and complexity of experience), as opposed to experiences of threat (i.e. violence exposure), as a potential mechanism through which family income contributes to alterations in neural activation during working memory. As part of a longitudinal study, 148 youth between aged 10 and 13 years completed a visuospatial working memory fMRI task. Early childhood low income, chronicity of low income in early childhood, and current income-to-needs were associated with task-related activation in the ventral visual stream and frontoparietal network. The association of family income with decreased activation in the lateral occipital cortex and intraparietal sulcus during working memory was mediated by experiences of cognitive deprivation. Surprisingly, however, family income and deprivation were not significantly related to working memory performance, and only deprivation was associated with academic achievement in this sample. Taken together, these findings suggest that early life low income and associated cognitive deprivation are important factors in neural function supporting working memory.