The electrophysiology of subjectively perceived memory confidence in relation to recollection and familiarity.

Subjectively perceived confidence is critically involved in distinguishing recollection from familiarity in episodic memory retrieval. However, the extent to which recollection and familiarity share similar electrophysiological processes associated with subjectively perceived memory confidence remains an open question. In addition, the role of memory encoding in subjectively perceived confidence during retrieval has not yet been investigated. To address these issues, an EEG study was performed in thirty healthy volunteers. During a memory task, participants encoded a subset of words while rating the words on pleasantness. Memory recognition and subjectively perceived confidence concerning these 'old' and additional 'new' words was tested. Results showed that during retrieval, correctly classifying an old item with high subjectively perceived confidence was associated with a parietal ERP and parietal theta power, while frontal theta activity was related to high-confident novelty processing. During the memory encoding phase, a parietal ERP and frontal theta oscillations were related to subsequent subjectively perceived memory confidence. Our findings provide the first evidence that subjectively perceived memory confidence is associated with distinct electrophysiological correlates during both memory encoding and retrieval.

Promotion and suppression of autobiographical thinking differentially affect episodic memory consolidation.

During a post-encoding delay period, the ongoing consolidation of recently acquired memories can suffer interference if the delay period involves encoding of new memories, or sensory stimulation tasks. Interestingly, two recent independent studies suggest that (i) autobiographical thinking also interferes markedly with ongoing consolidation of recently learned wordlist material, while (ii) a 2-Back task might not interfere with ongoing consolidation, possibly due to the suppression of autobiographical thinking. In this study, we directly compare these conditions against a quiet wakeful rest baseline to test whether the promotion (via familiar sound-cues) or suppression (via a 2-Back task) of autobiographical thinking during the post-encoding delay period can affect consolidation of studied wordlists in a negative or a positive way, respectively. Our results successfully replicate previous studies and show a significant interference effect (as compared to the rest condition) when learning is followed by familiar sound-cues that promote autobiographical thinking, whereas no interference effect is observed when learning is followed by the 2-Back task. Results from a post-experimental experience-sampling questionnaire further show significant differences in the degree of autobiographical thinking reported during the three post-encoding periods: highest in the presence of sound-cues and lowest during the 2-Back task. In conclusion, our results suggest that varying levels of autobiographical thought during the post-encoding period may modulate episodic memory consolidation.

The posterior parietal cortex and subjectively perceived confidence during memory retrieval.

Functional neuroimaging studies suggest a role for the left angular gyrus (AG) in processes related to memory recognition. However, results of neuropsychological and transcranial magnetic stimulation (TMS) studies have been inconclusive regarding the specific contribution of the AG in recollection, familiarity, and the subjective experience of memory. To obtain further insight into this issue, 20 healthy right-handed volunteers performed a memory task in a single-blind within-subject controlled TMS study. Neuronavigated inhibitory repetitive TMS (rTMS) was applied over the left AG and the vertex in a randomized and counterbalanced order. Prior to rTMS participants were presented with a list of words. After rTMS participants were shown a second list of words and instructed to indicate if the word was already shown prior to rTMS ("old") or was presented for the first time ("new"). In addition, subjectively perceived memory confidence was assessed. Results showed that recollection was unaffected following inhibitory left AG rTMS. In contrast, rTMS over the left AG improved both familiarity and the subjectively perceived confidence of participants that demonstrated low baseline memory recognition. Our study highlights the importance of taking into account individual differences in experimental designs involving noninvasive brain stimulation.

Non-Interfering Effects of Active Post-Encoding Tasks on Episodic Memory Consolidation in Humans.

So far, studies that investigated interference effects of post-learning processes on episodic memory consolidation in humans have used tasks involving only complex and meaningful information. Such tasks require reallocation of general or encoding-specific resources away from consolidation-relevant activities. The possibility that interference can be elicited using a task that heavily taxes our limited brain resources, but has low semantic and hippocampal related long-term memory processing demands, has never been tested. We address this question by investigating whether consolidation could persist in parallel with an active, encoding-irrelevant, minimally semantic task, regardless of its high resource demands for cognitive processing. We distinguish the impact of such a task on consolidation based on whether it engages resources that are: (1) general/executive, or (2) specific/overlapping with the encoding modality. Our experiments compared subsequent memory performance across two post-encoding consolidation periods: quiet wakeful rest and a cognitively demanding n-Back task. Across six different experiments (total N = 176), we carefully manipulated the design of the n-Back task to target general or specific resources engaged in the ongoing consolidation process. In contrast to previous studies that employed interference tasks involving conceptual stimuli and complex processing demands, we did not find any differences between n-Back and rest conditions on memory performance at delayed test, using both recall and recognition tests. Our results indicate that: (1) quiet, wakeful rest is not a necessary prerequisite for episodic memory consolidation; and (2) post-encoding cognitive engagement does not interfere with memory consolidation when task-performance has minimal semantic and hippocampally-based episodic memory processing demands. We discuss our findings with reference to resource and reactivation-led interference theories.

To boost or to CRUNCH? Effect of effortful encoding on episodic memory in older adults is dependent on executive functioning.

It is essential to develop effective interventions aimed at ameliorating age-related cognitive decline. Previous studies found that effortful encoding benefits episodic memory in older adults. However, to date it is unclear whether this benefit is different for individuals with strong versus weak executive functioning (EF). Fifty-one older adults were recruited and divided into low (N = 26) and high (N = 25) functioning groups, based on their EF capacity. All participants performed a semantic and a perceptual incidental encoding task. Each encoding task was performed under four difficulty levels to establish different effort levels. Encoding was followed by a recognition task. Results showed that the high EF group benefitted from increased effort in both tasks. However, the low EF group only showed a beneficial effect under low levels of effort. Results are consistent with the Compensation-Related Utilization of Neural Circuits Hypothesis (CRUNCH) and suggest that future research directed at developing efficient memory strategies to reduce negative cognitive aging effects should take individual cognitive differences among older adults into account, such as differences in EF.

Effortful semantic decision-making boosts memory performance in older adults.

A major concern in age-related cognitive decline is episodic memory (EM). Previous studies indicate that both resource and binding deficits contribute to EM decline. Environmental support by task manipulations encouraging stronger cognitive effort and deeper levels of processing may facilitate compensation for these two deficits. To clarify factors that can counteract age-related EM decline, we assessed effects of cognitive effort (four levels) and level of processing (LoP, shallow/deep) during encoding on subsequent retrieval. Young (YAs, N = 23) and older (OAs, N = 23) adults performed two incidental encoding tasks, deep/semantic and shallow/perceptual. Cognitive effort was manipulated by varying decision-making demands. EM performance, indexed by d-prime, was later tested using a recognition task. Results showed that regardless of LoP, increased cognitive effort caused higher d-primes in both age groups. Compared to YAs, OAs showed a lower d-prime after shallow encoding across all cognitive effort levels, and after deep encoding with low cognitive effort. Deep encoding with higher levels of cognitive effort completely eliminated these age differences. Our findings support an environmental-compensatory account of cognitive ageing and can have important therapeutic implications.

Neural substrates of successful working memory and long-term memory formation in a relational spatial memory task.

Working memory (WM) tasks may involve brain activation actually implicated in long-term memory (LTM). In order to disentangle these two memory systems, we employed a combined WM/LTM task, using a spatial relational (object-location) memory paradigm and analyzed which brain areas were associated with successful performance for either task using fMRI. Critically, we corrected for the performance on the respective memory task when analyzing subsequent memory effects. The WM task consisted of a delayed-match-to-sample task assessed in an MRI scanner. Each trial consisted of an indoor or outdoor scene in which the exact configuration of four objects had to be remembered. After a short delay (7-13 s), the scene was presented from a different angle and spatial recognition for two objects was tested. After scanning, participants received an unexpected subsequent recognition memory (LTM) task, where the two previously unprobed objects were tested. Brain activity during encoding, delay phase and probe phase was analyzed based on WM and LTM performance. Results showed that successful WM performance, when corrected for LTM performance, was associated with greater activation in the inferior frontal gyrus and left fusiform gyrus during the early stage of the maintenance phase. A correct decision during the WM probe was accompanied by greater activation in a wide network, including bilateral hippocampus, right superior parietal gyrus and bilateral insula. No voxels exhibited supra-threshold activity during the encoding phase, and we did not find any differential activity for correct versus incorrect trials in the WM task when comparing LTM correct versus LTM incorrect trials.

Brain activation during associative short-term memory maintenance is not predictive for subsequent retrieval.

Performance on working memory (WM) tasks may partially be supported by long-term memory (LTM) processing. Hence, brain activation recently being implicated in WM may actually have been driven by (incidental) LTM formation. We examined which brain regions actually support successful WM processing, rather than being confounded by LTM processes, during the maintenance and probe phase of a WM task. We administered a four-pair (faces and houses) associative delayed-match-to-sample (WM) task using event-related functional MRI (fMRI) and a subsequent associative recognition LTM task, using the same stimuli. This enabled us to analyze subsequent memory effects for both the WM and the LTM test by contrasting correctly recognized pairs with incorrect pairs for either task. Critically, with respect to the subsequent WM effect, we computed this analysis exclusively for trials that were forgotten in the subsequent LTM recognition task. Hence, brain activity associated with successful WM processing was less likely to be confounded by incidental LTM formation. The subsequent LTM effect, in contrast, was analyzed exclusively for pairs that previously had been correctly recognized in the WM task, disclosing brain regions involved in successful LTM formation after successful WM processing. Results for the subsequent WM effect showed no significantly activated brain areas for WM maintenance, possibly due to an insensitivity of fMRI to mechanisms underlying active WM maintenance. In contrast, a correct decision at WM probe was linked to activation in the "retrieval success network" (anterior and posterior midline brain structures). The subsequent LTM analyses revealed greater activation in left dorsolateral prefrontal cortex and posterior parietal cortex in the early phase of the maintenance stage. No supra-threshold activation was found during the WM probe. Together, we obtained clearer insights in which brain regions support successful WM and LTM without the potential confound of the respective memory system.

Less wiring, more firing: low-performing older adults compensate for impaired white matter with greater neural activity.

The reliable neuroimaging finding that older adults often show greater activity (over-recruitment) than younger adults is typically attributed to compensation. Yet, the neural mechanisms of over-recruitment in older adults (OAs) are largely unknown. Rodent electrophysiology studies have shown that as number of afferent fibers within a circuit decreases with age, the fibers that remain show higher synaptic field potentials (less wiring, more firing). Extrapolating to system-level measures in humans, we proposed and tested the hypothesis that greater activity in OAs compensates for impaired white-matter connectivity. Using a neuropsychological test battery, we measured individual differences in executive functions associated with the prefrontal cortex (PFC) and memory functions associated with the medial temporal lobes (MTLs). Using event-related functional magnetic resonance imaging, we compared activity for successful versus unsuccessful trials during a source memory task. Finally, we measured white-matter integrity using diffusion tensor imaging. The study yielded 3 main findings. First, low-executive OAs showed greater success-related activity in the PFC, whereas low-memory OAs showed greater success-related activity in the MTLs. Second, low-executive OAs displayed white-matter deficits in the PFC, whereas low-memory OAs displayed white-matter deficits in the MTLs. Finally, in both prefrontal and MTL regions, white-matter decline and success-related activations occurred in close proximity and were negatively correlated. This finding supports the less-wiring-more-firing hypothesis, which provides a testable account of compensatory over-recruitment in OAs.

Respiration phase-locks to fast stimulus presentations: implications for the interpretation of posterior midline "deactivations".

The posterior midline region (PMR)-considered a core of the default mode network-is deactivated during successful performance in different cognitive tasks. The extent of PMR-deactivations is correlated with task-demands and associated with successful performance in various cognitive domains. In the domain of episodic memory, functional MRI (fMRI) studies found that PMR-deactivations reliably predict learning (successful encoding). Yet it is unclear what explains this relation. One intriguing possibility is that PMR-deactivations are partially mediated by respiratory artifacts. There is evidence that the fMRI signal in PMR is particularly prone to respiratory artifacts, because of its large surrounding blood vessels. As respiratory fluctuations have been shown to track changes in attention, it is critical for the general interpretation of fMRI results to clarify the relation between respiratory fluctuations, cognitive performance, and fMRI signal. Here, we investigated this issue by measuring respiration during word encoding, together with a breath-holding condition during fMRI-scanning. Stimulus-locked respiratory analyses showed that respiratory fluctuations predicted successful encoding via a respiratory phase-locking mechanism. At the same time, the fMRI analyses showed that PMR-deactivations associated with learning were reduced during breath-holding and correlated with individual differences in the respiratory phase-locking effect during normal breathing. A left frontal region--used as a control region--did not show these effects. These findings indicate that respiration is a critical factor in explaining the link between PMR-deactivation and successful cognitive performance. Further research is necessary to demonstrate whether our findings are restricted to episodic memory encoding, or also extend to other cognitive domains.

The hippocampus is coupled with the default network during memory retrieval but not during memory encoding.

The brain's default mode network (DMN) is activated during internally-oriented tasks and shows strong coherence in spontaneous rest activity. Despite a surge of recent interest, the functional role of the DMN remains poorly understood. Interestingly, the DMN activates during retrieval of past events but deactivates during encoding of novel events into memory. One hypothesis is that these opposing effects reflect a difference between attentional orienting towards internal events, such as retrieved memories, vs. external events, such as to-be-encoded stimuli. Another hypothesis is that hippocampal regions are coupled with the DMN during retrieval but decoupled from the DMN during encoding. The present fMRI study investigated these two hypotheses by combining a resting-state coherence analysis with a task that measured the encoding and retrieval of both internally-generated and externally-presented events. Results revealed that the main DMN regions were activated during retrieval but deactivated during encoding. Counter to the internal orienting hypothesis, this pattern was not modulated by whether memory events were internal or external. Consistent with the hippocampal coupling hypothesis, the hippocampus behaved like other DMN regions during retrieval but not during encoding. Taken together, our findings clarify the relationship between the DMN and the neural correlates of memory retrieval and encoding.

Imagery and retrieval of auditory and visual information: neural correlates of successful and unsuccessful performance.

Remembering past events - or episodic retrieval - consists of several components. There is evidence that mental imagery plays an important role in retrieval and that the brain regions supporting imagery overlap with those supporting retrieval. An open issue is to what extent these regions support successful vs. unsuccessful imagery and retrieval processes. Previous studies that examined regional overlap between imagery and retrieval used uncontrolled memory conditions, such as autobiographical memory tasks, that cannot distinguish between successful and unsuccessful retrieval. A second issue is that fMRI studies that compared imagery and retrieval have used modality-aspecific cues that are likely to activate auditory and visual processing regions simultaneously. Thus, it is not clear to what extent identified brain regions support modality-specific or modality-independent imagery and retrieval processes. In the current fMRI study, we addressed this issue by comparing imagery to retrieval under controlled memory conditions in both auditory and visual modalities. We also obtained subjective measures of imagery quality allowing us to dissociate regions contributing to successful vs. unsuccessful imagery. Results indicated that auditory and visual regions contribute both to imagery and retrieval in a modality-specific fashion. In addition, we identified four sets of brain regions with distinct patterns of activity that contributed to imagery and retrieval in a modality-independent fashion. The first set of regions, including hippocampus, posterior cingulate cortex, medial prefrontal cortex and angular gyrus, showed a pattern common to imagery/retrieval and consistent with successful performance regardless of task. The second set of regions, including dorsal precuneus, anterior cingulate and dorsolateral prefrontal cortex, also showed a pattern common to imagery and retrieval, but consistent with unsuccessful performance during both tasks. Third, left ventrolateral prefrontal cortex showed an interaction between task and performance and was associated with successful imagery but unsuccessful retrieval. Finally, the fourth set of regions, including ventral precuneus, midcingulate cortex and supramarginal gyrus, showed the opposite interaction, supporting unsuccessful imagery, but successful retrieval performance. Results are discussed in relation to reconstructive, attentional, semantic memory, and working memory processes. This is the first study to separate the neural correlates of successful and unsuccessful performance for both imagery and retrieval and for both auditory and visual modalities.

Neural signatures of intransitive preferences.

It is often assumed that decisions are made by rank-ordering and thus comparing the available choice options based on their subjective values. Rank-ordering requires that the alternatives' subjective values are mentally represented at least on an ordinal scale. Because one alternative cannot be at the same time better and worse than another alternative, choices should satisfy transitivity (if alternative A is preferred over B, and B is preferred over C, A should be preferred over C). Yet, individuals often demonstrate striking violations of transitivity (preferring C over A). We used functional magnetic resonance imaging to study the neural correlates of intransitive choices between gambles varying in magnitude and probability of financial gains. Behavioral intransitivities were common. They occurred because participants did not evaluate the gambles independently, but in comparison with the alternative gamble presented. Neural value signals in prefrontal and parietal cortex were not ordinal-scaled and transitive, but reflected fluctuations in the gambles' local, pairing-dependent preference-ranks. Detailed behavioral analysis of gamble preferences showed that, depending on the difference in the offered gambles' attributes, participants gave variable priority to magnitude or probability and thus shifted between preferring richer or safer gambles. The variable, context-dependent priority given to magnitude and probability was tracked by insula (magnitude) and posterior cingulate (probability). Their activation-balance may reflect the individual decision rules leading to intransitivities. Thus, the phenomenon of intransitivity is reflected in the organization of the neural systems involved in risky decision-making.

Modality-specific and modality-independent components of the human imagery system.

Imagery research typically deals with the commonalities and differences between imagery and perception. As such, it is usually confined to one specific modality. Yet, it is likely that some of the underlying processes are shared between different sensory modalities while others are modality-specific. In this fMRI study, we used a balanced design that allowed for a direct comparison between imagery and perception in visual and auditory modalities, and also for a link between subjective imagery experience and brain activation. Results indicated a selective role for the "default mode network" as a modality-independent "core" imagery network. In addition, results identified areas in the visual and auditory association cortices that contributed to mental imagery in a modality-specific fashion. Interestingly during mental imagery, primary visual and auditory cortices showed modality-specific suppression of activity. This is the first fMRI study to characterize both modality-specific and modality-independent components of the human imagery system.

Overlapping brain activity between episodic memory encoding and retrieval: roles of the task-positive and task-negative networks.

The notion that the brain is organized into two complementary networks, one that is task-positive and supports externally-oriented processing, and the other that is task-negative and supports internally-oriented processing, has recently attracted increasing attention. The goal of the present study was to investigate involvement of the task-positive and task-negative networks in overlapping activity between episodic memory encoding and retrieval. To this end, we performed a functional MRI study that included both encoding and retrieval tasks. We hypothesized that during the study phase, encoding success activity (remembered > forgotten) involves mainly the task-positive network, whereas encoding failure activity (forgotten > remembered) involves mainly the task-negative network. We also hypothesized that during the test phase, retrieval success activity (old > new) involves mainly the task-negative network, whereas novelty detection activity (new > old) involves mainly the task-positive network. Based on these hypotheses, we made 3 predictions regarding study-test overlap. First, there would be relatively high level of overlap between encoding success and novelty detection activity involving the task-positive network. Second, there would be relatively high level of overlap between encoding failure and retrieval success activity involving the task-negative network. Third, there would be relatively low level of overlap between encoding success and retrieval success activity as well as between encoding failure and novelty detection activity. The results fully confirmed our 3 predictions. Taken together, the present findings clarify roles of the task-positive and task-negative networks in encoding and retrieval and the function of overlapping brain activity between encoding and retrieval.

Posterior midline and ventral parietal activity is associated with retrieval success and encoding failure.

The ventral part of lateral posterior parietal cortex (VPC) and the posterior midline region (PMR), including the posterior cingulate cortex and precuneus, tend to show deactivation during demanding cognitive tasks, and have been associated with the default mode of the brain. Interestingly, PMR and VPC activity has been associated with successful episodic retrieval but also with unsuccessful episodic encoding. However, the differential contributions of PMR and VPC to retrieval vs. encoding has never been demonstrated within-subjects and within the same experiment. Here, we directly tested the prediction that PMR and VPC activity should be associated with retrieval success but with encoding failure. Consistent with this prediction, we found across five different fMRI experiments that, during retrieval, activity in these regions is greater for hits than misses, whereas during encoding, it is greater for subsequent misses than hits. We also found that these regions overlap with the ones that show deactivations during conscious rest. Our findings further aid in clarifying the role of the default mode regions in learning and memory.

When learning and remembering compete: a functional MRI study.

Recent functional neuroimaging evidence suggests a bottleneck between learning new information and remembering old information. In two behavioral experiments and one functional MRI (fMRI) experiment, we tested the hypothesis that learning and remembering compete when both processes happen within a brief period of time. In the first behavioral experiment, participants intentionally remembered old words displayed in the foreground, while incidentally learning new scenes displayed in the background. In line with a memory competition, we found that remembering old information was associated with impaired learning of new information. We replicated this finding in a subsequent fMRI experiment, which showed that this behavioral effect was coupled with a suppression of learning-related activity in visual and medial temporal areas. Moreover, the fMRI experiment provided evidence that left mid-ventrolateral prefrontal cortex is involved in resolving the memory competition, possibly by facilitating rapid switching between learning and remembering. Critically, a follow-up behavioral experiment in which the background scenes were replaced with a visual target detection task provided indications that the competition between learning and remembering was not merely due to attention. This study not only provides novel insight into our capacity to learn and remember, but also clarifies the neural mechanisms underlying flexible behavior.

Que PASA? The posterior-anterior shift in aging.

A consistent finding from functional neuroimaging studies of cognitive aging is an age-related reduction in occipital activity coupled with increased frontal activity. This posterior-anterior shift in aging (PASA) has been typically attributed to functional compensation. The present functional magnetic resonance imaging sought to 1) confirm that PASA reflects the effects of aging rather than differences in task difficulty; 2) test the compensation hypothesis; and 3) investigate whether PASA generalizes to deactivations. Young and older participants were scanned during episodic retrieval and visual perceptual tasks, and age-related changes in brain activity common to both tasks were identified. The study yielded 3 main findings. First, inconsistent with a difficulty account, the PASA pattern was found across task and confidence levels when matching performance among groups. Second, supporting the compensatory hypothesis, age-related increases in frontal activity were positively correlated with performance and negatively correlated with the age-related occipital decreases. Age-related increases and correlations with parietal activity were also found. Finally, supporting the generalizability of the PASA pattern to deactivations, aging reduced deactivations in posterior midline cortex but increased deactivations in medial frontal cortex. Taken together, these findings demonstrate the validity, function, and generalizability of PASA, as well as its importance for the cognitive neuroscience of aging.

The spatiotemporal dynamics of autobiographical memory: neural correlates of recall, emotional intensity, and reliving.

We sought to map the time course of autobiographical memory retrieval, including brain regions that mediate phenomenological experiences of reliving and emotional intensity. Participants recalled personal memories to auditory word cues during event-related functional magnetic resonance imaging (fMRI). Participants pressed a button when a memory was accessed, maintained and elaborated the memory, and then gave subjective ratings of emotion and reliving. A novel fMRI approach based on timing differences capitalized on the protracted reconstructive process of autobiographical memory to segregate brain areas contributing to initial access and later elaboration and maintenance of episodic memories. The initial period engaged hippocampal, retrosplenial, and medial and right prefrontal activity, whereas the later period recruited visual, precuneus, and left prefrontal activity. Emotional intensity ratings were correlated with activity in several regions, including the amygdala and the hippocampus during the initial period. Reliving ratings were correlated with activity in visual cortex and ventromedial and inferior prefrontal regions during the later period. Frontopolar cortex was the only brain region sensitive to emotional intensity across both periods. Results were confirmed by time-locked averages of the fMRI signal. The findings indicate dynamic recruitment of emotion-, memory-, and sensory-related brain regions during remembering and their dissociable contributions to phenomenological features of the memories.

The medial temporal lobe distinguishes old from new independently of consciousness.

Although it is widely accepted that the medial temporal lobes (MTLs) are critical for becoming aware that something happened in the past, there is virtually no evidence whether MTL sensitivity to event oldness also depends on conscious awareness. Using event-related functional magnetic resonance imaging, we show that activity in posterior MTL tracks whether an item is actually old (true oldness), regardless of participants' awareness of oldness (perceived oldness). Confirming its sensitivity to the objective nature of the stimulus, activity in this region was strongly correlated with individual memory performance (r = 0.74). At the same time, we found that memory errors (misses) were associated with activity in an anterior MTL region, which signaled whether an item was consciously experienced as new (perceived novelty). Logistic regression analyses based on individual trial activity indicated that the two MTL regions showed opposing relationships with behavior, and that memory performance was determined by their joint activity. Furthermore, functional connectivity analyses showed that perceived novelty activity in the ANTERIOR [corrected] MTL inhibited true oldness activity in the POSTERIOR [corrected] MTL. These findings indicate that participants' behavior reflected the combined effects of multiple MTL regions. More generally, our results show that parts of MTL can distinguish old from new independently of consciousness.