An Enduring Role for Hippocampal Pattern Completion in Addition to an Emergent Nonhippocampal Contribution to Holistic Episodic Retrieval after a 24†h Delay.

Episodic memory retrieval is associated with the holistic neocortical reinstatement of all event information, an effect driven by hippocampal pattern completion. However, whether holistic reinstatement occurs, and whether hippocampal pattern completion continues to drive reinstatement, after a period of consolidation is unclear. Theories of systems consolidation predict either a time-variant or time-invariant role of the hippocampus in the holistic retrieval of episodic events. Here, we assessed whether episodic events continue to be reinstated holistically and whether hippocampal pattern completion continues to facilitate holistic reinstatement following a period of consolidation. Female and male human participants learned "events" that comprised multiple overlapping pairs of event elements (e.g., person-location, object-location, location-person). Importantly, encoding occurred either immediately before or 24 h before retrieval. Using fMRI during the retrieval of events, we show evidence for holistic reinstatement, as well as a correlation between reinstatement and hippocampal pattern completion, regardless of whether retrieval occurred immediately or 24 h after encoding. Thus, hippocampal pattern completion continues to contribute to holistic reinstatement after a delay. However, our results also revealed that some holistic reinstatement can occur without evidence for a corresponding signature of hippocampal pattern completion after a delay (but not immediately after encoding). We therefore show that hippocampal pattern completion, in addition to a nonhippocampal process, has a role in holistic reinstatement following a period of consolidation. Our results point to a consolidation process where the hippocampus and neocortex may work in an additive, rather than compensatory, manner to support episodic memory retrieval.

Theta and alpha oscillations in human hippocampus and medial parietal cortex support the formation of location-based representations.

Our ability to navigate in a new environment depends on learning new locations. Mental representations of locations are quickly accessible during navigation and allow us to know where we are regardless of our current viewpoint. Recent functional magnetic resonance imaging (fMRI) research using pattern classification has shown that these location-based representations emerge in the retrosplenial cortex and parahippocampal gyrus, regions theorized to be critically involved in spatial navigation. However, little is currently known about the oscillatory dynamics that support the formation of location-based representations. We used magnetoencephalogram (MEG) recordings to investigate region-specific oscillatory activity in a task where participants could form location-based representations. Participants viewed videos showing that two perceptually distinct scenes (180° apart) belonged to the same location. This "overlap" video allowed participants to bind the two distinct scenes together into a more coherent location-based representation. Participants also viewed control "non-overlap" videos where two distinct scenes from two different locations were shown, where no location-based representation could be formed. In a post-video behavioral task, participants successfully matched the two viewpoints shown in the overlap videos, but not the non-overlap videos, indicating they successfully learned the locations in the overlap condition. Comparing oscillatory activity between the overlap and non-overlap videos, we found greater theta and alpha/beta power during the overlap relative to non-overlap videos, specifically at time-points when we expected scene integration to occur. These oscillations localized to regions in the medial parietal cortex (precuneus and retrosplenial cortex) and the medial temporal lobe, including the hippocampus. Therefore, we find that theta and alpha/beta oscillations in the hippocampus and medial parietal cortex are likely involved in the formation of location-based representations.

Hippocampal theta activity during encoding promotes subsequent associative memory in humans.

Hippocampal theta oscillations have been implicated in associative memory in humans. However, findings from electrophysiological studies using scalp electroencephalography or magnetoencephalography, and those using intracranial electroencephalography are mixed. Here we asked 10 pre-surgical epilepsy patients undergoing intracranial electroencephalography recording, along with 21 participants undergoing magnetoencephalography recordings, to perform an associative memory task, and examined whether hippocampal theta activity during encoding was predictive of subsequent associative memory performance. Across the intracranial electroencephalography and magnetoencephalography studies, we observed that theta power in the hippocampus increased during encoding, and that this increase differed as a function of subsequent memory, with greater theta activity for pairs that were successfully retrieved in their entirety compared with those that were not remembered. This helps to clarify the role of theta oscillations in associative memory formation in humans, and further, demonstrates that findings in epilepsy patients undergoing intracranial electroencephalography recordings can be extended to healthy participants undergoing magnetoencephalography recordings.

Targeted memory reactivation during sleep can induce forgetting of overlapping memories.

Memory reactivation during sleep can shape new memories into a long-term form. Reactivation of memories can be induced via the delivery of auditory cues during sleep. Although this targeted memory reactivation (TMR) approach can strengthen newly acquired memories, research has tended to focus on single associative memories. It is less clear how TMR affects retention for overlapping associative memories. This is critical, given that repeated retrieval of overlapping associations during wake can lead to forgetting, a phenomenon known as retrieval-induced forgetting (RIF). We asked whether a similar pattern of forgetting occurs when TMR is used to cue reactivation of overlapping pairwise associations during sleep. Participants learned overlapping pairs-learned separately, interleaved with other unrelated pairs. During sleep, we cued a subset of overlapping pairs using TMR. While TMR increased retention for the first encoded pairs, memory decreased for the second encoded pairs. This pattern of retention was only present for pairs not tested prior to sleep. The results suggest that TMR can lead to forgetting, an effect similar to RIF during wake. However, this effect did not extend to memories that had been strengthened via retrieval prior to sleep. We therefore provide evidence for a reactivation-induced forgetting effect during sleep.

Tracking the Emergence of Location-based Spatial Representations in Human Scene-Selective Cortex.

Scene-selective regions of the human brain form allocentric representations of locations in our environment. These representations are independent of heading direction and allow us to know where we are regardless of our direction of travel. However, we know little about how these location-based representations are formed. Using fMRI representational similarity analysis and linear mixed models, we tracked the emergence of location-based representations in scene-selective brain regions. We estimated patterns of activity for two distinct scenes, taken before and after participants learnt they were from the same location. During a learning phase, we presented participants with two types of panoramic videos: (1) an overlap video condition displaying two distinct scenes (0° and 180°) from the same location and (2) a no-overlap video displaying two distinct scenes from different locations (which served as a control condition). In the parahippocampal cortex (PHC) and retrosplenial cortex (RSC), representations of scenes from the same location became more similar to each other only after they had been shown in the overlap condition, suggesting the emergence of viewpoint-independent location-based representations. Whereas these representations emerged in the PHC regardless of task performance, RSC representations only emerged for locations where participants could behaviorally identify the two scenes as belonging to the same location. The results suggest that we can track the emergence of location-based representations in the PHC and RSC in a single fMRI experiment. Further, they support computational models that propose the RSC plays a key role in transforming viewpoint-independent representations into behaviorally relevant representations of specific viewpoints.

Linked networks for learning and expressing location-specific threat.

Learning locations of danger within our environment is a vital adaptive ability whose neural bases are only partially understood. We examined fMRI brain activity while participants navigated a virtual environment in which flowers appeared and were "picked." Picking flowers in the danger zone (one-half of the environment) predicted an electric shock to the wrist (or "bee sting"); flowers in the safe zone never predicted shock; and household objects served as controls for neutral spatial memory. Participants demonstrated learning with shock expectancy ratings and skin conductance increases for flowers in the danger zone. Patterns of brain activity shifted between overlapping networks during different task stages. Learning about environmental threats, during flower approach in either zone, engaged the anterior hippocampus, amygdala, and ventromedial prefrontal cortex (vmPFC), with vmPFC-hippocampal functional connectivity increasing with experience. Threat appraisal, during approach in the danger zone, engaged the insula and dorsal anterior cingulate (dACC), with insula-hippocampal functional connectivity. During imminent threat, after picking a flower, this pattern was supplemented by activity in periaqueductal gray (PAG), insula-dACC coupling, and posterior hippocampal activity that increased with experience. We interpret these patterns in terms of multiple representations of spatial context (anterior hippocampus); specific locations (posterior hippocampus); stimuli (amygdala); value (vmPFC); threat, both visceral (insula) and cognitive (dACC); and defensive behaviors (PAG), interacting in different combinations to perform the functions required at each task stage. Our findings illuminate how we learn about location-specific threats and suggest how they might break down into overgeneralization or hypervigilance in anxiety disorders.

Holistic Recollection via Pattern Completion Involves Hippocampal Subfield CA3.

Episodic memories typically comprise multiple elements. A defining characteristic of episodic retrieval is holistic recollection, i.e., comprehensive recall of the elements a memorized event encompasses. A recent study implicated activity in the human hippocampus with holistic recollection of multi-element events based on cues (Horner et al., 2015). Here, we obtained ultra-high resolution functional neuroimaging data at 7 tesla in 30 younger adults (12 female) using the same paradigm. In accordance with anatomically inspired computational models and animal research, we found that metabolic activity in hippocampal subfield CA3 (but less pronounced in dentate gyrus) correlated with this form of mnemonic pattern completion across participants. Our study provides the first evidence in humans for a strong involvement of hippocampal subfield CA3 in holistic recollection via pattern completion.SIGNIFICANCE STATEMENT Memories of daily events usually involve multiple elements, although a single element can be sufficient to prompt recollection of the whole event. Such holistic recollection is thought to require reactivation of brain activity representing the full event from one event element ("pattern completion"). Computational and animal models suggest that mnemonic pattern completion is accomplished in a specific subregion of the hippocampus called CA3, but empirical evidence in humans was lacking. Here, we leverage the ultra-high resolution of 7 tesla neuroimaging to provide first evidence for a strong involvement of the human CA3 in holistic recollection of multi-element events via pattern completion.

Development of Holistic Episodic Recollection.

Episodic memory binds the diverse elements of an event into a coherent representation. This coherence allows for the reconstruction of different aspects of an experience when triggered by a cue related to a past event-a process of pattern completion. Previous work has shown that such holistic recollection is evident in young adults, as revealed by dependency in retrieval success for various associations from the same event. In addition, episodic memory shows clear quantitative increases during early childhood. However, the ontogeny of holistic recollection is uncharted. Using dependency analyses, we found here that 4-year-olds (n = 32), 6-year-olds (n = 30), and young adults (n = 31) all retrieved complex events in a holistic manner; specifically, retrieval accuracy for one aspect of an event predicted accuracy for other aspects of the same event. However, the degree of holistic retrieval increased from the age 4 to adulthood. Thus, extended refinement of multiway binding may be one aspect of episodic memory development.

Medial Prefrontal-Medial Temporal Theta Phase Coupling in Dynamic Spatial Imagery.

Hippocampal-medial prefrontal interactions are thought to play a crucial role in mental simulation. Notably, the frontal midline/medial pFC (mPFC) theta rhythm in humans has been linked to introspective thought and working memory. In parallel, theta rhythms have been proposed to coordinate processing in the medial temporal cortex, retrosplenial cortex (RSc), and parietal cortex during the movement of viewpoint in imagery, extending their association with physical movement in rodent models. Here, we used noninvasive whole-head MEG to investigate theta oscillatory power and phase-locking during the 18-sec postencoding delay period of a spatial working memory task, in which participants imagined previously learned object sequences either on a blank background (object maintenance), from a first-person viewpoint in a scene (static imagery), or moving along a path past the objects (dynamic imagery). We found increases in 4- to 7-Hz theta power in mPFC when comparing the delay period with a preencoding baseline. We then examined whether the mPFC theta rhythm was phase-coupled with ongoing theta oscillations elsewhere in the brain. The same mPFC region showed significantly higher theta phase coupling with the posterior medial temporal lobe/RSc for dynamic imagery versus either object maintenance or static imagery. mPFC theta phase coupling was not observed with any other brain region. These results implicate oscillatory coupling between mPFC and medial temporal lobe/RSc theta rhythms in the dynamic mental exploration of imagined scenes.

Categorical encoding of color in the brain.

The areas of the brain that encode color categorically have not yet been reliably identified. Here, we used functional MRI adaptation to identify neuronal populations that represent color categories irrespective of metric differences in color. Two colors were successively presented within a block of trials. The two colors were either from the same or different categories (e.g., "blue 1 and blue 2" or "blue 1 and green 1"), and the size of the hue difference was varied. Participants performed a target detection task unrelated to the difference in color. In the middle frontal gyrus of both hemispheres and to a lesser extent, the cerebellum, blood-oxygen level-dependent response was greater for colors from different categories relative to colors from the same category. Importantly, activation in these regions was not modulated by the size of the hue difference, suggesting that neurons in these regions represent color categorically, regardless of metric color difference. Representational similarity analyses, which investigated the similarity of the pattern of activity across local groups of voxels, identified other regions of the brain (including the visual cortex), which responded to metric but not categorical color differences. Therefore, categorical and metric hue differences appear to be coded in qualitatively different ways and in different brain regions. These findings have implications for the long-standing debate on the origin and nature of color categories, and also further our understanding of how color is processed by the brain.

Consolidation of Complex Events via Reinstatement in Posterior Cingulate Cortex.

It is well-established that active rehearsal increases the efficacy of memory consolidation. It is also known that complex events are interpreted with reference to prior knowledge. However, comparatively little attention has been given to the neural underpinnings of these effects. In healthy adults humans, we investigated the impact of effortful, active rehearsal on memory for events by showing people several short video clips and then asking them to recall these clips, either aloud (Experiment 1) or silently while in an MRI scanner (Experiment 2). In both experiments, actively rehearsed clips were remembered in far greater detail than unrehearsed clips when tested a week later. In Experiment 1, highly similar descriptions of events were produced across retrieval trials, suggesting a degree of semanticization of the memories had taken place. In Experiment 2, spatial patterns of BOLD signal in medial temporal and posterior midline regions were correlated when encoding and rehearsing the same video. Moreover, the strength of this correlation in the posterior cingulate predicted the amount of information subsequently recalled. This is likely to reflect a strengthening of the representation of the video's content. We argue that these representations combine both new episodic information and stored semantic knowledge (or "schemas"). We therefore suggest that posterior midline structures aid consolidation by reinstating and strengthening the associations between episodic details and more generic schematic information. This leads to the creation of coherent memory representations of lifelike, complex events that are resistant to forgetting, but somewhat inflexible and semantic-like in nature.

Replay of very early encoding representations during recollection.

Long-term memories are linked to cortical representations of perceived events, but it is unclear which types of representations can later be recollected. Using magnetoencephalography-based decoding, we examined which brain activity patterns elicited during encoding are later replayed during recollection in the human brain. The results show that the recollection of images depicting faces and scenes is associated with a replay of neural representations that are formed at very early (180 ms) stages of encoding. This replay occurs quite rapidly, ~500 ms after the onset of a cue that prompts recollection and correlates with source memory accuracy. Therefore, long-term memories are rapidly replayed during recollection and involve representations that were formed at very early stages of encoding. These findings indicate that very early representational information can be preserved in the memory engram and can be faithfully and rapidly reinstated during recollection. These novel insights into the nature of the memory engram provide constraints for mechanistic models of long-term memory function.

Medial Prefrontal Cortex: Adding Value to Imagined Scenarios.

The medial prefrontal cortex (mPFC) is consistently implicated in the network supporting autobiographical memory. Whereas more posterior regions in this network have been related to specific processes, such as the generation of visuospatial imagery or the association of items and contexts, the functional contribution of the mPFC remains unclear. However, the involvement of mPFC in estimation of value during decision-making suggests that it might play a similar role in memory. We investigated whether mPFC activity reflects the subjective value of elements in imagined scenarios. Participants in an MRI scanner imagined scenarios comprising a spatial context, a physiological state of need (e.g., thirst), and two items that could be congruent (e.g., drink) or incongruent (e.g., food) with the state of need. Memory for the scenarios was tested outside the scanner. Our manipulation of subjective value by imagined need was verified by increased subjective ratings of value for congruent items and improved subsequent memory for them. Consistent with our hypothesis, fMRI signal in mPFC reflected the modulation of an item's subjective value by the imagined physiological state, suggesting the mPFC selectively tracked subjective value within our imagination paradigm. Further analyses showed uncorrected effects in non-mPFC regions, including increased activity in the insula when imagining states of need, the caudate nucleus when imagining congruent items, and the anterior hippocampus/amygdala when imagining subsequently remembered items. We therefore provide evidence that the mPFC plays a role in constructing the subjective value of the components of imagined scenarios and thus potentially in reconstructing the value of components of autobiographical recollection.

Synchronization of medial temporal lobe and prefrontal rhythms in human decision making.

Optimal decision making requires that we integrate mnemonic information regarding previous decisions with value signals that entail likely rewards and punishments. The fact that memory and value signals appear to be coded by segregated brain regions, the hippocampus in the case of memory and sectors of prefrontal cortex in the case of value, raises the question as to how they are integrated during human decision making. Using magnetoencephalography to study healthy human participants, we show increased theta oscillations over frontal and temporal sensors during nonspatial decisions based on memories from previous trials. Using source reconstruction we found that the medial temporal lobe (MTL), in a location compatible with the anterior hippocampus, and the anterior cingulate cortex in the medial wall of the frontal lobe are the source of this increased theta power. Moreover, we observed a correlation between theta power in the MTL source and behavioral performance in decision making, supporting a role for MTL theta oscillations in decision-making performance. These MTL theta oscillations were synchronized with several prefrontal sources, including lateral superior frontal gyrus, dorsal anterior cingulate gyrus, and medial frontopolar cortex. There was no relationship between the strength of synchronization and the expected value of choices. Our results indicate a mnemonic guidance of human decision making, beyond anticipation of expected reward, is supported by hippocampal-prefrontal theta synchronization.

Human hippocampal processing of environmental novelty during spatial navigation.

The detection and processing of novel information encountered as we explore our environment is crucial for learning and adaptive behavior. The human hippocampus has been strongly implicated in laboratory tests of novelty detection and episodic memory, but has been less well studied during more ethological tasks such as spatial navigation, typically used in animals. We examined fMRI BOLD activity as a function of environmental and object novelty as humans performed an object-location virtual navigation task. We found greater BOLD response to novel relative to familiar environments in the hippocampus and adjacent parahippocampal gyrus. Object novelty was associated with increased activity in the posterior parahippocampal/fusiform gyrus and anterior hippocampus extending into the amygdala and superior temporal sulcus. Importantly, whilst mid-posterior hippocampus was more sensitive to environmental novelty than object novelty, the anterior hippocampus responded similarly to both forms of novelty. Amygdala activity showed an increase for novel objects that decreased linearly over the learning phase. By investigating how participants learn and use different forms of information during spatial navigation, we found that medial temporal lobe (MTL) activity reflects both the novelty of the environment and of the objects located within it. This novelty processing is likely supported by distinct, but partially overlapping, sets of regions within the MTL.

Forgetting unwanted memories in sleep.

Memories are sometimes best forgotten, but how do our brains weaken unwanted details of the past? We propose a theoretical framework in which memory reactivation during sleep supports adaptive forgetting. This mnemonic rebalancing underpins the affective benefits of sleep by ensuring that our memories remain aligned with our emotional goals.

Context in memory is reconstructed not encoded.

Context has long been regarded as an important element of long-term memory, and episodic memory in particular. The ability to remember not only the object or focus of a memory but also contextual details allow us to reconstruct integrated representations of events. However, despite its prevalence in the memory literature, context remains difficult to define and identify, with different studies using context to refer to different sets of stimuli or concepts. These varying definitions of context have not prevented it from being a key element of many models of memory. Within these models, context is usually explicitly encoded as an element of an event and processed through different neural pathways to other elements of the event, such as objects. Here we challenge the notion that context in memory is encoded. We offer an alternative where context in memory takes a variety of forms depending on the question being asked. We propose events are simply encoded, but the focus of retrieval (object) and context are not defined until recall.

A registered report testing the effect of sleep on Deese-Roediger-McDermott false memory: greater lure and veridical recall but fewer intrusions after sleep.

Human memory is known to be supported by sleep. However, less is known about the effect of sleep on false memory, where people incorrectly remember events that never occurred. In the laboratory, false memories are often induced via the Deese-Roediger-McDermott (DRM) paradigm where participants are presented with wordlists comprising semantically related words such as nurse, hospital and sick (studied words). Subsequently, participants are likely to falsely remember that a related lure word such as doctor was presented. Multiple studies have examined whether these false memories are influenced by sleep, with contradictory results. A recent meta-analysis suggests that sleep may increase DRM false memory when short lists are used. We tested this in a registered report (N = 488) with a 2 (Interval: Immediate versus 12 h delay) × 2 (Test Time: 9:00 versus 21:00) between-participant DRM experiment, using short DRM lists (N = 8 words/list) and free recall as the memory test. We found an unexpected time-of-day effect such that completing free recall in the evening led to more intrusions (neither studied nor lure words). Above and beyond this time-of-day effect, the Sleep participants produced fewer intrusions than their Wake counterparts. When this was statistically controlled for, the Sleep participants falsely produced more critical lures. They also correctly recalled more studied words (regardless of intrusions). Exploratory analysis showed that these findings cannot be attributed to differences in output bias, as indexed by the number of total responses. Our overall results cannot be fully captured by existing sleep-specific theories of false memory, but help to define the role of sleep in two more general theories (Fuzzy-Trace and Activation/Monitoring theories) and suggest that sleep may benefit gist abstraction/spreading activation on one hand and memory suppression/source monitoring on the other.

Incongruent abstract stimulus-response bindings result in response interference: FMRI and EEG evidence from visual object classification priming.

Stimulus repetition often leads to facilitated processing, resulting in neural decreases (repetition suppression) and faster RTs (repetition priming). Such repetition-related effects have been attributed to the facilitation of repeated cognitive processes and/or the retrieval of previously encoded stimulus-response (S-R) bindings. Although previous research has dissociated these two forms of learning, their interaction in the brain is not fully understood. Utilizing the spatial and temporal resolutions of fMRI and EEG, respectively, we examined a long-lag classification priming paradigm that required response repetitions or reversals at multiple levels of response representation. We found a repetition effect in occipital/temporal cortex (fMRI) that was time-locked to stimulus onset (EEG) and robust to switches in response, together with a repetition effect in inferior pFC (fMRI) that was time-locked to response onset (EEG) and sensitive to switches in response. The response-sensitive effect occurred even when changing from object names (words) to object pictures between repetitions, suggesting that S-R bindings can code abstract representations of stimuli. Most importantly, we found evidence for interference effects when incongruent S-R bindings were retrieved, with increased neural activity in inferior pFC, demonstrating that retrieval of S-R bindings can result in facilitation or interference, depending on the congruency of response between repetitions.

Schematic information influences memory and generalisation behaviour for schema-relevant and -irrelevant information.

Schemas modulate memory performance for schema-congruent and -incongruent information. However, it is assumed they do not influence behaviour for information irrelevant to themselves. We assessed memory and generalisation behaviour for information related to an underlying pattern, where a schema could be extracted (schema-relevant), and information that was unrelated and therefore irrelevant to the extracted schema (schema-irrelevant). Using precision measures of long-term memory, where participants learnt associations between words and locations around a circle, we assessed memory and generalisation for schema-relevant and -irrelevant information. Words belonged to two semantic categories: human-made and natural. For one category, word-locations were clustered around one point on the circle (clustered condition), while the other category had word-locations randomly distributed (non-clustered condition). The presence of an underlying pattern in the clustered condition allows for the extraction of a schema that can support both memory and generalisation. At test, participants were presented with old (memory) and new (generalisation) words, requiring them to identify a remembered location or make a best guess. The presence of the clustered pattern modulated memory and generalisation. In the clustered condition, participants placed old and new words in locations consistent with the underlying pattern. In contrast, for the non-clustered condition, participants were less likely to place old and new non-clustered words in locations consistent with the clustered condition. Therefore, we provide evidence that the presence of schematic information modulates memory and generalisation for schema-relevant and -irrelevant information. Our results highlight the need to carefully construct appropriate schema-irrelevant control conditions such that behaviour in these conditions is not modulated by the presence of a schema. Theoretically, models of schema processing need to account for how the presence of schematic information can have consequences for information that is irrelevant to itself.