Memory reactivation and suppression modulate integration of the semantic features of related memories in hippocampus.

Encoding an event that overlaps with a previous experience may involve reactivating an existing memory and integrating it with new information or suppressing the existing memory to promote formation of a distinct, new representation. We used fMRI during overlapping event encoding to track reactivation and suppression of individual, related memories. We further used a model of semantic knowledge based on Wikipedia to quantify both reactivation of semantic knowledge related to a previous event and formation of integrated memories containing semantic features of both events. Representational similarity analysis revealed that reactivation of semantic knowledge related to a prior event in posterior medial prefrontal cortex (pmPFC) supported memory integration during new learning. Moreover, anterior hippocampus (aHPC) formed integrated representations combining the semantic features of overlapping events. We further found evidence that aHPC integration may be modulated on a trial-by-trial basis by interactions between ventrolateral PFC and anterior mPFC, with suppression of item-specific memory representations in anterior mPFC inhibiting hippocampal integration. These results suggest that PFC-mediated control processes determine the availability of specific relevant memories during new learning, thus impacting hippocampal memory integration.

Representations of common event structure in medial temporal lobe and frontoparietal cortex support efficient inference.

Prior work has shown that the brain represents memories within a cognitive map that supports inference about connections between individual related events. Real-world adaptive behavior is also supported by recognizing common structure among numerous distinct contexts; for example, based on prior experience with restaurants, when visiting a new restaurant one can expect to first get a table, then order, eat, and finally pay the bill. We used a neurocomputational approach to examine how the brain extracts and uses abstract representations of common structure to support novel decisions. Participants learned image pairs (AB, BC) drawn from distinct triads (ABC) that shared the same internal structure and were then tested on their ability to infer indirect (AC) associations. We found that hippocampal and frontoparietal regions formed abstract representations that coded cross-triad relationships with a common geometric structure. Critically, such common representational geometries were formed despite the lack of explicit reinforcement to do so. Furthermore, we found that representations in parahippocampal cortex are hierarchical, reflecting both cross-triad relationships and distinctions between triads. We propose that representations with common geometric structure provide a vector space that codes inferred item relationships with a direction vector that is consistent across triads, thus supporting faster inference. Using computational modeling of response time data, we found evidence for dissociable vector-based retrieval and pattern-completion processes that contribute to successful inference. Moreover, we found evidence that these processes are mediated by distinct regions, with pattern completion supported by hippocampus and vector-based retrieval supported by parahippocampal cortex and lateral parietal cortex.

Semantic Knowledge of Famous People and Places Is Represented in Hippocampus and Distinct Cortical Networks.

Studies have found that anterior temporal lobe (ATL) is critical for detailed knowledge of object categories, suggesting that it has an important role in semantic memory. However, in addition to information about entities, such as people and objects, semantic memory also encompasses information about places. We tested predictions stemming from the PMAT model, which proposes there are distinct systems that support different kinds of semantic knowledge: an anterior temporal (AT) network, which represents information about entities; and a posterior medial (PM) network, which represents information about places. We used representational similarity analysis to test for activation of semantic features when human participants viewed pictures of famous people and places, while controlling for visual similarity. We used machine learning techniques to quantify the semantic similarity of items based on encyclopedic knowledge in the Wikipedia page for each item and found that these similarity models accurately predict human similarity judgments. We found that regions within the AT network, including ATL and inferior frontal gyrus, represented detailed semantic knowledge of people. In contrast, semantic knowledge of places was represented within PM network areas, including precuneus, posterior cingulate cortex, angular gyrus, and parahippocampal cortex. Finally, we found that hippocampus, which has been proposed to serve as an interface between the AT and PM networks, represented fine-grained semantic similarity for both individual people and places. Our results provide evidence that semantic knowledge of people and places is represented separately in AT and PM areas, whereas hippocampus represents semantic knowledge of both categories.SIGNIFICANCE STATEMENT Humans acquire detailed semantic knowledge about people (e.g., their occupation and personality) and places (e.g., their cultural or historical significance). While research has demonstrated that brain regions preferentially respond to pictures of people and places, less is known about whether these regions preferentially represent semantic knowledge about specific people and places. We used machine learning techniques to develop a model of semantic similarity based on information available from Wikipedia, validating the model against similarity ratings from human participants. Using our computational model, we found that semantic knowledge about people and places is represented in distinct anterior temporal and posterior medial brain networks, respectively. We further found that hippocampus, an important memory center, represented semantic knowledge for both types of stimuli.

Memory Reactivation during Learning Simultaneously Promotes Dentate Gyrus/CA2,3 Pattern Differentiation and CA1 Memory Integration.

Events that overlap with previous experience may trigger reactivation of existing memories. However, such reactivation may have different representational consequences within the hippocampal circuit. Computational theories of hippocampal function suggest that dentate gyrus and CA2,3 (DG/CA2,3) are biased to differentiate highly similar memories, whereas CA1 may integrate related events by representing them with overlapping neural codes. Here, we tested whether the formation of differentiated or integrated representations in hippocampal subfields depends on the strength of memory reactivation during learning. Human participants of both sexes learned associations (AB pairs, either face-shape or scene-shape), and then underwent fMRI scanning while they encoded overlapping associations (BC shape-object pairs). Both before and after learning, participants were also scanned while viewing indirectly related elements of the overlapping memories (A and C images) in isolation. We used multivariate pattern analyses to measure reactivation of initial pair memories (A items) during overlapping pair (BC) learning, as well as learning-related representational change for indirectly related memory elements in hippocampal subfields. When prior memories were strongly reactivated during overlapping pair encoding, DG/CA2,3 and subiculum representations for indirectly related images (A and C) became less similar, consistent with pattern differentiation. Simultaneously, memory reactivation during new learning promoted integration in CA1, where representations for indirectly related memory elements became more similar after learning. Furthermore, memory reactivation and subiculum representation predicted faster and more accurate inference (AC) decisions. These data show that reactivation of related memories during new learning leads to dissociable coding strategies in hippocampal subfields, in line with computational theories.SIGNIFICANCE STATEMENT The flexibility of episodic memory allows us to remember both the details that differentiate similar events and the commonalities among them. Here, we tested how reactivation of past experience during new learning promotes formation of neural representations that might serve these two memory functions. We found that memory reactivation during learning promoted formation of differentiated representations for overlapping memories in the dentate gyrus/CA2,3 and subiculum subfields of the hippocampus, while simultaneously leading to the formation of integrated representations of related events in subfield CA1 Furthermore, memory reactivation and subiculum representation predicted success when inferring indirect relationships among events. These findings indicate that memory reactivation is an important learning signal that influences how overlapping events are represented within the hippocampal circuit.

Representations of Temporal Community Structure in Hippocampus and Precuneus Predict Inductive Reasoning Decisions.

Our understanding of the world is shaped by inferences about underlying structure. For example, at the gym, you might notice that the same people tend to arrive around the same time and infer that they are friends that work out together. Consistent with this idea, after participants are presented with a temporal sequence of objects that follows an underlying community structure, they are biased to infer that objects from the same community share the same properties. Here, we used fMRI to measure neural representations of objects after temporal community structure learning and examine how these representations support inference about object relationships. We found that community structure learning affected inferred object similarity: When asked to spatially group items based on their experience, participants tended to group together objects from the same community. Neural representations in perirhinal cortex predicted individual differences in object grouping, suggesting that high-level object representations are affected by temporal community learning. Furthermore, participants were biased to infer that objects from the same community would share the same properties. Using computational modeling of temporal learning and inference decisions, we found that inductive reasoning is influenced by both detailed knowledge of temporal statistics and abstract knowledge of the temporal communities. The fidelity of temporal community representations in hippocampus and precuneus predicted the degree to which temporal community membership biased reasoning decisions. Our results suggest that temporal knowledge is represented at multiple levels of abstraction, and that perirhinal cortex, hippocampus, and precuneus may support inference based on this knowledge.

Beta-band activity represents the recent past during episodic encoding.

While much research has focused on understanding how individual stimuli are encoded in episodic memory, less is known about how a series of events is bound into a coherent episode. Cognitive models of episodic memory propose that information about presented stimuli is integrated into a composite representation reflecting one's past experience, allowing events separated in time to become associated. Recent evidence suggests that neural oscillatory activity may be critically involved in this process. To examine how oscillatory activity contributes to binding of information across events, we measured scalp EEG as participants studied categorized lists of people, places, and objects. We assessed their memory for the lists using free recall, allowing us to characterize the temporal and semantic organization of the studied items in memory. Using pattern classification, we identified EEG activity during encoding at a range of frequencies and scalp locations that was sensitive to the category of presented stimuli. In the beta band (16-25Hz) at right posterior electrodes, we observed activity that was also sensitive to the category of recently presented stimuli. This neural activity showed two characteristics consistent with a representation of the recent past: It became stronger when multiple items from the same category were presented in succession, and it contained a fading trace of the previous category after a category shift. When items were separated by an inter-item distraction task, this integrative beta-band activity was disrupted. Distraction also led to decreased semantic organization of the studied materials without affecting their temporal organization; this suggests that distraction disrupts the integration of semantic information over time, preventing encoding of items in terms of the semantic context of earlier items. Our results provide evidence that beta-band activity is involved in maintaining information about recent events, allowing construction of a coherent representation of a temporally extended episode in memory.

Neural activity in the medial temporal lobe reveals the fidelity of mental time travel.

Neural circuitry in the medial temporal lobe (MTL) is critically involved in mental time travel, which involves the vivid retrieval of the details of past experience. Neuroscientific theories propose that the MTL supports memory of the past by retrieving previously encoded episodic information, as well as by reactivating a temporal code specifying the position of a particular event within an episode. However, the neural computations supporting these abilities are underspecified. To test hypotheses regarding the computational mechanisms supported by different MTL subregions during mental time travel, we developed a computational model that linked a blood oxygenation level-dependent signal to cognitive operations, allowing us to predict human performance in a memory search task. Activity in the posterior MTL, including parahippocampal cortex, reflected how strongly one reactivates the temporal context of a retrieved memory, allowing the model to predict whether the next memory will correspond to a nearby moment in the study episode. A signal in the anterior MTL, including perirhinal cortex, indicated the successful retrieval of list items, without providing information regarding temporal organization. A hippocampal signal reflected both processes, consistent with theories that this region binds item and context information together to form episodic memories. These findings provide evidence for modern theories that describe complementary roles of the hippocampus and surrounding parahippocampal and perirhinal cortices during the retrieval of episodic memories, shaping how humans revisit the past.

Temporal context and the organisational impairment of memory search in schizophrenia.

INTRODUCTION: An influential theory of schizophrenic deficits in executive function suggests that patients have difficulty maintaining and utilising an internal contextual representation, whose function is to ensure that stimuli are processed in a task-appropriate manner. In basic research on episodic memory, retrieved-context theories propose that an internal contextual representation is critically involved in memory search, facilitating the retrieval of task-appropriate memories. This contextual machinery is thought to give rise to temporal organisation during free recall: the tendency for successive recall responses to correspond to items from nearby positions on the study list. If patients with schizophrenia have a generalised contextual deficit, then this leads to the prediction that these patients will exhibit reduced temporal organisation in free recall. METHODS: Using a combination of classic and recently developed organisational measures, we characterised recall organisation in 75 patients with schizophrenia and 72 nondisordered control participants performing a multi-trial free-recall task. RESULTS: Patients with schizophrenia showed diminished temporal organisation, as well as diminished subjective organisation of their recall sequences relative to control participants. The two groups showed similar amounts of semantic organisation during recall. CONCLUSIONS: The observation of reduced temporal organisation in the patient group is consistent with the proposal that the memory deficit in schizophrenia can be characterised as a deficit in contextual processing.

Category-specific neural oscillations predict recall organization during memory search.

Retrieved-context models of human memory propose that as material is studied, retrieval cues are constructed that allow one to target particular aspects of past experience. We examined the neural predictions of these models by using electrocorticographic/depth recordings and scalp electroencephalography (EEG) to characterize category-specific oscillatory activity, while participants studied and recalled items from distinct, neurally discriminable categories. During study, these category-specific patterns predict whether a studied item will be recalled. In the scalp EEG experiment, category-specific activity during study also predicts whether a given item will be recalled adjacent to other same-category items, consistent with the proposal that a category-specific retrieval cue is used to guide memory search. Retrieved-context models suggest that integrative neural circuitry is involved in the construction and maintenance of the retrieval cue. Consistent with this hypothesis, we observe category-specific patterns that rise in strength as multiple same-category items are studied sequentially, and find that individual differences in this category-specific neural integration during study predict the degree to which a participant will use category information to organize memory search. Finally, we track the deployment of this retrieval cue during memory search: Category-specific patterns are stronger when participants organize their responses according to the category of the studied material.

Concept formation as a computational cognitive process.

Hippocampus and entorhinal cortex form cognitive maps that represent relations among memories within a multidimensional space. While these relational maps have long been proposed to contribute to episodic memory, recent work suggests that they also support concept formation by representing relevant features for discriminating among related concepts. Cognitive maps may be refined by medial prefrontal cortex, which selects dimensions to represent based on their behavioral relevance. Hippocampal pattern completion, which is critical for retrieval of episodic memories, may also contribute to generalization of existing concepts to new exemplars. Navigation within hippocampal cognitive maps, which is guided by grid coding in entorhinal cortex, may contribute to imagination through recombination of event elements or concept features.

Memory integration constructs maps of space, time, and concepts.

Recent evidence demonstrates that new events are learned in the context of their relationships to existing memories. Within the hippocampus and medial prefrontal cortex, related memories are represented by integrated codes that connect events experienced at different times and places. Integrated codes form the basis of spatial, temporal, and conceptual maps of experience. These maps represent information that goes beyond direct experience and support generalization behaviors that require knowledge be used in new ways. The degree to which an individual memory is integrated into a coherent map is determined by its spatial, temporal, and conceptual proximity to existing knowledge. Integration is observed over a wide range of scales, suggesting that memories contain information about both broad and fine-grained contexts.

Lingering representations of stimuli influence recall organization.

Several prominent theories posit that information about recent experiences lingers in the brain and organizes memories for current experiences, by forming a temporal context that is linked to those memories at encoding. According to these theories, if the thoughts preceding an experience X resemble the thoughts preceding an experience Y, then X and Y should show an elevated probability of being recalled together. We tested this prediction by using multi-voxel pattern analysis (MVPA) of fMRI data to measure neural evidence for lingering processing of preceding stimuli. As predicted, memories encoded with similar lingering thoughts about the category of preceding stimuli were more likely to be recalled together. Our results demonstrate that the "fading embers" of previous stimuli help to organize recall, confirming a key prediction of computational models of episodic memory.

A predictive framework for evaluating models of semantic organization in free recall.

Research in free recall has demonstrated that semantic associations reliably influence the organization of search through episodic memory. However, the specific structure of these associations and the mechanisms by which they influence memory search remain unclear. We introduce a likelihood-based model-comparison technique, which embeds a model of semantic structure within the context maintenance and retrieval (CMR) model of human memory search. Within this framework, model variants are evaluated in terms of their ability to predict the specific sequence in which items are recalled. We compare three models of semantic structure, latent semantic analysis (LSA), global vectors (GloVe), and word association spaces (WAS), and find that models using WAS have the greatest predictive power. Furthermore, we find evidence that semantic and temporal organization is driven by distinct item and context cues, rather than a single context cue. This finding provides important constraint for theories of memory search.

The neural dynamics of task context in free recall.

Multivariate pattern analysis (MVPA) is a powerful tool for relating theories of cognitive function to the neural dynamics observed while people engage in cognitive tasks. Here, we use the Context Maintenance and Retrieval model of free recall (CMR; Polyn et al., 2009a) to interpret variability in the strength of task-specific patterns of distributed neural activity as participants study and recall lists of words. The CMR model describes how temporal and source-related (here, encoding task) information combine in a contextual representation that is responsible for guiding memory search. Each studied word in the free-recall paradigm is associated with one of two encoding tasks (size and animacy) that have distinct neural representations during encoding. We find evidence for the context retrieval hypothesis central to the CMR model: Task-specific patterns of neural activity are reactivated during memory search, as the participant recalls an item previously associated with a particular task. Furthermore, we find that the fidelity of these task representations during study is related to task-shifting, the serial position of the studied item, and variability in the magnitude of the recency effect across participants. The CMR model suggests that these effects may be related to a central parameter of the model that controls the rate that an internal contextual representation integrates information from the surrounding environment.