A complementary learning systems model of how sleep moderates retrieval practice effects.

While many theories assume that sleep is critical in stabilizing and strengthening memories, our recent behavioral study (Liu & Ranganath, 2021, Psychonomic Bulletin & Review, 28[6], 2035-2044) suggests that sleep does not simply stabilize memories. Instead, it plays a more complex role, integrating information across two temporally distinct learning episodes. In the current study, we simulated the results of Liu and Ranganath (2021) using our biologically plausible computational model, TEACH, developed based on the complementary learning systems (CLS) framework. Our model suggests that when memories are activated during sleep, the reduced influence of temporal context establishes connections across temporally separated events through mutual training between the hippocampus and neocortex. In addition to providing a compelling mechanistic explanation for the selective effect of sleep, this model offers new examples of the diverse ways in which the cortex and hippocampus can interact during learning.

Curiosity Satisfaction Increases Event-related Potentials Sensitive to Reward.

Successful learning depends on various factors such as depth of processing, motivation, or curiosity about information. A strong drive to learn something or the expectation of receiving a reward can be crucial to enhance learning. However, the influence of curiosity on the processing of new information and its similarity with reward processing is not well understood. This study examined whether states of curiosity influence specific ERPs associated with reward processing and whether these ERPs are related with later memory benefits. In an initial screening phase, participants indicated their curiosity and confidence in prior knowledge about answers to various trivia questions. In a subsequent study phase, we targeted different time windows related to reward processing during the presentation of trivia answers containing the reward positivity (RewP; 250-350 msec), the P3 (250-500 msec), and the late-positive-potential (LPP; 600-1000 msec). In a following surprise memory test, we found that participants recalled more high- than low-curiosity answers. The RewP, P3, and LPP showed greater positive mean amplitudes for high compared with low curiosity, reflecting increased reward processing. In addition, we found that the RewP and the P3 showed more positive mean amplitudes for later recalled compared with later forgotten answers, but curiosity did not modulate this encoding-related results. These findings support the view that the satisfaction of curiosity resembles reward processing, indicated by ERPs.

Hippocampal-cortical interactions during event boundaries support retention of complex narrative events.

According to most memory theories, encoding involves continuous communication between the hippocampus and neocortex, but recent work has shown that key moments at the end of an event, called event boundaries, may be especially critical for memory formation. We sought to determine how communication between the hippocampus and neocortical regions during the encoding of naturalistic events related to subsequent retrieval of those events and whether this was particularly important at event boundaries. Participants encoded and recalled two cartoon movies during fMRI scanning. Higher functional connectivity between the hippocampus and the posterior medial network (PMN) at an event's offset is related to the subsequent successful recall of that event. Furthermore, hippocampal-PMN offset connectivity also predicted the amount of detail retrieved after a 2-day delay. These data demonstrate that the relationship between memory encoding and hippocampal-neocortical interaction is dynamic and biased toward boundaries.

Proximity to boundaries reveals spatial context representation in human hippocampal CA1.

Recollection of real-world events is often accompanied by a sense of being in the place where the event transpired. Convergent evidence suggests the hippocampus plays a key role in supporting episodic memory by associating information with the time and place it was originally encountered. This representation is reinstated during memory retrieval. However, little is known about the roles of different subfields of the human hippocampus in this process. Research in humans and non-human animal models has suggested that spatial environmental boundaries have a powerful influence on spatial and episodic memory, as well as hippocampal representations of contexts and events. Here, we used high-resolution fMRI to investigate how boundaries influence hippocampal activity patterns during the recollection of objects encountered in different spatial contexts. During the encoding phase, participants viewed objects once in a naturalistic virtual reality task in which they passively explored two rooms in one of two houses. Following the encoding phase, participants were scanned while they recollected items in the absence of any spatial contextual information. Our behavioral results demonstrated that spatial context memory was enhanced for objects encountered near a boundary. Activity patterns in CA1 carried information about the spatial context associated with each of these boundary items. Exploratory analyses revealed that recollection performance was correlated with the fidelity of retrieved spatial context representations in anterior parahippocampal cortex and subiculum. Our results highlight the privileged role of boundaries in CA1 and suggest more generally a close relationship between memory for spatial contexts and representations in the hippocampus and parahippocampal region.

Integration of event experiences to build relational knowledge in the human brain.

We investigated how the human brain integrates experiences of specific events to build general knowledge about typical event structure. We examined an episodic memory area important for temporal relations, anterior-lateral entorhinal cortex, and a semantic memory area important for action concepts, middle temporal gyrus, to understand how and when these areas contribute to these processes. Participants underwent functional magnetic resonance imaging while learning and recalling temporal relations among novel events over two sessions 1 week apart. Across distinct contexts, individual temporal relations among events could either be consistent or inconsistent with each other. Within each context, during the recall phase, we measured associative coding as the difference of multivoxel correlations among related vs unrelated pairs of events. Neural regions that form integrative representations should exhibit stronger associative coding in the consistent than the inconsistent contexts. We found evidence of integrative representations that emerged quickly in anterior-lateral entorhinal cortex (at session 1), and only subsequently in middle temporal gyrus, which showed a significant change across sessions. A complementary pattern of findings was seen with signatures during learning. This suggests that integrative representations are established early in anterior-lateral entorhinal cortex and may be a pathway to the later emergence of semantic knowledge in middle temporal gyrus.

Goal-oriented representations in the human hippocampus during planning and navigation.

Recent work in cognitive and systems neuroscience has suggested that the hippocampus might support planning, imagination, and navigation by forming cognitive maps that capture the abstract structure of physical spaces, tasks, and situations. Navigation involves disambiguating similar contexts, and the planning and execution of a sequence of decisions to reach a goal. Here, we examine hippocampal activity patterns in humans during a goal-directed navigation task to investigate how contextual and goal information are incorporated in the construction and execution of navigational plans. During planning, hippocampal pattern similarity is enhanced across routes that share a context and a goal. During navigation, we observe prospective activation in the hippocampus that reflects the retrieval of pattern information related to a key-decision point. These results suggest that, rather than simply representing overlapping associations or state transitions, hippocampal activity patterns are shaped by context and goals.

Aging impacts memory for perceptual, but not narrative, event details.

Memory is well known to decline over the course of healthy aging. However, memory is not a monolith and draws from different kinds of representations. Historically, much of our understanding of age-related memory decline stems from recognition of isolated studied items. In contrast, real-life events are often remembered as narratives, and this kind of information is generally missed in typical recognition memory studies. Here, we designed a task to tax mnemonic discrimination of event details, directly contrasting perceptual and narrative memory. Older and younger adults watched an episode of a television show and later completed an old/new recognition test featuring targets, novel foils, and similar lures in narrative and perceptual domains. While we observed no age-related differences on basic recognition of repeated targets and novel foils, older adults showed a deficit in correctly rejecting perceptual, but not narrative, lures. These findings provide insight into the vulnerability of different memory domains in aging and may be useful in characterizing individuals at risk for pathological cognitive decline.

Flexible reuse of cortico-hippocampal representations during encoding and recall of naturalistic events.

Although every life event is unique, there are considerable commonalities across events. However, little is known about whether or how the brain flexibly represents information about different event components at encoding and during remembering. Here, we show that different cortico-hippocampal networks systematically represent specific components of events depicted in videos, both during online experience and during episodic memory retrieval. Regions of an Anterior Temporal Network represented information about people, generalizing across contexts, whereas regions of a Posterior Medial Network represented context information, generalizing across people. Medial prefrontal cortex generalized across videos depicting the same event schema, whereas the hippocampus maintained event-specific representations. Similar effects were seen in real-time and recall, suggesting reuse of event components across overlapping episodic memories. These representational profiles together provide a computationally optimal strategy to scaffold memory for different high-level event components, allowing efficient reuse for event comprehension, recollection, and imagination.

A role for the fornix in temporal sequence memory.

Converging evidence from studies of human and nonhuman animals suggests that the hippocampus contributes to sequence learning by using temporal context to bind sequentially occurring items. The fornix is a white matter pathway containing the major input and output pathways of the hippocampus, including projections from medial septum and to diencephalon, striatum, lateral septum and prefrontal cortex. If the fornix meaningfully contributes to hippocampal function, then individual differences in fornix microstructure might predict sequence memory. Here, we tested this prediction by performing tractography in 51 healthy adults who had undertaken a sequence memory task. Microstructure properties of the fornix were compared with those of tracts connecting medial temporal lobe regions but not predominantly the hippocampus: the Parahippocampal Cingulum bundle (PHC) (conveying retrosplenial projections to parahippocampal cortex) and the Inferior Longitudinal Fasciculus (ILF) (conveying occipital projections to perirhinal cortex). Using principal components analysis, we combined Free-Water Elimination Diffusion Tensor Imaging and Neurite Orientation Dispersion and Density Imaging measures obtained from multi-shell diffusion MRI into two informative indices: the first (PC1) capturing axonal packing/myelin and the second (PC2) capturing microstructural complexity. We found a significant correlation between fornix PC2 and implicit reaction-time indices of sequence memory, indicating that greater fornix microstructural complexity is associated with better sequence memory. No such relationship was found with measures from the PHC and ILF. This study highlights the importance of the fornix in aiding memory for objects within a temporal context, potentially reflecting a role in mediating inter-regional communication within an extended hippocampal system.

Memory-Based Prediction Deficits and Dorsolateral Prefrontal Dysfunction in Schizophrenia.

BACKGROUND: Theories suggest that people with schizophrenia (SZ) have problems generating predictions based on past experiences. The dorsolateral prefrontal cortex (DLPFC) and hippocampus participate in memory-based prediction. We used functional magnetic resonance imaging to investigate DLPFC and hippocampal function in healthy control (HC) subjects and people with SZ during memory-based prediction. METHODS: Prior to scanning, HC subjects (n = 54) and people with SZ (n = 31) learned 5-object sequences presented in fixed or random orders on each repetition. During scanning, participants made semantic decisions (e.g., "Can this object fit in a shoebox?") on a continuous stream of objects from fixed and random sequences. Sequence prediction was demonstrated by faster semantic decisions for objects in fixed versus random sequences because memory could be used to anticipate and more efficiently process semantic information about upcoming objects in fixed sequences. Representational similarity analyses were used to determine how each sequence type was represented in the posterior hippocampus and DLPFC. RESULTS: Sequence predictions were reduced in individuals with SZ relative to HC subjects. Representational similarity analyses revealed stronger memory-based predictions in the DLPFC of HC subjects than people with SZ, and DLPFC representations correlated with more successful predictions in HC subjects only. For the posterior hippocampus, voxel pattern similarity was increased for fixed versus random sequences in HC subjects only, but no significant between-group differences or correlations with prediction success were observed. CONCLUSIONS: Individuals with SZ are capable of learning temporal sequences; however, they are impaired using memory to predict upcoming events as efficiently as HC subjects. This deficit appears related to disrupted neural representation of sequence information in the DLPFC.

Cognitive [Computational] Neuroscience Test Reliability and Clinical Applications for Serious Mental Illness (CNTRaCS) Consortium: Progress and Future Directions.

The development of treatments for impaired cognition in schizophrenia has been characterized as the most important challenge facing psychiatry at the beginning of the twenty-first century. The Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS) project was designed to build on the potential benefits of using tasks and tools from cognitive neuroscience to better understanding and treat cognitive impairments in psychosis. These benefits include: (1) the use of fine-grained tasks that measure discrete cognitive processes; (2) the ability to design tasks that distinguish between specific cognitive domain deficits and poor performance due to generalized deficits resulting from sedation, low motivation, poor test taking skills, etc.; and (3) the ability to link cognitive deficits to specific neural systems, using animal models, neuropsychology, and functional imaging. CNTRICS convened a series of meetings to identify paradigms from cognitive neuroscience that maximize these benefits and identified the steps need for translation into use in clinical populations. The Cognitive Neuroscience Test Reliability and Clinical Applications for Schizophrenia (CNTRaCS) Consortium was developed to help carry out these steps. CNTRaCS consists of investigators at five different sites across the country with diverse expertise relevant to a wide range of the cognitive systems identified as critical as part of CNTRICs. This work reports on the progress and current directions in the evaluation and optimization carried out by CNTRaCS of the tasks identified as part of the original CNTRICs process, as well as subsequent extensions into the Positive Valence systems domain of Research Domain Criteria (RDoC). We also describe the current focus of CNTRaCS, which involves taking a computational psychiatry approach to measuring cognitive and motivational function across the spectrum of psychosis. Specifically, the current iteration of CNTRaCS is using computational modeling to isolate parameters reflecting potentially more specific cognitive and visual processes that may provide greater interpretability in understanding shared and distinct impairments across psychiatric disorders.

What is episodic memory and how do we use it?

What are the neural and computational principles that give rise to episodic memory? Although memory is probably the most studied topic in psychology and cognitive neuroscience, most research has focused on learning at the micro-level. I outline the limitations of this approach and propose a 'molar' approach to tackle episodic memory at the scale of life.

Correcting the hebbian mistake: Toward a fully error-driven hippocampus.

The hippocampus plays a critical role in the rapid learning of new episodic memories. Many computational models propose that the hippocampus is an autoassociator that relies on Hebbian learning (i.e., "cells that fire together, wire together"). However, Hebbian learning is computationally suboptimal as it does not learn in a way that is driven toward, and limited by, the objective of achieving effective retrieval. Thus, Hebbian learning results in more interference and a lower overall capacity. Our previous computational models have utilized a powerful, biologically plausible form of error-driven learning in hippocampal CA1 and entorhinal cortex (EC) (functioning as a sparse autoencoder) by contrasting local activity states at different phases in the theta cycle. Based on specific neural data and a recent abstract computational model, we propose a new model called Theremin (Total Hippocampal ERror MINimization) that extends error-driven learning to area CA3-the mnemonic heart of the hippocampal system. In the model, CA3 responds to the EC monosynaptic input prior to the EC disynaptic input through dentate gyrus (DG), giving rise to a temporal difference between these two activation states, which drives error-driven learning in the EC→CA3 and CA3↔CA3 projections. In effect, DG serves as a teacher to CA3, correcting its patterns into more pattern-separated ones, thereby reducing interference. Results showed that Theremin, compared with our original Hebbian-based model, has significantly increased capacity and learning speed. The model makes several novel predictions that can be tested in future studies.

Representations of Complex Contexts: A Role for Hippocampus.

The hippocampus plays a critical role in supporting episodic memory, in large part by binding together experiences and items with surrounding contextual information. At present, however, little is known about the roles of different hippocampal subfields in supporting this item-context binding. To address this question, we constructed a task in which items were affiliated with differing types of context-cognitive associations that vary at the local, item level and membership in temporally organized lists that linked items together at a global level. Participants made item recognition judgments while undergoing high-resolution fMRI. We performed voxel pattern similarity analyses to answer the question of how human hippocampal subfields represent retrieved information about cognitive states and the time at which a past event took place. As participants recollected previously presented items, activity patterns in the CA23DG subregion carried information about prior cognitive states associated with these items. We found no evidence to suggest reinstatement of information about temporal context at the level of list membership, but exploratory analyses revealed representations of temporal context at a coarse level in conjunction with representations of cognitive contexts. Results are consistent with characterizations of CA23DG as a critical site for binding together items and contexts in the service of memory retrieval.

The Structure of Systematicity in the Brain.

A hallmark of human intelligence is the ability to adapt to new situations, by applying learned rules to new content (systematicity) and thereby enabling an open-ended number of inferences and actions (generativity). Here, we propose that the human brain accomplishes these feats through pathways in the parietal cortex that encode the abstract structure of space, events, and tasks, and pathways in the temporal cortex that encode information about specific people, places, and things (content). Recent neural network models show how the separation of structure and content might emerge through a combination of architectural biases and learning, and these networks show dramatic improvements in the ability to capture systematic, generative behavior. We close by considering how the hippocampal formation may form integrative memories that enable rapid learning of new structure and content representations.

Contextual Expectations Shape Cortical Reinstatement of Sensory Representations.

When making a turn at a familiar intersection, we know what items and landmarks will come into view. These perceptual expectations, or predictions, come from our knowledge of the context; however, it is unclear how memory and perceptual systems interact to support the prediction and reactivation of sensory details in cortex. To address this, human participants learned the spatial layout of animals positioned in a cross maze. During fMRI, participants of both sexes navigated between animals to reach a target, and in the process saw a predictable sequence of five animal images. Critically, to isolate activity patterns related to item predictions, rather than bottom-up inputs, one-fourth of trials ended early, with a blank screen presented instead. Using multivariate pattern similarity analysis, we reveal that activity patterns in early visual cortex, posterior medial regions, and the posterior hippocampus showed greater similarity when seeing the same item compared with different items. Further, item effects in posterior hippocampus were specific to the sequence context. Critically, activity patterns associated with seeing an item in visual cortex and posterior medial cortex, were also related to activity patterns when an item was expected, but omitted, suggesting sequence predictions were reinstated in these regions. Finally, multivariate connectivity showed that patterns in the posterior hippocampus at one position in the sequence were related to patterns in early visual cortex and posterior medial cortex at a later position. Together, our results support the idea that hippocampal representations facilitate sensory processing by modulating visual cortical activity in anticipation of expected items.SIGNIFICANCE STATEMENT Our visual world is a series of connected events, where we can predict what we might see next based on our recent past. Understanding the neural circuitry and mechanisms of the perceptual and memory systems that support these expectations is fundamental to revealing how we perceive and act in our world. Using brain imaging, we studied what happens when we expect to see specific visual items, and how such expectations relate to top-down memory signals. We find both visual and memory systems reflect item predictions, and moreover, we show that hippocampal activity supports predictions of future expected items. This demonstrates that the hippocampus acts to predict upcoming items, and reinstates such predictions in cortex.

Individual differences in behavioral and electrophysiological signatures of familiarity- and recollection-based recognition memory.

Our everyday memories can vary in terms of accuracy and phenomenology. According to one theoretical account, these differences hinge on whether the memories contain information about both an item itself as well as associated details (remember) versus those that are devoid of these associated contextual details (familiar). This distinction has been supported by computational modeling of behavior, studies in patients, and neuroimaging work including differences both in electrophysiological and functional magnetic resonance imaging. At present, however, little evidence has emerged to suggest that neurophysiological measures track individual differences in estimates of recollection and familiarity. Here, we conducted electrophysiological recordings of brain activity during a recognition memory task designed to differentiate between behavioral indices of recollection and familiarity. Non-parametric cluster-based permutation analyses revealed associations between electrophysiological signatures of familiarity and recollection with their respective behavioral estimates. These results support the idea that recollection and familiarity are distinct phenomena and is the first, to our knowledge, to identify distinct electrophysiological signatures that track individual differences in these processes.

Event boundaries shape temporal organization of memory by resetting temporal context.

In memory, our continuous experiences are broken up into discrete events. Boundaries between events are known to influence the temporal organization of memory. However, how and through which mechanism event boundaries shape temporal order memory (TOM) remains unknown. Across four experiments, we show that event boundaries exert a dual role: improving TOM for items within an event and impairing TOM for items across events. Decreasing event length in a list enhances TOM, but only for items at earlier local event positions, an effect we term the local primacy effect. A computational model, in which items are associated to a temporal context signal that drifts over time but resets at boundaries captures all behavioural results. Our findings provide a unified algorithmic mechanism for understanding how and why event boundaries affect TOM, reconciling a long-standing paradox of why both contextual similarity and dissimilarity promote TOM.

The hippocampus supports high-precision binding in visual working memory.

It is well established that the hippocampus is critical for long-term episodic memory, but a growing body of research suggests that it also plays a critical role in supporting memory over very brief delays as measured in tests of working memory (WM). However, the circumstances under which the hippocampus is necessary for WM and the specific processes that it supports remain controversial. We propose that the hippocampus supports WM by binding together high-precision properties of an event, and we test this claim by examining the precision of color-location bindings in a visual WM task in which participants report the precise color of studied items using a continuous color wheel. Amnestic patients with hippocampal damage were significantly impaired at retrieving these colors after a 1-s delay, and these impairments reflected a reduction in the precision of those memories rather than increases in total memory failures or binding errors. Moreover, a parallel fMRI study in healthy subjects revealed that neural activity in the head and body of the hippocampus was directly related to the precision of visual WM decisions. Together, these results indicate that the hippocampus is critical in complex high-precision binding that supports memory over brief delays.

Narratives bridge the divide between distant events in episodic memory.

Many studies suggest that information about past experience, or episodic memory, is divided into discrete units called "events." Yet we can often remember experiences that span multiple events. Events that occur in close succession might simply be linked because of their proximity to one another, but we can also build links between events that occur farther apart in time. Intuitively, some kind of organizing principle should enable temporally distant events to become bridged in memory. We tested the hypothesis that episodic memory exhibits a narrative-level organization, enabling temporally distant events to be better remembered if they form a coherent narrative. Furthermore, we tested whether post-encoding memory consolidation is necessary to integrate temporally distant events. In three experiments, participants learned and subsequently recalled events from fictional stories, in which pairs of temporally distant events involving side characters ("sideplots") either formed one coherent narrative or two unrelated narratives. Across participants, we varied whether recall was assessed immediately after learning, or after a delay: 24 hours, 12 hours between morning and evening ("wake"), or 12 hours between evening and morning ("sleep"). Participants recalled more information about coherent than unrelated narrative events, in most delay conditions, including immediate recall and wake conditions, suggesting that post-encoding consolidation was not necessary to integrate temporally distant events into a larger narrative. Furthermore, post hoc modeling across experiments suggested that narrative coherence facilitated recall over and above any effects of sentence-level semantic similarity. This reliable memory benefit for coherent narrative events supports theoretical accounts which propose that narratives provide a high-level architecture for episodic memory.