Scene construction processes in the anterior hippocampus during temporal episodic memory retrieval.

Although the hippocampus has been implicated in both the temporal organization of memories and association of scene elements, some theoretical accounts posit that the role of the hippocampus in episodic memory is largely atemporal. In this study, we set out to explore this discrepancy by identifying hippocampal activity patterns related to scene construction while participants performed a temporal order memory task. Participants in the fMRI scanner were shown a sequence of photographs, each consisting of a central object and a contextual background scene. On each retrieval trial, participants were shown a pair of the original photographs (FULL), objects from the scenes without the background (OBJ), or background contexts without the main foreground object (BACK). In the temporal order judgment (TOJ) task, participants judged the temporal order of the pair of scenes; in the Viewing trials, two identical scenes were shown without any task. First, we found that the anterior hippocampus-particularly the CA1 and subiculum-showed similar patterns of activation between the BACK and OBJ conditions, suggesting that scene construction occurred spontaneously during both TOJ and Viewing. Furthermore, neural markers of scene construction in the anterior hippocampus did not apply to incorrect trials, showing that successful temporal memory retrieval was functionally linked to scene construction. In the cortex, time-processing areas, such as the supplementary motor area and the precuneus, and scene-processing areas, such as the parahippocampal cortex, were activated and functionally connected with the hippocampus. Together, these results support the view that the hippocampus is concurrently involved in scene construction and temporal organization of memory and propose a model of hippocampal episodic memory that takes both processes into account.

An Efficient Deep Learning-Based High-Definition Image Compressed Sensing Framework for Large-Scene Construction Site Monitoring.

High-definition images covering entire large-scene construction sites are increasingly used for monitoring management. However, the transmission of high-definition images is a huge challenge for construction sites with harsh network conditions and scarce computing resources. Thus, an effective compressed sensing and reconstruction method for high-definition monitoring images is urgently needed. Although current deep learning-based image compressed sensing methods exhibit superior performance in recovering images from a reduced number of measurements, they still face difficulties in achieving efficient and accurate high-definition image compressed sensing with less memory usage and computational cost at large-scene construction sites. This paper investigated an efficient deep learning-based high-definition image compressed sensing framework (EHDCS-Net) for large-scene construction site monitoring, which consists of four parts, namely the sampling, initial recovery, deep recovery body, and recovery head subnets. This framework was exquisitely designed by rational organization of the convolutional, downsampling, and pixelshuffle layers based on the procedures of block-based compressed sensing. To effectively reduce memory occupation and computational cost, the framework utilized nonlinear transformations on downscaled feature maps in reconstructing images. Moreover, the efficient channel attention (ECA) module was introduced to further increase the nonlinear reconstruction capability on downscaled feature maps. The framework was tested on large-scene monitoring images from a real hydraulic engineering megaproject. Extensive experiments showed that the proposed EHDCS-Net framework not only used less memory and floating point operations (FLOPs), but it also achieved better reconstruction accuracy with faster recovery speed than other state-of-the-art deep learning-based image compressed sensing methods.

Unrestricted eye movements strengthen effective connectivity from hippocampal to oculomotor regions during scene construction.

Scene construction is a key component of memory recall, navigation, and future imagining, and relies on the medial temporal lobes (MTL). A parallel body of work suggests that eye movements may enable the imagination and construction of scenes, even in the absence of external visual input. There are vast structural and functional connections between regions of the MTL and those of the oculomotor system. However, the directionality of connections between the MTL and oculomotor control regions, and how it relates to scene construction, has not been studied directly in human neuroimaging. In the current study, we used dynamic causal modeling (DCM) to interrogate effective connectivity between the MTL and oculomotor regions using a scene construction task in which participants' eye movements were either restricted (fixed-viewing) or unrestricted (free-viewing). By omitting external visual input, and by contrasting free- versus fixed- viewing, the directionality of neural connectivity during scene construction could be determined. As opposed to when eye movements were restricted, allowing free-viewing during construction of scenes strengthened top-down connections from the MTL to the frontal eye fields, and to lower-level cortical visual processing regions, suppressed bottom-up connections along the visual stream, and enhanced vividness of the constructed scenes. Taken together, these findings provide novel, non-invasive evidence for the underlying, directional, connectivity between the MTL memory system and oculomotor system associated with constructing vivid mental representations of scenes.

vmPFC Drives Hippocampal Processing during Autobiographical Memory Recall Regardless of Remoteness.

Our ability to recall past experiences, autobiographical memories (AMs), is crucial to cognition, endowing us with a sense of self and underwriting our capacity for autonomy. Traditional views assume that the hippocampus orchestrates event recall, whereas recent accounts propose that the ventromedial prefrontal cortex (vmPFC) instigates and coordinates hippocampal-dependent processes. Here we sought to characterize the dynamic interplay between the hippocampus and vmPFC during AM recall to adjudicate between these perspectives. Leveraging the high temporal resolution of magnetoencephalography, we found that the left hippocampus and the vmPFC showed the greatest power changes during AM retrieval. Moreover, responses in the vmPFC preceded activity in the hippocampus during initiation of AM recall, except during retrieval of the most recent AMs. The vmPFC drove hippocampal activity during recall initiation and also as AMs unfolded over subsequent seconds, and this effect was evident regardless of AM age. These results recast the positions of the hippocampus and the vmPFC in the AM retrieval hierarchy, with implications for theoretical accounts of memory processing and systems-level consolidation.

The Neural Dynamics of Novel Scene Imagery.

Retrieval of long-term episodic memories is characterized by synchronized neural activity between hippocampus and ventromedial prefrontal cortex (vmPFC), with additional evidence that vmPFC activity leads that of the hippocampus. It has been proposed that the mental generation of scene imagery is a crucial component of episodic memory processing. If this is the case, then a comparable interaction between the two brain regions should exist during the construction of novel scene imagery. To address this question, we leveraged the high temporal resolution of MEG to investigate the construction of novel mental imagery. We tasked male and female humans with imagining scenes and single isolated objects in response to one-word cues. We performed source-level power, coherence, and causality analyses to characterize the underlying interregional interactions. Both scene and object imagination resulted in theta power changes in the anterior hippocampus. However, higher theta coherence was observed between the hippocampus and vmPFC in the scene compared with the object condition. This interregional theta coherence also predicted whether imagined scenes were subsequently remembered. Dynamic causal modeling of this interaction revealed that vmPFC drove activity in hippocampus during novel scene construction. Additionally, theta power changes in the vmPFC preceded those observed in the hippocampus. These results constitute the first evidence in humans that episodic memory retrieval and scene imagination rely on similar vmPFC-hippocampus neural dynamics. Furthermore, they provide support for theories emphasizing similarities between both cognitive processes and perspectives that propose the vmPFC guides the construction of context-relevant representations in the hippocampus.SIGNIFICANCE STATEMENT Episodic memory retrieval is characterized by a dialog between hippocampus and ventromedial prefrontal cortex (vmPFC). It has been proposed that the mental generation of scene imagery is a crucial component of episodic memory processing. An ensuing prediction would be of a comparable interaction between the two brain regions during the construction of novel scene imagery. Here, we leveraged the high temporal resolution of MEG and combined it with a scene imagination task. We found that a hippocampal-vmPFC dialog existed and that it took the form of vmPFC driving the hippocampus. We conclude that episodic memory and scene imagination share fundamental neural dynamics and the process of constructing vivid, spatially coherent, contextually appropriate scene imagery is strongly modulated by vmPFC.

A Posterior-Anterior Distinction between Scene Perception and Scene Construction in Human Medial Parietal Cortex.

Human retrosplenial complex (RSC), located in medial parietal cortex, has been implicated in numerous cognitive functions, including scene perception, spatial navigation, and autobiographical memory retrieval. Recently, a posterior-anterior distinction within RSC was proposed, such that posterior aspects process scene-related visual information (constituting a medial place area [MPA]), whereas anterior aspects process information that is vividly retrieved from memory, thereby supporting remembering and potentially navigation. Here, we tested this proposed distinction in a single group of participants (both male and female) using fMRI with both perceptual and mnemonic tasks. After completing a resting-state scan, participants performed a task that required constructing scenes from memory and completed a scene selectivity localizer task. We tested directly perceptual and mnemonic responses in MPA and an anterior, connectivity-defined region (CON), which showed strong functional connectivity with anterior parahippocampal place area. A double dissociation was observed, such that CON was more strongly activated during scene construction than was MPA, whereas MPA was more perceptually responsive than CON. Further, peak responses from the scene construction task were anterior to perceptual peaks in all but 1 participant and hemisphere. Finally, through analyses of the posterior-anterior response profiles, we identify the fundus of the parieto-occipital sulcus as a potential location for the crossover from perceptual to mnemonic representations and highlight a potential left-hemisphere advantage for mnemonic representations. Collectively, our results support a distinction between posterior and anterior aspects of the RSC, suggesting that more specific functional-anatomic terms should be used in its place in future work.SIGNIFICANCE STATEMENT The retrosplenial complex (RSC) has been implicated in vision, spatial cognition, and memory. We previously speculated on a potential posterior-anterior distinction within RSC for scene perception and memory-based scene construction/navigation. Here, we tested this distinction through a combination of resting-state, perceptual, and mnemonic task data. Consistent with our predictions, we demonstrate that perceptual responses peak consistently posterior of those elicited by memory-based scene construction within the broader RSC. Further, we highlight (1) the fundus of the parieto-occipital sulcus as a landmark for the transition between these representations, (2) the anterior bank of parieto-occipital sulcus as the point of maximal separation between these representations, and (3) identify a potential hemispheric asymmetry in mnemonic representations. These data support functional dissociations within RSC.

Does hippocampal volume explain performance differences on hippocampal-dependant tasks?

Marked disparities exist across healthy individuals in their ability to imagine scenes, recall autobiographical memories, think about the future and navigate in the world. The importance of the hippocampus in supporting these critical cognitive functions has prompted the question of whether differences in hippocampal grey matter volume could be one source of performance variability. Evidence to date has been somewhat mixed. In this study we sought to mitigate issues that commonly affect these types of studies. Data were collected from a large sample of 217 young, healthy adult participants, including whole brain structural MRI data (0.8 mm isotropic voxels) and widely-varying performance on scene imagination, autobiographical memory, future thinking and navigation tasks. We found little evidence that hippocampal grey matter volume was related to task performance in this healthy sample. This was the case using different analysis methods (voxel-based morphometry, partial correlations), when whole brain or hippocampal regions of interest were examined, when comparing different sub-groups (divided by gender, task performance, self-reported ability), and when using latent variables derived from across the cognitive tasks. Hippocampal grey matter volume may not, therefore, significantly influence performance on tasks known to require the hippocampus in healthy people. Perhaps only in extreme situations, as in the case of licensed London taxi drivers, are measurable ability-related hippocampus volume changes consistently exhibited.

Imaging the human hippocampus with optically-pumped magnetoencephalography.

Optically-pumped (OP) magnetometers allow magnetoencephalography (MEG) to be performed while a participant's head is unconstrained. To fully leverage this new technology, and in particular its capacity for mobility, the activity of deep brain structures which facilitate explorative behaviours such as navigation, must be detectable using OP-MEG. One such crucial brain region is the hippocampus. Here we had three healthy adult participants perform a hippocampal-dependent task - the imagination of novel scene imagery - while being scanned using OP-MEG. A conjunction analysis across these three participants revealed a significant change in theta power in the medial temporal lobe. The peak of this activated cluster was located in the anterior hippocampus. We repeated the experiment with the same participants in a conventional SQUID-MEG scanner and found similar engagement of the medial temporal lobe, also with a peak in the anterior hippocampus. These OP-MEG findings indicate exciting new opportunities for investigating the neural correlates of a range of crucial cognitive functions in naturalistic contexts including spatial navigation, episodic memory and social interactions.

Medial Temporal Lobe Contributions to Episodic Future Thinking: Scene Construction or Future Projection?

Previous research has shown that the medial temporal lobes (MTL) are more strongly engaged when individuals think about the future than about the present, leading to the suggestion that future projection drives MTL engagement. However, future thinking tasks often involve scene processing, leaving open the alternative possibility that scene-construction demands, rather than future projection, are responsible for the MTL differences observed in prior work. This study explores this alternative account. Using functional magnetic resonance imaging, we directly contrasted MTL activity in 1) high scene-construction and low scene-construction imagination conditions matched in future thinking demands and 2) future-oriented and present-oriented imagination conditions matched in scene-construction demands. Consistent with the alternative account, the MTL was more active for the high versus low scene-construction condition. By contrast, MTL differences were not observed when comparing the future versus present conditions. Moreover, the magnitude of MTL activation was associated with the extent to which participants imagined a scene but was not associated with the extent to which participants thought about the future. These findings help disambiguate which component processes of imagination specifically involve the MTL.

Episodic specificity induction and scene construction: Evidence for an event construction account.

Research has suggested that an episodic specificity induction (ESI)- training in recollecting details of a past event- impacts subsequent memory, imagination, problem solving, and creativity. We have hypothesized that induction effects may be attributable to event construction- the assembly and maintenance of a mental scenario filled with setting, people, and action details. We examine whether ESI impacts metrics of event detail in a standard scene construction task, which is a paradigm focused on the spatial integrity of a mental scenario and the stage upon or setting in which such a scenario occurs. Relative to a control, ESI significantly increased details generated across all categories of event detail in scene construction, including spatial references, entities present, sensory descriptions, and thoughts/emotions/actions. ESI did not influence scores on the Spatial Coherence Index, a critical measure of spatial processing. These findings inform theoretical and functional accounts of the nature and malleability of constructive retrieval.

Hippocampal Damage Increases Deontological Responses during Moral Decision Making.

Complex moral decision making is associated with the ventromedial prefrontal cortex (vmPFC) in humans, and damage to this region significantly increases the frequency of utilitarian judgments. Since the vmPFC has strong anatomical and functional links with the hippocampus, here we asked how patients with selective bilateral hippocampal damage would derive moral decisions on a classic moral dilemmas paradigm. We found that the patients approved of the utilitarian options significantly less often than control participants, favoring instead deontological responses-rejecting actions that harm even one person. Thus, patients with hippocampal damage have a strikingly opposite approach to moral decision making than vmPFC-lesioned patients. Skin-conductance data collected during the task showed increased emotional arousal in the hippocampal-damaged patients and they stated that their moral decisions were based on emotional instinct. By contrast, control participants made moral decisions based on the integration of an adverse emotional response to harming others, visualization of the consequences of one's action, and the rational re-evaluation of future benefits. This integration may be disturbed in patients with either hippocampal or vmPFC damage. Hippocampal lesions decreased the ability to visualize a scenario and its future consequences, which seemed to render the adverse emotional response overwhelmingly dominant. In patients with vmPFC damage, visualization might also be reduced alongside an inability to detect the adverse emotional response, leaving only the utilitarian option open. Overall, these results provide insights into the processes involved in moral decision making and highlight the complementary roles played by two closely connected brain regions. SIGNIFICANCE STATEMENT: The ventromedial prefrontal cortex (vmPFC) is closely associated with the ability to make complex moral judgements. When this area is damaged, patients become more utilitarian (the ends justify the means) and have decreased emotional arousal during moral decision making. The vmPFC is closely connected with another brain region-the hippocampus. In this study we found that patients with selective bilateral hippocampal damage show a strikingly opposite response pattern to those with vmPFC damage when making moral judgements. They rejected harmful actions of any kind (thus their responses were deontological) and showed increased emotional arousal. These results provide new insights into the processes involved in moral decision making and highlight the complementary roles played by two closely connected brain regions.

Deciding what is possible and impossible following hippocampal damage in humans.

There is currently much debate about whether the precise role of the hippocampus in scene processing is predominantly constructive, perceptual, or mnemonic. Here, we developed a novel experimental paradigm designed to control for general perceptual and mnemonic demands, thus enabling us to specifically vary the requirement for constructive processing. We tested the ability of patients with selective bilateral hippocampal damage and matched control participants to detect either semantic (e.g., an elephant with butterflies for ears) or constructive (e.g., an endless staircase) violations in realistic images of scenes. Thus, scenes could be semantically or constructively 'possible' or 'impossible'. Importantly, general perceptual and memory requirements were similar for both types of scene. We found that the patients performed comparably to control participants when deciding whether scenes were semantically possible or impossible, but were selectively impaired at judging if scenes were constructively possible or impossible. Post-task debriefing indicated that control participants constructed flexible mental representations of the scenes in order to make constructive judgements, whereas the patients were more constrained and typically focused on specific fragments of the scenes, with little indication of having constructed internal scene models. These results suggest that one contribution the hippocampus makes to scene processing is to construct internal representations of spatially coherent scenes, which may be vital for modelling the world during both perception and memory recall. © 2016 The Authors. Hippocampus Published by Wiley Periodicals, Inc.

Remembering Preservation in Hippocampal Amnesia.

The lesion-deficit model dominates neuropsychology. This is unsurprising given powerful demonstrations that focal brain lesions can affect specific aspects of cognition. Nowhere is this more evident than in patients with bilateral hippocampal damage. In the past 60 years, the amnesia and other impairments exhibited by these patients have helped to delineate the functions of the hippocampus and shape the field of memory. We do not question the value of this approach. However, less prominent are the cognitive processes that remain intact following hippocampal lesions. Here, we collate the piecemeal reports of preservation of function following focal bilateral hippocampal damage, highlighting a wealth of information often veiled by the field's focus on deficits. We consider how a systematic understanding of what is preserved as well as what is lost could add an important layer of precision to models of memory and the hippocampus.

Constructing, Perceiving, and Maintaining Scenes: Hippocampal Activity and Connectivity.

In recent years, evidence has accumulated to suggest the hippocampus plays a role beyond memory. A strong hippocampal response to scenes has been noted, and patients with bilateral hippocampal damage cannot vividly recall scenes from their past or construct scenes in their imagination. There is debate about whether the hippocampus is involved in the online processing of scenes independent of memory. Here, we investigated the hippocampal response to visually perceiving scenes, constructing scenes in the imagination, and maintaining scenes in working memory. We found extensive hippocampal activation for perceiving scenes, and a circumscribed area of anterior medial hippocampus common to perception and construction. There was significantly less hippocampal activity for maintaining scenes in working memory. We also explored the functional connectivity of the anterior medial hippocampus and found significantly stronger connectivity with a distributed set of brain areas during scene construction compared with scene perception. These results increase our knowledge of the hippocampus by identifying a subregion commonly engaged by scenes, whether perceived or constructed, by separating scene construction from working memory, and by revealing the functional network underlying scene construction, offering new insights into why patients with hippocampal lesions cannot construct scenes.

Deconstructing the nature of episodic foresight deficits associated with chronic opiate use.

OBJECTIVES: Episodic foresight refers to the capacity to mentally travel forward in time and has been linked to a wide variety of important functional behaviours. Evidence has recently emerged that chronic opiate use is associated with deficits in this critical capacity and that these difficulties are not simply a secondary consequence of broader cognitive dysfunction. The current study aimed to better understand the circumstances in which chronic opiate users might be expected to have problems with episodic foresight, by addressing whether deficits reflect compromised scene construction, self-projection, or narrative ability. METHODS: Thirty-five chronic opiate users and 35 demographically matched controls completed an imagination task in which they were instructed to imagine and provide descriptions of an atemporal event, a plausible, self-relevant future event, as well as complete a narrative task. These three imagination conditions systematically varied in their demands on scene construction, self-projection, and narrative ability. RESULTS: Consistent with prior literature, chronic opiate users exhibited reduced capacity for episodic foresight relative to controls. However, this study was the first to show that these difficulties were independent of capacity for scene construction and narration. Instead, a specific impairment in self-projection into the future appears to contribute to the problems with episodic foresight seen in this clinical group. CONCLUSIONS: Deficits in self-projection into the future may have important implications in therapeutic environments given that many relapse prevention strategies rely heavily on the ability to project oneself into an unfamiliar future, free of problem substance use. PRACTITIONER POINTS: A reduced capacity for episodic foresight highlights the importance of refining current relapse prevention protocols that place significant demands for mental time travel into the future. Psychosocial treatments should focus on the attainment of more immediate or short-term goals. It is difficult to delineate the effects of specific substances given long-standing drug use history common to chronic opiate users. Conclusions relating to neurological functioning are speculative given the absence of neuroimaging data.

Memory, Imagination, and Predicting the Future: A Common Brain Mechanism?

On the face of it, memory, imagination, and prediction seem to be distinct cognitive functions. However, metacognitive, cognitive, neuropsychological, and neuroimaging evidence is emerging that they are not, suggesting intimate links in their underlying processes. Here, we explore these empirical findings and the evolving theoretical frameworks that seek to explain how a common neural system supports our recollection of times past, imagination, and our attempts to predict the future.

Counterfactual thinking in patients with amnesia.

We often engage in counterfactual (CF) thinking, which involves reflecting on "what might have been." Creating alternative versions of reality seems to have parallels with recollecting the past and imagining the future in requiring the simulation of internally generated models of complex events. Given that episodic memory and imagining the future are impaired in patients with hippocampal damage and amnesia, we wondered whether successful CF thinking also depends upon the integrity of the hippocampus. Here using two nonepisodic CF thinking tasks, we found that patients with bilateral hippocampal damage and amnesia performed comparably with matched controls. They could deconstruct reality, add in and recombine elements, change relations between temporal sequences of events, enabling them to determine plausible alternatives of complex episodes. A difference between the patients and control participants was evident, however, in the patients' subtle avoidance of CF simulations that required the construction of an internal spatial representation. Overall, our findings suggest that mental simulation in the form of nonepisodic CF thinking does not seem to depend upon the hippocampus unless there is the added requirement for construction of a coherent spatial scene within which to play out scenarios.

A matter of precision? Scene imagery in individuals with high-functioning autism spectrum disorder.

The ability to create mental representations of scenes is essential for remembering, predicting, and imagining. In individuals with autism spectrum disorders (ASD) this ability may be impaired. Considering that autistic characteristics such as weak central coherence or reduced communication abilities may disadvantage autistic participants in traditional imagery tasks, this study attempted to use a novel task design to measure the ability of scene imagery. Thirty high-functioning adults with ASD and 27 non-autistic matched control adults were asked to describe imagined fictitious scenes using two types of scene imagery tasks. In a free imagery task, participants were asked to imagine a scene based on a given keyword. In a guided imagery task, participants had to imagine a scene based on a detailed description of the scene. Additionally, narrative abilities were assessed using the Narrative Scoring Scheme. Statistical analyses revealed no group effects in the free and guided imagery of fictional scenes. Participants with ASD performed worse than control participants in the narrative task. Narrative abilities correlated positively with performance in both imagery tasks in the ASD group only. Hence, individuals with ASD seem to show as good imagery abilities as non-autistic individuals. The results are discussed in the light of the differences between imagery and imagination and possible gender differences.

Scene construction ability in neurotypical and autistic adults.

LAY ABSTRACT: People with autism spectrum conditions (ASC) have difficulties imagining events, which might result from difficulty mentally generating and maintaining a coherent spatial scene. This study compared this scene construction ability between autistic (N = 55) and neurotypical (N = 63) adults. Results showed that scene construction was diminished in autistic compared to neurotypical participants, and participants with fewer autistic traits had better scene construction ability. ASC diagnosis did not influence the frequency of mentions of the self or of sensory experiences. Exploratory analysis suggests that scene construction ability is associated with the ability to understand our own and other people's mental states, and that these individual-level preferences/cognitive styles can overrule typical group-level characteristics.

Measuring episodic memory and mental time travel: crossing the species gap.

Mental time travel is the projection of the mind into the past or future, and relates to experiential aspects of episodic memory, and episodic future thinking. Framing episodic memory and future thinking in this way causes a challenge when studying memory in animals, where demonstration of this mental projection is prevented by the absence of language. However, there is good evidence that non-human animals pass tests of episodic memory that are based on behavioural criteria, meaning a better understanding needs to be had of the relationship between episodic memory and mental time travel. We argue that mental time travel and episodic memory are not synonymous, and that mental time travel is neither a requirement of, nor an irrelevance to, episodic memory. Mental time travel can allow improved behavioural choices based on episodic memory, and work in all species (including humans) should include careful consideration of the behavioural outputs being measured. This article is part of the theme issue 'Elements of episodic memory: lessons from 40 years of research'.