Temporal organization of narrative recall is present but attenuated in adults with hippocampal amnesia.

Studies of the impact of brain injury on memory processes often focus on the quantity and episodic richness of those recollections. Here, we argue that the organization of one's recollections offers critical insights into the impact of brain injury on functional memory. It is well-established in studies of word list memory that free recall of unrelated words exhibits a clear temporal organization. This temporal contiguity effect refers to the fact that the order in which word lists are recalled reflects the original presentation order. Little is known, however, about the organization of recall for semantically rich materials, nor how recall organization is impacted by hippocampal damage and memory impairment. The present research is the first study, to our knowledge, of temporal organization in semantically rich narratives in three groups: (1) Adults with bilateral hippocampal damage and severe declarative memory impairment, (2) adults with bilateral ventromedial prefrontal cortex (vmPFC) damage and no memory impairment, and (3) demographically matched non-brain-injured comparison participants. We find that although the narrative recall of adults with bilateral hippocampal damage reflected the temporal order in which those narratives were experienced above chance levels, their temporal contiguity effect was significantly attenuated relative to comparison groups. In contrast, individuals with vmPFC damage did not differ from non-brain-injured comparison participants in temporal contiguity. This pattern of group differences yields insights into the cognitive and neural systems that support the use of temporal organization in recall. These data provide evidence that the retrieval of temporal context in narrative recall is hippocampal-dependent, whereas damage to the vmPFC does not impair the temporal organization of narrative recall. This evidence of limited but demonstrable organization of memory in participants with hippocampal damage and amnesia speaks to the power of narrative structures in supporting meaningfully organized recall despite memory impairment.

PEPPR: A post-encoding pre-production reinstatement model of dual-list free recall.

Recent events are easy to recall, but they also interfere with the recall of more distant, non-recent events. In many computational models, non-recent memories are recalled by using the context associated with those events as a cue. Some models, however, do little to explain how people initially activate non-recent contexts in the service of accurate recall. We addressed this limitation by evaluating two candidate mechanisms within the Context-Maintenance and Retrieval model. The first is a Backward-Walk mechanism that iteratively applies a generate/recognize process to covertly retrieve progressively less recent items. The second is a Post-Encoding Pre-Production Reinstatement (PEPPR) mechanism that formally implements a metacognitive control process that reinstates non-recent contexts prior to retrieval. Models including these mechanisms make divergent predictions about the dynamics of response production and monitoring when recalling non-recent items. Before producing non-recent items, Backward-Walk cues covert retrievals of several recent items, whereas PEPPR cues few, if any, covert retrievals of that sort. We tested these predictions using archival data from a dual-list externalized free recall paradigm that required subjects to report all items that came to mind while recalling from the non-recent list. Simulations showed that only the model including PEPPR accurately predicted covert recall patterns. That same model fit the behavioral data well. These findings suggest that self-initiated context reinstatement plays an important role in recall of non-recent memories and provides a formal model that uses a parsimonious non-hierarchical context representation of how such reinstatement might occur.

Recall initiation instructions influence how space and time interact in memory.

Recent work has examined the interaction between space and time in memory search, but there is still limited understanding of this relationship. Here, we test the hypothesis that individuals can exert control over how time and space interact in response to subtle differences in task instructions. To test this hypothesis, we analyzed two experiments where participants completed two immediate free recall tasks, a verbal task involving words presented at a central location and a spatial task involving squares presented at different locations. Some participants were free to recall the words or locations spontaneously in any order they preferred. In contrast, another group was subtly biased toward temporal information by instructions to begin recall from the last presented item before recalling the remaining items in any order they wished. Replicating recent work, all conditions showed clear evidence that recall was organized along both the temporal and the spatial dimensions. Extending this work, we found that the subtle change in recall instructions increased the reliance on temporal information in the spatial recall task. Correlational analyses suggest that spatial and temporal information do not compete when participants search memory spontaneously. However, they do compete when instructions favor temporal information. These findings highlight that individuals can exert some cognitive control over how associative dimensions interact during memory search and emphasize the importance of incorporating such processes into theoretical models.

Contiguity and overshadowing interactions in the rapid-streaming procedure.

When multiple cues are associated with the same outcome, organisms tend to select between the cues, with one revealing greater behavioral control at the expense of the others (i.e., cue competition). However, non-human and human studies have not always observed this competition, creating a puzzling scenario in which the interaction between cues can result in competition, no interaction, or facilitation as a function of several learning parameters. In five experiments, we assessed whether temporal contiguity and overshadowing effects are reliably observed in the streamed-trial procedure, and whether there was an interaction between them. We anticipated that weakening temporal contiguity (ranging from 500 to 1,000 ms) should attenuate competition. Using within-subject designs, participants experienced independent series of rapid streams in which they had to learn the relationship between visual cues (presented either alone or with another cue) and an outcome, with the cue-outcome pairings being presented with either a delay or trace relationship. Across experiments, we observed overshadowing (Experiments 1, 2, 4, and 5) and temporal contiguity effects (Experiments 2, 3, and 4). Despite the frequent occurrence of both effects, we did not find that trace conditioning abolished competition between cues. Overall, these results suggest that the extent to which contiguity determines cue interactions depends on multiple variables, some of which we address in the General discussion.

Modality Effects Examined by Means of an Online Sentence-Picture Comparison Task.

Are oral sentences accompanied by pictures easier to understand than written sentences accompanied by the same pictures? This question-intensely discussed for more than two decades in educational, psychological, and psycholinguistic research in terms of modality effect in multimedia learning, split-attention effect, or visuospatial load effect-was examined by means of an online sentence-picture comparison task, with participants reading or listening to short sentences accompanied by pictures. Sentences and pictures referred to a conceptually and linguistically basic universe that was constructed from a limited number of familiar objects and characteristics. Mixed repeated-measures ANOVAs were calculated separately for simultaneously and sequentially presented sentence-picture versions, with modality (oral, written), picture complexity (complex, simple), and sentence-picture compatibility (compatible, incompatible) as within-subject factors, and age (6th-graders, adults) as between-subjects factor. The experiment was based on reaction time and acuity measures. The online sentence-picture comparison task requires participants to take note of both components (verbal and pictorial information). The presence of two age groups made it possible to examine modality effects from a developmental point of view by suggesting that learners' written comprehension and monitoring skills at some point equal and then surpass their oral comprehension and monitoring skills. The experiment showed the necessity to interpret modality main effects in the context of their two-way and three-way interactions with other variables since modality effects taken alone do not tell the whole story. The concepts of split attention, temporal contiguity, and element interactivity were discussed in this context.

A new application of the temporal contiguity effect in designing narrated slideshows.

We investigated whether the temporal contiguity effect, which holds that information sources, such as visual information and narration need to be temporally coordinated for learning to be effective, can also be found in narrated slideshows. A concurrent presentation-key point format (CPK), in which visual information sequentially appeared as key points on the slide with corresponding narration, was compared to a concurrent presentation-whole format (CPW), in which visual information was shown all at once on the slide with corresponding narration, and a sequential presentation format (SP), in which the narration was played first before all the corresponding visual information was presented at once. Ninety-nine undergraduates were randomly divided across the CPK, CPW and SP conditions. Results revealed that participants in the CPK group had higher post-test performance and learning efficiency than participants in the CPW and SP conditions. Performance in the CPW condition was higher than in the SP conditions, but only in terms of learning efficiency. The results suggested that the occurrence of the temporal contiguity effect not only depends on whether the presentation of narration and visual information in narrated slideshows is concurrent or not, but also on how concurrent it is.

An investigation of the effect of temporal contiguity training on size-tolerant representations in object-selective cortex.

The human visual system has a remarkable ability to reliably identify objects across variations in appearance, such as variations in viewpoint, lighting and size. Here we used fMRI in humans to test whether temporal contiguity training with natural and altered image dynamics can respectively build and break neural size tolerance for objects. Participants (N â€‹= â€‹23) were presented with sequences of images of "growing" and "shrinking" objects. In half of the trials, the object also changed identity when the size change happened. According to the temporal contiguity hypothesis, and studies with a similar paradigm in monkeys, this training process should alter size tolerance. After the training phase, BOLD responses to each of the object images were measured in the scanner. Neural patterns in LOC and V1 contained information on size, similarity and identity. In LOC, the representation of object identity was partially invariant to changes in size. However, temporal contiguity training did not affect size tolerance in LOC. Size tolerance in human object-selective cortex is more robust to variations in input statistics than expected based on prior work in monkeys supporting the temporal contiguity hypothesis.

Age-related prefrontal cortex activation in associative memory: An fNIRS pilot study.

Older adults typically perform more poorly than younger adults in free recall memory tests. This age-related deficit has been linked to decline of brain activation and brain prefrontal lateralization, which may be the result of compensatory mechanisms. In the present pilot study, we investigated the effect of age on prefrontal cortex (PFC) activation during performance of a task that requires memory associations (temporal vs. spatial clustering), using functional Near-Infrared Spectroscopy (fNIRS). Ten younger adults, ten cognitively high-performing older individuals, and ten low-performing older individuals completed a free recall task, where either a temporal or spatial strategy (but not both simultaneously) could be employed to retrieve groups of same-category stimuli, whilst changes in PFC hemodynamics were recorded by means of a 12-channel fNIRS system. The results suggest PFC activation, and right lateralization specific to younger adults. Moreover, age did not affect use of memory organization, given that temporal clustering was preferred over spatial clustering in all groups. These findings are in line with previous literature on the aging brain and on temporal organization of memory. Our results also suggest that the PFC may be specifically involved in memory for temporal associations. Future research may consider whether age-related deficits in temporal organization may be an early sign of PFC pathology and possible neurodegeneration.

Causing time: Evaluating causal changes to the when rather than the whether of an outcome.

Studies of human causal learning typically conceptualize an effect as the presence or absence of an outcome or event in a given trial following a cause. However, causes may exert their influence in other ways, notably, by advancing or postponing the time at which an outcome occurs. Prior research has not examined how humans evaluate causal changes where the change in timing itself is the effect of interest. This research took a first step in this direction by investigating whether participants can accurately judge cause-effect contingencies when the effect is a change in outcome timing, as distinct from outcome occurrence: A change to the when of the outcome rather than to the whether. Three experiments presented scenarios where a candidate cause could either advance or postpone an inevitable outcome by a given amount of time and with a given probability. Consistent with previous research on judgments about event occurrence, participants gave higher ratings to scenarios with greater contingency. These effects were generally consistent for actions that advanced or postponed the outcome. Overall, our findings demonstrate that people are sensitive to probabilistic contrasts involving causal changes in event timing.

Temporal Proximity Links Unrelated News Events in Memory.

Some memories are linked such that recalling one can trigger the retrieval of another. What determines which memories are linked? Some models predict that simply occurring close together in time is sufficient for links to form between memories. A competing theory suggests that temporal proximity is generally not sufficient, and existing evidence for such links is an artifact of using chainlike lists of items in artificial laboratory tasks. To test these competing accounts, we asked subjects to recall news stories that they had encountered over the past 2 years (Experiment 1) or 4 months (Experiment 2). In both experiments, subjects showed a strong bias to successively recall stories that appeared in the news within days of each other-even after accounting for the fact that stories that occur close in time tend to be semantically related. By moving beyond laboratory tasks, this research solidifies the foundation of contemporary memory theory.

When causality shapes the experience of time: Evidence for temporal binding in young children.

It is well established that the temporal proximity of two events is a fundamental cue to causality. Recent research with adults has shown that this relation is bidirectional: events that are believed to be causally related are perceived as occurring closer together in time-the so-called temporal binding effect. Here, we examined the developmental origins of temporal binding. Participants predicted when an event that was either caused by a button press, or preceded by a non-causal signal, would occur. We demonstrate for the first time that children as young as 4 years are susceptible to temporal binding. Binding occurred both when the button press was executed via intentional action, and when a machine caused it. These results suggest binding is a fundamental, early developing property of perception and grounded in causal knowledge. A video abstract of this article can be viewed at https://www.youtube.com/watch?v=EQC_MqjxZQQ.

Subtle temporal delays of mothers' responses affect imitation learning in children: Mother-child interaction study.

The relationship between temporal contiguity of mothers' teaching behaviors and children's imitation learning was investigated. Participants (2-year-old children) observed their mothers' demonstration of using novel toys over a double television system under live and delayed conditions. The dyads normally interacted in the live condition, whereas they interacted with a 1-s time delay inserted between the children's actions and mothers' responses in the delayed condition. Then, the children were tested with identical toys. Results indicated that children's smiling responses and imitation performances were significantly decreased in the delayed condition compared with the live condition, although mothers' teaching approach did not differ between conditions. These results suggest that a subtle temporal delay in mothers' responses could affect young children's imitation learning.

The role of control processes in temporal and semantic contiguity.

Atkinson and Shiffrin (1968) argued that performance on any memory task reflects the combined influence of both the fixed structure of the memory system and control processes tailored to the specific task. We investigated the role of control processes in governing the temporal contiguity and semantic contiguity effects in free recall-tendencies to organize recall based on proximity in the study list and pre-existing semantic associations. Subjects studied lists that contained four "clusters", each composed of four semantically associated words but presented in random order such that associates were not in adjacent serial positions. Subjects were given either standard free-recall instructions, instructions to focus on order-based associations (i.e., the original order of presentation), or meaning-based associations (i.e., pre-existing semantic relationships). Replicating previous work, lists with strong semantic relationships resulted in a reduced overall temporal contiguity effect when recalled under standard free-recall instructions. However, under meaning-based recall instructions, the temporal contiguity effect was nearly eliminated. Detailed analyses of within-cluster transitions and an order reconstruction task revealed that temporal information was encoded, but control processes prevented it from dominating memory search. These results point to a need for more empirical work exploring how control processes change recall dynamics and for more theoretical work modeling the computational basis of these processes.

RECAPP-XPR: A smartphone application for presenting and recalling experimentally controlled stimuli over longer timescales.

We report two experiments that used smartphone applications for presenting and recalling verbal stimuli over extended timescales. In Experiment 1, we used an iPhone application that we had developed, called RECAPP-XPR, to present 76 participants with a single list of eight words presented at a rate of one word every hour, followed by a test of free recall an hour later. The experiment was exceptionally easy to schedule, taking only between 5 and 10 min to set up using a web-based interface. RECAPP-XPR randomly samples the stimuli, presents the stimuli, and collects the free recall data. The stimuli disappear shortly after they have been presented, and RECAPP-XPR collects data on when each stimulus was viewed. In Experiment 2, the study was replicated using the widely used image-sharing application Snapchat. A total of 197 participants were tested by 38 student experimenters, who manually presented the stimuli as "snaps" of experimentally controlled stimuli using the same experimental rates that had been used in Experiment 1. Like all snaps, these stimuli disappeared from view after a very short interval. In both experiments, we observed significant recall advantages for the first and last list items (primacy and recency effects, respectively), and there were clear tendencies to make more transitions at output between near-neighboring items, with a forward-ordered bias, consistent with temporal contiguity effects. The respective advantages and disadvantages of RECAPP-XPR and Snapchat as experimental software packages are discussed, as is the relationship between single-study-list smartphone experiments and long-term recency studies of real-world events.

Eye-Tracking Analyses of a Coach's Pointing Gestures Timed With Speech: Implications for Players' Recall of Basketball Tactical Instructions.

Coaches often use pointing gestures alongside their speech to reinforce their message and emphasize important concepts during instructional communications, but the impact of simultaneous pointing gestures and speech on learners' recall remains unclear. We used eye-tracking and recalled performance to investigate the impact of a coach's variously timed pointing gestures and speech on two groups of learners' (novices and experts) visual attention and recall of tactical instructions. Participants were 96 basketball players (48 novice and 48 expert) who attempted to recall instructions about the evolution of a basketball game system under two teaching conditions: speech accompanied by gestures and speech followed by gestures. Overall, the results showed that novice players benefited more from instructional speech accompanied by gestures than from speech followed by gestures alone. This was evidenced by their greater visual attention to the diagrams, demonstrated through a higher fixation count and decreased saccadic shifts between the coach and the diagrams. Additionally, they exhibited improved recall and experienced reduced mental effort, despite having the same fixation time on the diagrams and equivalent recall time. Conversely, experts benefited more from instructional speech followed by gestures, indicating an expertise reversal effect. These results suggest that coaches and educators may improve their tactical instructions by timing the pairing of their hand gestures and speech in relation to the learner's level of expertise.

Retrieval of temporal structure at recall can occur automatically.

Temporal-structure, namely, the order in which events unfold over time, is one of the fundamental principles of episodic memory organization. A seminal empirical demonstration of the prominence of temporal structure in memory organization is the Temporal Contiguity Effect (TCE), whereby the proximity between two items at encoding predicts the likelihood of those two items being retrieved consecutively during recall. Recent studies have found that TCE occurs under a wide variety of conditions in which strategic control processes at encoding are reduced or even eliminated. This suggests that the encoding of temporal structure occurs automatically. Extending these findings, in the current study we asked whether the retrieval of temporal structure, as reflected by indices of the TCE, is influenced by strategic control processes at retrieval. To manipulate participants' ability to rely on strategic control processes, we compared standard recall performance (Full Attention condition) to a condition in which attention was divided between recall and a concurrent task (Divided Attention condition), which has been shown to disrupt such control processes. Across two experiments-one with standard encoding conditions and one with continual distraction during encoding-we found no differences in any index of the TCE between the two conditions. These results are all the more striking considering that in both experiments, dividing attention negatively affected overall recall performance compared to the Full Attention condition. Thus, while recall performance is reduced when disrupting strategic processes, the ability to use temporal structure to drive recall is not affected.

Incidentally encoded temporal associations produce priming in implicit memory.

A key assumption of some leading memory theories is that information about the relative order of events is automatically encoded whenever memories are formed and automatically retrieved whenever events are remembered. This information is often used to guide memory search: Remembering one event tends to trigger the retrieval of other events previously experienced nearby in time (temporal contiguity effect). The retrieved context framework attributes this temporal contiguity effect to automatic encoding and retrieval processes, predicting temporal contiguity even in incidental encoding and implicit retrieval. There is strong evidence of temporal contiguity following incidental encoding, but does the prediction hold for implicit retrieval? In this experiment, we tested the framework's predictions for recall and repetition priming. Across 30 trials, undergraduates ([Formula: see text]) read a series of words aloud as they appeared onscreen. In each trial, two words were repeated (cue and target), initially separated by |lag[Formula: see text] 1, 2, or 5. On their second presentation, the cue word was presented first, immediately followed by the target word. We found a strong temporal contiguity effect in a surprise free recall test, replicating previous work with explicit retrieval. For implicit retrieval, we compared repetition priming (how quickly subjects began reading a word on its first versus second presentation) for cue and target words. Repeating a cue word enhanced repetition priming for its associated target word, and this effect varied with the initial lag between the cue and target. These results support theories that assume temporal information is encoded and retrieved automatically.

An effect that counts: Temporally contiguous action effect enhances motor performance.

An action-effect temporal contiguity holds essential information for motor control. Emerging accounts suggest that the temporally contiguous action effect is rewarding in and of itself, further promoting the development of motor representations and reinforcing the selection of the relevant motor program. The current study follows these theoretical and empirical indications to directly investigate the promoting impact of action effect temporal contiguity on motor performance. In two experiments, participants rapidly moved toward a target location on a computer monitor and clicked on the target with their mouse key as quickly and accurately as possible. Their click response triggered a perceptual effect (a brief flash) on the target. To examine the impact of action-effect delay and its temporal contiguity context, we manipulated action-effect delay in two temporal contiguity contexts-long versus short lag conditions. The findings demonstrate that the temporally contiguous perceptual effect enhances motor performance as indicated by end-point precision and movement speed. In addition, a substantial impact of the temporal contiguity context was observed. Namely, we found enhanced motor performance after an ambiguous (300 ms) action-effect delay sampled from short compared to long lag distributions (Experiment 1). This pattern was inconclusive for an immediate action effect (Experiment 2). We discuss the findings in the context of reinforcement from action effect and movement control.

Temporal contiguity determines overshadowing and potentiation of human Action-Outcome performance.

Three experiments (n = 81, n = 81, n = 82, respectively) explored how temporal contiguity influences Action-Outcome learning, assessing whether an intervening signal competed, facilitated, or had no effect on performance and causal attribution in undergraduate participants. Across experiments, we observed competition and facilitation as a function of the temporal contiguity between Action and Outcome. When there was a strong temporal relationship between Action and Outcome, the signal competed with the action, hindering instrumental performance but not causal attribution (Experiments 1 and 3). However, with weak temporal contiguity, the same signal facilitated both instrumental performance and causal attribution (Experiments 1 and 2). Finally, the physical intensity of the signal determined the magnitude of competition. As anticipated by associative learning models, a more salient signal attenuated to a greater extent instrumental performance (Experiment 3). These results are discussed by reference to a recent adaptation of the configural theory of learning.

Does depth of processing affect temporal contiguity?

Memory tends to be better when items are processed for their meaning (deep processing) rather than their perceptual features (shallow processing). This levels of processing (LOP) effect is well-replicated and has been applied in many settings, but the mechanisms involved are still not well understood. The temporal contiguity effect (TCE), the finding that recalling one event often triggers recall of another event experienced nearby in time, also predicts memory performance. This effect has given rise to several competing theories with specific contiguity-generating mechanisms related to how items are processed. Therefore, studying how LOP and the TCE interact may shed light on the mechanisms underlying both effects. However, it is unknown how LOP and the TCE interact-various theories make differing predictions. In this preregistered study, we tested predictions of three theoretical explanations: accounts which assume temporal information is automatically encoded, accounts based on a trade-off between item and order information, and accounts which emphasize the importance of strategic control processes. Participants completed an immediate free recall task where they either engaged in deep processing, shallow processing, or no additional task while studying each word. Recall and the TCE were highest for no-task lists and greater for deep than shallow processing. Our results support theories which assume temporal associations are automatically encoded and those which emphasize strategic control processes. Both perspectives should be considered in theory development. These findings also suggest temporal information may contribute to better recall under deeper processing with implications for determining which situations benefit from deep processing.