Psychological Momentum.

Our mental experience is largely continuous on the scale of seconds and minutes. However, this continuity does not always arise from a volitional carrying forward of ideas. Instead, recent actions, thoughts, dispositions, and emotions can persist in mind, continually shaping our later experience. Aspects of this fundamental property of human cognition - psychological momentum - have been studied under the rubrics of memory, task set, mood, mind-wandering, and mindset. Reviewing these largely independent threads of research, we argue that psychological momentum is best understood from an integrated perspective, as an adaptation that helps us meet the current demands of our environment and to form lasting memories.

A smartphone intervention that enhances real-world memory and promotes differentiation of hippocampal activity in older adults.

The act of remembering an everyday experience influences how we interpret the world, how we think about the future, and how we perceive ourselves. It also enhances long-term retention of the recalled content, increasing the likelihood that it will be recalled again. Unfortunately, the ability to recollect event-specific details and reexperience the past tends to decline with age. This decline in recollection may reflect a corresponding decrease in the distinctiveness of hippocampal memory representations. Despite these well-established changes, there are few effective cognitive behavioral interventions that target real-world episodic memory. We addressed this gap by developing a smartphone-based application called HippoCamera that allows participants to record labeled videos of everyday events and subsequently replay, high-fidelity autobiographical memory cues. In two experiments, we found that older adults were able to easily integrate this noninvasive intervention into their daily lives. Using HippoCamera to repeatedly reactivate memories for real-world events improved episodic recollection and it evoked more positive autobiographical sentiment at the time of retrieval. In both experiments, these benefits were observed shortly after the intervention and again after a 3-mo delay. Moreover, more detailed recollection was associated with more differentiated memory signals in the hippocampus. Thus, using this smartphone application to systematically reactivate memories for recent real-world experiences can help to maintain a bridge between the present and past in older adults.

Narrative thinking lingers in spontaneous thought.

Some experiences linger in mind, spontaneously returning to our thoughts for minutes after their conclusion. Other experiences fall out of mind immediately. It remains unclear why. We hypothesize that an input is more likely to persist in our thoughts when it has been deeply processed: when we have extracted its situational meaning rather than its physical properties or low-level semantics. Here, participants read sequences of words with different levels of coherence (word-, sentence-, or narrative-level). We probe participants' spontaneous thoughts via free word association, before and after reading. By measuring lingering subjectively (via self-report) and objectively (via changes in free association content), we find that information lingers when it is coherent at the narrative level. Furthermore, and an individual's feeling of transportation into reading material predicts lingering better than the material's objective coherence. Thus, our thoughts in the present moment echo prior experiences that have been incorporated into deeper, narrative forms of thinking.

Social-affective features drive human representations of observed actions.

Humans observe actions performed by others in many different visual and social settings. What features do we extract and attend when we view such complex scenes, and how are they processed in the brain? To answer these questions, we curated two large-scale sets of naturalistic videos of everyday actions and estimated their perceived similarity in two behavioral experiments. We normed and quantified a large range of visual, action-related, and social-affective features across the stimulus sets. Using a cross-validated variance partitioning analysis, we found that social-affective features predicted similarity judgments better than, and independently of, visual and action features in both behavioral experiments. Next, we conducted an electroencephalography experiment, which revealed a sustained correlation between neural responses to videos and their behavioral similarity. Visual, action, and social-affective features predicted neural patterns at early, intermediate, and late stages, respectively, during this behaviorally relevant time window. Together, these findings show that social-affective features are important for perceiving naturalistic actions and are extracted at the final stage of a temporal gradient in the brain.

The "Narratives" fMRI dataset for evaluating models of naturalistic language comprehension.

The "Narratives" collection aggregates a variety of functional MRI datasets collected while human subjects listened to naturalistic spoken stories. The current release includes 345 subjects, 891 functional scans, and 27 diverse stories of varying duration totaling ~4.6 hours of unique stimuli (~43,000 words). This data collection is well-suited for naturalistic neuroimaging analysis, and is intended to serve as a benchmark for models of language and narrative comprehension. We provide standardized MRI data accompanied by rich metadata, preprocessed versions of the data ready for immediate use, and the spoken story stimuli with time-stamped phoneme- and word-level transcripts. All code and data are publicly available with full provenance in keeping with current best practices in transparent and reproducible neuroimaging.

Phase and amplitude dynamics of coupled oscillator systems on complex networks.

We investigated locking behaviors of coupled limit-cycle oscillators with phase and amplitude dynamics. We focused on how the dynamics are affected by inhomogeneous coupling strength and by angular and radial shifts in coupling functions. We performed mean-field analyses of oscillator systems with inhomogeneous coupling strength, testing Gaussian, power-law, and brain-like degree distributions. Even for oscillators with identical intrinsic frequencies and intrinsic amplitudes, we found that the coupling strength distribution and the coupling function generated a wide repertoire of phase and amplitude dynamics. These included fully and partially locked states in which high-degree or low-degree nodes would phase-lead the network. The mean-field analytical findings were confirmed via numerical simulations. The results suggest that, in oscillator systems in which individual nodes can independently vary their amplitude over time, qualitatively different dynamics can be produced via shifts in the coupling strength distribution and the coupling form. Of particular relevance to information flows in oscillator networks, changes in the non-specific drive to individual nodes can make high-degree nodes phase-lag or phase-lead the rest of the network.

Constructing and Forgetting Temporal Context in the Human Cerebral Cortex.

How does information from seconds earlier affect neocortical responses to new input? We found that when two groups of participants heard the same sentence in a narrative, preceded by different contexts, the neural responses of each group were initially different but gradually fell into alignment. We observed a hierarchical gradient: sensory cortices aligned most quickly, followed by mid-level regions, while some higher-order cortical regions took more than 10 seconds to align. What computations explain this hierarchical temporal organization? Linear integration models predict that regions that are slower to integrate new information should also be slower to forget old information. However, we found that higher-order regions could rapidly forget prior context. The data from the cortical hierarchy were instead captured by a model in which each region maintains a temporal context representation that is nonlinearly integrated with input at each moment, and this integration is gated by local prediction error.

Temporal integration of narrative information in a hippocampal amnesic patient.

Default network regions appear to integrate information over time windows of 30 â€‹s or more during narrative listening. Does this long-timescale capability require the hippocampus? Amnesic behavior suggests that regions other than the hippocampus can independently support some online processing when input is continuous and semantically rich: amnesics can participate in conversations and tell stories spanning minutes, and when tested immediately on recently heard prose they are able to retain some information. We hypothesized that default network regions can integrate the semantically coherent information of a narrative across long time windows, even in the absence of an intact hippocampus. To test this prediction, we measured BOLD activity in the brain of a hippocampal amnesic patient (D.A.) and healthy control participants while they listened to a 7 min narrative. The narrative was played either in its intact form, or as a paragraph-scrambled version, which has been previously shown to interfere with the long-range temporal dependencies in default network activity. In the intact story condition, D.A.'s moment-by-moment BOLD activity spatial patterns were similar to those of controls in low-level auditory cortex as well as in some high-level default network regions (including lateral and medial posterior parietal cortex). Moreover, as in controls, D.A.'s response patterns in medial and lateral posterior parietal cortex were disrupted when paragraphs of the story were presented in a shuffled order, suggesting that activity in these areas did depend on information from 30 â€‹s or more in the past. Together, these results suggest that some default network cortical areas can integrate information across long timescales, even when the hippocampus is severely damaged.

Transformation of speech sequences in human sensorimotor circuits.

After we listen to a series of words, we can silently replay them in our mind. Does this mental replay involve a reactivation of our original perceptual dynamics? We recorded electrocorticographic (ECoG) activity across the lateral cerebral cortex as people heard and then mentally rehearsed spoken sentences. For each region, we tested whether silent rehearsal of sentences involved reactivation of sentence-specific representations established during perception or transformation to a distinct representation. In sensorimotor and premotor cortex, we observed reliable and temporally precise responses to speech; these patterns transformed to distinct sentence-specific representations during mental rehearsal. In contrast, we observed less reliable and less temporally precise responses in prefrontal and temporoparietal cortex; these higher-order representations, which were sensitive to sentence semantics, were shared across perception and rehearsal of the same sentence. The mental rehearsal of natural speech involves the transformation of stimulus-locked speech representations in sensorimotor and premotor cortex, combined with diffuse reactivation of higher-order semantic representations.

Switching between internal and external modes: A multiscale learning principle.

Brains construct internal models that support perception, prediction, and action in the external world. Individual circuits within a brain also learn internal models of the local world of input they receive, in order to facilitate efficient and robust representation. How are these internal models learned? We propose that learning is facilitated by continual switching between internally biased and externally biased modes of processing. We review computational evidence that this mode-switching can produce an error signal to drive learning. We then consider empirical evidence for the instantiation of mode-switching in diverse neural systems, ranging from subsecond fluctuations in the hippocampus to wake-sleep alternations across the whole brain. We hypothesize that these internal/external switching processes, which occur at multiple scales, can drive learning at each scale. This framework predicts that (a) slower mode-switching should be associated with learning of more temporally extended input features and (b) disruption of switching should impair the integration of new information with prior information.

Induction and Quantification of Excitability Changes in Human Cortical Networks.

How does human brain stimulation result in lasting changes in cortical excitability? Uncertainty on this question hinders the development of personalized brain stimulation therapies. To characterize how cortical excitability is altered by stimulation, we applied repetitive direct electrical stimulation in eight human subjects (male and female) undergoing intracranial monitoring. We evaluated single-pulse corticocortical-evoked potentials (CCEPs) before and after repetitive stimulation across prefrontal (n = 4), temporal (n = 1), and motor (n = 3) cortices. We asked whether a single session of repetitive stimulation was sufficient to induce excitability changes across distributed cortical sites. We found a subset of regions at which 10 Hz prefrontal repetitive stimulation resulted in both potentiation and suppression of excitability that persisted for at least 10 min. We then asked whether these dynamics could be modeled by the prestimulation connectivity profile of each subject. We found that cortical regions (1) anatomically close to the stimulated site and (2) exhibiting high-amplitude CCEPs underwent changes in excitability following repetitive stimulation. We demonstrate high accuracy (72-95%) and discriminability (81-99%) in predicting regions exhibiting changes using individual subjects' prestimulation connectivity profile, and show that adding prestimulation connectivity features significantly improved model performance. The same features predicted regions of modulation following motor and temporal cortices stimulation in an independent dataset. Together, baseline connectivity profile can be used to predict regions susceptible to brain changes and provides a basis for personalizing brain stimulation.SIGNIFICANCE STATEMENT Brain stimulation is increasingly used to treat neuropsychiatric disorders by inducing excitability changes at specific brain regions. However, our understanding of how, when, and where these changes are induced is critically lacking. We inferred plasticity in the human brain after applying electrical stimulation to the brain's surface and measuring changes in excitability. We observed excitability changes in regions anatomically and functionally closer to the stimulation site. Those in responsive regions were accurately predicted using a classifier trained on baseline brain network characteristics. Finally, we showed that the excitability changes can potentially be monitored in real-time. These results begin to fill basic gaps in our understanding of stimulation-induced brain dynamics in humans and offer pathways to optimize stimulation protocols.

Elucidating relations between fMRI, ECoG, and EEG through a common natural stimulus.

Human brain mapping relies heavily on fMRI, ECoG and EEG, which capture different physiological signals. Relationships between these signals have been established in the context of specific tasks or during resting state, often using spatially confined concurrent recordings in animals. But it is not certain whether these correlations generalize to other contexts relevant for human cognitive neuroscience. Here, we address the case of complex naturalistic stimuli and ask two basic questions. First, how reliable are the responses evoked by a naturalistic audio-visual stimulus in each of these imaging methods, and second, how similar are stimulus-related responses across methods? To this end, we investigated a wide range of brain regions and frequency bands. We presented the same movie clip twice to three different cohorts of subjects (NEEG = 45, NfMRI = 11, NECoG = 5) and assessed stimulus-driven correlations across viewings and between imaging methods, thereby ruling out task-irrelevant confounds. All three imaging methods had similar repeat-reliability across viewings when fMRI and EEG data were averaged across subjects, highlighting the potential to achieve large signal-to-noise ratio by leveraging large sample sizes. The fMRI signal correlated positively with high-frequency ECoG power across multiple task-related cortical structures but positively with low-frequency EEG and ECoG power. In contrast to previous studies, these correlations were as strong for low-frequency as for high frequency ECoG. We also observed links between fMRI and infra-slow EEG voltage fluctuations. These results extend previous findings to the case of natural stimulus processing.

Principles of Temporal Processing Across the Cortical Hierarchy.

The world is richly structured on multiple spatiotemporal scales. In order to represent spatial structure, many machine-learning models repeat a set of basic operations at each layer of a hierarchical architecture. These iterated spatial operations - including pooling, normalization and pattern completion - enable these systems to recognize and predict spatial structure, while robust to changes in the spatial scale, contrast and noisiness of the input signal. Because our brains also process temporal information that is rich and occurs across multiple time scales, might the brain employ an analogous set of operations for temporal information processing? Here we define a candidate set of temporal operations, and we review evidence that they are implemented in the mammalian cerebral cortex in a hierarchical manner. We conclude that multiple consecutive stages of cortical processing can be understood to perform temporal pooling, temporal normalization and temporal pattern completion.

Causal Evidence for a Neural Component of Spatially Global Hemodynamic Signals.

In this issue of Neuron, Turchi et al. (2018) reversibly inactivate the basal forebrain to show that this region magnifies global neocortical signal fluctuations without altering the topography of canonical resting-state networks. Thus, spatially diffuse signals measurable via functional neuroimaging may track large-scale neuromodulatory state changes in the primate brain.

Neuroscience: When a Single Image Can Cause a Seizure.

It has been known since classical antiquity that viewing particular images can trigger seizures in some individuals. Now we have a clue to the mechanism, as many of these images amplify 30-80 Hz rhythmic activity in the visual brain.

iELVis: An open source MATLAB toolbox for localizing and visualizing human intracranial electrode data.

BACKGROUND: Intracranial electrical recordings (iEEG) and brain stimulation (iEBS) are invaluable human neuroscience methodologies. However, the value of such data is often unrealized as many laboratories lack tools for localizing electrodes relative to anatomy. To remedy this, we have developed a MATLAB toolbox for intracranial electrode localization and visualization, iELVis. NEW METHOD: iELVis uses existing tools (BioImage Suite, FSL, and FreeSurfer) for preimplant magnetic resonance imaging (MRI) segmentation, neuroimaging coregistration, and manual identification of electrodes in postimplant neuroimaging. Subsequently, iELVis implements methods for correcting electrode locations for postimplant brain shift with millimeter-scale accuracy and provides interactive visualization on 3D surfaces or in 2D slices with optional functional neuroimaging overlays. iELVis also localizes electrodes relative to FreeSurfer-based atlases and can combine data across subjects via the FreeSurfer average brain. RESULTS: It takes 30-60min of user time and 12-24h of computer time to localize and visualize electrodes from one brain. We demonstrate iELVis's functionality by showing that three methods for mapping primary hand somatosensory cortex (iEEG, iEBS, and functional MRI) provide highly concordant results. COMPARISON WITH EXISTING METHODS: iELVis is the first public software for electrode localization that corrects for brain shift, maps electrodes to an average brain, and supports neuroimaging overlays. Moreover, its interactive visualizations are powerful and its tutorial material is extensive. CONCLUSIONS: iELVis promises to speed the progress and enhance the robustness of intracranial electrode research. The software and extensive tutorial materials are freely available as part of the EpiSurg software project: https://github.com/episurg/episurg.

Same Story, Different Story.

Differences in people's beliefs can substantially impact their interpretation of a series of events. In this functional MRI study, we manipulated subjects' beliefs, leading two groups of subjects to interpret the same narrative in different ways. We found that responses in higher-order brain areas-including the default-mode network, language areas, and subsets of the mirror neuron system-tended to be similar among people who shared the same interpretation, but different from those of people with an opposing interpretation. Furthermore, the difference in neural responses between the two groups at each moment was correlated with the magnitude of the difference in the interpretation of the narrative. This study demonstrates that brain responses to the same event tend to cluster together among people who share the same views.

Shared memories reveal shared structure in neural activity across individuals.

Our lives revolve around sharing experiences and memories with others. When different people recount the same events, how similar are their underlying neural representations? Participants viewed a 50-min movie, then verbally described the events during functional MRI, producing unguided detailed descriptions lasting up to 40 min. As each person spoke, event-specific spatial patterns were reinstated in default-network, medial-temporal, and high-level visual areas. Individual event patterns were both highly discriminable from one another and similar among people, suggesting consistent spatial organization. In many high-order areas, patterns were more similar between people recalling the same event than between recall and perception, indicating systematic reshaping of percept into memory. These results reveal the existence of a common spatial organization for memories in high-level cortical areas, where encoded information is largely abstracted beyond sensory constraints, and that neural patterns during perception are altered systematically across people into shared memory representations for real-life events.

Neural pattern change during encoding of a narrative predicts retrospective duration estimates.

What mechanisms support our ability to estimate durations on the order of minutes? Behavioral studies in humans have shown that changes in contextual features lead to overestimation of past durations. Based on evidence that the medial temporal lobes and prefrontal cortex represent contextual features, we related the degree of fMRI pattern change in these regions with people's subsequent duration estimates. After listening to a radio story in the scanner, participants were asked how much time had elapsed between pairs of clips from the story. Our ROI analyses found that duration estimates were correlated with the neural pattern distance between two clips at encoding in the right entorhinal cortex. Moreover, whole-brain searchlight analyses revealed a cluster spanning the right anterior temporal lobe. Our findings provide convergent support for the hypothesis that retrospective time judgments are driven by 'drift' in contextual representations supported by these regions.